[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:04:03.190661 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:36509
I20260709 13:04:03.192335 13792 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:04:03.193431 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:03.210855 13801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:03.210844 13799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:03.210855 13798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:03.212689 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:04.429687 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:04.429980 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:04.430205 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602244430181 us; error 0 us; skew 500 ppm
I20260709 13:04:04.431061 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:04.437919 13792 webserver.cc:533] Webserver started at http://127.13.120.62:40615/ using document root <none> and password file <none>
I20260709 13:04:04.438848 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:04.439103 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:04.439631 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:04.445601 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "ba06e0afc3c444379214eee21bac6e44"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-mcck"
I20260709 13:04:04.453655 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:04:04.458860 13807 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.460141 13792 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:04:04.460577 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "ba06e0afc3c444379214eee21bac6e44"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-mcck"
I20260709 13:04:04.460958 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:04.521502 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:04.523082 13792 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:04:04.523591 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:04.595814 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:36509
I20260709 13:04:04.595892 13858 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:36509 every 8 connection(s)
I20260709 13:04:04.603768 13859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:04.625609 13859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44: Bootstrap starting.
I20260709 13:04:04.631680 13859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:04.633545 13859 log.cc:826] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44: Log is configured to *not* fsync() on all Append() calls
I20260709 13:04:04.638154 13859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44: No bootstrap required, opened a new log
I20260709 13:04:04.658656 13859 raft_consensus.cc:359] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba06e0afc3c444379214eee21bac6e44" member_type: VOTER }
I20260709 13:04:04.659215 13859 raft_consensus.cc:385] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:04.659483 13859 raft_consensus.cc:740] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba06e0afc3c444379214eee21bac6e44, State: Initialized, Role: FOLLOWER
I20260709 13:04:04.660363 13859 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba06e0afc3c444379214eee21bac6e44" member_type: VOTER }
I20260709 13:04:04.660830 13859 raft_consensus.cc:399] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:04.661079 13859 raft_consensus.cc:493] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:04.661388 13859 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:04.665444 13859 raft_consensus.cc:515] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba06e0afc3c444379214eee21bac6e44" member_type: VOTER }
I20260709 13:04:04.666141 13859 leader_election.cc:304] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba06e0afc3c444379214eee21bac6e44; no voters: 
I20260709 13:04:04.667994 13859 leader_election.cc:290] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:04.668326 13862 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:04.671066 13862 raft_consensus.cc:697] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 1 LEADER]: Becoming Leader. State: Replica: ba06e0afc3c444379214eee21bac6e44, State: Running, Role: LEADER
I20260709 13:04:04.672016 13862 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba06e0afc3c444379214eee21bac6e44" member_type: VOTER }
I20260709 13:04:04.673043 13859 sys_catalog.cc:565] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:04.682898 13863 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba06e0afc3c444379214eee21bac6e44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba06e0afc3c444379214eee21bac6e44" member_type: VOTER } }
I20260709 13:04:04.682878 13864 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba06e0afc3c444379214eee21bac6e44. Latest consensus state: current_term: 1 leader_uuid: "ba06e0afc3c444379214eee21bac6e44" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba06e0afc3c444379214eee21bac6e44" member_type: VOTER } }
I20260709 13:04:04.683782 13864 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:04.683779 13863 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:04.686699 13871 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:04.698328 13871 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:04.700559 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:04.715847 13871 catalog_manager.cc:1383] Generated new cluster ID: 3ca1fe465bf149b19e92a7e7c1b3c0ac
I20260709 13:04:04.716125 13871 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:04.738533 13871 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:04.740118 13871 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:04.755506 13871 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44: Generated new TSK 0
I20260709 13:04:04.756423 13871 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:04.767146 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:04.775602 13881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:04.776613 13882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.782574 13792 server_base.cc:1061] running on GCE node
W20260709 13:04:04.782532 13884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.783627 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:04.783818 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:04.784041 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602244784014 us; error 0 us; skew 500 ppm
I20260709 13:04:04.784636 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:04.788331 13792 webserver.cc:533] Webserver started at http://127.13.120.1:44643/ using document root <none> and password file <none>
I20260709 13:04:04.789047 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:04.789259 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:04.789601 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:04.790731 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-mcck"
I20260709 13:04:04.796718 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:04:04.801431 13889 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.802307 13792 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:04.802618 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-mcck"
I20260709 13:04:04.802932 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:04.836047 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:04.837409 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:04.840281 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:04.844404 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:04.844635 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.844970 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:04.845171 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.945420 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:39005
I20260709 13:04:04.945514 13951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:39005 every 8 connection(s)
I20260709 13:04:04.953418 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:04.962026 13956 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:04.965029 13957 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:04.973343 13959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:04.974478 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:04.975559 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:04.975841 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:04.976104 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602244976080 us; error 0 us; skew 500 ppm
I20260709 13:04:04.976950 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:04.980098 13792 webserver.cc:533] Webserver started at http://127.13.120.2:46577/ using document root <none> and password file <none>
I20260709 13:04:04.980791 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:04.980732 13952 heartbeater.cc:344] Connected to a master server at 127.13.120.62:36509
I20260709 13:04:04.981288 13952 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:04.982211 13952 heartbeater.cc:507] Master 127.13.120.62:36509 requested a full tablet report, sending...
I20260709 13:04:04.983317 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:04.983727 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:04.985189 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "63f3a6b98cd447cea520bf9333bb82e1"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-mcck"
I20260709 13:04:04.985579 13824 ts_manager.cc:194] Registered new tserver with Master: f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005)
I20260709 13:04:04.988662 13824 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56974
I20260709 13:04:04.992509 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:04:04.997829 13964 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:04.998813 13792 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:04.999202 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "63f3a6b98cd447cea520bf9333bb82e1"
format_stamp: "Formatted at 2026-07-09 13:04:04 on dist-test-slave-mcck"
I20260709 13:04:04.999660 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:05.023972 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:05.025799 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:05.028633 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:05.032768 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:05.033095 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:05.033429 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:05.033670 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:05.124223 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:34757
I20260709 13:04:05.124347 14026 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:34757 every 8 connection(s)
I20260709 13:04:05.131448 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:05.140673 14030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:05.148027 13792 server_base.cc:1061] running on GCE node
W20260709 13:04:05.149240 14033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:05.149927 14027 heartbeater.cc:344] Connected to a master server at 127.13.120.62:36509
I20260709 13:04:05.150359 14027 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:05.151142 14027 heartbeater.cc:507] Master 127.13.120.62:36509 requested a full tablet report, sending...
W20260709 13:04:05.152601 14031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:05.153542 13824 ts_manager.cc:194] Registered new tserver with Master: 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:05.153888 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:05.154146 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:05.154353 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602245154334 us; error 0 us; skew 500 ppm
I20260709 13:04:05.155071 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:05.155324 13824 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56982
I20260709 13:04:05.158866 13792 webserver.cc:533] Webserver started at http://127.13.120.3:36289/ using document root <none> and password file <none>
I20260709 13:04:05.159371 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:05.159632 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:05.159914 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:05.161106 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "80f422c9c1654dc9a4d82ad0355919a7"
format_stamp: "Formatted at 2026-07-09 13:04:05 on dist-test-slave-mcck"
I20260709 13:04:05.166332 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:05.170310 14038 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:05.171236 13792 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:04:05.171599 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "80f422c9c1654dc9a4d82ad0355919a7"
format_stamp: "Formatted at 2026-07-09 13:04:05 on dist-test-slave-mcck"
I20260709 13:04:05.171921 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:05.192839 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:05.194347 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:05.195907 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:05.198225 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:05.198490 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:05.198755 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:05.198953 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:05.293653 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:33125
I20260709 13:04:05.293821 14100 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:33125 every 8 connection(s)
I20260709 13:04:05.310312 14101 heartbeater.cc:344] Connected to a master server at 127.13.120.62:36509
I20260709 13:04:05.310796 14101 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:05.311851 14101 heartbeater.cc:507] Master 127.13.120.62:36509 requested a full tablet report, sending...
I20260709 13:04:05.314129 13824 ts_manager.cc:194] Registered new tserver with Master: 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:05.314316 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015486459s
I20260709 13:04:05.315632 13824 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56988
I20260709 13:04:05.369102 13824 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56990:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:05.372743 13824 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:05.480261 13917 tablet_service.cc:1511] Processing CreateTablet for tablet f863e11e752e46b2af05256f45036628 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:05.481914 13917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863e11e752e46b2af05256f45036628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.485906 14066 tablet_service.cc:1511] Processing CreateTablet for tablet f863e11e752e46b2af05256f45036628 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:05.487286 14066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863e11e752e46b2af05256f45036628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.488538 14065 tablet_service.cc:1511] Processing CreateTablet for tablet a14fbb79102140e2a66ab8122a595618 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:05.489890 14065 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14fbb79102140e2a66ab8122a595618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.492708 14064 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee9f1d3686f4c3db8a87f364912745a (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:05.494174 14064 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee9f1d3686f4c3db8a87f364912745a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.495533 13916 tablet_service.cc:1511] Processing CreateTablet for tablet a14fbb79102140e2a66ab8122a595618 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:05.497128 13916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14fbb79102140e2a66ab8122a595618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.496963 14063 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4dfe9135504786affd7ec941fa47b3 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:05.498554 14063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4dfe9135504786affd7ec941fa47b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.500677 14062 tablet_service.cc:1511] Processing CreateTablet for tablet 15390eb9342b4c4b8ce26f572dcade34 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:05.502055 14062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15390eb9342b4c4b8ce26f572dcade34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.504701 14061 tablet_service.cc:1511] Processing CreateTablet for tablet c773cdf624714a798aff540385f47d90 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:05.506029 14061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773cdf624714a798aff540385f47d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.508654 14060 tablet_service.cc:1511] Processing CreateTablet for tablet 460251996db44ee390a8cc4c552a4bc1 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:05.510201 14060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460251996db44ee390a8cc4c552a4bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.512697 14059 tablet_service.cc:1511] Processing CreateTablet for tablet d09430a733264aefb6783fcde1003221 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:05.515084 14058 tablet_service.cc:1511] Processing CreateTablet for tablet 62bfef359e374220957a663807fb3812 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:05.516165 13992 tablet_service.cc:1511] Processing CreateTablet for tablet f863e11e752e46b2af05256f45036628 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:04:05.517911 13992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f863e11e752e46b2af05256f45036628. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.519778 14058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bfef359e374220957a663807fb3812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.521306 14059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09430a733264aefb6783fcde1003221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.523445 13991 tablet_service.cc:1511] Processing CreateTablet for tablet a14fbb79102140e2a66ab8122a595618 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:04:05.525292 13991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a14fbb79102140e2a66ab8122a595618. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.562500 13911 tablet_service.cc:1511] Processing CreateTablet for tablet 460251996db44ee390a8cc4c552a4bc1 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:05.560110 13914 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4dfe9135504786affd7ec941fa47b3 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:05.579322 13909 tablet_service.cc:1511] Processing CreateTablet for tablet 62bfef359e374220957a663807fb3812 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:05.564924 13990 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee9f1d3686f4c3db8a87f364912745a (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:05.585644 13990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee9f1d3686f4c3db8a87f364912745a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.582302 13914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4dfe9135504786affd7ec941fa47b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.597692 13988 tablet_service.cc:1511] Processing CreateTablet for tablet 15390eb9342b4c4b8ce26f572dcade34 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:05.599665 13988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15390eb9342b4c4b8ce26f572dcade34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.595870 13987 tablet_service.cc:1511] Processing CreateTablet for tablet c773cdf624714a798aff540385f47d90 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:05.564038 13915 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee9f1d3686f4c3db8a87f364912745a (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:04:05.575819 13912 tablet_service.cc:1511] Processing CreateTablet for tablet c773cdf624714a798aff540385f47d90 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:04:05.561434 13989 tablet_service.cc:1511] Processing CreateTablet for tablet 8b4dfe9135504786affd7ec941fa47b3 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:04:05.609022 13910 tablet_service.cc:1511] Processing CreateTablet for tablet d09430a733264aefb6783fcde1003221 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:05.610498 13913 tablet_service.cc:1511] Processing CreateTablet for tablet 15390eb9342b4c4b8ce26f572dcade34 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:04:05.608929 14119 tablet_bootstrap.cc:492] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:05.620008 13986 tablet_service.cc:1511] Processing CreateTablet for tablet 460251996db44ee390a8cc4c552a4bc1 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:04:05.628814 13984 tablet_service.cc:1511] Processing CreateTablet for tablet 62bfef359e374220957a663807fb3812 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:04:05.626950 13909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bfef359e374220957a663807fb3812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.637382 13985 tablet_service.cc:1511] Processing CreateTablet for tablet d09430a733264aefb6783fcde1003221 (DEFAULT_TABLE table=test-workload [id=b18b578f4e534a9794a097b105a13456]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:04:05.640821 13987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773cdf624714a798aff540385f47d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.648747 13913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15390eb9342b4c4b8ce26f572dcade34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.652379 13985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09430a733264aefb6783fcde1003221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.658543 13989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b4dfe9135504786affd7ec941fa47b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.652746 13911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460251996db44ee390a8cc4c552a4bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.660612 13984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62bfef359e374220957a663807fb3812. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.671641 13912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c773cdf624714a798aff540385f47d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.673972 13986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 460251996db44ee390a8cc4c552a4bc1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.676607 13915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee9f1d3686f4c3db8a87f364912745a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:05.696250 13872 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:05.700224 13910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d09430a733264aefb6783fcde1003221. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:05.730794 14120 tablet_bootstrap.cc:492] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:05.832911 14119 tablet_bootstrap.cc:654] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.852578 14121 tablet_bootstrap.cc:492] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:05.859153 14120 tablet_bootstrap.cc:654] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.866696 14119 tablet_bootstrap.cc:492] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:05.867187 14119 ts_tablet_manager.cc:1403] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.303s	user 0.009s	sys 0.008s
I20260709 13:04:05.882218 14120 tablet_bootstrap.cc:492] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:05.882674 14120 ts_tablet_manager.cc:1403] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.005s
I20260709 13:04:05.877168 14119 raft_consensus.cc:359] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.884064 14119 raft_consensus.cc:385] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.884393 14119 raft_consensus.cc:740] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.885248 14121 tablet_bootstrap.cc:654] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.887712 14119 consensus_queue.cc:260] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.890825 14120 raft_consensus.cc:359] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.892529 14120 raft_consensus.cc:385] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.893042 14120 raft_consensus.cc:740] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.893371 14101 heartbeater.cc:499] Master 127.13.120.62:36509 was elected leader, sending a full tablet report...
I20260709 13:04:05.894232 14120 consensus_queue.cc:260] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.898478 14119 ts_tablet_manager.cc:1434] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 13:04:05.899848 14119 tablet_bootstrap.cc:492] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:05.905115 14121 tablet_bootstrap.cc:492] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:05.905725 14121 ts_tablet_manager.cc:1403] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.009s
I20260709 13:04:05.910511 14121 raft_consensus.cc:359] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.911615 14121 raft_consensus.cc:385] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.912006 14121 raft_consensus.cc:740] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.913012 14121 consensus_queue.cc:260] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.908586 14119 tablet_bootstrap.cc:654] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.920336 13952 heartbeater.cc:499] Master 127.13.120.62:36509 was elected leader, sending a full tablet report...
I20260709 13:04:05.921185 14120 ts_tablet_manager.cc:1434] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.038s	user 0.001s	sys 0.021s
I20260709 13:04:05.922468 14120 tablet_bootstrap.cc:492] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:05.928960 14027 heartbeater.cc:499] Master 127.13.120.62:36509 was elected leader, sending a full tablet report...
I20260709 13:04:05.932521 14121 ts_tablet_manager.cc:1434] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.026s	user 0.014s	sys 0.004s
I20260709 13:04:05.933590 14121 tablet_bootstrap.cc:492] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:05.940070 14120 tablet_bootstrap.cc:654] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.950191 14119 tablet_bootstrap.cc:492] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:05.950695 14119 ts_tablet_manager.cc:1403] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.012s
W20260709 13:04:05.953923 13953 tablet.cc:2406] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:04:05.953581 14119 raft_consensus.cc:359] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.954454 14119 raft_consensus.cc:385] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.954797 14119 raft_consensus.cc:740] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.956048 14119 consensus_queue.cc:260] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.958525 14119 ts_tablet_manager.cc:1434] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:05.956988 14120 tablet_bootstrap.cc:492] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:05.959471 14119 tablet_bootstrap.cc:492] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:05.959810 14120 ts_tablet_manager.cc:1403] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.012s
I20260709 13:04:05.962869 14120 raft_consensus.cc:359] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.966349 14119 tablet_bootstrap.cc:654] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.963687 14120 raft_consensus.cc:385] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:05.967303 14120 raft_consensus.cc:740] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:05.968210 14120 consensus_queue.cc:260] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.971271 14120 ts_tablet_manager.cc:1434] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:04:05.972211 14120 tablet_bootstrap.cc:492] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:05.973496 14126 raft_consensus.cc:493] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:05.973978 14126 raft_consensus.cc:515] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:05.976135 14121 tablet_bootstrap.cc:654] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.981092 14126 leader_election.cc:290] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:05.990386 14119 tablet_bootstrap.cc:492] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:05.990880 14119 ts_tablet_manager.cc:1403] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.008s
I20260709 13:04:05.993112 14120 tablet_bootstrap.cc:654] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:05.997143 14121 tablet_bootstrap.cc:492] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.002014 14121 ts_tablet_manager.cc:1403] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.006s
I20260709 13:04:06.002460 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.002661 14119 raft_consensus.cc:359] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.003443 14119 raft_consensus.cc:385] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.003762 14119 raft_consensus.cc:740] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
W20260709 13:04:06.004657 13892 leader_election.cc:343] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.004586 14119 consensus_queue.cc:260] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.005445 14121 raft_consensus.cc:359] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.006119 14121 raft_consensus.cc:385] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.006417 14121 raft_consensus.cc:740] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.008996 14119 ts_tablet_manager.cc:1434] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.006s
I20260709 13:04:06.009971 14119 tablet_bootstrap.cc:492] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:06.016808 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
W20260709 13:04:06.018571 13893 leader_election.cc:343] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.007076 14121 consensus_queue.cc:260] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.019016 13893 leader_election.cc:304] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f020ba3143634acb8b0f8e0ae5872ebf; no voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:06.019945 14126 raft_consensus.cc:2749] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.021198 14119 tablet_bootstrap.cc:654] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.022490 14125 raft_consensus.cc:493] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.022799 14121 ts_tablet_manager.cc:1434] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:04:06.022977 14125 raft_consensus.cc:515] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.023825 14121 tablet_bootstrap.cc:492] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.025658 14125 leader_election.cc:290] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.031720 14120 tablet_bootstrap.cc:492] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.032244 14120 ts_tablet_manager.cc:1403] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.060s	user 0.015s	sys 0.005s
I20260709 13:04:06.035542 14120 raft_consensus.cc:359] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.036463 14120 raft_consensus.cc:385] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.036834 14120 raft_consensus.cc:740] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.038326 14120 consensus_queue.cc:260] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.041416 14120 ts_tablet_manager.cc:1434] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:06.042572 14120 tablet_bootstrap.cc:492] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:06.050143 14120 tablet_bootstrap.cc:654] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.059764 14120 tablet_bootstrap.cc:492] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.060364 14120 ts_tablet_manager.cc:1403] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
I20260709 13:04:06.062697 14127 raft_consensus.cc:493] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.063246 14127 raft_consensus.cc:515] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.063941 14120 raft_consensus.cc:359] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.064872 14120 raft_consensus.cc:385] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.065213 14120 raft_consensus.cc:740] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.066129 14127 leader_election.cc:290] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.072166 14121 tablet_bootstrap.cc:654] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.084506 14120 consensus_queue.cc:260] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.091939 14125 raft_consensus.cc:493] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.092509 14125 raft_consensus.cc:515] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.093472 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.094394 13927 raft_consensus.cc:2468] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.097108 14125 leader_election.cc:290] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.097326 14119 tablet_bootstrap.cc:492] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:06.097756 14119 ts_tablet_manager.cc:1403] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.088s	user 0.020s	sys 0.010s
I20260709 13:04:06.097920 14120 ts_tablet_manager.cc:1434] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.037s	user 0.008s	sys 0.001s
I20260709 13:04:06.099321 14120 tablet_bootstrap.cc:492] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:06.109436 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.108532 14119 raft_consensus.cc:359] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.110314 13927 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.110479 14119 raft_consensus.cc:385] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.110780 14119 raft_consensus.cc:740] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.111505 14119 consensus_queue.cc:260] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.115674 14121 tablet_bootstrap.cc:492] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.117074 14121 ts_tablet_manager.cc:1403] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.093s	user 0.018s	sys 0.003s
I20260709 13:04:06.120307 14120 tablet_bootstrap.cc:654] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.120549 14121 raft_consensus.cc:359] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.116796 14039 leader_election.cc:304] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.121516 14121 raft_consensus.cc:385] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.124488 14125 raft_consensus.cc:2804] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.124924 14125 raft_consensus.cc:493] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.125347 14125 raft_consensus.cc:3060] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.126693 14119 ts_tablet_manager.cc:1434] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.004s
I20260709 13:04:06.123839 14121 raft_consensus.cc:740] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.129076 14119 tablet_bootstrap.cc:492] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:06.124516 14039 leader_election.cc:304] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.133563 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.134213 14002 raft_consensus.cc:2468] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.136104 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.144582 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.148566 14119 tablet_bootstrap.cc:654] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.145567 14121 consensus_queue.cc:260] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.150751 14001 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.152740 14121 ts_tablet_manager.cc:1434] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260709 13:04:06.154117 14121 tablet_bootstrap.cc:492] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.158217 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.158877 13927 raft_consensus.cc:2468] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 0.
I20260709 13:04:06.160326 13965 leader_election.cc:304] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.161190 14127 raft_consensus.cc:2804] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.161655 14127 raft_consensus.cc:493] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.162097 14127 raft_consensus.cc:3060] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.167289 14125 raft_consensus.cc:515] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.168622 14076 raft_consensus.cc:2393] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 63f3a6b98cd447cea520bf9333bb82e1 in current term 1: Already voted for candidate 80f422c9c1654dc9a4d82ad0355919a7 in this term.
I20260709 13:04:06.173982 14120 tablet_bootstrap.cc:492] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.174052 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.174554 14120 ts_tablet_manager.cc:1403] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.075s	user 0.036s	sys 0.018s
I20260709 13:04:06.174808 14125 leader_election.cc:290] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.175423 14125 raft_consensus.cc:2804] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.175782 14125 raft_consensus.cc:493] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.176126 14125 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.174607 14127 raft_consensus.cc:515] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.177378 14001 raft_consensus.cc:2393] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 80f422c9c1654dc9a4d82ad0355919a7 in current term 1: Already voted for candidate 63f3a6b98cd447cea520bf9333bb82e1 in this term.
I20260709 13:04:06.177660 14120 raft_consensus.cc:359] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.178279 14127 leader_election.cc:290] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.178403 14120 raft_consensus.cc:385] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.178757 14120 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.179061 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.179838 13927 raft_consensus.cc:3060] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.179566 14120 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.180069 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:06.180850 14076 raft_consensus.cc:2393] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 63f3a6b98cd447cea520bf9333bb82e1 in current term 1: Already voted for candidate 80f422c9c1654dc9a4d82ad0355919a7 in this term.
I20260709 13:04:06.182802 14121 tablet_bootstrap.cc:654] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.182963 14039 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:39005, user_credentials={real_user=slave}} blocked reactor thread for 58471.3us
I20260709 13:04:06.184660 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d09430a733264aefb6783fcde1003221" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.186159 14039 leader_election.cc:304] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7; no voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:06.187429 14145 raft_consensus.cc:2749] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.187954 14120 ts_tablet_manager.cc:1434] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:04:06.188970 14120 tablet_bootstrap.cc:492] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:06.189102 14119 tablet_bootstrap.cc:492] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:06.189258 13927 raft_consensus.cc:2468] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 1.
I20260709 13:04:06.189570 14119 ts_tablet_manager.cc:1403] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.003s
I20260709 13:04:06.191450 13965 leader_election.cc:304] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:06.192459 14119 raft_consensus.cc:359] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.192524 14125 raft_consensus.cc:515] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.193339 14119 raft_consensus.cc:385] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.193675 14119 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.194424 14119 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.195303 14126 raft_consensus.cc:493] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.195562 14127 raft_consensus.cc:2804] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.195742 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.200016 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.195782 14126 raft_consensus.cc:515] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.202194 14125 leader_election.cc:290] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.202378 14001 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.204030 14126 leader_election.cc:290] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.204245 14119 ts_tablet_manager.cc:1434] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:04:06.205217 14119 tablet_bootstrap.cc:492] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:06.205088 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.206736 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.201054 14121 tablet_bootstrap.cc:492] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.207882 14121 ts_tablet_manager.cc:1403] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.003s
W20260709 13:04:06.208254 13893 leader_election.cc:343] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:06.209313 13892 leader_election.cc:343] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.209725 13892 leader_election.cc:304] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f020ba3143634acb8b0f8e0ae5872ebf; no voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:06.210131 14001 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.210947 13927 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.211480 14041 leader_election.cc:304] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:06.211534 14126 raft_consensus.cc:2749] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.215776 14121 raft_consensus.cc:359] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.216254 14125 raft_consensus.cc:2804] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.216557 14121 raft_consensus.cc:385] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.216912 14121 raft_consensus.cc:740] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.217105 14125 raft_consensus.cc:697] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:06.218156 13927 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.218575 14120 tablet_bootstrap.cc:654] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.218060 14125 consensus_queue.cc:237] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.222446 14119 tablet_bootstrap.cc:654] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.224920 14121 consensus_queue.cc:260] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.227047 14127 raft_consensus.cc:697] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:06.227936 14127 consensus_queue.cc:237] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.235162 14121 ts_tablet_manager.cc:1434] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.002s
I20260709 13:04:06.236199 14121 tablet_bootstrap.cc:492] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.240450 13823 catalog_manager.cc:5697] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.248838 14119 tablet_bootstrap.cc:492] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:06.249361 14119 ts_tablet_manager.cc:1403] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.000s
I20260709 13:04:06.250986 13824 catalog_manager.cc:5697] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.252339 14119 raft_consensus.cc:359] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.253015 14119 raft_consensus.cc:385] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.253301 14119 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.254058 14119 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.257489 14119 ts_tablet_manager.cc:1434] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:06.258423 14120 tablet_bootstrap.cc:492] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.258423 14119 tablet_bootstrap.cc:492] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:06.258868 14121 tablet_bootstrap.cc:654] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.259261 14120 ts_tablet_manager.cc:1403] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.013s
I20260709 13:04:06.262454 14120 raft_consensus.cc:359] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.263491 14120 raft_consensus.cc:385] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.263967 14120 raft_consensus.cc:740] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.264999 14120 consensus_queue.cc:260] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.268450 14120 ts_tablet_manager.cc:1434] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:04:06.269834 14120 tablet_bootstrap.cc:492] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:06.274894 14125 raft_consensus.cc:493] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.274923 14119 tablet_bootstrap.cc:654] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.275419 14125 raft_consensus.cc:515] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.277554 14125 leader_election.cc:290] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.277853 14120 tablet_bootstrap.cc:654] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.279197 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bfef359e374220957a663807fb3812" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.279862 13927 raft_consensus.cc:2468] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.279925 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bfef359e374220957a663807fb3812" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.281234 14039 leader_election.cc:304] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
W20260709 13:04:06.282117 14041 leader_election.cc:343] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.283298 14125 raft_consensus.cc:2804] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.283867 14125 raft_consensus.cc:493] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.284376 14125 raft_consensus.cc:3060] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.294440 14125 raft_consensus.cc:515] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.298285 14121 tablet_bootstrap.cc:492] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.299024 14121 ts_tablet_manager.cc:1403] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.063s	user 0.019s	sys 0.007s
I20260709 13:04:06.304313 14119 tablet_bootstrap.cc:492] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:06.304839 14119 ts_tablet_manager.cc:1403] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.009s
I20260709 13:04:06.305375 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bfef359e374220957a663807fb3812" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.306103 13927 raft_consensus.cc:3060] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.307623 14119 raft_consensus.cc:359] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.308351 14119 raft_consensus.cc:385] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.308640 14119 raft_consensus.cc:740] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.309381 14119 consensus_queue.cc:260] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.312014 14119 ts_tablet_manager.cc:1434] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:06.312911 14119 tablet_bootstrap.cc:492] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:06.315740 14145 raft_consensus.cc:493] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.316407 14145 raft_consensus.cc:515] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.320608 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.321239 14001 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.321832 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.322523 14041 leader_election.cc:304] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:06.322681 13926 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.323467 14145 leader_election.cc:290] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.324332 14145 raft_consensus.cc:2804] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.325671 14145 raft_consensus.cc:493] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.326179 14145 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.330971 14125 leader_election.cc:290] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.335084 13927 raft_consensus.cc:2468] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.337944 14119 tablet_bootstrap.cc:654] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.338446 14145 raft_consensus.cc:515] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.338923 14039 leader_election.cc:304] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.339874 14125 raft_consensus.cc:2804] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.340373 14125 raft_consensus.cc:697] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:06.303049 14121 raft_consensus.cc:359] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.341907 14121 raft_consensus.cc:385] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.344039 14121 raft_consensus.cc:740] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.344758 14121 consensus_queue.cc:260] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.346947 14121 ts_tablet_manager.cc:1434] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.000s
I20260709 13:04:06.347898 14121 tablet_bootstrap.cc:492] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.341193 14125 consensus_queue.cc:237] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.357636 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62bfef359e374220957a663807fb3812" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.357841 14145 leader_election.cc:290] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
W20260709 13:04:06.360217 14041 leader_election.cc:343] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.360478 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.361923 13927 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.364130 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.369076 14120 tablet_bootstrap.cc:492] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.369575 14120 ts_tablet_manager.cc:1403] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.052s
I20260709 13:04:06.367223 14001 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.372174 14119 tablet_bootstrap.cc:492] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:06.372581 14119 ts_tablet_manager.cc:1403] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.008s
I20260709 13:04:06.375756 14127 raft_consensus.cc:493] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.375559 14120 raft_consensus.cc:359] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.376313 14120 raft_consensus.cc:385] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.376219 14127 raft_consensus.cc:515] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.376634 14120 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.377377 14120 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.378371 14127 leader_election.cc:290] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.379043 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.379060 13927 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.379635 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.380625 14039 leader_election.cc:304] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
W20260709 13:04:06.380805 13965 leader_election.cc:343] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.380604 14119 raft_consensus.cc:359] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.381415 14119 raft_consensus.cc:385] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:06.381561 13968 leader_election.cc:343] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.381727 14119 raft_consensus.cc:740] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.381839 14160 raft_consensus.cc:2804] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.382035 13968 leader_election.cc:304] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1; no voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:06.382345 14160 raft_consensus.cc:697] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:06.382475 14119 consensus_queue.cc:260] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.383204 14160 consensus_queue.cc:237] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.377959 13824 catalog_manager.cc:5697] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.385737 14120 ts_tablet_manager.cc:1434] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:04:06.387006 14145 raft_consensus.cc:493] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.390187 14120 tablet_bootstrap.cc:492] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:06.389943 14145 raft_consensus.cc:515] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.391949 14145 leader_election.cc:290] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.396878 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.397629 14127 raft_consensus.cc:2749] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.398579 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
W20260709 13:04:06.400136 14039 leader_election.cc:343] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.402014 14120 tablet_bootstrap.cc:654] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.402119 14121 tablet_bootstrap.cc:654] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:06.404685 14041 leader_election.cc:343] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:06.405135 14041 leader_election.cc:304] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7; no voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:06.406282 14160 raft_consensus.cc:2749] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:06.388447 14001 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.411578 14119 ts_tablet_manager.cc:1434] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.039s	user 0.010s	sys 0.009s
I20260709 13:04:06.413244 14119 tablet_bootstrap.cc:492] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: Bootstrap starting.
I20260709 13:04:06.416401 13824 catalog_manager.cc:5697] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.419185 14119 tablet_bootstrap.cc:654] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.422758 14120 tablet_bootstrap.cc:492] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.423674 14120 ts_tablet_manager.cc:1403] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.000s
I20260709 13:04:06.426317 14120 raft_consensus.cc:359] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.427170 14120 raft_consensus.cc:385] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.427462 14120 raft_consensus.cc:740] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.428171 14120 consensus_queue.cc:260] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.429122 14121 tablet_bootstrap.cc:492] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.429575 14121 ts_tablet_manager.cc:1403] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.082s	user 0.015s	sys 0.007s
I20260709 13:04:06.432061 14120 ts_tablet_manager.cc:1434] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:06.432436 14121 raft_consensus.cc:359] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.432966 14120 tablet_bootstrap.cc:492] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: Bootstrap starting.
I20260709 13:04:06.442988 14120 tablet_bootstrap.cc:654] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.433168 14121 raft_consensus.cc:385] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.451472 14121 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.454331 14120 tablet_bootstrap.cc:492] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: No bootstrap required, opened a new log
I20260709 13:04:06.454116 14121 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.454787 14120 ts_tablet_manager.cc:1403] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:04:06.454836 14119 tablet_bootstrap.cc:492] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: No bootstrap required, opened a new log
I20260709 13:04:06.455346 14119 ts_tablet_manager.cc:1403] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.014s
I20260709 13:04:06.456986 14121 ts_tablet_manager.cc:1434] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:06.457455 14120 raft_consensus.cc:359] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.458045 14121 tablet_bootstrap.cc:492] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.458161 14120 raft_consensus.cc:385] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.458578 14120 raft_consensus.cc:740] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.459273 14120 consensus_queue.cc:260] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.461241 14120 ts_tablet_manager.cc:1434] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:06.461155 14119 raft_consensus.cc:359] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.461880 14119 raft_consensus.cc:385] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.462177 14119 raft_consensus.cc:740] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.462829 14119 consensus_queue.cc:260] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.465261 14119 ts_tablet_manager.cc:1434] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:06.472766 14121 tablet_bootstrap.cc:654] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.476554 14126 raft_consensus.cc:493] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.477037 14126 raft_consensus.cc:515] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.479144 14126 leader_election.cc:290] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.479884 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.480504 14001 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 0.
I20260709 13:04:06.481418 14121 tablet_bootstrap.cc:492] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.481849 14121 ts_tablet_manager.cc:1403] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 13:04:06.481787 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.482446 14076 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 0.
I20260709 13:04:06.483665 13893 leader_election.cc:304] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.484412 14126 raft_consensus.cc:2804] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.484738 14126 raft_consensus.cc:493] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.485019 14126 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.487711 14121 raft_consensus.cc:359] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.488440 14121 raft_consensus.cc:385] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.488737 14121 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.489491 14121 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.490628 14126 raft_consensus.cc:515] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.491775 14121 ts_tablet_manager.cc:1434] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:06.492684 14126 leader_election.cc:290] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.493656 14121 tablet_bootstrap.cc:492] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.494491 14127 raft_consensus.cc:493] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.494910 14127 raft_consensus.cc:515] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.496984 14127 leader_election.cc:290] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.498374 14075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.498847 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.499078 14075 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 0.
I20260709 13:04:06.499521 13927 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 0.
I20260709 13:04:06.500331 13968 leader_election.cc:304] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:06.500718 14121 tablet_bootstrap.cc:654] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.498862 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:06.502221 14076 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.499188 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.505477 14001 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.507586 14127 raft_consensus.cc:2804] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.507932 14127 raft_consensus.cc:493] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.508253 14127 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.514665 14121 tablet_bootstrap.cc:492] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.515090 14121 ts_tablet_manager.cc:1403] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:04:06.516873 14127 raft_consensus.cc:515] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.517787 14121 raft_consensus.cc:359] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.518548 14076 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 1.
I20260709 13:04:06.518466 14121 raft_consensus.cc:385] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.519717 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.519878 14121 raft_consensus.cc:740] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.519985 14075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:06.520331 13927 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.519032 14127 leader_election.cc:290] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.520574 14075 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.520998 14121 consensus_queue.cc:260] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.522902 14121 ts_tablet_manager.cc:1434] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:04:06.523762 14121 tablet_bootstrap.cc:492] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1: Bootstrap starting.
I20260709 13:04:06.527040 13927 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 1.
I20260709 13:04:06.520272 13893 leader_election.cc:304] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.528354 14126 raft_consensus.cc:2804] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.529127 13965 leader_election.cc:304] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.529809 14001 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 1.
I20260709 13:04:06.530083 14150 raft_consensus.cc:2804] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.527040 14075 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 1.
I20260709 13:04:06.530798 14150 raft_consensus.cc:697] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:06.531940 14150 consensus_queue.cc:237] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.535856 14121 tablet_bootstrap.cc:654] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:06.537253 14126 raft_consensus.cc:697] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:06.538272 14126 consensus_queue.cc:237] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.551565 13824 catalog_manager.cc:5697] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.571333 14121 tablet_bootstrap.cc:492] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1: No bootstrap required, opened a new log
I20260709 13:04:06.571820 14121 ts_tablet_manager.cc:1403] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent bootstrapping tablet: real 0.048s	user 0.022s	sys 0.019s
I20260709 13:04:06.572417 13824 catalog_manager.cc:5697] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 0 to 1, leader changed from <none> to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 1 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.574520 14121 raft_consensus.cc:359] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.575207 14121 raft_consensus.cc:385] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:06.575553 14121 raft_consensus.cc:740] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Initialized, Role: FOLLOWER
I20260709 13:04:06.576242 14121 consensus_queue.cc:260] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.578234 14121 ts_tablet_manager.cc:1434] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:06.594269 14126 raft_consensus.cc:493] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.594713 14126 raft_consensus.cc:515] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.596392 14126 leader_election.cc:290] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.597260 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.597455 14075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.597795 14001 raft_consensus.cc:2468] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 0.
I20260709 13:04:06.598111 14075 raft_consensus.cc:2468] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 0.
I20260709 13:04:06.598834 13892 leader_election.cc:304] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.599666 14126 raft_consensus.cc:2804] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.600028 14126 raft_consensus.cc:493] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.600343 14126 raft_consensus.cc:3060] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.604341 14171 raft_consensus.cc:493] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.604833 14171 raft_consensus.cc:515] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.606904 14171 leader_election.cc:290] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.606717 14126 raft_consensus.cc:515] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.608053 14075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7" is_pre_election: true
I20260709 13:04:06.608481 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.608656 14126 leader_election.cc:290] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.608659 14075 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 0.
I20260709 13:04:06.609961 14075 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:06.610085 13893 leader_election.cc:304] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.610481 14075 raft_consensus.cc:3060] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.610937 14126 raft_consensus.cc:2804] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.611176 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.611328 14126 raft_consensus.cc:493] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.611752 14126 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.612115 14001 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 0.
I20260709 13:04:06.611780 14002 raft_consensus.cc:3060] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.617683 14075 raft_consensus.cc:2468] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 1.
I20260709 13:04:06.618945 13893 leader_election.cc:304] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.618935 14126 raft_consensus.cc:515] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.620057 14171 raft_consensus.cc:2804] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.621228 14126 leader_election.cc:290] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:06.622047 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.622287 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:06.622627 14001 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.622839 14076 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.627877 14002 raft_consensus.cc:2468] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 1.
I20260709 13:04:06.629215 14076 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 1.
I20260709 13:04:06.632091 13893 leader_election.cc:304] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.632513 14171 raft_consensus.cc:697] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:06.633533 14175 raft_consensus.cc:2804] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.634024 14175 raft_consensus.cc:697] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:06.634411 14171 consensus_queue.cc:237] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.634825 14175 consensus_queue.cc:237] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.635233 14001 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 1.
I20260709 13:04:06.650830 14163 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.652915 13822 catalog_manager.cc:5697] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 0 to 1, leader changed from <none> to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 1 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.670742 13824 catalog_manager.cc:5697] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 0 to 1, leader changed from <none> to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 1 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:06.676177 14125 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.684803 14150 consensus_queue.cc:1048] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:06.700225 13872 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:06.702028 14127 consensus_queue.cc:1048] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.732017 14160 raft_consensus.cc:493] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:06.732569 14160 raft_consensus.cc:515] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.734683 14160 leader_election.cc:290] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.735548 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" is_pre_election: true
I20260709 13:04:06.735948 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1" is_pre_election: true
I20260709 13:04:06.736261 13926 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.736986 14001 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 0.
I20260709 13:04:06.737958 14039 leader_election.cc:304] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:06.739153 14160 raft_consensus.cc:2804] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:06.739480 14160 raft_consensus.cc:493] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:06.739807 14160 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.741873 14125 consensus_queue.cc:1048] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.745954 14160 raft_consensus.cc:515] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.747781 14160 leader_election.cc:290] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:06.749253 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:06.749883 14001 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.749253 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:06.752130 13927 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.756816 14001 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.758092 14041 leader_election.cc:304] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:06.759997 14163 raft_consensus.cc:2804] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:06.759117 13927 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 1.
I20260709 13:04:06.760463 14163 raft_consensus.cc:697] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:06.761344 14163 consensus_queue.cc:237] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:06.762679 14001 raft_consensus.cc:3060] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:06.773733 14163 consensus_queue.cc:1048] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:06.777993 13824 catalog_manager.cc:5697] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:06.799597 14163 consensus_queue.cc:1048] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:06.813690 14160 consensus_queue.cc:1048] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.006160 14076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f863e11e752e46b2af05256f45036628"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
mode: GRACEFUL
new_leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:59638
I20260709 13:04:07.006769 14076 raft_consensus.cc:606] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Received request to transfer leadership to TS f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:07.012318 14076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
mode: GRACEFUL
new_leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:59638
I20260709 13:04:07.012912 14076 raft_consensus.cc:606] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Received request to transfer leadership to TS f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:07.030103 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:42478
I20260709 13:04:07.030642 14001 raft_consensus.cc:606] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Received request to transfer leadership to TS f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:07.035674 14175 consensus_queue.cc:1048] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.037416 14076 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:59638
I20260709 13:04:07.037983 14076 raft_consensus.cc:606] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:07.059293 14195 consensus_queue.cc:1048] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.065032 13926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:07.065655 13926 raft_consensus.cc:606] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:07.072861 14127 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.074759 13926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:07.075367 13926 raft_consensus.cc:606] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:07.082858 14163 raft_consensus.cc:993] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: : Instructing follower f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:07.083324 14163 raft_consensus.cc:1081] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Signalling peer f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:07.087148 13926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f863e11e752e46b2af05256f45036628"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:04:07.089166 13926 raft_consensus.cc:493] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.089582 13926 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.091992 14127 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.101970 13926 raft_consensus.cc:515] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.105347 13926 leader_election.cc:290] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 2 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:07.106530 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:07.107120 14076 raft_consensus.cc:3055] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.107158 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:07.107573 14076 raft_consensus.cc:740] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:07.107831 14001 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.108397 14076 consensus_queue.cc:260] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.109740 14076 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.109844 14150 raft_consensus.cc:993] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:07.110280 14150 raft_consensus.cc:1081] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Signalling peer f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:07.112207 13927 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:04:07.112758 13927 raft_consensus.cc:493] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.113108 13927 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.114871 14001 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 2.
I20260709 13:04:07.116076 13892 leader_election.cc:304] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:07.116894 14195 raft_consensus.cc:2804] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.117352 14195 raft_consensus.cc:697] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:07.118148 14195 consensus_queue.cc:237] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.120653 13927 raft_consensus.cc:515] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.123915 14076 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 2.
I20260709 13:04:07.123881 13926 raft_consensus.cc:1240] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Rejecting Update request from peer 63f3a6b98cd447cea520bf9333bb82e1 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:07.127825 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:07.127779 14150 consensus_queue.cc:1059] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.128692 14127 raft_consensus.cc:3055] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.129065 14127 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:07.129334 13927 leader_election.cc:290] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 2 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:07.129601 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:07.129923 14127 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.127276 13824 catalog_manager.cc:5697] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 1 to 2, leader changed from 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3) to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 2 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.131035 14127 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.140861 14195 consensus_queue.cc:1048] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.152256 14001 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 2.
I20260709 13:04:07.154239 13892 leader_election.cc:304] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:07.155575 14195 raft_consensus.cc:2804] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.156212 14195 raft_consensus.cc:697] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:07.157238 14195 consensus_queue.cc:237] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.162335 14175 consensus_queue.cc:1048] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.167053 14175 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.174033 14163 consensus_queue.cc:1048] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:07.179827 13822 catalog_manager.cc:5697] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 1 to 2, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 2 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.183646 14126 raft_consensus.cc:993] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:07.184098 14126 raft_consensus.cc:1081] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:07.187045 14002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:07.187600 14002 raft_consensus.cc:493] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.187948 14002 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.194413 14175 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:07.197721 14160 raft_consensus.cc:993] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: : Instructing follower f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:07.198246 14160 raft_consensus.cc:1081] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Signalling peer f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:07.198902 14002 raft_consensus.cc:515] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.201122 14002 leader_election.cc:290] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:07.202862 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:07.207477 13927 raft_consensus.cc:3055] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.207835 13927 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:07.208812 14145 consensus_queue.cc:1048] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.208603 13927 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.210342 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:07.210903 13927 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.215647 13926 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:52030
I20260709 13:04:07.216298 13926 raft_consensus.cc:493] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.217965 13927 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:07.219918 13926 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.220346 13965 leader_election.cc:304] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:07.221556 14127 raft_consensus.cc:2804] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.222013 14127 raft_consensus.cc:697] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:07.222812 14127 consensus_queue.cc:237] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.235018 13823 catalog_manager.cc:5697] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 1 to 2, leader changed from f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.228560 13926 raft_consensus.cc:515] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.241788 13927 raft_consensus.cc:1240] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Rejecting Update request from peer 80f422c9c1654dc9a4d82ad0355919a7 for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:07.246537 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:07.247123 14076 raft_consensus.cc:3055] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.247469 14076 raft_consensus.cc:740] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:07.245363 13926 leader_election.cc:290] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 2 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:07.248243 14076 consensus_queue.cc:260] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.249354 14076 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.255821 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:07.256341 14002 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.262112 14002 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 2.
I20260709 13:04:07.262548 14076 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 2.
I20260709 13:04:07.263432 13892 leader_election.cc:304] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:07.264277 14195 raft_consensus.cc:2804] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.264927 14195 raft_consensus.cc:697] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
W20260709 13:04:07.255474 14160 consensus_queue.cc:1175] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 80f422c9c1654dc9a4d82ad0355919a7 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:04:07.265734 14195 consensus_queue.cc:237] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.274957 13821 catalog_manager.cc:5697] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 1 to 2, leader changed from 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3) to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 2 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.327704 14163 raft_consensus.cc:993] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:07.328264 14160 raft_consensus.cc:1081] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:07.329689 14002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42464
I20260709 13:04:07.330156 14002 raft_consensus.cc:493] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.330447 14002 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.334827 14002 raft_consensus.cc:515] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.336961 14002 leader_election.cc:290] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:07.337407 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:07.337543 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:07.338091 13926 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.338112 14076 raft_consensus.cc:3055] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.338730 14076 raft_consensus.cc:740] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:07.339484 14076 consensus_queue.cc:260] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.340348 14076 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.344444 14076 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:07.344760 13926 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:07.345438 13968 leader_election.cc:304] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:07.346204 14148 raft_consensus.cc:2804] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.346668 14148 raft_consensus.cc:697] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:07.347448 14148 consensus_queue.cc:237] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.354239 13821 catalog_manager.cc:5697] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 1 to 2, leader changed from 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.505676 14175 raft_consensus.cc:993] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:07.506203 14195 raft_consensus.cc:1081] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:07.508107 14002 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:07.508674 14002 raft_consensus.cc:493] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:07.509083 14002 raft_consensus.cc:3060] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.514034 14002 raft_consensus.cc:515] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.516404 14002 leader_election.cc:290] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:07.516745 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:07.517093 14076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "460251996db44ee390a8cc4c552a4bc1" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:07.517506 13926 raft_consensus.cc:3055] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:07.517874 14076 raft_consensus.cc:3060] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.517892 13926 raft_consensus.cc:740] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:07.518849 13926 consensus_queue.cc:260] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.520151 13926 raft_consensus.cc:3060] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.525533 14076 raft_consensus.cc:2468] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:07.526747 13968 leader_election.cc:304] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:07.527331 13926 raft_consensus.cc:2468] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:07.527704 14148 raft_consensus.cc:2804] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:07.528236 14148 raft_consensus.cc:697] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:07.529093 14148 consensus_queue.cc:237] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:07.536603 13821 catalog_manager.cc:5697] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 1 to 2, leader changed from f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:07.577152 14002 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.578344 14195 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.589452 14076 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.596783 14076 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.598093 14195 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:07.620918 13926 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.622233 14148 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.634514 14076 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:07.645242 14076 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.649580 14127 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.665189 14002 raft_consensus.cc:1275] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.666611 14126 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.678148 14076 raft_consensus.cc:1275] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.681501 14171 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.722429 14002 raft_consensus.cc:1275] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.723549 14171 consensus_queue.cc:1048] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.730862 14076 raft_consensus.cc:1275] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.732563 14195 consensus_queue.cc:1048] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.813742 13926 raft_consensus.cc:1275] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.815117 14127 consensus_queue.cc:1048] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.824223 14076 raft_consensus.cc:1275] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.825842 14148 consensus_queue.cc:1048] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.937665 13926 raft_consensus.cc:1275] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.938803 14148 consensus_queue.cc:1048] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:07.945996 14076 raft_consensus.cc:1275] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:07.947556 14127 consensus_queue.cc:1048] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:09.701634 14097 debug-util.cc:398] Leaking SignalData structure 0x7b080016d060 after lost signal to thread 13795
W20260709 13:04:09.702339 14097 debug-util.cc:398] Leaking SignalData structure 0x7b080016d740 after lost signal to thread 13858
W20260709 13:04:09.703086 14097 debug-util.cc:398] Leaking SignalData structure 0x7b08001d41a0 after lost signal to thread 13951
W20260709 13:04:09.703805 14097 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7bc0 after lost signal to thread 14026
W20260709 13:04:09.704486 14097 debug-util.cc:398] Leaking SignalData structure 0x7b08001c7720 after lost signal to thread 14100
I20260709 13:04:10.188530 13792 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:04:10.189443 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:10.210899 13926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
mode: GRACEFUL
new_leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:52054
I20260709 13:04:10.211588 13926 raft_consensus.cc:606] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Received request to transfer leadership to TS 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:10.224160 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:42484
I20260709 13:04:10.224840 14001 raft_consensus.cc:606] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Received request to transfer leadership to TS 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:10.226439 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:10.226907 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:10.287515 14209 raft_consensus.cc:993] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:10.287994 14127 raft_consensus.cc:1081] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Signalling peer 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:10.289616 14074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:04:10.290091 14074 raft_consensus.cc:493] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.290410 14074 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.294976 14074 raft_consensus.cc:515] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:10.296669 14074 leader_election.cc:290] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 3 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:10.297729 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:10.297719 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:10.298457 14001 raft_consensus.cc:3055] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:10.298507 13926 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.298892 14001 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:10.299719 14001 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:10.300971 14001 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.305950 13926 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 3.
I20260709 13:04:10.308408 14001 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 3.
I20260709 13:04:10.309583 14041 leader_election.cc:304] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:10.310330 14160 raft_consensus.cc:2804] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:10.311800 14160 raft_consensus.cc:697] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:10.316032 14160 consensus_queue.cc:237] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:10.326867 13821 catalog_manager.cc:5697] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 2 to 3, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.694178 14219 raft_consensus.cc:993] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: : Instructing follower 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:10.694651 14171 raft_consensus.cc:1081] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Signalling peer 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:10.696466 14074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:59612
I20260709 13:04:10.697044 14074 raft_consensus.cc:493] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:10.697378 14074 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.701988 14074 raft_consensus.cc:515] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:10.703820 14074 leader_election.cc:290] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 3 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:10.704761 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:10.704866 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:10.705386 13926 raft_consensus.cc:3055] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:10.705520 14001 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.705758 13926 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:10.706581 13926 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:10.707553 13926 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:10.713899 13926 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 3.
I20260709 13:04:10.715150 14001 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 3.
I20260709 13:04:10.715127 14039 leader_election.cc:304] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:10.716127 14160 raft_consensus.cc:2804] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:10.716620 14160 raft_consensus.cc:697] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:10.717454 14160 consensus_queue.cc:237] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:10.725965 13821 catalog_manager.cc:5697] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 2 to 3, leader changed from f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1) to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:10.821026 13926 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:10.822487 14160 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:10.833648 14001 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:10.835388 14160 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.227790 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:11.238535 13926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f863e11e752e46b2af05256f45036628"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:11.239248 13926 raft_consensus.cc:606] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:11.244328 13926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:11.244817 13926 raft_consensus.cc:606] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:11.249459 13926 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:52048
I20260709 13:04:11.249935 13926 raft_consensus.cc:606] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:11.254428 14074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:59638
I20260709 13:04:11.254897 14074 raft_consensus.cc:606] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:11.261978 14074 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
mode: GRACEFUL
new_leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:59638
I20260709 13:04:11.262435 14074 raft_consensus.cc:606] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Received request to transfer leadership to TS 63f3a6b98cd447cea520bf9333bb82e1
I20260709 13:04:11.284147 14002 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.285429 14160 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.291234 14223 raft_consensus.cc:993] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.291808 14213 raft_consensus.cc:1081] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.293704 14001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42464
I20260709 13:04:11.294212 14001 raft_consensus.cc:493] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.294520 14001 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:11.302611 13926 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.302197 14001 raft_consensus.cc:515] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.304425 14160 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:11.305090 14002 raft_consensus.cc:1240] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Rejecting Update request from peer 80f422c9c1654dc9a4d82ad0355919a7 for earlier term 3. Current term is 4. Ops: []
I20260709 13:04:11.306638 14001 leader_election.cc:290] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 4 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:11.309047 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:11.309605 14074 raft_consensus.cc:3055] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:11.309950 14074 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:11.310781 14074 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.311697 14074 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:11.313144 13927 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:11.319146 14074 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 4.
I20260709 13:04:11.320497 14171 raft_consensus.cc:993] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.320941 14230 raft_consensus.cc:1081] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.320765 13968 leader_election.cc:304] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:11.321903 14127 raft_consensus.cc:2804] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:11.323865 14001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:11.324376 14001 raft_consensus.cc:493] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.324678 14001 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.333138 14127 raft_consensus.cc:697] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:11.333503 14001 raft_consensus.cc:515] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.334270 14127 consensus_queue.cc:237] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.336081 14001 leader_election.cc:290] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:11.336257 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:11.336846 13926 raft_consensus.cc:3055] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:11.337180 13926 raft_consensus.cc:740] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:11.337141 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:11.338340 14073 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.338136 13926 consensus_queue.cc:260] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.339367 13926 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:11.343852 13821 catalog_manager.cc:5697] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 3 to 4, leader changed from 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.346246 14073 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:11.347637 13968 leader_election.cc:304] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:11.348138 13926 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 2.
I20260709 13:04:11.348878 14127 raft_consensus.cc:2804] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:11.350265 14127 raft_consensus.cc:697] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:11.350984 14127 consensus_queue.cc:237] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.362967 13821 catalog_manager.cc:5697] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 1 to 2, leader changed from f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.402537 14223 raft_consensus.cc:993] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.403064 14213 raft_consensus.cc:1081] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.404666 14001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42464
I20260709 13:04:11.405169 14001 raft_consensus.cc:493] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.405519 14001 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:11.409523 14001 raft_consensus.cc:515] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.411334 14001 leader_election.cc:290] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 4 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:11.411729 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:11.411994 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:11.412299 13926 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:11.412582 14073 raft_consensus.cc:3055] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:11.412909 14073 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:11.413609 14073 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.414484 14073 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:11.418829 14073 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 4.
I20260709 13:04:11.418926 13926 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 4.
I20260709 13:04:11.420006 13968 leader_election.cc:304] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:11.420830 14127 raft_consensus.cc:2804] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:11.421311 14127 raft_consensus.cc:697] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:11.422060 14127 consensus_queue.cc:237] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.428735 13821 catalog_manager.cc:5697] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 3 to 4, leader changed from 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.466274 14171 raft_consensus.cc:993] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.466851 14230 raft_consensus.cc:1081] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.469584 14001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f863e11e752e46b2af05256f45036628"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:11.470062 14001 raft_consensus.cc:493] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.470363 14001 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.474381 14001 raft_consensus.cc:515] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.475952 14001 leader_election.cc:290] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 3 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:11.476723 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:11.477181 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:11.477305 13926 raft_consensus.cc:3055] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:11.477716 14073 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.477654 13926 raft_consensus.cc:740] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:11.478578 13926 consensus_queue.cc:260] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.479739 13926 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.484251 14073 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 3.
I20260709 13:04:11.487304 13968 leader_election.cc:304] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:11.488276 14231 raft_consensus.cc:2804] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:11.488765 14231 raft_consensus.cc:697] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:11.489094 13926 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 3.
I20260709 13:04:11.489629 14231 consensus_queue.cc:237] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.497370 13821 catalog_manager.cc:5697] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 2 to 3, leader changed from f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 3 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.702675 14171 raft_consensus.cc:993] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: : Instructing follower 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.703199 14230 raft_consensus.cc:1081] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Signalling peer 63f3a6b98cd447cea520bf9333bb82e1 to start an election
I20260709 13:04:11.704739 14001 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:04:11.705303 14001 raft_consensus.cc:493] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:11.705648 14001 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.712198 14001 raft_consensus.cc:515] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.714597 14001 leader_election.cc:290] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 3 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:11.714830 13926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:11.715126 14074 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a14fbb79102140e2a66ab8122a595618" candidate_uuid: "63f3a6b98cd447cea520bf9333bb82e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:11.715436 13926 raft_consensus.cc:3055] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:11.715711 14074 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.715729 13926 raft_consensus.cc:740] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:11.716768 13926 consensus_queue.cc:260] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.718014 13926 raft_consensus.cc:3060] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:11.722021 14074 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 3.
I20260709 13:04:11.723264 13968 leader_election.cc:304] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, 80f422c9c1654dc9a4d82ad0355919a7; no voters: 
I20260709 13:04:11.724005 14231 raft_consensus.cc:2804] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:11.724440 14231 raft_consensus.cc:697] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Becoming Leader. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:11.724992 13926 raft_consensus.cc:2468] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 63f3a6b98cd447cea520bf9333bb82e1 in term 3.
I20260709 13:04:11.725234 14231 consensus_queue.cc:237] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:11.732930 13821 catalog_manager.cc:5697] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 reported cstate change: term changed from 2 to 3, leader changed from f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1) to 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2). New cstate: current_term: 3 leader_uuid: "63f3a6b98cd447cea520bf9333bb82e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:11.786376 13926 raft_consensus.cc:1275] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.787578 14231 consensus_queue.cc:1048] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.800817 13927 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:11.808880 13927 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:11.810495 14231 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:11.815078 14074 raft_consensus.cc:1275] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:11.816596 14228 consensus_queue.cc:1048] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:11.823397 14073 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:11.825022 14228 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:11.879292 13925 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:11.880682 14228 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:11.891077 14074 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:11.893294 14228 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:11.905586 14074 raft_consensus.cc:1275] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.907223 14228 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:11.918483 13925 raft_consensus.cc:1275] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:11.920054 14231 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:12.144275 13927 raft_consensus.cc:1275] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:12.145715 14231 consensus_queue.cc:1048] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:12.156347 14074 raft_consensus.cc:1275] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Refusing update from remote peer 63f3a6b98cd447cea520bf9333bb82e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:12.157744 14231 consensus_queue.cc:1048] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:14.271792 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:14.278827 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:42484
I20260709 13:04:14.279524 14001 raft_consensus.cc:606] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Received request to transfer leadership to TS 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:14.282132 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:42484
I20260709 13:04:14.282580 14001 raft_consensus.cc:606] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Received request to transfer leadership to TS 80f422c9c1654dc9a4d82ad0355919a7
I20260709 13:04:14.284806 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:42484
I20260709 13:04:14.285225 14001 raft_consensus.cc:606] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Received request to transfer leadership to TS f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:14.287218 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:42484
I20260709 13:04:14.287672 14001 raft_consensus.cc:606] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Received request to transfer leadership to TS f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:14.289693 14001 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f863e11e752e46b2af05256f45036628"
dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
mode: GRACEFUL
new_leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:42484
I20260709 13:04:14.290091 14001 raft_consensus.cc:606] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Received request to transfer leadership to TS f020ba3143634acb8b0f8e0ae5872ebf
I20260709 13:04:14.290994 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:04:14.291433 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:14.358000 14231 raft_consensus.cc:993] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:14.358455 14231 raft_consensus.cc:1081] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Signalling peer 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:14.359949 14074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:04:14.360466 14074 raft_consensus.cc:493] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.360808 14074 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.366514 14074 raft_consensus.cc:515] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.368325 14074 leader_election.cc:290] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 3 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:14.369199 13925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:14.369342 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15390eb9342b4c4b8ce26f572dcade34" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:14.369984 13925 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.369993 14001 raft_consensus.cc:3055] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:14.370417 14001 raft_consensus.cc:740] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:14.371071 14001 consensus_queue.cc:260] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.372035 14001 raft_consensus.cc:3060] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.375025 13925 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 3.
I20260709 13:04:14.376320 14001 raft_consensus.cc:2468] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 3.
I20260709 13:04:14.376325 14039 leader_election.cc:304] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:14.377391 14249 raft_consensus.cc:2804] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:14.378401 14249 raft_consensus.cc:697] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:14.379230 14249 consensus_queue.cc:237] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.382949 14251 raft_consensus.cc:993] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:14.383524 14231 raft_consensus.cc:1081] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Signalling peer f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:14.385102 13925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f863e11e752e46b2af05256f45036628"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:04:14.385615 13925 raft_consensus.cc:493] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.385975 13925 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:14.387831 14251 raft_consensus.cc:993] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:14.388339 14231 raft_consensus.cc:1081] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Signalling peer 80f422c9c1654dc9a4d82ad0355919a7 to start an election
I20260709 13:04:14.387516 13821 catalog_manager.cc:5697] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 2 to 3, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.389853 14074 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3"
dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
 from {username='slave'} at 127.0.0.1:59624
I20260709 13:04:14.390341 14074 raft_consensus.cc:493] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.390695 14074 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.392752 13925 raft_consensus.cc:515] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.395205 13925 leader_election.cc:290] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 4 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:14.395428 14001 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:14.395960 14001 raft_consensus.cc:3055] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:14.396296 14001 raft_consensus.cc:740] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:14.396944 14001 consensus_queue.cc:260] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.397703 14001 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:14.398026 14074 raft_consensus.cc:515] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.400442 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f863e11e752e46b2af05256f45036628" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:14.401005 14073 raft_consensus.cc:3060] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:14.401974 14074 leader_election.cc:290] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 5 election: Requested vote from peers f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005), 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757)
I20260709 13:04:14.404361 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:14.404959 14002 raft_consensus.cc:3055] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:14.405237 14002 raft_consensus.cc:740] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:14.405838 14001 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 4.
I20260709 13:04:14.405984 14002 consensus_queue.cc:260] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.407991 13925 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b4dfe9135504786affd7ec941fa47b3" candidate_uuid: "80f422c9c1654dc9a4d82ad0355919a7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
I20260709 13:04:14.408599 13925 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.407248 14002 raft_consensus.cc:3060] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.407248 13892 leader_election.cc:304] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 63f3a6b98cd447cea520bf9333bb82e1, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:14.416302 13925 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 5.
I20260709 13:04:14.423720 14073 raft_consensus.cc:2468] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 4.
I20260709 13:04:14.425416 14039 leader_election.cc:304] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:14.424866 14257 raft_consensus.cc:2804] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:14.426513 14249 raft_consensus.cc:2804] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:14.426995 14249 raft_consensus.cc:697] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 LEADER]: Becoming Leader. State: Replica: 80f422c9c1654dc9a4d82ad0355919a7, State: Running, Role: LEADER
I20260709 13:04:14.427912 14249 consensus_queue.cc:237] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.415397 14002 raft_consensus.cc:2468] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80f422c9c1654dc9a4d82ad0355919a7 in term 5.
I20260709 13:04:14.431707 14251 raft_consensus.cc:993] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:14.432220 14251 raft_consensus.cc:1081] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Signalling peer f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:14.434640 14257 raft_consensus.cc:697] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:14.439302 13925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c773cdf624714a798aff540385f47d90"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:04:14.438674 14257 consensus_queue.cc:237] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.439929 13925 raft_consensus.cc:493] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.440354 13925 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.446122 13925 raft_consensus.cc:515] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.448360 13925 leader_election.cc:290] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 5 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:14.451172 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:14.451566 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c773cdf624714a798aff540385f47d90" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:14.451792 14002 raft_consensus.cc:3055] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:04:14.452116 14073 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.452725 13821 catalog_manager.cc:5697] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 3 to 4, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 4 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.453737 13822 catalog_manager.cc:5697] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 reported cstate change: term changed from 4 to 5, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3). New cstate: current_term: 5 leader_uuid: "80f422c9c1654dc9a4d82ad0355919a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:14.452138 14002 raft_consensus.cc:740] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:14.455924 14002 consensus_queue.cc:260] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.456830 14002 raft_consensus.cc:3060] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:04:14.459764 14073 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 5.
I20260709 13:04:14.461156 13893 leader_election.cc:304] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:14.461928 14257 raft_consensus.cc:2804] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:04:14.462541 14257 raft_consensus.cc:697] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:14.463511 14257 consensus_queue.cc:237] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.466977 14002 raft_consensus.cc:2468] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 5.
I20260709 13:04:14.470822 13822 catalog_manager.cc:5697] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 4 to 5, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 5 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.563719 14231 raft_consensus.cc:993] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: : Instructing follower f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:14.564177 14251 raft_consensus.cc:1081] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Signalling peer f020ba3143634acb8b0f8e0ae5872ebf to start an election
I20260709 13:04:14.565619 13925 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a"
dest_uuid: "f020ba3143634acb8b0f8e0ae5872ebf"
 from {username='slave'} at 127.0.0.1:52036
I20260709 13:04:14.566099 13925 raft_consensus.cc:493] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:14.566408 13925 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.570832 13925 raft_consensus.cc:515] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.572607 13925 leader_election.cc:290] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 3 election: Requested vote from peers 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2:34757), 80f422c9c1654dc9a4d82ad0355919a7 (127.13.120.3:33125)
I20260709 13:04:14.573434 14002 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "63f3a6b98cd447cea520bf9333bb82e1"
I20260709 13:04:14.573704 14073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee9f1d3686f4c3db8a87f364912745a" candidate_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "80f422c9c1654dc9a4d82ad0355919a7"
I20260709 13:04:14.573944 14002 raft_consensus.cc:3055] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:14.574222 14073 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.574286 14002 raft_consensus.cc:740] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 63f3a6b98cd447cea520bf9333bb82e1, State: Running, Role: LEADER
I20260709 13:04:14.575107 14002 consensus_queue.cc:260] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.576058 14002 raft_consensus.cc:3060] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:14.579035 14073 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 3.
I20260709 13:04:14.580108 13893 leader_election.cc:304] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 80f422c9c1654dc9a4d82ad0355919a7, f020ba3143634acb8b0f8e0ae5872ebf; no voters: 
I20260709 13:04:14.580792 14257 raft_consensus.cc:2804] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:14.580853 14002 raft_consensus.cc:2468] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f020ba3143634acb8b0f8e0ae5872ebf in term 3.
I20260709 13:04:14.581250 14257 raft_consensus.cc:697] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 3 LEADER]: Becoming Leader. State: Replica: f020ba3143634acb8b0f8e0ae5872ebf, State: Running, Role: LEADER
I20260709 13:04:14.582154 14257 consensus_queue.cc:237] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } }
I20260709 13:04:14.589078 13822 catalog_manager.cc:5697] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf reported cstate change: term changed from 2 to 3, leader changed from 63f3a6b98cd447cea520bf9333bb82e1 (127.13.120.2) to f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1). New cstate: current_term: 3 leader_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:14.775301 13925 raft_consensus.cc:1275] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:14.776604 14252 consensus_queue.cc:1048] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:14.786903 14002 raft_consensus.cc:1275] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:14.789443 14252 consensus_queue.cc:1048] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:14.929509 14002 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:14.930760 14257 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:14.939852 14073 raft_consensus.cc:1275] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:14.941506 14259 consensus_queue.cc:1048] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:14.955304 14002 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:14.956730 14268 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:14.966068 13925 raft_consensus.cc:1275] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Refusing update from remote peer 80f422c9c1654dc9a4d82ad0355919a7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:04:14.967664 14252 consensus_queue.cc:1048] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f020ba3143634acb8b0f8e0ae5872ebf" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 39005 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:14.970183 14002 raft_consensus.cc:1275] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:14.972810 14273 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:14.986982 14073 raft_consensus.cc:1275] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:14.988502 14257 consensus_queue.cc:1048] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:15.013417 14002 raft_consensus.cc:1275] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:15.014621 14257 consensus_queue.cc:1048] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "63f3a6b98cd447cea520bf9333bb82e1" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 34757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:15.025754 14073 raft_consensus.cc:1275] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Refusing update from remote peer f020ba3143634acb8b0f8e0ae5872ebf: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:15.027021 14259 consensus_queue.cc:1048] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [LEADER]: Connected to new peer: Peer: permanent_uuid: "80f422c9c1654dc9a4d82ad0355919a7" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 33125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:15.292323 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:15.297461 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
W20260709 13:04:15.307514 13965 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:04:15.313133 13965 consensus_peers.cc:597] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 -> Peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Couldn't send request to peer f020ba3143634acb8b0f8e0ae5872ebf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.333154 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:15.334035 13792 tablet_replica.cc:333] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.334924 13792 raft_consensus.cc:2243] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.335933 13792 raft_consensus.cc:2272] T 9ee9f1d3686f4c3db8a87f364912745a P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.338521 13792 tablet_replica.cc:333] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.339170 13792 raft_consensus.cc:2243] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.339802 13792 raft_consensus.cc:2272] T 460251996db44ee390a8cc4c552a4bc1 P f020ba3143634acb8b0f8e0ae5872ebf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.342234 13792 tablet_replica.cc:333] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.342981 13792 raft_consensus.cc:2243] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.343580 13792 raft_consensus.cc:2272] T d09430a733264aefb6783fcde1003221 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.343645 13965 consensus_peers.cc:597] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 -> Peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Couldn't send request to peer f020ba3143634acb8b0f8e0ae5872ebf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.345669 13792 tablet_replica.cc:333] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.346251 13792 raft_consensus.cc:2243] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.346707 13792 raft_consensus.cc:2272] T 8b4dfe9135504786affd7ec941fa47b3 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.349251 13792 tablet_replica.cc:333] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.349786 13792 raft_consensus.cc:2243] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.350293 13792 raft_consensus.cc:2272] T 15390eb9342b4c4b8ce26f572dcade34 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.352789 13792 tablet_replica.cc:333] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.353262 13792 raft_consensus.cc:2243] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.353622 13792 raft_consensus.cc:2272] T 62bfef359e374220957a663807fb3812 P f020ba3143634acb8b0f8e0ae5872ebf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.355170 13792 tablet_replica.cc:333] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.355659 13792 raft_consensus.cc:2243] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.356015 13792 raft_consensus.cc:2272] T a14fbb79102140e2a66ab8122a595618 P f020ba3143634acb8b0f8e0ae5872ebf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.357618 13792 tablet_replica.cc:333] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.358027 13792 raft_consensus.cc:2243] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.358654 13792 raft_consensus.cc:2272] T c773cdf624714a798aff540385f47d90 P f020ba3143634acb8b0f8e0ae5872ebf [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.360544 13792 tablet_replica.cc:333] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf: stopping tablet replica
I20260709 13:04:15.360958 13792 raft_consensus.cc:2243] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.361579 13792 raft_consensus.cc:2272] T f863e11e752e46b2af05256f45036628 P f020ba3143634acb8b0f8e0ae5872ebf [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.475574 13965 consensus_peers.cc:597] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 -> Peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Couldn't send request to peer f020ba3143634acb8b0f8e0ae5872ebf. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:39005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:15.476488 14039 consensus_peers.cc:597] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 -> Peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Couldn't send request to peer f020ba3143634acb8b0f8e0ae5872ebf. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:39005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.482788 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:04:15.500850 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
I20260709 13:04:15.537952 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:15.538617 13792 tablet_replica.cc:333] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.539602 13792 raft_consensus.cc:2243] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.540544 13792 raft_consensus.cc:2272] T 460251996db44ee390a8cc4c552a4bc1 P 63f3a6b98cd447cea520bf9333bb82e1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.542172 13792 tablet_replica.cc:333] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.542634 13792 raft_consensus.cc:2243] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.542976 13792 raft_consensus.cc:2272] T 62bfef359e374220957a663807fb3812 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.544595 13792 tablet_replica.cc:333] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.545012 13792 raft_consensus.cc:2243] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.545648 13792 raft_consensus.cc:2272] T a14fbb79102140e2a66ab8122a595618 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.547220 13792 tablet_replica.cc:333] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.547711 13792 raft_consensus.cc:2243] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.548041 13792 raft_consensus.cc:2272] T 15390eb9342b4c4b8ce26f572dcade34 P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.549861 13792 tablet_replica.cc:333] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.550359 13792 raft_consensus.cc:2243] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.550761 13792 raft_consensus.cc:2272] T 8b4dfe9135504786affd7ec941fa47b3 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.552537 13792 tablet_replica.cc:333] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.552973 13792 raft_consensus.cc:2243] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.553619 13792 raft_consensus.cc:2272] T d09430a733264aefb6783fcde1003221 P 63f3a6b98cd447cea520bf9333bb82e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.555086 13792 tablet_replica.cc:333] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.555534 13792 raft_consensus.cc:2243] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.555855 13792 raft_consensus.cc:2272] T c773cdf624714a798aff540385f47d90 P 63f3a6b98cd447cea520bf9333bb82e1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.557821 13792 tablet_replica.cc:333] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.558281 13792 raft_consensus.cc:2243] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.558658 13792 raft_consensus.cc:2272] T f863e11e752e46b2af05256f45036628 P 63f3a6b98cd447cea520bf9333bb82e1 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.560761 14039 consensus_peers.cc:597] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 -> Peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Couldn't send request to peer f020ba3143634acb8b0f8e0ae5872ebf. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:39005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.561035 13792 tablet_replica.cc:333] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1: stopping tablet replica
I20260709 13:04:15.561532 13792 raft_consensus.cc:2243] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.561853 13792 raft_consensus.cc:2272] T 9ee9f1d3686f4c3db8a87f364912745a P 63f3a6b98cd447cea520bf9333bb82e1 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:04:15.583911 14039 consensus_peers.cc:597] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 -> Peer f020ba3143634acb8b0f8e0ae5872ebf (127.13.120.1:39005): Couldn't send request to peer f020ba3143634acb8b0f8e0ae5872ebf. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:39005: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:15.589735 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
I20260709 13:04:15.606729 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
I20260709 13:04:15.631707 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:15.632452 13792 tablet_replica.cc:333] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.633008 13792 raft_consensus.cc:2243] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.633453 13792 raft_consensus.cc:2272] T 9ee9f1d3686f4c3db8a87f364912745a P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.635532 13792 tablet_replica.cc:333] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.636075 13792 raft_consensus.cc:2243] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.636757 13792 raft_consensus.cc:2272] T 15390eb9342b4c4b8ce26f572dcade34 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.638731 13792 tablet_replica.cc:333] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.639223 13792 raft_consensus.cc:2243] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.639644 13792 raft_consensus.cc:2272] T d09430a733264aefb6783fcde1003221 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.641129 13792 tablet_replica.cc:333] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.641566 13792 raft_consensus.cc:2243] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.642192 13792 raft_consensus.cc:2272] T 8b4dfe9135504786affd7ec941fa47b3 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.643973 13792 tablet_replica.cc:333] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.644384 13792 raft_consensus.cc:2243] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.644726 13792 raft_consensus.cc:2272] T a14fbb79102140e2a66ab8122a595618 P 80f422c9c1654dc9a4d82ad0355919a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.646099 13792 tablet_replica.cc:333] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.646500 13792 raft_consensus.cc:2243] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.647140 13792 raft_consensus.cc:2272] T 62bfef359e374220957a663807fb3812 P 80f422c9c1654dc9a4d82ad0355919a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.648633 13792 tablet_replica.cc:333] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.649024 13792 raft_consensus.cc:2243] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.649333 13792 raft_consensus.cc:2272] T 460251996db44ee390a8cc4c552a4bc1 P 80f422c9c1654dc9a4d82ad0355919a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.650735 13792 tablet_replica.cc:333] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.651103 13792 raft_consensus.cc:2243] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.651436 13792 raft_consensus.cc:2272] T c773cdf624714a798aff540385f47d90 P 80f422c9c1654dc9a4d82ad0355919a7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.653272 13792 tablet_replica.cc:333] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7: stopping tablet replica
I20260709 13:04:15.653676 13792 raft_consensus.cc:2243] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:15.654033 13792 raft_consensus.cc:2272] T f863e11e752e46b2af05256f45036628 P 80f422c9c1654dc9a4d82ad0355919a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.697542 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
I20260709 13:04:15.715063 13792 master.cc:562] Master@127.13.120.62:36509 shutting down...
I20260709 13:04:15.932742 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:15.933370 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:15.933779 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P ba06e0afc3c444379214eee21bac6e44: stopping tablet replica
I20260709 13:04:15.954334 13792 master.cc:584] Master@127.13.120.62:36509 shutdown complete.
63f3a6b98cd447cea520bf9333bb82e1  4
80f422c9c1654dc9a4d82ad0355919a7  1
f020ba3143634acb8b0f8e0ae5872ebf  4
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (12805 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:04:15.993283 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:43057
I20260709 13:04:15.994360 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:16.000062 14286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.000006 14285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.001904 13792 server_base.cc:1061] running on GCE node
W20260709 13:04:16.001892 14288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.002979 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:16.003162 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:16.003274 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602256003263 us; error 0 us; skew 500 ppm
I20260709 13:04:16.003794 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:16.006112 13792 webserver.cc:533] Webserver started at http://127.13.120.62:36827/ using document root <none> and password file <none>
I20260709 13:04:16.006556 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:16.006705 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:16.006919 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:16.008036 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "58f4d7003c4841e1b1024045eec8469e"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.012720 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:04:16.016237 14293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.016993 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:04:16.017307 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "58f4d7003c4841e1b1024045eec8469e"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.017609 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:16.033421 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:16.034714 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:16.072371 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:43057
I20260709 13:04:16.072496 14344 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:43057 every 8 connection(s)
I20260709 13:04:16.076222 14345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.085543 14345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e: Bootstrap starting.
I20260709 13:04:16.090122 14345 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.094506 14345 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e: No bootstrap required, opened a new log
I20260709 13:04:16.096585 14345 raft_consensus.cc:359] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f4d7003c4841e1b1024045eec8469e" member_type: VOTER }
I20260709 13:04:16.096943 14345 raft_consensus.cc:385] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.097236 14345 raft_consensus.cc:740] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58f4d7003c4841e1b1024045eec8469e, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.097895 14345 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f4d7003c4841e1b1024045eec8469e" member_type: VOTER }
I20260709 13:04:16.098361 14345 raft_consensus.cc:399] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:16.098593 14345 raft_consensus.cc:493] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:16.098866 14345 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:16.102684 14345 raft_consensus.cc:515] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f4d7003c4841e1b1024045eec8469e" member_type: VOTER }
I20260709 13:04:16.103184 14345 leader_election.cc:304] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58f4d7003c4841e1b1024045eec8469e; no voters: 
I20260709 13:04:16.104283 14345 leader_election.cc:290] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:16.104673 14348 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:16.105998 14348 raft_consensus.cc:697] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 1 LEADER]: Becoming Leader. State: Replica: 58f4d7003c4841e1b1024045eec8469e, State: Running, Role: LEADER
I20260709 13:04:16.106585 14348 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f4d7003c4841e1b1024045eec8469e" member_type: VOTER }
I20260709 13:04:16.107158 14345 sys_catalog.cc:565] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:16.110684 14350 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58f4d7003c4841e1b1024045eec8469e. Latest consensus state: current_term: 1 leader_uuid: "58f4d7003c4841e1b1024045eec8469e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f4d7003c4841e1b1024045eec8469e" member_type: VOTER } }
I20260709 13:04:16.111361 14350 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:16.111799 14349 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58f4d7003c4841e1b1024045eec8469e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58f4d7003c4841e1b1024045eec8469e" member_type: VOTER } }
I20260709 13:04:16.112566 14349 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:16.114948 14355 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:16.120009 14355 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:16.124380 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:16.129309 14355 catalog_manager.cc:1383] Generated new cluster ID: 3372aad0529a4269b2502c8b4888c724
I20260709 13:04:16.129592 14355 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:16.164981 14355 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:16.166170 14355 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:16.180255 14355 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e: Generated new TSK 0
I20260709 13:04:16.180827 14355 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:16.190726 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:16.196960 14366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.197623 14367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.199110 14369 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.199293 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:16.200284 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:16.200460 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:16.200590 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602256200579 us; error 0 us; skew 500 ppm
I20260709 13:04:16.201025 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:16.203298 13792 webserver.cc:533] Webserver started at http://127.13.120.1:45423/ using document root <none> and password file <none>
I20260709 13:04:16.203790 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:16.203948 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:16.204159 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:16.205219 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "3557beff822f4768bf60275fa12df785"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.209362 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:16.212330 14374 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.213024 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:16.213410 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "3557beff822f4768bf60275fa12df785"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.213716 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:16.241153 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:16.242383 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:16.243919 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:16.246167 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:16.246387 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.246642 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:16.246832 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.285600 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:34585
I20260709 13:04:16.285702 14436 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:34585 every 8 connection(s)
I20260709 13:04:16.290343 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:16.297257 14441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.298249 14442 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.300930 14444 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.302202 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:16.303115 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:16.303320 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:16.303565 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602256303545 us; error 0 us; skew 500 ppm
I20260709 13:04:16.304085 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:16.306527 13792 webserver.cc:533] Webserver started at http://127.13.120.2:45025/ using document root <none> and password file <none>
I20260709 13:04:16.307032 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:16.307255 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:16.307641 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:16.308892 14437 heartbeater.cc:344] Connected to a master server at 127.13.120.62:43057
I20260709 13:04:16.309072 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "0dcc1072331f4eb3975c515a0e3ed912"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.309301 14437 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:16.310168 14437 heartbeater.cc:507] Master 127.13.120.62:43057 requested a full tablet report, sending...
I20260709 13:04:16.312320 14310 ts_manager.cc:194] Registered new tserver with Master: 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585)
I20260709 13:04:16.313956 14310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52344
I20260709 13:04:16.314363 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:04:16.318296 14449 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.318948 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:16.319258 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "0dcc1072331f4eb3975c515a0e3ed912"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.319628 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:16.337531 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:16.338757 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:16.340340 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:16.342463 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:16.342693 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.342950 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:16.343128 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.380705 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:39755
I20260709 13:04:16.380791 14511 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:39755 every 8 connection(s)
I20260709 13:04:16.385331 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:16.392100 14515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.395624 14516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:16.397404 14519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:16.397516 14512 heartbeater.cc:344] Connected to a master server at 127.13.120.62:43057
I20260709 13:04:16.397987 14512 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:16.398002 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:16.398867 14512 heartbeater.cc:507] Master 127.13.120.62:43057 requested a full tablet report, sending...
I20260709 13:04:16.398994 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:16.399281 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:16.399493 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602256399473 us; error 0 us; skew 500 ppm
I20260709 13:04:16.400040 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:16.401048 14310 ts_manager.cc:194] Registered new tserver with Master: 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:16.402704 13792 webserver.cc:533] Webserver started at http://127.13.120.3:42091/ using document root <none> and password file <none>
I20260709 13:04:16.402839 14310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52360
I20260709 13:04:16.403350 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:16.403643 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:16.403957 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:16.405386 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "c6799044ec3c445baf7035cde756250a"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.409538 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:16.412443 14523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.413177 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:16.413466 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "c6799044ec3c445baf7035cde756250a"
format_stamp: "Formatted at 2026-07-09 13:04:16 on dist-test-slave-mcck"
I20260709 13:04:16.413758 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:16.438560 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:16.439800 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:16.441263 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:16.443358 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:16.443624 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.443874 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:16.444051 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:16.483858 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:39075
I20260709 13:04:16.483940 14585 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:39075 every 8 connection(s)
I20260709 13:04:16.497462 14586 heartbeater.cc:344] Connected to a master server at 127.13.120.62:43057
I20260709 13:04:16.497841 14586 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:16.498564 14586 heartbeater.cc:507] Master 127.13.120.62:43057 requested a full tablet report, sending...
I20260709 13:04:16.500528 14310 ts_manager.cc:194] Registered new tserver with Master: c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:16.501391 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014420929s
I20260709 13:04:16.502048 14310 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52366
I20260709 13:04:16.526180 14310 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52372:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:16.529269 14310 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:16.611100 14474 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab9fa06ca95422f9fa9154e2298947c (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:16.611259 14477 tablet_service.cc:1511] Processing CreateTablet for tablet 37fe3e432f0342aea599097ae71def74 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:16.612680 14474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab9fa06ca95422f9fa9154e2298947c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.613392 14476 tablet_service.cc:1511] Processing CreateTablet for tablet 91dc3acd9673401293cceb9ad3e6b688 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:16.615484 14475 tablet_service.cc:1511] Processing CreateTablet for tablet 8f8fdb7752d145f5b85c416e1610f2c5 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:16.616920 14473 tablet_service.cc:1511] Processing CreateTablet for tablet f66bb24a741244269d9741caa1bd6ba1 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:16.618865 14551 tablet_service.cc:1511] Processing CreateTablet for tablet 37fe3e432f0342aea599097ae71def74 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:16.620393 14551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fe3e432f0342aea599097ae71def74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.620514 14550 tablet_service.cc:1511] Processing CreateTablet for tablet 91dc3acd9673401293cceb9ad3e6b688 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:16.623149 14402 tablet_service.cc:1511] Processing CreateTablet for tablet 37fe3e432f0342aea599097ae71def74 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:04:16.624238 14476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91dc3acd9673401293cceb9ad3e6b688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.624439 14402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fe3e432f0342aea599097ae71def74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.624526 14549 tablet_service.cc:1511] Processing CreateTablet for tablet 8f8fdb7752d145f5b85c416e1610f2c5 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:16.626780 14548 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab9fa06ca95422f9fa9154e2298947c (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:16.628861 14400 tablet_service.cc:1511] Processing CreateTablet for tablet 8f8fdb7752d145f5b85c416e1610f2c5 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:04:16.629046 14547 tablet_service.cc:1511] Processing CreateTablet for tablet f66bb24a741244269d9741caa1bd6ba1 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:16.630105 14400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f8fdb7752d145f5b85c416e1610f2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.622040 14399 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab9fa06ca95422f9fa9154e2298947c (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:04:16.632073 14475 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f8fdb7752d145f5b85c416e1610f2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.632588 14401 tablet_service.cc:1511] Processing CreateTablet for tablet 91dc3acd9673401293cceb9ad3e6b688 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:04:16.635568 14398 tablet_service.cc:1511] Processing CreateTablet for tablet f66bb24a741244269d9741caa1bd6ba1 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:04:16.637181 14477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fe3e432f0342aea599097ae71def74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.639149 14397 tablet_service.cc:1511] Processing CreateTablet for tablet c204c847498e4f54a23fa75a500672dd (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:16.639974 14473 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66bb24a741244269d9741caa1bd6ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.641973 14396 tablet_service.cc:1511] Processing CreateTablet for tablet 4e26b8c648914886b0b37b52af89e806 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:16.644549 14471 tablet_service.cc:1511] Processing CreateTablet for tablet 4e26b8c648914886b0b37b52af89e806 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:16.645879 14471 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e26b8c648914886b0b37b52af89e806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.642884 14472 tablet_service.cc:1511] Processing CreateTablet for tablet c204c847498e4f54a23fa75a500672dd (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:16.649919 14546 tablet_service.cc:1511] Processing CreateTablet for tablet c204c847498e4f54a23fa75a500672dd (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:04:16.651405 14395 tablet_service.cc:1511] Processing CreateTablet for tablet 2014a2fc6931460d9802c5166edb7a90 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:16.652357 14545 tablet_service.cc:1511] Processing CreateTablet for tablet 4e26b8c648914886b0b37b52af89e806 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:04:16.654143 14399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab9fa06ca95422f9fa9154e2298947c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.655539 14470 tablet_service.cc:1511] Processing CreateTablet for tablet 2014a2fc6931460d9802c5166edb7a90 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:16.660130 14396 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e26b8c648914886b0b37b52af89e806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.659772 14544 tablet_service.cc:1511] Processing CreateTablet for tablet 2014a2fc6931460d9802c5166edb7a90 (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:04:16.662226 14394 tablet_service.cc:1511] Processing CreateTablet for tablet d711b87051164cbebe350cdfcd6f683e (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:16.663616 14394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d711b87051164cbebe350cdfcd6f683e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.663563 14469 tablet_service.cc:1511] Processing CreateTablet for tablet d711b87051164cbebe350cdfcd6f683e (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:16.664657 14398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66bb24a741244269d9741caa1bd6ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.665961 14397 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204c847498e4f54a23fa75a500672dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.622032 14550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91dc3acd9673401293cceb9ad3e6b688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.679881 14544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2014a2fc6931460d9802c5166edb7a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.683768 14548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab9fa06ca95422f9fa9154e2298947c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.683401 14543 tablet_service.cc:1511] Processing CreateTablet for tablet d711b87051164cbebe350cdfcd6f683e (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:04:16.684832 14543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d711b87051164cbebe350cdfcd6f683e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.684551 14393 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3604a7950c4ea19c28d891da4285ff (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:16.685276 14395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2014a2fc6931460d9802c5166edb7a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.685909 14393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3604a7950c4ea19c28d891da4285ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.686529 14545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e26b8c648914886b0b37b52af89e806. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.688165 14401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91dc3acd9673401293cceb9ad3e6b688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.691754 14547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f66bb24a741244269d9741caa1bd6ba1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.692960 14546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204c847498e4f54a23fa75a500672dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.695878 14549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f8fdb7752d145f5b85c416e1610f2c5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.695995 14602 tablet_bootstrap.cc:492] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:16.707288 14602 tablet_bootstrap.cc:654] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.716168 14468 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3604a7950c4ea19c28d891da4285ff (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:16.717168 14543 tablet_service.cc:1511] Processing CreateTablet for tablet 4e3604a7950c4ea19c28d891da4285ff (DEFAULT_TABLE table=test-workload [id=28c86539ae1444efadd6db54be23931d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:04:16.718552 14543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3604a7950c4ea19c28d891da4285ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.761196 14472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c204c847498e4f54a23fa75a500672dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.764014 14468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e3604a7950c4ea19c28d891da4285ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.768303 14469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d711b87051164cbebe350cdfcd6f683e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.774760 14470 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2014a2fc6931460d9802c5166edb7a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:16.775568 14604 tablet_bootstrap.cc:492] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:16.786841 14602 tablet_bootstrap.cc:492] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:16.787380 14602 ts_tablet_manager.cc:1403] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.092s	user 0.011s	sys 0.027s
I20260709 13:04:16.790292 14602 raft_consensus.cc:359] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:16.791008 14602 raft_consensus.cc:385] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.795886 14601 tablet_bootstrap.cc:492] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:16.791307 14602 raft_consensus.cc:740] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.803776 14602 consensus_queue.cc:260] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:16.826723 14604 tablet_bootstrap.cc:654] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.842120 14601 tablet_bootstrap.cc:654] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.845605 14602 ts_tablet_manager.cc:1434] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.058s	user 0.022s	sys 0.012s
I20260709 13:04:16.845755 14437 heartbeater.cc:499] Master 127.13.120.62:43057 was elected leader, sending a full tablet report...
I20260709 13:04:16.846592 14602 tablet_bootstrap.cc:492] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:16.847291 14604 tablet_bootstrap.cc:492] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:16.847874 14604 ts_tablet_manager.cc:1403] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.073s	user 0.004s	sys 0.010s
I20260709 13:04:16.850713 14604 raft_consensus.cc:359] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.851564 14604 raft_consensus.cc:385] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.851929 14604 raft_consensus.cc:740] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.852833 14604 consensus_queue.cc:260] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.853421 14602 tablet_bootstrap.cc:654] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.858924 14604 ts_tablet_manager.cc:1434] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:04:16.859761 14512 heartbeater.cc:499] Master 127.13.120.62:43057 was elected leader, sending a full tablet report...
I20260709 13:04:16.860059 14601 tablet_bootstrap.cc:492] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:16.860136 14604 tablet_bootstrap.cc:492] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:16.860838 14601 ts_tablet_manager.cc:1403] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.003s
I20260709 13:04:16.865106 14601 raft_consensus.cc:359] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:16.865865 14601 raft_consensus.cc:385] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.866190 14601 raft_consensus.cc:740] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.867117 14604 tablet_bootstrap.cc:654] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.867340 14601 consensus_queue.cc:260] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:16.870550 14602 tablet_bootstrap.cc:492] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:16.871186 14602 ts_tablet_manager.cc:1403] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.007s
I20260709 13:04:16.874945 14602 raft_consensus.cc:359] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.875856 14602 raft_consensus.cc:385] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.876160 14602 raft_consensus.cc:740] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.876914 14601 ts_tablet_manager.cc:1434] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.004s
I20260709 13:04:16.877053 14602 consensus_queue.cc:260] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.877635 14586 heartbeater.cc:499] Master 127.13.120.62:43057 was elected leader, sending a full tablet report...
I20260709 13:04:16.879170 14602 ts_tablet_manager.cc:1434] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:16.880205 14602 tablet_bootstrap.cc:492] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:16.886755 14602 tablet_bootstrap.cc:654] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.895018 14601 tablet_bootstrap.cc:492] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:16.902776 14604 tablet_bootstrap.cc:492] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:16.903075 14601 tablet_bootstrap.cc:654] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.903496 14604 ts_tablet_manager.cc:1403] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.027s
I20260709 13:04:16.904996 14602 tablet_bootstrap.cc:492] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:16.905471 14602 ts_tablet_manager.cc:1403] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.006s
I20260709 13:04:16.906694 14604 raft_consensus.cc:359] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.907501 14604 raft_consensus.cc:385] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.907867 14604 raft_consensus.cc:740] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.908479 14602 raft_consensus.cc:359] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.908772 14604 consensus_queue.cc:260] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.909297 14602 raft_consensus.cc:385] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.910377 14602 raft_consensus.cc:740] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.911279 14604 ts_tablet_manager.cc:1434] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:04:16.911247 14602 consensus_queue.cc:260] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.913570 14602 ts_tablet_manager.cc:1434] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:16.914479 14602 tablet_bootstrap.cc:492] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:16.914664 14604 tablet_bootstrap.cc:492] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:16.921487 14602 tablet_bootstrap.cc:654] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.921487 14604 tablet_bootstrap.cc:654] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.930339 14602 tablet_bootstrap.cc:492] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:16.930759 14604 tablet_bootstrap.cc:492] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:16.930851 14602 ts_tablet_manager.cc:1403] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260709 13:04:16.931447 14604 ts_tablet_manager.cc:1403] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.005s
I20260709 13:04:16.933364 14601 tablet_bootstrap.cc:492] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:16.933348 14602 raft_consensus.cc:359] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.934017 14601 ts_tablet_manager.cc:1403] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.008s
I20260709 13:04:16.934094 14602 raft_consensus.cc:385] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.934531 14602 raft_consensus.cc:740] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.935187 14602 consensus_queue.cc:260] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.935050 14604 raft_consensus.cc:359] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:16.935973 14604 raft_consensus.cc:385] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.936345 14604 raft_consensus.cc:740] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.937294 14602 ts_tablet_manager.cc:1434] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:04:16.937160 14604 consensus_queue.cc:260] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:16.938299 14602 tablet_bootstrap.cc:492] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:16.939779 14604 ts_tablet_manager.cc:1434] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:16.940914 14604 tablet_bootstrap.cc:492] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:16.947757 14602 tablet_bootstrap.cc:654] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.937654 14601 raft_consensus.cc:359] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.949993 14601 raft_consensus.cc:385] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.950376 14601 raft_consensus.cc:740] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.951225 14604 tablet_bootstrap.cc:654] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.951464 14601 consensus_queue.cc:260] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.956861 14602 tablet_bootstrap.cc:492] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:16.957396 14602 ts_tablet_manager.cc:1403] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
I20260709 13:04:16.960374 14601 ts_tablet_manager.cc:1434] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 13:04:16.960246 14602 raft_consensus.cc:359] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.961001 14602 raft_consensus.cc:385] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.961297 14602 raft_consensus.cc:740] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.961540 14601 tablet_bootstrap.cc:492] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:16.962126 14602 consensus_queue.cc:260] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.965907 14605 raft_consensus.cc:493] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:16.966799 14602 ts_tablet_manager.cc:1434] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 13:04:16.966476 14605 raft_consensus.cc:515] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.967839 14602 tablet_bootstrap.cc:492] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:16.968513 14601 tablet_bootstrap.cc:654] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.975737 14602 tablet_bootstrap.cc:654] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:16.980926 14605 leader_election.cc:290] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:16.987685 14604 tablet_bootstrap.cc:492] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:16.988288 14604 ts_tablet_manager.cc:1403] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.012s
I20260709 13:04:16.992209 14604 raft_consensus.cc:359] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.994445 14604 raft_consensus.cc:385] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:16.994840 14604 raft_consensus.cc:740] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:16.995790 14604 consensus_queue.cc:260] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:16.996948 14601 tablet_bootstrap.cc:492] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:16.997496 14601 ts_tablet_manager.cc:1403] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.007s
I20260709 13:04:17.000379 14602 tablet_bootstrap.cc:492] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:17.000864 14602 ts_tablet_manager.cc:1403] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.011s
I20260709 13:04:17.001269 14601 raft_consensus.cc:359] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.001991 14601 raft_consensus.cc:385] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.002272 14601 raft_consensus.cc:740] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.002986 14601 consensus_queue.cc:260] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.004231 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.004880 14487 raft_consensus.cc:2468] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.004611 14602 raft_consensus.cc:359] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.005394 14602 raft_consensus.cc:385] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.007329 14601 ts_tablet_manager.cc:1434] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:04:17.005708 14602 raft_consensus.cc:740] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.008394 14601 tablet_bootstrap.cc:492] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.006441 14604 ts_tablet_manager.cc:1434] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.003s
I20260709 13:04:17.008661 14602 consensus_queue.cc:260] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.009357 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.010746 14605 raft_consensus.cc:493] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.011219 14605 raft_consensus.cc:515] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:17.013407 14605 leader_election.cc:290] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.015625 14601 tablet_bootstrap.cc:654] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.018283 14604 tablet_bootstrap.cc:492] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:17.021347 14602 ts_tablet_manager.cc:1434] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 13:04:17.022416 14602 tablet_bootstrap.cc:492] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:17.026522 14604 tablet_bootstrap.cc:654] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.026520 14375 leader_election.cc:304] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: 
I20260709 13:04:17.028671 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.029549 14487 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.031004 14605 raft_consensus.cc:2804] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.031548 14605 raft_consensus.cc:493] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.032018 14605 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:17.036176 14378 leader_election.cc:343] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.038401 14602 tablet_bootstrap.cc:654] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.038582 14604 tablet_bootstrap.cc:492] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:17.039156 14604 ts_tablet_manager.cc:1403] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.001s
I20260709 13:04:17.041828 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.042171 14604 raft_consensus.cc:359] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.042726 14561 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.043187 14604 raft_consensus.cc:385] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.043655 14604 raft_consensus.cc:740] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.044124 14378 leader_election.cc:304] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.044955 14622 raft_consensus.cc:2804] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.044595 14604 consensus_queue.cc:260] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.045361 14622 raft_consensus.cc:493] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.045710 14622 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.053496 14622 raft_consensus.cc:515] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:17.053923 14604 ts_tablet_manager.cc:1434] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:04:17.056627 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.057415 14487 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.058027 14622 leader_election.cc:290] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.056663 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.060242 14561 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.062405 14604 tablet_bootstrap.cc:492] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:17.063124 14602 tablet_bootstrap.cc:492] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:17.063611 14602 ts_tablet_manager.cc:1403] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260709 13:04:17.066565 14602 raft_consensus.cc:359] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.067303 14602 raft_consensus.cc:385] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.067651 14602 raft_consensus.cc:740] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.068380 14622 raft_consensus.cc:493] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.068838 14622 raft_consensus.cc:515] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.069700 14604 tablet_bootstrap.cc:654] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.072244 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.073045 14486 raft_consensus.cc:2468] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.072276 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
W20260709 13:04:17.076218 14378 leader_election.cc:343] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.077481 14622 leader_election.cc:290] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.077831 14375 leader_election.cc:304] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.078387 14602 consensus_queue.cc:260] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.079849 14622 raft_consensus.cc:2804] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.080229 14622 raft_consensus.cc:493] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.080569 14622 raft_consensus.cc:3060] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.081991 14604 tablet_bootstrap.cc:492] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:17.082516 14604 ts_tablet_manager.cc:1403] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:04:17.084190 14487 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.085671 14604 raft_consensus.cc:359] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.085824 14375 leader_election.cc:304] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: 
I20260709 13:04:17.086547 14604 raft_consensus.cc:385] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.086938 14604 raft_consensus.cc:740] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.087091 14622 raft_consensus.cc:515] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.087910 14604 consensus_queue.cc:260] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.090245 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
W20260709 13:04:17.091549 14378 leader_election.cc:343] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.093305 14604 ts_tablet_manager.cc:1434] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:04:17.095533 14602 ts_tablet_manager.cc:1434] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.005s
I20260709 13:04:17.095889 14622 leader_election.cc:290] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.096017 14604 tablet_bootstrap.cc:492] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:17.096999 14602 tablet_bootstrap.cc:492] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:17.094650 14627 raft_consensus.cc:2804] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.097568 14627 raft_consensus.cc:697] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.098454 14627 consensus_queue.cc:237] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:17.104115 14602 tablet_bootstrap.cc:654] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.109613 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.110406 14486 raft_consensus.cc:3060] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.104683 14604 tablet_bootstrap.cc:654] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.090904 14605 raft_consensus.cc:515] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
W20260709 13:04:17.121821 14358 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:17.127676 14601 tablet_bootstrap.cc:492] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.128170 14601 ts_tablet_manager.cc:1403] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.120s	user 0.055s	sys 0.061s
I20260709 13:04:17.118546 14561 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.130815 14486 raft_consensus.cc:2468] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.131279 14602 tablet_bootstrap.cc:492] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:17.131774 14602 ts_tablet_manager.cc:1403] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.013s
I20260709 13:04:17.132345 14375 leader_election.cc:304] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.132934 14628 raft_consensus.cc:493] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.132851 14601 raft_consensus.cc:359] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.133409 14622 raft_consensus.cc:2804] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.133862 14601 raft_consensus.cc:385] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.134306 14601 raft_consensus.cc:740] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.135080 14601 consensus_queue.cc:260] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.135950 14602 raft_consensus.cc:359] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.136611 14602 raft_consensus.cc:385] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.136919 14602 raft_consensus.cc:740] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.133505 14628 raft_consensus.cc:515] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.139060 14601 ts_tablet_manager.cc:1434] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:17.139700 14628 leader_election.cc:290] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.137619 14602 consensus_queue.cc:260] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.141058 14601 tablet_bootstrap.cc:492] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.140897 14485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.142127 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.142556 14604 tablet_bootstrap.cc:492] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:17.143054 14604 ts_tablet_manager.cc:1403] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.002s
W20260709 13:04:17.143321 14378 leader_election.cc:343] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:17.145298 14375 leader_election.cc:343] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.145771 14375 leader_election.cc:304] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3557beff822f4768bf60275fa12df785; no voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.146196 14604 raft_consensus.cc:359] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.146952 14604 raft_consensus.cc:385] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.147006 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.147356 14604 raft_consensus.cc:740] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.148169 14604 consensus_queue.cc:260] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.148833 14601 tablet_bootstrap.cc:654] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.150596 14602 ts_tablet_manager.cc:1434] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:04:17.151574 14602 tablet_bootstrap.cc:492] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:17.152704 14307 catalog_manager.cc:5697] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.156325 14628 raft_consensus.cc:2749] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.157760 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.158989 14602 tablet_bootstrap.cc:654] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:17.159279 14378 leader_election.cc:343] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.161450 14605 leader_election.cc:290] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.147662 14487 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.170272 14604 ts_tablet_manager.cc:1434] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 13:04:17.174575 14622 raft_consensus.cc:697] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.175561 14622 consensus_queue.cc:237] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.177161 14487 raft_consensus.cc:2468] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.178439 14375 leader_election.cc:304] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.179077 14608 raft_consensus.cc:493] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.179330 14632 raft_consensus.cc:2804] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.179602 14608 raft_consensus.cc:515] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.180078 14632 raft_consensus.cc:697] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.180953 14632 consensus_queue.cc:237] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.182804 14604 tablet_bootstrap.cc:492] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:17.190677 14604 tablet_bootstrap.cc:654] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.191231 14605 raft_consensus.cc:493] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.191833 14605 raft_consensus.cc:515] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.193405 14608 leader_election.cc:290] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.194984 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.195659 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.196259 14561 raft_consensus.cc:2468] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
W20260709 13:04:17.196301 14375 leader_election.cc:343] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.194219 14605 leader_election.cc:290] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.197494 14378 leader_election.cc:304] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:17.199435 14602 tablet_bootstrap.cc:492] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:17.199648 14632 raft_consensus.cc:2804] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.200003 14602 ts_tablet_manager.cc:1403] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.007s
I20260709 13:04:17.200081 14632 raft_consensus.cc:493] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.200628 14632 raft_consensus.cc:3060] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.203636 14602 raft_consensus.cc:359] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.204517 14602 raft_consensus.cc:385] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.204839 14602 raft_consensus.cc:740] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.205756 14602 consensus_queue.cc:260] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.207830 14605 raft_consensus.cc:493] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.208253 14602 ts_tablet_manager.cc:1434] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:04:17.207830 14632 raft_consensus.cc:515] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.209204 14601 tablet_bootstrap.cc:492] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.209312 14602 tablet_bootstrap.cc:492] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785: Bootstrap starting.
I20260709 13:04:17.209815 14601 ts_tablet_manager.cc:1403] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.021s
I20260709 13:04:17.210469 14632 leader_election.cc:290] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.208282 14605 raft_consensus.cc:515] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.211476 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.211615 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.212265 14561 raft_consensus.cc:3060] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.212452 14605 leader_election.cc:290] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
W20260709 13:04:17.213522 14375 leader_election.cc:343] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.215157 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.216316 14307 catalog_manager.cc:5697] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:17.217164 14378 leader_election.cc:343] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.218091 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.218956 14487 raft_consensus.cc:2468] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.218384 14307 catalog_manager.cc:5697] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.220142 14375 leader_election.cc:304] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.221283 14605 raft_consensus.cc:2804] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.221668 14605 raft_consensus.cc:493] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.222007 14605 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.223466 14561 raft_consensus.cc:2468] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.224749 14378 leader_election.cc:304] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:17.228986 14622 raft_consensus.cc:2804] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.229578 14622 raft_consensus.cc:697] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.229082 14601 raft_consensus.cc:359] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.230434 14622 consensus_queue.cc:237] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.232074 14601 raft_consensus.cc:385] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.231247 14627 raft_consensus.cc:493] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.232633 14605 raft_consensus.cc:515] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.233393 14602 tablet_bootstrap.cc:654] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.233259 14627 raft_consensus.cc:515] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.235577 14627 leader_election.cc:290] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.236661 14601 raft_consensus.cc:740] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.237221 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.244078 14605 leader_election.cc:290] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.244978 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.246560 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.237591 14601 consensus_queue.cc:260] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.252349 14486 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.253405 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.254494 14601 ts_tablet_manager.cc:1434] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.004s
I20260709 13:04:17.254179 14561 raft_consensus.cc:2468] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.256006 14601 tablet_bootstrap.cc:492] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.256440 14605 raft_consensus.cc:493] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.257207 14605 raft_consensus.cc:515] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
W20260709 13:04:17.258888 14378 leader_election.cc:343] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.259466 14605 leader_election.cc:290] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.259663 14378 leader_election.cc:304] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.260564 14605 raft_consensus.cc:2804] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.261020 14605 raft_consensus.cc:493] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.261227 14485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.261423 14605 raft_consensus.cc:3060] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.261677 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.262471 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
W20260709 13:04:17.263706 14378 leader_election.cc:343] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:17.264021 14453 leader_election.cc:343] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6799044ec3c445baf7035cde756250a (127.13.120.3:39075): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:17.264683 14375 leader_election.cc:343] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:17.265153 14375 leader_election.cc:304] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3557beff822f4768bf60275fa12df785; no voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.265998 14604 tablet_bootstrap.cc:492] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:17.266460 14604 ts_tablet_manager.cc:1403] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.084s	user 0.019s	sys 0.003s
I20260709 13:04:17.268041 14487 raft_consensus.cc:2468] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 0.
I20260709 13:04:17.269068 14604 raft_consensus.cc:359] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.269742 14604 raft_consensus.cc:385] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.270006 14604 raft_consensus.cc:740] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.270614 14604 consensus_queue.cc:260] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.270418 14309 catalog_manager.cc:5697] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.273865 14627 raft_consensus.cc:2749] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.273839 14486 raft_consensus.cc:2468] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.275974 14375 leader_election.cc:304] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.276541 14608 raft_consensus.cc:493] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.276806 14627 raft_consensus.cc:2804] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.277019 14608 raft_consensus.cc:515] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.277388 14627 raft_consensus.cc:697] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.276917 14605 raft_consensus.cc:515] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.278342 14627 consensus_queue.cc:237] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.278431 14602 tablet_bootstrap.cc:492] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785: No bootstrap required, opened a new log
I20260709 13:04:17.279533 14602 ts_tablet_manager.cc:1403] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.000s
I20260709 13:04:17.282660 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.280862 14605 leader_election.cc:290] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.283241 14560 raft_consensus.cc:3060] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.283880 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.283998 14602 raft_consensus.cc:359] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.284528 14561 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 0.
I20260709 13:04:17.284759 14602 raft_consensus.cc:385] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.285137 14602 raft_consensus.cc:740] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.285723 14453 leader_election.cc:304] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.285811 14602 consensus_queue.cc:260] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.279259 14608 leader_election.cc:290] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.287249 14608 raft_consensus.cc:2804] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.287593 14608 raft_consensus.cc:493] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.287909 14608 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.287982 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.288599 14486 raft_consensus.cc:3060] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.291560 14560 raft_consensus.cc:2468] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.292858 14378 leader_election.cc:304] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.293718 14605 raft_consensus.cc:2804] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.294195 14605 raft_consensus.cc:697] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.294981 14605 consensus_queue.cc:237] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.295652 14486 raft_consensus.cc:2468] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 1.
I20260709 13:04:17.299369 14602 ts_tablet_manager.cc:1434] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:04:17.302238 14604 ts_tablet_manager.cc:1434] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:04:17.302969 14604 tablet_bootstrap.cc:492] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:17.301184 14608 raft_consensus.cc:515] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.305124 14608 leader_election.cc:290] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.306769 14601 tablet_bootstrap.cc:654] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.306663 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.308638 14604 tablet_bootstrap.cc:654] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.311942 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785" is_pre_election: true
I20260709 13:04:17.307452 14560 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.313721 14411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785" is_pre_election: true
I20260709 13:04:17.314424 14411 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 0.
I20260709 13:04:17.315611 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.316282 14410 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.320511 14452 leader_election.cc:304] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912; no voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.322467 14608 raft_consensus.cc:2749] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.324059 14560 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 1.
I20260709 13:04:17.325384 14453 leader_election.cc:304] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.326349 14608 raft_consensus.cc:2804] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.326844 14608 raft_consensus.cc:697] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:17.327764 14608 consensus_queue.cc:237] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.331084 14410 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 1.
I20260709 13:04:17.341076 14309 catalog_manager.cc:5697] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.343854 14604 tablet_bootstrap.cc:492] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:17.344410 14604 ts_tablet_manager.cc:1403] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.019s
I20260709 13:04:17.344476 14601 tablet_bootstrap.cc:492] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.345887 14601 ts_tablet_manager.cc:1403] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.090s	user 0.010s	sys 0.024s
I20260709 13:04:17.347329 14604 raft_consensus.cc:359] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.348101 14604 raft_consensus.cc:385] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.348446 14604 raft_consensus.cc:740] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.348812 14601 raft_consensus.cc:359] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.349527 14601 raft_consensus.cc:385] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.350011 14601 raft_consensus.cc:740] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.349557 14604 consensus_queue.cc:260] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.349407 14310 catalog_manager.cc:5697] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.351024 14601 consensus_queue.cc:260] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.352039 14604 ts_tablet_manager.cc:1434] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:04:17.352939 14604 tablet_bootstrap.cc:492] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: Bootstrap starting.
I20260709 13:04:17.353291 14601 ts_tablet_manager.cc:1434] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:17.354257 14601 tablet_bootstrap.cc:492] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.359068 14604 tablet_bootstrap.cc:654] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.360848 14601 tablet_bootstrap.cc:654] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.363050 14608 raft_consensus.cc:493] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.363538 14608 raft_consensus.cc:515] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.351812 14310 catalog_manager.cc:5697] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.365574 14608 leader_election.cc:290] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.366322 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d711b87051164cbebe350cdfcd6f683e" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785" is_pre_election: true
I20260709 13:04:17.366933 14410 raft_consensus.cc:2468] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 0.
I20260709 13:04:17.367046 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d711b87051164cbebe350cdfcd6f683e" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a" is_pre_election: true
I20260709 13:04:17.367658 14560 raft_consensus.cc:2468] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 0.
I20260709 13:04:17.368163 14452 leader_election.cc:304] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: 
I20260709 13:04:17.368925 14608 raft_consensus.cc:2804] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.369273 14608 raft_consensus.cc:493] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.369598 14608 raft_consensus.cc:3060] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.372227 14604 tablet_bootstrap.cc:492] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: No bootstrap required, opened a new log
I20260709 13:04:17.372838 14604 ts_tablet_manager.cc:1403] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
I20260709 13:04:17.376441 14608 raft_consensus.cc:515] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.376605 14604 raft_consensus.cc:359] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.377815 14604 raft_consensus.cc:385] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.378245 14604 raft_consensus.cc:740] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.379324 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d711b87051164cbebe350cdfcd6f683e" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.379181 14604 consensus_queue.cc:260] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.380013 14410 raft_consensus.cc:3060] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.382104 14604 ts_tablet_manager.cc:1434] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:17.384341 14608 leader_election.cc:290] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.385393 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d711b87051164cbebe350cdfcd6f683e" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.385988 14560 raft_consensus.cc:3060] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.386636 14601 tablet_bootstrap.cc:492] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.387059 14601 ts_tablet_manager.cc:1403] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.005s
I20260709 13:04:17.389662 14601 raft_consensus.cc:359] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.390422 14601 raft_consensus.cc:385] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.390743 14601 raft_consensus.cc:740] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.391580 14601 consensus_queue.cc:260] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.393126 14560 raft_consensus.cc:2468] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 1.
I20260709 13:04:17.394459 14453 leader_election.cc:304] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.395656 14601 ts_tablet_manager.cc:1434] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260709 13:04:17.395819 14608 raft_consensus.cc:2804] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.396217 14410 raft_consensus.cc:2468] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 1.
I20260709 13:04:17.396679 14601 tablet_bootstrap.cc:492] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.396646 14608 raft_consensus.cc:697] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:17.397737 14608 consensus_queue.cc:237] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.403913 14601 tablet_bootstrap.cc:654] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.407552 14308 catalog_manager.cc:5697] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.409116 14601 tablet_bootstrap.cc:492] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.409703 14601 ts_tablet_manager.cc:1403] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.013s	user 0.002s	sys 0.008s
I20260709 13:04:17.411608 14601 raft_consensus.cc:359] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.412081 14601 raft_consensus.cc:385] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.412308 14601 raft_consensus.cc:740] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.412871 14601 consensus_queue.cc:260] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.414407 14601 ts_tablet_manager.cc:1434] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:04:17.415297 14610 raft_consensus.cc:493] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.415577 14601 tablet_bootstrap.cc:492] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.415787 14610 raft_consensus.cc:515] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.418376 14610 leader_election.cc:290] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:17.422680 14601 tablet_bootstrap.cc:654] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.434319 14601 tablet_bootstrap.cc:492] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.434791 14601 ts_tablet_manager.cc:1403] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.011s
I20260709 13:04:17.437431 14601 raft_consensus.cc:359] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.438112 14601 raft_consensus.cc:385] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.438393 14601 raft_consensus.cc:740] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.439038 14601 consensus_queue.cc:260] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.441987 14601 ts_tablet_manager.cc:1434] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:17.443032 14601 tablet_bootstrap.cc:492] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a: Bootstrap starting.
I20260709 13:04:17.442862 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.443531 14486 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 0.
I20260709 13:04:17.445145 14524 leader_election.cc:304] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.445756 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785" is_pre_election: true
I20260709 13:04:17.446051 14610 raft_consensus.cc:2804] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.446406 14410 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 0.
I20260709 13:04:17.446411 14610 raft_consensus.cc:493] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.447477 14610 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.448873 14601 tablet_bootstrap.cc:654] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:17.453375 14601 tablet_bootstrap.cc:492] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a: No bootstrap required, opened a new log
I20260709 13:04:17.453758 14601 ts_tablet_manager.cc:1403] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a: Time spent bootstrapping tablet: real 0.011s	user 0.006s	sys 0.003s
I20260709 13:04:17.453707 14610 raft_consensus.cc:515] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.456144 14610 leader_election.cc:290] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:17.456772 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.456868 14601 raft_consensus.cc:359] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.457352 14410 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.457188 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.457731 14601 raft_consensus.cc:385] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:17.457952 14486 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.458045 14601 raft_consensus.cc:740] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Initialized, Role: FOLLOWER
I20260709 13:04:17.459990 14601 consensus_queue.cc:260] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.461709 14601 ts_tablet_manager.cc:1434] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:04:17.464449 14410 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 1.
I20260709 13:04:17.464449 14486 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 1.
I20260709 13:04:17.465720 14526 leader_election.cc:304] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.466511 14610 raft_consensus.cc:2804] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.467561 14610 raft_consensus.cc:697] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:17.468233 14610 consensus_queue.cc:237] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.476438 14308 catalog_manager.cc:5697] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 0 to 1, leader changed from <none> to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.485437 14610 raft_consensus.cc:493] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.486008 14610 raft_consensus.cc:515] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.487632 14610 leader_election.cc:290] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:17.488621 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.488622 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785" is_pre_election: true
I20260709 13:04:17.489606 14486 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 0.
I20260709 13:04:17.489606 14410 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 0.
I20260709 13:04:17.490865 14526 leader_election.cc:304] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.491561 14610 raft_consensus.cc:2804] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:17.491940 14610 raft_consensus.cc:493] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:17.492223 14610 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.497530 14610 raft_consensus.cc:515] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.499179 14610 leader_election.cc:290] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:17.500029 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.500229 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.500504 14410 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.500825 14486 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.507688 14486 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 1.
I20260709 13:04:17.508462 14410 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 1.
I20260709 13:04:17.509294 14524 leader_election.cc:304] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.510123 14610 raft_consensus.cc:2804] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:17.510548 14610 raft_consensus.cc:697] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:17.511394 14610 consensus_queue.cc:237] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.518143 14605 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.519749 14308 catalog_manager.cc:5697] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 0 to 1, leader changed from <none> to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.533963 14605 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.564787 14486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
mode: GRACEFUL
new_leader_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:39056
I20260709 13:04:17.565341 14486 raft_consensus.cc:606] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Received request to transfer leadership to TS 3557beff822f4768bf60275fa12df785
I20260709 13:04:17.580941 14560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
mode: GRACEFUL
new_leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:32940
I20260709 13:04:17.581455 14560 raft_consensus.cc:606] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Received request to transfer leadership to TS 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:17.593005 14560 raft_consensus.cc:3060] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.594492 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:34698
I20260709 13:04:17.594991 14410 raft_consensus.cc:606] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Received request to transfer leadership to TS 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:17.596019 14610 raft_consensus.cc:493] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:17.596459 14610 raft_consensus.cc:515] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.598495 14610 leader_election.cc:290] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:17.599144 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3557beff822f4768bf60275fa12df785" is_pre_election: true
I20260709 13:04:17.599915 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912" is_pre_election: true
I20260709 13:04:17.600155 14605 consensus_queue.cc:1048] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.600652 14486 raft_consensus.cc:2393] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6799044ec3c445baf7035cde756250a in current term 1: Already voted for candidate 3557beff822f4768bf60275fa12df785 in this term.
I20260709 13:04:17.601598 14524 leader_election.cc:304] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6799044ec3c445baf7035cde756250a; no voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785
I20260709 13:04:17.601677 14560 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
mode: GRACEFUL
new_leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:32940
I20260709 13:04:17.602427 14560 raft_consensus.cc:606] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Received request to transfer leadership to TS 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:17.603471 14660 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.609504 14627 consensus_queue.cc:1048] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.610800 14660 raft_consensus.cc:2749] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:17.618693 14410 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:34698
I20260709 13:04:17.619339 14410 raft_consensus.cc:606] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Received request to transfer leadership to TS c6799044ec3c445baf7035cde756250a
I20260709 13:04:17.622773 14605 consensus_queue.cc:1048] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.633379 14627 consensus_queue.cc:1048] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.729869 14486 raft_consensus.cc:3060] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.735576 14627 consensus_queue.cc:1048] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.745667 14605 consensus_queue.cc:1048] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.752910 14632 raft_consensus.cc:993] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: : Instructing follower c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:17.753345 14605 raft_consensus.cc:1081] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Signalling peer c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:17.754784 14561 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:32928
I20260709 13:04:17.755231 14561 raft_consensus.cc:493] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.755602 14561 raft_consensus.cc:3060] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.761245 14561 raft_consensus.cc:515] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.762791 14561 leader_election.cc:290] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:17.763623 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.763882 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e3604a7950c4ea19c28d891da4285ff" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.764238 14410 raft_consensus.cc:3055] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.764451 14486 raft_consensus.cc:3060] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.764640 14410 raft_consensus.cc:740] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.765493 14410 consensus_queue.cc:260] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.766757 14410 raft_consensus.cc:3060] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.769403 14486 raft_consensus.cc:2468] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:17.770371 14524 leader_election.cc:304] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.771034 14660 raft_consensus.cc:2804] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.771526 14660 raft_consensus.cc:697] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:17.772464 14410 raft_consensus.cc:2468] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:17.772377 14660 consensus_queue.cc:237] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.778635 14307 catalog_manager.cc:5697] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 1 to 2, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 2 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:17.812379 14561 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:17.818142 14605 consensus_queue.cc:1048] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.822070 14632 consensus_queue.cc:1048] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.829691 14605 consensus_queue.cc:1048] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.838127 14632 raft_consensus.cc:993] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: : Instructing follower 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:17.838631 14632 raft_consensus.cc:1081] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Signalling peer 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:17.840200 14608 consensus_queue.cc:1048] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.842558 14486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:39040
I20260709 13:04:17.843474 14486 raft_consensus.cc:493] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.843848 14486 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.845011 14605 consensus_queue.cc:1048] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.850553 14486 raft_consensus.cc:515] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.852610 14486 leader_election.cc:290] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.853370 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.853941 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.854108 14410 raft_consensus.cc:3055] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.854493 14561 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.854557 14410 raft_consensus.cc:740] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.855842 14410 consensus_queue.cc:260] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.857417 14410 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.861716 14561 raft_consensus.cc:2468] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:17.862933 14453 leader_election.cc:304] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.863716 14608 raft_consensus.cc:2804] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.864094 14608 raft_consensus.cc:697] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:17.864848 14608 consensus_queue.cc:237] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.865737 14410 raft_consensus.cc:2468] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:17.872529 14310 catalog_manager.cc:5697] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 1 to 2, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.873169 14608 consensus_queue.cc:1048] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.892874 14660 consensus_queue.cc:1048] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.902843 14660 consensus_queue.cc:1048] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.909960 14682 raft_consensus.cc:993] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: : Instructing follower 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:17.910461 14682 raft_consensus.cc:1081] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Signalling peer 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:17.911897 14486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:39042
I20260709 13:04:17.912358 14486 raft_consensus.cc:493] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.912657 14486 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.917414 14486 raft_consensus.cc:515] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.919854 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.920137 14561 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.920440 14410 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.920720 14561 raft_consensus.cc:3055] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.921093 14561 raft_consensus.cc:740] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:17.921972 14561 consensus_queue.cc:260] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.923009 14561 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.927225 14660 consensus_queue.cc:1048] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.928223 14410 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:17.928400 14608 consensus_queue.cc:1048] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:17.929481 14561 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:17.919574 14486 leader_election.cc:290] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.930797 14453 leader_election.cc:304] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.931653 14647 raft_consensus.cc:2804] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.932798 14647 raft_consensus.cc:697] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:17.932772 14608 consensus_queue.cc:1048] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.933756 14647 consensus_queue.cc:237] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.934902 14682 raft_consensus.cc:993] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: : Instructing follower 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:17.935308 14682 raft_consensus.cc:1081] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Signalling peer 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:17.940052 14486 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:39042
I20260709 13:04:17.940634 14486 raft_consensus.cc:493] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.941010 14486 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.946044 14685 raft_consensus.cc:993] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: : Instructing follower 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:17.946758 14608 raft_consensus.cc:1081] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Signalling peer 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:17.948352 14682 consensus_queue.cc:1048] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:17.952318 14411 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c"
dest_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:34688
I20260709 13:04:17.952929 14411 raft_consensus.cc:493] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:17.953310 14411 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.957873 14486 raft_consensus.cc:515] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.959291 14487 raft_consensus.cc:1240] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Rejecting Update request from peer c6799044ec3c445baf7035cde756250a for earlier term 1. Current term is 2. Ops: []
I20260709 13:04:17.961853 14486 leader_election.cc:290] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.964339 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.964931 14560 raft_consensus.cc:3055] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.965261 14560 raft_consensus.cc:740] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:17.968779 14411 raft_consensus.cc:515] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.969218 14410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:17.970736 14411 leader_election.cc:290] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 2 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:17.972591 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:17.972716 14559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:17.972384 14560 consensus_queue.cc:260] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.972997 14486 raft_consensus.cc:3055] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:17.973270 14559 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.973300 14486 raft_consensus.cc:740] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:17.973423 14560 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.974290 14486 consensus_queue.cc:260] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.975540 14486 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:17.979750 14310 catalog_manager.cc:5697] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 1 to 2, leader changed from c6799044ec3c445baf7035cde756250a (127.13.120.3) to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:17.980996 14559 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 2.
I20260709 13:04:17.982175 14378 leader_election.cc:304] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:17.982901 14605 raft_consensus.cc:2804] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.983392 14605 raft_consensus.cc:697] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:17.981186 14560 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:17.984115 14605 consensus_queue.cc:237] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.985073 14486 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 2.
I20260709 13:04:17.985224 14453 leader_election.cc:304] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 3557beff822f4768bf60275fa12df785
I20260709 13:04:17.986204 14688 raft_consensus.cc:2804] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:17.986670 14688 raft_consensus.cc:697] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:17.987465 14688 consensus_queue.cc:237] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:17.999914 14307 catalog_manager.cc:5697] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 1 to 2, leader changed from c6799044ec3c445baf7035cde756250a (127.13.120.3) to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.006943 14310 catalog_manager.cc:5697] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 1 to 2, leader changed from 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2) to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:18.235395 14412 raft_consensus.cc:1275] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.236697 14682 consensus_queue.cc:1048] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.244441 14486 raft_consensus.cc:1275] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.245883 14682 consensus_queue.cc:1048] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.256430 14412 raft_consensus.cc:1275] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.257766 14688 consensus_queue.cc:1048] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.266938 14560 raft_consensus.cc:1275] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.268410 14685 consensus_queue.cc:1048] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.381278 14560 raft_consensus.cc:1275] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.382753 14627 consensus_queue.cc:1048] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.390491 14486 raft_consensus.cc:1275] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.391891 14605 consensus_queue.cc:1048] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.488094 14412 raft_consensus.cc:1275] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.489367 14685 consensus_queue.cc:1048] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.496801 14560 raft_consensus.cc:1275] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.498231 14608 consensus_queue.cc:1048] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.527614 14560 raft_consensus.cc:1275] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.529140 14608 consensus_queue.cc:1048] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:18.534754 14412 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:18.541393 14412 raft_consensus.cc:1275] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:18.542766 14608 consensus_queue.cc:1048] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:20.652343 13792 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:04:20.653069 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:20.669946 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37fe3e432f0342aea599097ae71def74"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:04:20.670454 14412 raft_consensus.cc:606] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Received request to transfer leadership to TS c6799044ec3c445baf7035cde756250a
I20260709 13:04:20.672957 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:04:20.673537 14412 raft_consensus.cc:606] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Received request to transfer leadership to TS c6799044ec3c445baf7035cde756250a
I20260709 13:04:20.674698 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:04:20.675307 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:20.681867 14622 raft_consensus.cc:993] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: : Instructing follower c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:20.682303 14695 raft_consensus.cc:1081] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Signalling peer c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:20.683673 14560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:32928
I20260709 13:04:20.684170 14560 raft_consensus.cc:493] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.684504 14560 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.689172 14560 raft_consensus.cc:515] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:20.690830 14560 leader_election.cc:290] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:20.691888 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:20.691766 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:20.692397 14486 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.692437 14412 raft_consensus.cc:3055] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.692840 14412 raft_consensus.cc:740] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:20.693461 14412 consensus_queue.cc:260] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:20.694376 14412 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.696705 14486 raft_consensus.cc:2468] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:20.697736 14524 leader_election.cc:304] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:20.698400 14692 raft_consensus.cc:2804] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.699009 14412 raft_consensus.cc:2468] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:20.699775 14692 raft_consensus.cc:697] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:20.700801 14692 consensus_queue.cc:237] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:20.708767 14310 catalog_manager.cc:5697] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 1 to 2, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 2 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:20.716140 14622 raft_consensus.cc:993] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: : Instructing follower c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:20.716653 14695 raft_consensus.cc:1081] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Signalling peer c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:20.718371 14560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37fe3e432f0342aea599097ae71def74"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:32928
I20260709 13:04:20.718832 14560 raft_consensus.cc:493] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:20.719189 14560 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.724578 14560 raft_consensus.cc:515] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:20.726264 14560 leader_election.cc:290] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585)
I20260709 13:04:20.727001 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:20.727566 14486 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.727593 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:20.728243 14412 raft_consensus.cc:3055] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:20.728529 14412 raft_consensus.cc:740] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:20.729238 14412 consensus_queue.cc:260] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:20.730080 14412 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:20.732683 14486 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:20.733686 14524 leader_election.cc:304] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:20.734465 14692 raft_consensus.cc:2804] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:20.734853 14692 raft_consensus.cc:697] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:20.735464 14412 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:20.735577 14692 consensus_queue.cc:237] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:20.741968 14310 catalog_manager.cc:5697] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 1 to 2, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 2 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.144168 14486 raft_consensus.cc:1275] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.145426 14692 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.145895 14412 raft_consensus.cc:1275] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.147269 14692 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.167436 14486 raft_consensus.cc:1275] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.168977 14708 consensus_queue.cc:1048] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.188126 14412 raft_consensus.cc:1275] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:21.189945 14707 consensus_queue.cc:1048] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:21.676251 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:21.688091 14559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37fe3e432f0342aea599097ae71def74"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
mode: GRACEFUL
new_leader_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:32940
I20260709 13:04:21.688561 14559 raft_consensus.cc:606] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Received request to transfer leadership to TS 3557beff822f4768bf60275fa12df785
I20260709 13:04:21.696588 14559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
mode: GRACEFUL
new_leader_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:32940
I20260709 13:04:21.697042 14559 raft_consensus.cc:606] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Received request to transfer leadership to TS 3557beff822f4768bf60275fa12df785
I20260709 13:04:21.706414 14713 raft_consensus.cc:993] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: : Instructing follower 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:21.706892 14707 raft_consensus.cc:1081] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Signalling peer 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:21.707681 14486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
mode: GRACEFUL
new_leader_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:39056
I20260709 13:04:21.708256 14486 raft_consensus.cc:606] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Received request to transfer leadership to TS 3557beff822f4768bf60275fa12df785
I20260709 13:04:21.708468 14412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5"
dest_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:34690
I20260709 13:04:21.709087 14412 raft_consensus.cc:493] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:21.709493 14412 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:21.713169 14486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
mode: GRACEFUL
new_leader_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:39056
I20260709 13:04:21.713603 14486 raft_consensus.cc:606] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Received request to transfer leadership to TS 3557beff822f4768bf60275fa12df785
I20260709 13:04:21.716470 14412 raft_consensus.cc:515] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:21.718189 14486 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
mode: GRACEFUL
new_leader_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:39056
I20260709 13:04:21.718886 14412 leader_election.cc:290] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:21.719156 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:21.719758 14487 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:21.720292 14559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f8fdb7752d145f5b85c416e1610f2c5" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:21.720767 14559 raft_consensus.cc:3055] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:21.721004 14559 raft_consensus.cc:740] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:21.721828 14559 consensus_queue.cc:260] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:21.722695 14559 raft_consensus.cc:3060] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:21.724608 14487 raft_consensus.cc:2468] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:21.718842 14486 raft_consensus.cc:606] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Received request to transfer leadership to TS 3557beff822f4768bf60275fa12df785
I20260709 13:04:21.725942 14375 leader_election.cc:304] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: 
I20260709 13:04:21.726702 14695 raft_consensus.cc:2804] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:21.727789 14695 raft_consensus.cc:697] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:21.728582 14695 consensus_queue.cc:237] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:21.731030 14559 raft_consensus.cc:2468] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:21.738427 14307 catalog_manager.cc:5697] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 2 to 3, leader changed from c6799044ec3c445baf7035cde756250a (127.13.120.3) to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:21.839502 14608 raft_consensus.cc:993] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: : Instructing follower 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:21.839926 14608 raft_consensus.cc:1081] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Signalling peer 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:21.841159 14412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90"
dest_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:34688
I20260709 13:04:21.841615 14412 raft_consensus.cc:493] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:21.841898 14412 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:21.846189 14412 raft_consensus.cc:515] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:21.847783 14412 leader_election.cc:290] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:21.848520 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:21.848838 14559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2014a2fc6931460d9802c5166edb7a90" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:21.849062 14486 raft_consensus.cc:3055] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:21.849426 14486 raft_consensus.cc:740] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:21.849478 14559 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:21.850072 14486 consensus_queue.cc:260] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:21.850859 14486 raft_consensus.cc:3060] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:21.854000 14559 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:21.854678 14486 raft_consensus.cc:2468] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:21.855296 14378 leader_election.cc:304] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:21.856071 14695 raft_consensus.cc:2804] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:21.856469 14695 raft_consensus.cc:697] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:21.857185 14695 consensus_queue.cc:237] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:21.863708 14307 catalog_manager.cc:5697] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 2 to 3, leader changed from 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2) to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.055872 14720 raft_consensus.cc:993] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: : Instructing follower 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:22.056349 14608 raft_consensus.cc:1081] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Signalling peer 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:22.057992 14412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806"
dest_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:34688
I20260709 13:04:22.058468 14412 raft_consensus.cc:493] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:22.058771 14412 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.063140 14412 raft_consensus.cc:515] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:22.064698 14412 leader_election.cc:290] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:22.065670 14559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:22.065670 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e26b8c648914886b0b37b52af89e806" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:22.066388 14559 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.066399 14486 raft_consensus.cc:3055] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:22.066896 14486 raft_consensus.cc:740] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:22.067646 14486 consensus_queue.cc:260] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:22.068710 14486 raft_consensus.cc:3060] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.073079 14559 raft_consensus.cc:2468] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:22.074234 14378 leader_election.cc:304] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3557beff822f4768bf60275fa12df785, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:22.074435 14486 raft_consensus.cc:2468] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:22.074951 14695 raft_consensus.cc:2804] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:22.075495 14695 raft_consensus.cc:697] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:22.076215 14695 consensus_queue.cc:237] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:22.083667 14307 catalog_manager.cc:5697] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 2 to 3, leader changed from 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2) to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.127002 14713 raft_consensus.cc:993] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: : Instructing follower 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:22.127506 14707 raft_consensus.cc:1081] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Signalling peer 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:22.129137 14412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37fe3e432f0342aea599097ae71def74"
dest_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:34690
I20260709 13:04:22.129662 14412 raft_consensus.cc:493] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:22.130002 14412 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.134649 14412 raft_consensus.cc:515] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:22.136293 14412 leader_election.cc:290] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:22.137153 14486 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:22.137241 14559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:22.137828 14486 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.137920 14559 raft_consensus.cc:3055] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:22.138304 14559 raft_consensus.cc:740] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:22.139047 14559 consensus_queue.cc:260] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:22.140057 14559 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.142027 14486 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:22.142999 14375 leader_election.cc:304] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: 
I20260709 13:04:22.143769 14695 raft_consensus.cc:2804] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:22.144200 14695 raft_consensus.cc:697] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:22.144943 14695 consensus_queue.cc:237] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:22.145427 14559 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:22.150810 14307 catalog_manager.cc:5697] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 2 to 3, leader changed from c6799044ec3c445baf7035cde756250a (127.13.120.3) to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:22.278716 14559 raft_consensus.cc:1275] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.280028 14695 consensus_queue.cc:1048] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.281317 14720 raft_consensus.cc:993] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: : Instructing follower 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:22.281785 14608 raft_consensus.cc:1081] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Signalling peer 3557beff822f4768bf60275fa12df785 to start an election
I20260709 13:04:22.283694 14412 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd"
dest_uuid: "3557beff822f4768bf60275fa12df785"
 from {username='slave'} at 127.0.0.1:34688
I20260709 13:04:22.284380 14412 raft_consensus.cc:493] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:22.284830 14412 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.284993 14486 raft_consensus.cc:1275] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.286386 14695 consensus_queue.cc:1048] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.293694 14412 raft_consensus.cc:515] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:22.296876 14487 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:22.297389 14412 leader_election.cc:290] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Requested vote from peers 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:22.297951 14487 raft_consensus.cc:3055] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:22.298509 14487 raft_consensus.cc:740] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:22.299494 14487 consensus_queue.cc:260] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:22.301587 14559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c204c847498e4f54a23fa75a500672dd" candidate_uuid: "3557beff822f4768bf60275fa12df785" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:22.301589 14487 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.302376 14559 raft_consensus.cc:3060] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:22.309327 14487 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:22.310545 14375 leader_election.cc:304] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, 3557beff822f4768bf60275fa12df785; no voters: 
I20260709 13:04:22.311364 14559 raft_consensus.cc:2468] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3557beff822f4768bf60275fa12df785 in term 3.
I20260709 13:04:22.311894 14716 raft_consensus.cc:2804] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:22.312374 14716 raft_consensus.cc:697] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Becoming Leader. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:22.313163 14716 consensus_queue.cc:237] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:22.321496 14310 catalog_manager.cc:5697] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 reported cstate change: term changed from 2 to 3, leader changed from 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2) to 3557beff822f4768bf60275fa12df785 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "3557beff822f4768bf60275fa12df785" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:22.347492 14559 raft_consensus.cc:1275] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.348762 14716 consensus_queue.cc:1048] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.359822 14487 raft_consensus.cc:1275] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.361868 14724 consensus_queue.cc:1048] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:22.572309 14559 raft_consensus.cc:1275] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.573601 14724 consensus_queue.cc:1048] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.582063 14487 raft_consensus.cc:1275] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.583742 14716 consensus_queue.cc:1048] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.648083 14487 raft_consensus.cc:1275] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.649503 14716 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.650132 14559 raft_consensus.cc:1275] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.651484 14716 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.722627 14559 raft_consensus.cc:1275] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.723904 14695 consensus_queue.cc:1048] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:22.732064 14487 raft_consensus.cc:1275] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Refusing update from remote peer 3557beff822f4768bf60275fa12df785: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:22.734229 14695 consensus_queue.cc:1048] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:24.738991 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:24.746572 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:04:24.747484 14412 raft_consensus.cc:606] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 LEADER]: Received request to transfer leadership to TS c6799044ec3c445baf7035cde756250a
I20260709 13:04:24.750002 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37fe3e432f0342aea599097ae71def74"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:04:24.750423 14412 raft_consensus.cc:606] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Received request to transfer leadership to TS 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:24.752456 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:04:24.752882 14412 raft_consensus.cc:606] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Received request to transfer leadership to TS c6799044ec3c445baf7035cde756250a
I20260709 13:04:24.754940 14412 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1"
dest_uuid: "3557beff822f4768bf60275fa12df785"
mode: GRACEFUL
new_leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:34710
I20260709 13:04:24.755357 14412 raft_consensus.cc:606] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Received request to transfer leadership to TS 0dcc1072331f4eb3975c515a0e3ed912
I20260709 13:04:24.756409 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:04:24.757017 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:24.820492 14741 raft_consensus.cc:993] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: : Instructing follower c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:24.821029 14742 raft_consensus.cc:1081] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 LEADER]: Signalling peer c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:24.822585 14559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:32928
I20260709 13:04:24.823093 14559 raft_consensus.cc:493] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.823449 14559 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.830356 14559 raft_consensus.cc:515] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:24.832079 14559 leader_election.cc:290] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 3 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:24.832742 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:24.833146 14485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab9fa06ca95422f9fa9154e2298947c" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:24.833702 14412 raft_consensus.cc:3055] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:04:24.833755 14485 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.834136 14412 raft_consensus.cc:740] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:24.835007 14412 consensus_queue.cc:260] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:24.836336 14412 raft_consensus.cc:3060] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:04:24.840898 14741 raft_consensus.cc:993] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: : Instructing follower 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:24.841192 14485 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 3.
I20260709 13:04:24.841432 14742 raft_consensus.cc:1081] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Signalling peer 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:24.842541 14524 leader_election.cc:304] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:24.843076 14485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37fe3e432f0342aea599097ae71def74"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:39040
I20260709 13:04:24.843485 14707 raft_consensus.cc:2804] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:04:24.843654 14485 raft_consensus.cc:493] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.844044 14485 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:24.844233 14412 raft_consensus.cc:2468] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 3.
I20260709 13:04:24.844492 14707 raft_consensus.cc:697] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 3 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:24.845506 14707 consensus_queue.cc:237] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:24.852085 14485 raft_consensus.cc:515] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:24.852514 14307 catalog_manager.cc:5697] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 2 to 3, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 3 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:24.853785 14485 leader_election.cc:290] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 4 election: Requested vote from peers c6799044ec3c445baf7035cde756250a (127.13.120.3:39075), 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585)
I20260709 13:04:24.854692 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:24.855123 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fe3e432f0342aea599097ae71def74" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:24.855365 14560 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:24.855741 14412 raft_consensus.cc:3055] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:04:24.856055 14412 raft_consensus.cc:740] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:24.856954 14412 consensus_queue.cc:260] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:24.858188 14412 raft_consensus.cc:3060] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:04:24.862041 14560 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 4.
I20260709 13:04:24.863453 14453 leader_election.cc:304] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:24.864537 14608 raft_consensus.cc:2804] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:04:24.865614 14412 raft_consensus.cc:2468] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 4.
I20260709 13:04:24.865902 14608 raft_consensus.cc:697] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 4 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:24.866796 14608 consensus_queue.cc:237] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } }
I20260709 13:04:24.874023 14307 catalog_manager.cc:5697] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 3 to 4, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:24.927935 14741 raft_consensus.cc:993] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: : Instructing follower c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:24.928380 14742 raft_consensus.cc:1081] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Signalling peer c6799044ec3c445baf7035cde756250a to start an election
I20260709 13:04:24.929689 14560 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688"
dest_uuid: "c6799044ec3c445baf7035cde756250a"
 from {username='slave'} at 127.0.0.1:32928
I20260709 13:04:24.930122 14560 raft_consensus.cc:493] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:24.930379 14560 raft_consensus.cc:3060] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.934298 14560 raft_consensus.cc:515] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:24.935715 14560 leader_election.cc:290] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755)
I20260709 13:04:24.936619 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:24.936862 14485 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91dc3acd9673401293cceb9ad3e6b688" candidate_uuid: "c6799044ec3c445baf7035cde756250a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
I20260709 13:04:24.937197 14412 raft_consensus.cc:3055] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:24.937429 14485 raft_consensus.cc:3060] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.937522 14412 raft_consensus.cc:740] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:24.938337 14412 consensus_queue.cc:260] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:24.939505 14412 raft_consensus.cc:3060] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:24.944557 14485 raft_consensus.cc:2468] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:24.945883 14412 raft_consensus.cc:2468] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6799044ec3c445baf7035cde756250a in term 2.
I20260709 13:04:24.945951 14524 leader_election.cc:304] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:24.946842 14707 raft_consensus.cc:2804] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:24.947301 14707 raft_consensus.cc:697] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Becoming Leader. State: Replica: c6799044ec3c445baf7035cde756250a, State: Running, Role: LEADER
I20260709 13:04:24.948235 14707 consensus_queue.cc:237] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:24.954846 14307 catalog_manager.cc:5697] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a reported cstate change: term changed from 1 to 2, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to c6799044ec3c445baf7035cde756250a (127.13.120.3). New cstate: current_term: 2 leader_uuid: "c6799044ec3c445baf7035cde756250a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:25.231576 14741 raft_consensus.cc:993] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: : Instructing follower 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:25.232127 14742 raft_consensus.cc:1081] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Signalling peer 0dcc1072331f4eb3975c515a0e3ed912 to start an election
I20260709 13:04:25.233772 14485 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1"
dest_uuid: "0dcc1072331f4eb3975c515a0e3ed912"
 from {username='slave'} at 127.0.0.1:39040
I20260709 13:04:25.234279 14485 raft_consensus.cc:493] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:25.234608 14485 raft_consensus.cc:3060] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.239048 14485 raft_consensus.cc:515] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:25.240705 14485 leader_election.cc:290] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Requested vote from peers 3557beff822f4768bf60275fa12df785 (127.13.120.1:34585), c6799044ec3c445baf7035cde756250a (127.13.120.3:39075)
I20260709 13:04:25.241448 14412 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3557beff822f4768bf60275fa12df785"
I20260709 13:04:25.241659 14560 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f66bb24a741244269d9741caa1bd6ba1" candidate_uuid: "0dcc1072331f4eb3975c515a0e3ed912" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6799044ec3c445baf7035cde756250a"
I20260709 13:04:25.242039 14412 raft_consensus.cc:3055] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:25.242082 14560 raft_consensus.cc:3060] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.242455 14412 raft_consensus.cc:740] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3557beff822f4768bf60275fa12df785, State: Running, Role: LEADER
I20260709 13:04:25.243208 14412 consensus_queue.cc:260] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:25.244339 14412 raft_consensus.cc:3060] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:25.248271 14560 raft_consensus.cc:2468] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:25.249311 14453 leader_election.cc:304] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0dcc1072331f4eb3975c515a0e3ed912, c6799044ec3c445baf7035cde756250a; no voters: 
I20260709 13:04:25.249876 14412 raft_consensus.cc:2468] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0dcc1072331f4eb3975c515a0e3ed912 in term 2.
I20260709 13:04:25.249979 14608 raft_consensus.cc:2804] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:25.250432 14608 raft_consensus.cc:697] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Becoming Leader. State: Replica: 0dcc1072331f4eb3975c515a0e3ed912, State: Running, Role: LEADER
I20260709 13:04:25.251152 14608 consensus_queue.cc:237] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } }
I20260709 13:04:25.257710 14307 catalog_manager.cc:5697] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 reported cstate change: term changed from 1 to 2, leader changed from 3557beff822f4768bf60275fa12df785 (127.13.120.1) to 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0dcc1072331f4eb3975c515a0e3ed912" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:25.320823 14412 raft_consensus.cc:1275] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.322116 14707 consensus_queue.cc:1048] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.332432 14485 raft_consensus.cc:1275] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:04:25.334203 14755 consensus_queue.cc:1048] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:25.373978 14560 raft_consensus.cc:1275] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 4 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:25.375161 14608 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:25.383127 14412 raft_consensus.cc:1275] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 4 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:04:25.385417 14760 consensus_queue.cc:1048] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:25.516438 14412 raft_consensus.cc:1275] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.517518 14707 consensus_queue.cc:1048] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.527508 14485 raft_consensus.cc:1275] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Refusing update from remote peer c6799044ec3c445baf7035cde756250a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.528918 14743 consensus_queue.cc:1048] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [LEADER]: Connected to new peer: Peer: permanent_uuid: "0dcc1072331f4eb3975c515a0e3ed912" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 39755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.738909 14560 raft_consensus.cc:1275] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.740031 14760 consensus_queue.cc:1048] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6799044ec3c445baf7035cde756250a" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 39075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.748194 14412 raft_consensus.cc:1275] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Refusing update from remote peer 0dcc1072331f4eb3975c515a0e3ed912: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:25.750355 14608 consensus_queue.cc:1048] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3557beff822f4768bf60275fa12df785" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:25.757843 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:25.764964 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
I20260709 13:04:25.791801 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:25.792773 13792 tablet_replica.cc:333] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.793396 13792 raft_consensus.cc:2243] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.793851 13792 raft_consensus.cc:2272] T 0ab9fa06ca95422f9fa9154e2298947c P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.796824 13792 tablet_replica.cc:333] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.797772 13792 raft_consensus.cc:2243] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.798851 13792 raft_consensus.cc:2272] T 2014a2fc6931460d9802c5166edb7a90 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.801043 13792 tablet_replica.cc:333] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.801581 13792 raft_consensus.cc:2243] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.802268 13792 raft_consensus.cc:2272] T c204c847498e4f54a23fa75a500672dd P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.803982 13792 tablet_replica.cc:333] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.804504 13792 raft_consensus.cc:2243] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.805225 13792 raft_consensus.cc:2272] T 8f8fdb7752d145f5b85c416e1610f2c5 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.807032 13792 tablet_replica.cc:333] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.807593 13792 raft_consensus.cc:2243] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.808019 13792 raft_consensus.cc:2272] T 4e3604a7950c4ea19c28d891da4285ff P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.809644 13792 tablet_replica.cc:333] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.810127 13792 raft_consensus.cc:2243] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.810524 13792 raft_consensus.cc:2272] T d711b87051164cbebe350cdfcd6f683e P 3557beff822f4768bf60275fa12df785 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.812160 13792 tablet_replica.cc:333] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.812618 13792 raft_consensus.cc:2243] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.813570 13792 raft_consensus.cc:2272] T 4e26b8c648914886b0b37b52af89e806 P 3557beff822f4768bf60275fa12df785 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.815917 13792 tablet_replica.cc:333] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.816572 13792 raft_consensus.cc:2243] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.817020 13792 raft_consensus.cc:2272] T f66bb24a741244269d9741caa1bd6ba1 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.819689 13792 tablet_replica.cc:333] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.820267 13792 raft_consensus.cc:2243] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.820658 13792 raft_consensus.cc:2272] T 91dc3acd9673401293cceb9ad3e6b688 P 3557beff822f4768bf60275fa12df785 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.822902 13792 tablet_replica.cc:333] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785: stopping tablet replica
I20260709 13:04:25.823375 13792 raft_consensus.cc:2243] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.823843 13792 raft_consensus.cc:2272] T 37fe3e432f0342aea599097ae71def74 P 3557beff822f4768bf60275fa12df785 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.842514 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:04:25.862413 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
I20260709 13:04:25.882130 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:25.882812 13792 tablet_replica.cc:333] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.883522 13792 raft_consensus.cc:2243] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.883988 13792 raft_consensus.cc:2272] T 2014a2fc6931460d9802c5166edb7a90 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.885722 13792 tablet_replica.cc:333] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.886256 13792 raft_consensus.cc:2243] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.886674 13792 raft_consensus.cc:2272] T c204c847498e4f54a23fa75a500672dd P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.888418 13792 tablet_replica.cc:333] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.888917 13792 raft_consensus.cc:2243] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.889307 13792 raft_consensus.cc:2272] T 4e3604a7950c4ea19c28d891da4285ff P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.891011 13792 tablet_replica.cc:333] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.891561 13792 raft_consensus.cc:2243] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.891937 13792 raft_consensus.cc:2272] T 8f8fdb7752d145f5b85c416e1610f2c5 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.893422 13792 tablet_replica.cc:333] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.893884 13792 raft_consensus.cc:2243] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.894565 13792 raft_consensus.cc:2272] T d711b87051164cbebe350cdfcd6f683e P 0dcc1072331f4eb3975c515a0e3ed912 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.896143 13792 tablet_replica.cc:333] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.896597 13792 raft_consensus.cc:2243] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.897255 13792 raft_consensus.cc:2272] T f66bb24a741244269d9741caa1bd6ba1 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.899696 13792 tablet_replica.cc:333] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.900177 13792 raft_consensus.cc:2243] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.900560 13792 raft_consensus.cc:2272] T 91dc3acd9673401293cceb9ad3e6b688 P 0dcc1072331f4eb3975c515a0e3ed912 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.902367 13792 tablet_replica.cc:333] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.902846 13792 raft_consensus.cc:2243] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.903246 13792 raft_consensus.cc:2272] T 4e26b8c648914886b0b37b52af89e806 P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.904717 13792 tablet_replica.cc:333] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.905157 13792 raft_consensus.cc:2243] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.905882 13792 raft_consensus.cc:2272] T 37fe3e432f0342aea599097ae71def74 P 0dcc1072331f4eb3975c515a0e3ed912 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.907653 13792 tablet_replica.cc:333] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912: stopping tablet replica
I20260709 13:04:25.908100 13792 raft_consensus.cc:2243] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.908496 13792 raft_consensus.cc:2272] T 0ab9fa06ca95422f9fa9154e2298947c P 0dcc1072331f4eb3975c515a0e3ed912 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.927168 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
I20260709 13:04:25.946188 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
W20260709 13:04:25.948489 14524 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.2:39755: connect: Connection refused (error 111) [suppressed 5 similar messages]
W20260709 13:04:25.954967 14524 consensus_peers.cc:597] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a -> Peer 0dcc1072331f4eb3975c515a0e3ed912 (127.13.120.2:39755): Couldn't send request to peer 0dcc1072331f4eb3975c515a0e3ed912. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:39755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:25.970793 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:04:25.971556 13792 tablet_replica.cc:333] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.972482 13792 raft_consensus.cc:2243] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.973021 13792 raft_consensus.cc:2272] T 2014a2fc6931460d9802c5166edb7a90 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.974771 13792 tablet_replica.cc:333] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.975317 13792 raft_consensus.cc:2243] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.975816 13792 raft_consensus.cc:2272] T c204c847498e4f54a23fa75a500672dd P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.977553 13792 tablet_replica.cc:333] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.978081 13792 raft_consensus.cc:2243] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.978857 13792 raft_consensus.cc:2272] T 91dc3acd9673401293cceb9ad3e6b688 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.981578 13792 tablet_replica.cc:333] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.982092 13792 raft_consensus.cc:2243] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.982491 13792 raft_consensus.cc:2272] T 4e26b8c648914886b0b37b52af89e806 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.984127 13792 tablet_replica.cc:333] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.984614 13792 raft_consensus.cc:2243] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.984977 13792 raft_consensus.cc:2272] T d711b87051164cbebe350cdfcd6f683e P c6799044ec3c445baf7035cde756250a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.986644 13792 tablet_replica.cc:333] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.987098 13792 raft_consensus.cc:2243] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.987529 13792 raft_consensus.cc:2272] T f66bb24a741244269d9741caa1bd6ba1 P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.989460 13792 tablet_replica.cc:333] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.989938 13792 raft_consensus.cc:2243] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.990589 13792 raft_consensus.cc:2272] T 0ab9fa06ca95422f9fa9154e2298947c P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.992645 13792 tablet_replica.cc:333] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.993098 13792 raft_consensus.cc:2243] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.993465 13792 raft_consensus.cc:2272] T 8f8fdb7752d145f5b85c416e1610f2c5 P c6799044ec3c445baf7035cde756250a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.995051 13792 tablet_replica.cc:333] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.995565 13792 raft_consensus.cc:2243] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:04:25.996289 13792 raft_consensus.cc:2272] T 4e3604a7950c4ea19c28d891da4285ff P c6799044ec3c445baf7035cde756250a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:25.997864 13792 tablet_replica.cc:333] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a: stopping tablet replica
I20260709 13:04:25.998284 13792 raft_consensus.cc:2243] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:25.998641 13792 raft_consensus.cc:2272] T 37fe3e432f0342aea599097ae71def74 P c6799044ec3c445baf7035cde756250a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.026684 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
I20260709 13:04:26.044399 13792 master.cc:562] Master@127.13.120.62:43057 shutting down...
I20260709 13:04:26.063527 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:04:26.064047 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:26.064422 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P 58f4d7003c4841e1b1024045eec8469e: stopping tablet replica
I20260709 13:04:26.084031 13792 master.cc:584] Master@127.13.120.62:43057 shutdown complete.
0dcc1072331f4eb3975c515a0e3ed912  4
3557beff822f4768bf60275fa12df785  5
c6799044ec3c445baf7035cde756250a  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10131 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:04:26.125178 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:42905
I20260709 13:04:26.126266 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.132119 14768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.132120 14769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.132992 14771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.133235 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:26.134078 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.134250 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.134366 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602266134355 us; error 0 us; skew 500 ppm
I20260709 13:04:26.134824 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.137068 13792 webserver.cc:533] Webserver started at http://127.13.120.62:36491/ using document root <none> and password file <none>
I20260709 13:04:26.137480 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.137630 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.137854 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.138871 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "d930a2d37e98496a8994b1d260968086"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.143127 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:26.146224 14776 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.146941 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:26.147182 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "d930a2d37e98496a8994b1d260968086"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.147467 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.167025 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.168277 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.206773 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:42905
I20260709 13:04:26.206878 14827 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:42905 every 8 connection(s)
I20260709 13:04:26.210537 14828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.220052 14828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Bootstrap starting.
I20260709 13:04:26.224713 14828 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.229036 14828 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: No bootstrap required, opened a new log
I20260709 13:04:26.231123 14828 raft_consensus.cc:359] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d930a2d37e98496a8994b1d260968086" member_type: VOTER }
I20260709 13:04:26.231658 14828 raft_consensus.cc:385] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.231853 14828 raft_consensus.cc:740] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d930a2d37e98496a8994b1d260968086, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.232326 14828 consensus_queue.cc:260] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d930a2d37e98496a8994b1d260968086" member_type: VOTER }
I20260709 13:04:26.232729 14828 raft_consensus.cc:399] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:04:26.232913 14828 raft_consensus.cc:493] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:04:26.233129 14828 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:26.237277 14828 raft_consensus.cc:515] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d930a2d37e98496a8994b1d260968086" member_type: VOTER }
I20260709 13:04:26.237761 14828 leader_election.cc:304] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d930a2d37e98496a8994b1d260968086; no voters: 
I20260709 13:04:26.238903 14828 leader_election.cc:290] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:04:26.239336 14831 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:26.240712 14831 raft_consensus.cc:697] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 1 LEADER]: Becoming Leader. State: Replica: d930a2d37e98496a8994b1d260968086, State: Running, Role: LEADER
I20260709 13:04:26.241392 14831 consensus_queue.cc:237] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d930a2d37e98496a8994b1d260968086" member_type: VOTER }
I20260709 13:04:26.241925 14828 sys_catalog.cc:565] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:04:26.245988 14832 sys_catalog.cc:455] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d930a2d37e98496a8994b1d260968086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d930a2d37e98496a8994b1d260968086" member_type: VOTER } }
I20260709 13:04:26.246277 14833 sys_catalog.cc:455] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d930a2d37e98496a8994b1d260968086. Latest consensus state: current_term: 1 leader_uuid: "d930a2d37e98496a8994b1d260968086" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d930a2d37e98496a8994b1d260968086" member_type: VOTER } }
I20260709 13:04:26.246659 14832 sys_catalog.cc:458] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:26.246817 14833 sys_catalog.cc:458] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [sys.catalog]: This master's current role is: LEADER
I20260709 13:04:26.248586 14838 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:04:26.253499 14838 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:04:26.257162 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:04:26.261921 14838 catalog_manager.cc:1383] Generated new cluster ID: 2dd8c3ac9bfa4db38e3c0ce0b6e93455
I20260709 13:04:26.262178 14838 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:04:26.292704 14838 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:04:26.293896 14838 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:04:26.310117 14838 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Generated new TSK 0
I20260709 13:04:26.310654 14838 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:04:26.323807 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.329226 14849 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.330547 14850 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.332129 14852 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.332556 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:26.333707 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.333889 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.334007 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602266333997 us; error 0 us; skew 500 ppm
I20260709 13:04:26.334455 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.336627 13792 webserver.cc:533] Webserver started at http://127.13.120.1:38661/ using document root <none> and password file <none>
I20260709 13:04:26.337041 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.337216 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.337512 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.338496 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "e4938453819c469599f515b22d92fe27"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.342860 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:04:26.346069 14857 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.346761 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:04:26.347015 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "e4938453819c469599f515b22d92fe27"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.347255 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.362002 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.363159 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.364593 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:26.366935 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:26.367134 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.367398 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:26.367609 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:04:26.406002 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:46755
I20260709 13:04:26.406095 14919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:46755 every 8 connection(s)
I20260709 13:04:26.410737 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.417213 14924 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.418780 14925 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.420502 14927 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.421880 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:26.422984 14920 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42905
I20260709 13:04:26.423115 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:04:26.423363 14920 heartbeater.cc:461] Registering TS with master...
W20260709 13:04:26.423455 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.423741 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602266423722 us; error 0 us; skew 500 ppm
I20260709 13:04:26.424211 14920 heartbeater.cc:507] Master 127.13.120.62:42905 requested a full tablet report, sending...
I20260709 13:04:26.424355 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.426256 14793 ts_manager.cc:194] Registered new tserver with Master: e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:26.427212 13792 webserver.cc:533] Webserver started at http://127.13.120.2:40309/ using document root <none> and password file <none>
I20260709 13:04:26.427728 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.427940 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.428036 14793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47184
I20260709 13:04:26.428197 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.429368 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "25b8f0cc46f748468395543b8b174bf4"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.433534 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:04:26.436612 14932 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.437444 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:26.437671 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "25b8f0cc46f748468395543b8b174bf4"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.437896 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.458582 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.459739 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.461074 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:26.463218 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:26.463388 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.463696 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:26.463855 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.501389 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:43345
I20260709 13:04:26.501497 14994 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:43345 every 8 connection(s)
I20260709 13:04:26.505874 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:26.511934 14998 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.512794 14999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:26.514276 15001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:26.515889 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:26.516927 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:26.517220 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:26.517434 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602266517415 us; error 0 us; skew 500 ppm
I20260709 13:04:26.518126 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:26.518388 14995 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42905
I20260709 13:04:26.518805 14995 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:26.519712 14995 heartbeater.cc:507] Master 127.13.120.62:42905 requested a full tablet report, sending...
I20260709 13:04:26.520838 13792 webserver.cc:533] Webserver started at http://127.13.120.3:36625/ using document root <none> and password file <none>
I20260709 13:04:26.521440 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:26.521678 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:26.521826 14793 ts_manager.cc:194] Registered new tserver with Master: 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:26.521989 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:26.523509 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "eb4a5ac9f0c5425b92051187b939860f"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.523604 14793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47190
I20260709 13:04:26.528163 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:04:26.531574 15006 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.532372 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:04:26.532723 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "eb4a5ac9f0c5425b92051187b939860f"
format_stamp: "Formatted at 2026-07-09 13:04:26 on dist-test-slave-mcck"
I20260709 13:04:26.533028 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:26.559362 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:26.560632 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:26.562124 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:26.564329 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:26.564563 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.564808 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:26.564990 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:26.604113 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:46271
I20260709 13:04:26.604213 15068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:46271 every 8 connection(s)
I20260709 13:04:26.617722 15069 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42905
I20260709 13:04:26.618103 15069 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:26.618808 15069 heartbeater.cc:507] Master 127.13.120.62:42905 requested a full tablet report, sending...
I20260709 13:04:26.620657 14793 ts_manager.cc:194] Registered new tserver with Master: eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:26.621738 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01446107s
I20260709 13:04:26.621909 14793 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47196
I20260709 13:04:26.648595 14793 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47208:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:04:26.654709 14793 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:04:26.842765 15034 tablet_service.cc:1511] Processing CreateTablet for tablet cf48bf0f29ee4f8fabd84185b8cc6a88 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:26.844296 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf48bf0f29ee4f8fabd84185b8cc6a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.848513 15033 tablet_service.cc:1511] Processing CreateTablet for tablet 7d441a969a644366b3cb4d386d7273e1 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:26.849896 15033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d441a969a644366b3cb4d386d7273e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.852622 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 13ff541fc966499ea2706d34cfb2c964 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:26.853897 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ff541fc966499ea2706d34cfb2c964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.857853 14960 tablet_service.cc:1511] Processing CreateTablet for tablet cf48bf0f29ee4f8fabd84185b8cc6a88 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:26.859189 14960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf48bf0f29ee4f8fabd84185b8cc6a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.860388 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 13ff541fc966499ea2706d34cfb2c964 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:26.861675 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ff541fc966499ea2706d34cfb2c964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.861544 14885 tablet_service.cc:1511] Processing CreateTablet for tablet cf48bf0f29ee4f8fabd84185b8cc6a88 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:04:26.862823 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf48bf0f29ee4f8fabd84185b8cc6a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.859213 14957 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac8b7ea8eec4d01847e30ae2626afd0 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:26.864854 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac8b7ea8eec4d01847e30ae2626afd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.864576 14959 tablet_service.cc:1511] Processing CreateTablet for tablet 7d441a969a644366b3cb4d386d7273e1 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:26.865844 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d441a969a644366b3cb4d386d7273e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.877125 15084 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:26.877506 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 7d441a969a644366b3cb4d386d7273e1 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:04:26.878858 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d441a969a644366b3cb4d386d7273e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.882462 14883 tablet_service.cc:1511] Processing CreateTablet for tablet 13ff541fc966499ea2706d34cfb2c964 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:04:26.883810 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ff541fc966499ea2706d34cfb2c964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.888670 15084 tablet_bootstrap.cc:654] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.888567 14882 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac8b7ea8eec4d01847e30ae2626afd0 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:26.890002 14882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac8b7ea8eec4d01847e30ae2626afd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.895287 15033 tablet_service.cc:1511] Processing CreateTablet for tablet 3ac8b7ea8eec4d01847e30ae2626afd0 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:04:26.896582 15033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac8b7ea8eec4d01847e30ae2626afd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.898078 14956 tablet_service.cc:1511] Processing CreateTablet for tablet da044c14437c4be087d871f129926239 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:26.899366 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da044c14437c4be087d871f129926239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.908668 14881 tablet_service.cc:1511] Processing CreateTablet for tablet da044c14437c4be087d871f129926239 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:26.910018 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da044c14437c4be087d871f129926239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.920004 15031 tablet_service.cc:1511] Processing CreateTablet for tablet da044c14437c4be087d871f129926239 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:04:26.921854 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da044c14437c4be087d871f129926239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.938206 14883 tablet_service.cc:1511] Processing CreateTablet for tablet a3da3e723e874330b684997f3ab5385e (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:26.940217 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da3e723e874330b684997f3ab5385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.945693 15085 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:26.950742 15086 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:26.954962 14880 tablet_service.cc:1511] Processing CreateTablet for tablet 599606a370ab4d629b9cac083be835da (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:26.956393 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599606a370ab4d629b9cac083be835da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.959091 15085 tablet_bootstrap.cc:654] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.960470 15034 tablet_service.cc:1511] Processing CreateTablet for tablet a3da3e723e874330b684997f3ab5385e (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:26.961706 14958 tablet_service.cc:1511] Processing CreateTablet for tablet a3da3e723e874330b684997f3ab5385e (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:04:26.962864 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da3e723e874330b684997f3ab5385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.963109 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da3e723e874330b684997f3ab5385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.973425 15086 tablet_bootstrap.cc:654] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:26.978991 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 599606a370ab4d629b9cac083be835da (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:26.980224 15084 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:26.980351 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599606a370ab4d629b9cac083be835da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.980751 15084 ts_tablet_manager.cc:1403] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.104s	user 0.005s	sys 0.020s
I20260709 13:04:26.980084 14880 tablet_service.cc:1511] Processing CreateTablet for tablet 338c720b04aa4c14b53937055c254e24 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:26.982043 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 338c720b04aa4c14b53937055c254e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.982272 14959 tablet_service.cc:1511] Processing CreateTablet for tablet 338c720b04aa4c14b53937055c254e24 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:26.983479 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 338c720b04aa4c14b53937055c254e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.985306 15084 raft_consensus.cc:359] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:26.985980 15084 raft_consensus.cc:385] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.986258 15084 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:26.977648 14956 tablet_service.cc:1511] Processing CreateTablet for tablet 599606a370ab4d629b9cac083be835da (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:04:26.989398 15085 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:26.989472 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599606a370ab4d629b9cac083be835da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.991547 15085 ts_tablet_manager.cc:1403] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260709 13:04:26.994463 15085 raft_consensus.cc:359] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.002863 15085 raft_consensus.cc:385] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:26.998240 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 2287a0d46a894be29150ebdc058fcfb6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:27.000227 14957 tablet_service.cc:1511] Processing CreateTablet for tablet 2287a0d46a894be29150ebdc058fcfb6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:27.003319 15085 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.004206 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2287a0d46a894be29150ebdc058fcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.003845 15033 tablet_service.cc:1511] Processing CreateTablet for tablet 2287a0d46a894be29150ebdc058fcfb6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:04:27.005158 15033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2287a0d46a894be29150ebdc058fcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.989977 15084 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.007560 15085 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.008589 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae8a41be2704a038fb65d4e543a826c (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:27.011670 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae8a41be2704a038fb65d4e543a826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.013798 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2287a0d46a894be29150ebdc058fcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.018786 14960 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae8a41be2704a038fb65d4e543a826c (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:27.020121 14960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae8a41be2704a038fb65d4e543a826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:26.990688 15031 tablet_service.cc:1511] Processing CreateTablet for tablet 338c720b04aa4c14b53937055c254e24 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:04:27.032343 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 338c720b04aa4c14b53937055c254e24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.033933 15086 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:27.034411 15086 ts_tablet_manager.cc:1403] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.012s
I20260709 13:04:27.037110 15086 raft_consensus.cc:359] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.037797 15086 raft_consensus.cc:385] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.038089 15086 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.048027 15069 heartbeater.cc:499] Master 127.13.120.62:42905 was elected leader, sending a full tablet report...
I20260709 13:04:27.058228 15084 ts_tablet_manager.cc:1434] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.077s	user 0.019s	sys 0.010s
I20260709 13:04:27.059185 15084 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:27.060461 14880 tablet_service.cc:1511] Processing CreateTablet for tablet b4b44d3457824f63aaf8c5cafbd75ea0 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:27.061721 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44d3457824f63aaf8c5cafbd75ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.065459 15030 tablet_service.cc:1511] Processing CreateTablet for tablet b4b44d3457824f63aaf8c5cafbd75ea0 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:27.065891 15034 tablet_service.cc:1511] Processing CreateTablet for tablet 5ae8a41be2704a038fb65d4e543a826c (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:04:27.066804 15030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44d3457824f63aaf8c5cafbd75ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.069347 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 4db89b17bfcd40e0a2e2d53f7cf21079 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:27.070606 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db89b17bfcd40e0a2e2d53f7cf21079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.072682 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 4db89b17bfcd40e0a2e2d53f7cf21079 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:27.073962 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db89b17bfcd40e0a2e2d53f7cf21079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.047137 15086 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.075750 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae8a41be2704a038fb65d4e543a826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.076614 14920 heartbeater.cc:499] Master 127.13.120.62:42905 was elected leader, sending a full tablet report...
I20260709 13:04:27.077740 14959 tablet_service.cc:1511] Processing CreateTablet for tablet b4b44d3457824f63aaf8c5cafbd75ea0 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:04:27.078990 15028 tablet_service.cc:1511] Processing CreateTablet for tablet 77cfe8a6078741239e2d788a50d260dc (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:27.079191 14957 tablet_service.cc:1511] Processing CreateTablet for tablet 4db89b17bfcd40e0a2e2d53f7cf21079 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:04:27.080287 15028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cfe8a6078741239e2d788a50d260dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.078985 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44d3457824f63aaf8c5cafbd75ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.081655 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db89b17bfcd40e0a2e2d53f7cf21079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.083400 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 6a698f3a4fb348b4a13de15324682404 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:27.085559 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a698f3a4fb348b4a13de15324682404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.083400 14883 tablet_service.cc:1511] Processing CreateTablet for tablet 77cfe8a6078741239e2d788a50d260dc (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:27.086751 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cfe8a6078741239e2d788a50d260dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.090212 15031 tablet_service.cc:1511] Processing CreateTablet for tablet 6a698f3a4fb348b4a13de15324682404 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:27.096103 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a698f3a4fb348b4a13de15324682404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.096470 15085 ts_tablet_manager.cc:1434] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.105s	user 0.010s	sys 0.004s
I20260709 13:04:27.097486 15085 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:27.065490 15084 tablet_bootstrap.cc:654] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.112581 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 6a698f3a4fb348b4a13de15324682404 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:04:27.114394 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a698f3a4fb348b4a13de15324682404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.116986 14883 tablet_service.cc:1511] Processing CreateTablet for tablet 46876532b5b6444ba4fbaa536a316857 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:27.116806 14960 tablet_service.cc:1511] Processing CreateTablet for tablet 77cfe8a6078741239e2d788a50d260dc (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:04:27.119508 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46876532b5b6444ba4fbaa536a316857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.124778 14960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cfe8a6078741239e2d788a50d260dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.131829 14956 tablet_service.cc:1511] Processing CreateTablet for tablet 46876532b5b6444ba4fbaa536a316857 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:27.132252 15031 tablet_service.cc:1511] Processing CreateTablet for tablet 46876532b5b6444ba4fbaa536a316857 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:04:27.133267 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46876532b5b6444ba4fbaa536a316857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.134045 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46876532b5b6444ba4fbaa536a316857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.170928 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3b63f39d444317899acc30914f8801 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:27.172297 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3b63f39d444317899acc30914f8801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.180469 15086 ts_tablet_manager.cc:1434] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.146s	user 0.021s	sys 0.025s
I20260709 13:04:27.181273 14995 heartbeater.cc:499] Master 127.13.120.62:42905 was elected leader, sending a full tablet report...
I20260709 13:04:27.181517 15086 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:27.184952 15084 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:27.185434 15084 ts_tablet_manager.cc:1403] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.126s	user 0.008s	sys 0.007s
I20260709 13:04:27.171268 15085 tablet_bootstrap.cc:654] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.193166 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3b63f39d444317899acc30914f8801 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:04:27.194444 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3b63f39d444317899acc30914f8801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.197234 15084 raft_consensus.cc:359] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.198007 15084 raft_consensus.cc:385] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.200120 15084 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.201025 15084 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.204164 15084 ts_tablet_manager.cc:1434] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:04:27.205260 15084 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:27.207016 15086 tablet_bootstrap.cc:654] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.212790 15084 tablet_bootstrap.cc:654] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.223699 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 67571e95c6f547b989f85aa109da10a9 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:27.224961 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67571e95c6f547b989f85aa109da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.234807 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 67571e95c6f547b989f85aa109da10a9 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:27.236415 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67571e95c6f547b989f85aa109da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.237423 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 9648bab22a13442a81e0775163508e93 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:27.238647 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648bab22a13442a81e0775163508e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.238965 14957 tablet_service.cc:1511] Processing CreateTablet for tablet 9648bab22a13442a81e0775163508e93 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:27.240247 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648bab22a13442a81e0775163508e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.241071 15030 tablet_service.cc:1511] Processing CreateTablet for tablet 9648bab22a13442a81e0775163508e93 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:04:27.242689 15030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648bab22a13442a81e0775163508e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.248855 15031 tablet_service.cc:1511] Processing CreateTablet for tablet 0d3b63f39d444317899acc30914f8801 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
W20260709 13:04:27.253319 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:27.254104 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3b63f39d444317899acc30914f8801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.263705 14959 tablet_service.cc:1511] Processing CreateTablet for tablet 67571e95c6f547b989f85aa109da10a9 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:04:27.265506 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67571e95c6f547b989f85aa109da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.283813 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 376f02b12a354291b7600c9c176e3885 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:27.285606 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376f02b12a354291b7600c9c176e3885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.297339 15034 tablet_service.cc:1511] Processing CreateTablet for tablet 376f02b12a354291b7600c9c176e3885 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:27.299150 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376f02b12a354291b7600c9c176e3885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.303265 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 1040e321bc7c46f79cd0ad55259aba21 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:27.303933 14957 tablet_service.cc:1511] Processing CreateTablet for tablet 376f02b12a354291b7600c9c176e3885 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:04:27.304638 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1040e321bc7c46f79cd0ad55259aba21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.305361 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 376f02b12a354291b7600c9c176e3885. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.315758 15092 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.316650 15085 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:27.316298 15092 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.319020 15085 ts_tablet_manager.cc:1403] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.222s	user 0.007s	sys 0.016s
I20260709 13:04:27.320768 15092 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:27.325637 15084 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:27.326114 15084 ts_tablet_manager.cc:1403] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.121s	user 0.029s	sys 0.080s
I20260709 13:04:27.328958 15090 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.329408 15090 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.335330 15085 raft_consensus.cc:359] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.338971 15091 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.339578 15091 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.339089 15090 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:27.341849 15086 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:27.342295 15091 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:27.349009 15085 raft_consensus.cc:385] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.350024 15085 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.353003 15084 raft_consensus.cc:359] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.342322 15086 ts_tablet_manager.cc:1403] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.161s	user 0.029s	sys 0.021s
I20260709 13:04:27.356339 15085 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.363930 15085 ts_tablet_manager.cc:1434] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:04:27.356644 15084 raft_consensus.cc:385] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.373238 15084 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.383400 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 1040e321bc7c46f79cd0ad55259aba21 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:27.384706 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1040e321bc7c46f79cd0ad55259aba21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.388931 15085 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:27.391932 15086 raft_consensus.cc:359] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.392719 15086 raft_consensus.cc:385] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.393029 15086 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.393759 15086 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.394915 15085 tablet_bootstrap.cc:654] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.398337 14956 tablet_service.cc:1511] Processing CreateTablet for tablet 37a7135d72784bd590fd05aeda0ea3b6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:27.399695 14960 tablet_service.cc:1511] Processing CreateTablet for tablet b1b0b2aff5c14c50aac568802fb9aa6c (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:27.398571 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 770c4e1c2abb48cba0a9b362f6be74f5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:27.402523 15086 ts_tablet_manager.cc:1434] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:04:27.403504 15086 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:27.403159 14955 tablet_service.cc:1511] Processing CreateTablet for tablet 6eec3351a3e94e158c79a8784e2c6574 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:27.405047 14957 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9af86494f14821b5b88018dbe4a1c2 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:27.399642 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a7135d72784bd590fd05aeda0ea3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.406615 14960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b0b2aff5c14c50aac568802fb9aa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.409035 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770c4e1c2abb48cba0a9b362f6be74f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.409757 14957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9af86494f14821b5b88018dbe4a1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.411429 14884 tablet_service.cc:1511] Processing CreateTablet for tablet b1b0b2aff5c14c50aac568802fb9aa6c (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:27.413098 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b0b2aff5c14c50aac568802fb9aa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.414253 15090 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.414572 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eec3351a3e94e158c79a8784e2c6574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.414757 15090 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.411326 14883 tablet_service.cc:1511] Processing CreateTablet for tablet 770c4e1c2abb48cba0a9b362f6be74f5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:27.416217 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770c4e1c2abb48cba0a9b362f6be74f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.420347 15090 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:27.430806 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:27.432332 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:27.434278 15008 leader_election.cc:343] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.434094 14954 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecb36ffe5e640f88b50155fa361883d (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
W20260709 13:04:27.434942 15008 leader_election.cc:343] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.435549 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecb36ffe5e640f88b50155fa361883d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.438324 14880 tablet_service.cc:1511] Processing CreateTablet for tablet 37a7135d72784bd590fd05aeda0ea3b6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:27.438568 14882 tablet_service.cc:1511] Processing CreateTablet for tablet 6eec3351a3e94e158c79a8784e2c6574 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:27.438675 15034 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9af86494f14821b5b88018dbe4a1c2 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:27.439224 14959 tablet_service.cc:1511] Processing CreateTablet for tablet 1040e321bc7c46f79cd0ad55259aba21 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:04:27.439736 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a7135d72784bd590fd05aeda0ea3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.439987 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9af86494f14821b5b88018dbe4a1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.440539 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1040e321bc7c46f79cd0ad55259aba21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.440858 14879 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecb36ffe5e640f88b50155fa361883d (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:27.442066 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecb36ffe5e640f88b50155fa361883d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.444579 14878 tablet_service.cc:1511] Processing CreateTablet for tablet c8fa9dae6116418f8b520fc591ae5757 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:27.449451 15084 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.450330 15090 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:27.450800 15090 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.451488 14953 tablet_service.cc:1511] Processing CreateTablet for tablet c8fa9dae6116418f8b520fc591ae5757 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:27.453274 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fa9dae6116418f8b520fc591ae5757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.456135 15090 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:27.456415 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:27.457194 14969 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:27.459164 15008 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:27.460157 15090 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.460597 15090 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.461023 15090 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.463754 14882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eec3351a3e94e158c79a8784e2c6574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.466874 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fa9dae6116418f8b520fc591ae5757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.470968 14877 tablet_service.cc:1511] Processing CreateTablet for tablet 022fa149e13b44eeae0eb2555eb6eb80 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:27.480065 14877 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022fa149e13b44eeae0eb2555eb6eb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.480705 15090 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.484090 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:27.485967 14969 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.476909 15086 tablet_bootstrap.cc:654] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.493412 15084 ts_tablet_manager.cc:1434] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.167s	user 0.012s	sys 0.011s
I20260709 13:04:27.494704 15084 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:27.496405 15031 tablet_service.cc:1511] Processing CreateTablet for tablet 770c4e1c2abb48cba0a9b362f6be74f5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:04:27.486569 15090 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:27.497742 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770c4e1c2abb48cba0a9b362f6be74f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.509059 14876 tablet_service.cc:1511] Processing CreateTablet for tablet b9511e929bc448349baf940df42e2a22 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:27.505802 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9af86494f14821b5b88018dbe4a1c2 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:04:27.510505 14876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9511e929bc448349baf940df42e2a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.511190 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9af86494f14821b5b88018dbe4a1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.512745 14952 tablet_service.cc:1511] Processing CreateTablet for tablet 022fa149e13b44eeae0eb2555eb6eb80 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:27.513381 14951 tablet_service.cc:1511] Processing CreateTablet for tablet b9511e929bc448349baf940df42e2a22 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:27.514163 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022fa149e13b44eeae0eb2555eb6eb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.515446 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:27.515748 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9511e929bc448349baf940df42e2a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.519829 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:27.520663 15044 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:27.522125 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:27.523276 15091 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.524286 15030 tablet_service.cc:1511] Processing CreateTablet for tablet b1b0b2aff5c14c50aac568802fb9aa6c (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:04:27.524642 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 37a7135d72784bd590fd05aeda0ea3b6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:04:27.524286 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1d51e80f4e47638e5c23566e217993 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:27.525781 15030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b0b2aff5c14c50aac568802fb9aa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.529421 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:27.530120 14895 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:27.531759 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a7135d72784bd590fd05aeda0ea3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.531553 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:27.532442 15092 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:27.533655 15092 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:27.535144 15092 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.541062 15028 tablet_service.cc:1511] Processing CreateTablet for tablet 6eec3351a3e94e158c79a8784e2c6574 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:04:27.541370 15033 tablet_service.cc:1511] Processing CreateTablet for tablet 1ecb36ffe5e640f88b50155fa361883d (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:04:27.542389 15028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eec3351a3e94e158c79a8784e2c6574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.546926 15033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecb36ffe5e640f88b50155fa361883d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.547524 15027 tablet_service.cc:1511] Processing CreateTablet for tablet c8fa9dae6116418f8b520fc591ae5757 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:04:27.548995 15027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fa9dae6116418f8b520fc591ae5757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.553052 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 022fa149e13b44eeae0eb2555eb6eb80 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:04:27.554883 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022fa149e13b44eeae0eb2555eb6eb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.557085 15025 tablet_service.cc:1511] Processing CreateTablet for tablet b9511e929bc448349baf940df42e2a22 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:04:27.560221 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9511e929bc448349baf940df42e2a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.563380 14955 tablet_service.cc:1511] Processing CreateTablet for tablet cfa2777cd48541b3b2bcf2ed038ac645 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:27.585129 14955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa2777cd48541b3b2bcf2ed038ac645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.586134 15091 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.590230 14969 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:27.591593 15008 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:27.592571 15106 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.593209 15106 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:27.594019 15106 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:04:27.596939 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1d51e80f4e47638e5c23566e217993 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:27.586184 15092 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.598223 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1d51e80f4e47638e5c23566e217993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.600625 15092 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:27.605125 14956 tablet_service.cc:1511] Processing CreateTablet for tablet 8b1d51e80f4e47638e5c23566e217993 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:04:27.606415 14956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1d51e80f4e47638e5c23566e217993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.609156 14958 tablet_service.cc:1511] Processing CreateTablet for tablet a86ee695370844fcbe0c2c00edd26e73 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:27.610352 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ee695370844fcbe0c2c00edd26e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.619331 14959 tablet_service.cc:1511] Processing CreateTablet for tablet f85c193fa13b46d9bceea2295f514c29 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:27.623510 14959 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85c193fa13b46d9bceea2295f514c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.623435 15031 tablet_service.cc:1511] Processing CreateTablet for tablet cfa2777cd48541b3b2bcf2ed038ac645 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:27.624761 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa2777cd48541b3b2bcf2ed038ac645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.640008 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1d51e80f4e47638e5c23566e217993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.640969 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:27.641031 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:27.643201 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:27.644423 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:27.644800 15007 leader_election.cc:343] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.645103 14891 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:27.645264 15007 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:27.648699 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:27.671619 14936 leader_election.cc:343] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:27.673095 14936 leader_election.cc:343] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.654148 15090 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:27.684540 15007 leader_election.cc:343] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:27.685105 15007 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:27.686460 15090 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:27.698246 15029 tablet_service.cc:1511] Processing CreateTablet for tablet a86ee695370844fcbe0c2c00edd26e73 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:27.699690 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ee695370844fcbe0c2c00edd26e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.700603 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 66e4432ba29a43668db5483ebef3b522 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:27.702327 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e4432ba29a43668db5483ebef3b522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.703781 15084 tablet_bootstrap.cc:654] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.708300 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:27.708665 14891 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:27.709066 14893 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:27.709905 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:27.712322 15092 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:27.723994 15026 tablet_service.cc:1511] Processing CreateTablet for tablet f85c193fa13b46d9bceea2295f514c29 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:27.725404 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85c193fa13b46d9bceea2295f514c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.729419 15085 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:27.730098 15085 ts_tablet_manager.cc:1403] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.350s	user 0.003s	sys 0.019s
I20260709 13:04:27.735581 15086 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:27.736129 15086 ts_tablet_manager.cc:1403] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.333s	user 0.049s	sys 0.063s
I20260709 13:04:27.741596 14882 tablet_service.cc:1511] Processing CreateTablet for tablet cfa2777cd48541b3b2bcf2ed038ac645 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:04:27.745262 14880 tablet_service.cc:1511] Processing CreateTablet for tablet a86ee695370844fcbe0c2c00edd26e73 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:04:27.747370 14882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa2777cd48541b3b2bcf2ed038ac645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.754118 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 66e4432ba29a43668db5483ebef3b522 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:27.738241 14793 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.761498 14880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ee695370844fcbe0c2c00edd26e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.755664 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:27.756938 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e4432ba29a43668db5483ebef3b522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.769781 14954 tablet_service.cc:1511] Processing CreateTablet for tablet 146ff3031af843e3a501710c2301a015 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:27.780066 15085 raft_consensus.cc:359] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.783461 15034 tablet_service.cc:1511] Processing CreateTablet for tablet 146ff3031af843e3a501710c2301a015 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:27.739107 15086 raft_consensus.cc:359] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.784340 15030 tablet_service.cc:1511] Processing CreateTablet for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:27.763512 15092 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:27.788301 14878 tablet_service.cc:1511] Processing CreateTablet for tablet f85c193fa13b46d9bceea2295f514c29 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:04:27.793226 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85c193fa13b46d9bceea2295f514c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.793838 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 66e4432ba29a43668db5483ebef3b522 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:04:27.794158 14879 tablet_service.cc:1511] Processing CreateTablet for tablet 146ff3031af843e3a501710c2301a015 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:04:27.795039 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e4432ba29a43668db5483ebef3b522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.800117 14892 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:27.800881 14951 tablet_service.cc:1511] Processing CreateTablet for tablet ebef2badb7124b9fa530c8877d638abe (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:27.801900 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff3031af843e3a501710c2301a015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.802513 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef2badb7124b9fa530c8877d638abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.808682 14883 tablet_service.cc:1511] Processing CreateTablet for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:27.812161 15092 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.816170 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff3031af843e3a501710c2301a015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.816845 14883 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.818547 14876 tablet_service.cc:1511] Processing CreateTablet for tablet ebef2badb7124b9fa530c8877d638abe (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:27.788538 15085 raft_consensus.cc:385] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.819658 15085 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.821871 15084 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:27.822373 15084 ts_tablet_manager.cc:1403] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.328s	user 0.011s	sys 0.004s
I20260709 13:04:27.824504 14953 tablet_service.cc:1511] Processing CreateTablet for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:04:27.791905 15086 raft_consensus.cc:385] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.819656 14876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef2badb7124b9fa530c8877d638abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.831637 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff3031af843e3a501710c2301a015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.839115 15085 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.843564 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.844671 14952 tablet_service.cc:1511] Processing CreateTablet for tablet 7b35154b94cb40bc8e8f780311834ad6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:27.845170 15085 ts_tablet_manager.cc:1434] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.115s	user 0.008s	sys 0.002s
I20260709 13:04:27.845963 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b35154b94cb40bc8e8f780311834ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.846320 15085 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:27.830117 15086 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.849370 15030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.850045 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 7b35154b94cb40bc8e8f780311834ad6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:27.868156 15086 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.869580 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b35154b94cb40bc8e8f780311834ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.871229 15086 ts_tablet_manager.cc:1434] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.135s	user 0.007s	sys 0.000s
I20260709 13:04:27.872285 15086 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:27.857524 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 7b35154b94cb40bc8e8f780311834ad6 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:04:27.833433 15084 raft_consensus.cc:359] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.855922 15025 tablet_service.cc:1511] Processing CreateTablet for tablet ebef2badb7124b9fa530c8877d638abe (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:04:27.902197 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b35154b94cb40bc8e8f780311834ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.903992 14882 tablet_service.cc:1511] Processing CreateTablet for tablet be840274e2c843b9b2b9f24277dca78d (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:27.904843 14958 tablet_service.cc:1511] Processing CreateTablet for tablet be840274e2c843b9b2b9f24277dca78d (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:27.905326 14882 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be840274e2c843b9b2b9f24277dca78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.906095 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be840274e2c843b9b2b9f24277dca78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.902220 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef2badb7124b9fa530c8877d638abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.900101 15084 raft_consensus.cc:385] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:27.909148 15084 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:27.913792 14884 tablet_service.cc:1511] Processing CreateTablet for tablet cbe1d22f90c742fd86d8bd93e5d59e59 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:27.915107 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe1d22f90c742fd86d8bd93e5d59e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.915815 14953 tablet_service.cc:1511] Processing CreateTablet for tablet cbe1d22f90c742fd86d8bd93e5d59e59 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:27.917032 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe1d22f90c742fd86d8bd93e5d59e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.905733 14790 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:27.926097 15084 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:27.928658 15084 ts_tablet_manager.cc:1434] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.000s
I20260709 13:04:27.929654 15084 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:27.930971 15030 tablet_service.cc:1511] Processing CreateTablet for tablet cbe1d22f90c742fd86d8bd93e5d59e59 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:04:27.932363 15030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbe1d22f90c742fd86d8bd93e5d59e59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.933936 15034 tablet_service.cc:1511] Processing CreateTablet for tablet be840274e2c843b9b2b9f24277dca78d (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:04:27.937752 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be840274e2c843b9b2b9f24277dca78d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.942552 14879 tablet_service.cc:1511] Processing CreateTablet for tablet 80a1bdc86202444db87b94ea818eedd5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:27.944190 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a1bdc86202444db87b94ea818eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.943941 14954 tablet_service.cc:1511] Processing CreateTablet for tablet 80a1bdc86202444db87b94ea818eedd5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:27.945202 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a1bdc86202444db87b94ea818eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.934075 15085 tablet_bootstrap.cc:654] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.956951 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 80a1bdc86202444db87b94ea818eedd5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:04:27.957310 14876 tablet_service.cc:1511] Processing CreateTablet for tablet 754b0ca0f8c0459c8b6f122a5ff76b39 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:27.958316 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a1bdc86202444db87b94ea818eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.958451 14876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754b0ca0f8c0459c8b6f122a5ff76b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.968847 15084 tablet_bootstrap.cc:654] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.969537 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 754b0ca0f8c0459c8b6f122a5ff76b39 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:27.970796 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754b0ca0f8c0459c8b6f122a5ff76b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.971216 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 5cbe935ec59f4f31a383418c80f8823b (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:27.972571 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cbe935ec59f4f31a383418c80f8823b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.977226 14951 tablet_service.cc:1511] Processing CreateTablet for tablet 7d87ff4cfb034c7eb5e9fdb522974b90 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:27.973248 15086 tablet_bootstrap.cc:654] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:27.978451 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87ff4cfb034c7eb5e9fdb522974b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.974285 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 5cbe935ec59f4f31a383418c80f8823b (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:27.975039 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 7d87ff4cfb034c7eb5e9fdb522974b90 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:27.979180 14878 tablet_service.cc:1511] Processing CreateTablet for tablet 73ceb2cea7314e0cadb64aa9ccbad8de (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:27.983481 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87ff4cfb034c7eb5e9fdb522974b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.984243 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ceb2cea7314e0cadb64aa9ccbad8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.980402 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 5cbe935ec59f4f31a383418c80f8823b (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:04:27.984476 15031 tablet_service.cc:1511] Processing CreateTablet for tablet 7d87ff4cfb034c7eb5e9fdb522974b90 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:04:27.985077 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cbe935ec59f4f31a383418c80f8823b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.985626 15031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87ff4cfb034c7eb5e9fdb522974b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.988032 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5cbe935ec59f4f31a383418c80f8823b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:27.993863 14953 tablet_service.cc:1511] Processing CreateTablet for tablet 754b0ca0f8c0459c8b6f122a5ff76b39 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:04:27.995203 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754b0ca0f8c0459c8b6f122a5ff76b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.012512 15106 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.065794 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 73ceb2cea7314e0cadb64aa9ccbad8de (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:28.067024 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ceb2cea7314e0cadb64aa9ccbad8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.072201 15030 tablet_service.cc:1511] Processing CreateTablet for tablet 73ceb2cea7314e0cadb64aa9ccbad8de (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:04:28.073485 15030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73ceb2cea7314e0cadb64aa9ccbad8de. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.087993 14884 tablet_service.cc:1511] Processing CreateTablet for tablet b7dd8999b5f24b039d0adbe5c24edbc3 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:28.089092 15086 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:28.089293 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dd8999b5f24b039d0adbe5c24edbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.089738 15086 ts_tablet_manager.cc:1403] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.218s	user 0.010s	sys 0.005s
I20260709 13:04:28.093681 14954 tablet_service.cc:1511] Processing CreateTablet for tablet 8de39bcda9f4437d8538be04713851b1 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:28.094954 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de39bcda9f4437d8538be04713851b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.103704 14952 tablet_service.cc:1511] Processing CreateTablet for tablet b7dd8999b5f24b039d0adbe5c24edbc3 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:28.105015 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dd8999b5f24b039d0adbe5c24edbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.104615 15086 raft_consensus.cc:359] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.105453 15086 raft_consensus.cc:385] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.105829 15086 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.106726 15086 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.125898 15085 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:28.128077 15085 ts_tablet_manager.cc:1403] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.282s	user 0.042s	sys 0.043s
I20260709 13:04:28.129019 14881 tablet_service.cc:1511] Processing CreateTablet for tablet 83edd178ff3943b58ccf199ddc331aec (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:28.130263 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83edd178ff3943b58ccf199ddc331aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.132426 15084 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.132368 15029 tablet_service.cc:1511] Processing CreateTablet for tablet b7dd8999b5f24b039d0adbe5c24edbc3 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:04:28.133069 15084 ts_tablet_manager.cc:1403] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.204s	user 0.037s	sys 0.031s
I20260709 13:04:28.133850 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7dd8999b5f24b039d0adbe5c24edbc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.135802 15091 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.136276 15091 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.130884 15085 raft_consensus.cc:359] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.130885 15086 ts_tablet_manager.cc:1434] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.001s
I20260709 13:04:28.141309 15091 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.140081 15085 raft_consensus.cc:385] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.142652 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:28.147730 15043 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:28.147326 15084 raft_consensus.cc:359] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.151371 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 83edd178ff3943b58ccf199ddc331aec (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:28.152657 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83edd178ff3943b58ccf199ddc331aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.152453 14879 tablet_service.cc:1511] Processing CreateTablet for tablet 410c57dd04b546f3be0269aecdb13719 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:28.154102 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410c57dd04b546f3be0269aecdb13719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.146304 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 83edd178ff3943b58ccf199ddc331aec (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:04:28.144163 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:28.149288 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:28.148527 15085 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.149884 15086 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:28.162437 14969 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:28.163285 15085 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.163767 15091 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.164889 15091 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.165269 15091 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.166442 14954 tablet_service.cc:1511] Processing CreateTablet for tablet 410c57dd04b546f3be0269aecdb13719 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:28.161067 15025 tablet_service.cc:1511] Processing CreateTablet for tablet 8de39bcda9f4437d8538be04713851b1 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:28.174347 14878 tablet_service.cc:1511] Processing CreateTablet for tablet 8de39bcda9f4437d8538be04713851b1 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:04:28.174610 15034 tablet_service.cc:1511] Processing CreateTablet for tablet 410c57dd04b546f3be0269aecdb13719 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:04:28.175733 14878 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de39bcda9f4437d8538be04713851b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.176913 15091 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.150539 15084 raft_consensus.cc:385] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.182401 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410c57dd04b546f3be0269aecdb13719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.187892 15084 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.188808 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:28.189493 14969 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.189332 15084 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.190620 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 205008a787ca45349273b1e8daaebdf5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:28.192039 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205008a787ca45349273b1e8daaebdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.192508 15084 ts_tablet_manager.cc:1434] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.059s	user 0.003s	sys 0.003s
I20260709 13:04:28.197299 15106 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.198393 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83edd178ff3943b58ccf199ddc331aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.202286 15090 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.206115 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410c57dd04b546f3be0269aecdb13719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.209942 15092 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.210407 15092 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.212448 15092 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.212957 15084 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.213977 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:28.214596 14891 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:28.197772 15106 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.217109 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:28.217989 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de39bcda9f4437d8538be04713851b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.218080 15092 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.223896 15092 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.223819 14951 tablet_service.cc:1511] Processing CreateTablet for tablet 205008a787ca45349273b1e8daaebdf5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:28.224406 15092 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.225292 14951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205008a787ca45349273b1e8daaebdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.225452 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:28.226881 15008 leader_election.cc:343] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.219480 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:28.219074 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:28.227698 15043 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
W20260709 13:04:28.228652 15007 leader_election.cc:343] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.224123 15026 tablet_service.cc:1511] Processing CreateTablet for tablet 205008a787ca45349273b1e8daaebdf5 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:04:28.229074 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:28.227458 15106 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:28.229846 15090 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:28.230131 15091 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.232048 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:28.232597 15043 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.235314 15026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 205008a787ca45349273b1e8daaebdf5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.236950 14969 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:28.238404 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:28.247671 15091 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.248325 15091 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:28.249748 15091 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.250876 15085 ts_tablet_manager.cc:1434] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.122s	user 0.011s	sys 0.016s
I20260709 13:04:28.252034 15085 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:28.262367 15092 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.267720 15086 tablet_bootstrap.cc:654] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:28.268697 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:28.273048 15085 tablet_bootstrap.cc:654] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.274195 15043 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:28.276676 15092 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.274731 14952 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab3877f8e9e4155a67e7a196ed5eb60 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:28.277269 14879 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab3877f8e9e4155a67e7a196ed5eb60 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:28.279496 14879 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab3877f8e9e4155a67e7a196ed5eb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.280040 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:28.280638 14891 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.286748 14891 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:28.288092 14952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab3877f8e9e4155a67e7a196ed5eb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.294817 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:28.297758 15092 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.298233 15092 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:28.298120 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 7933f8a0325b4bf7a8bafc99c9284091 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:28.299116 15092 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.299948 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7933f8a0325b4bf7a8bafc99c9284091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.300846 14954 tablet_service.cc:1511] Processing CreateTablet for tablet 7933f8a0325b4bf7a8bafc99c9284091 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:28.305751 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 7933f8a0325b4bf7a8bafc99c9284091 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:04:28.306042 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 6ab3877f8e9e4155a67e7a196ed5eb60 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:04:28.307017 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7933f8a0325b4bf7a8bafc99c9284091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.295120 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:28.308357 15043 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.321722 15043 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:28.321400 14790 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.325992 14881 tablet_service.cc:1511] Processing CreateTablet for tablet f7a1be4a55754b9baba160c70df7dc21 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:28.327641 14881 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a1be4a55754b9baba160c70df7dc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.329111 15025 tablet_service.cc:1511] Processing CreateTablet for tablet f7a1be4a55754b9baba160c70df7dc21 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:28.332688 14958 tablet_service.cc:1511] Processing CreateTablet for tablet f7a1be4a55754b9baba160c70df7dc21 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:04:28.337597 15034 tablet_service.cc:1511] Processing CreateTablet for tablet e466470834d346b8a99b98e620844e85 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:28.339118 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ab3877f8e9e4155a67e7a196ed5eb60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.336756 14953 tablet_service.cc:1511] Processing CreateTablet for tablet e466470834d346b8a99b98e620844e85 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:28.335356 14885 tablet_service.cc:1511] Processing CreateTablet for tablet e466470834d346b8a99b98e620844e85 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:04:28.341619 14954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7933f8a0325b4bf7a8bafc99c9284091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.342054 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e466470834d346b8a99b98e620844e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.345991 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e466470834d346b8a99b98e620844e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.350706 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 060cd1347c834f27a9abc4cf6d5584a9 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:28.352366 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060cd1347c834f27a9abc4cf6d5584a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.373479 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a1be4a55754b9baba160c70df7dc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.386025 15084 tablet_bootstrap.cc:654] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.389081 15086 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:28.389565 15086 ts_tablet_manager.cc:1403] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.240s	user 0.009s	sys 0.014s
I20260709 13:04:28.389581 14960 tablet_service.cc:1511] Processing CreateTablet for tablet 060cd1347c834f27a9abc4cf6d5584a9 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:28.391546 14960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060cd1347c834f27a9abc4cf6d5584a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.359056 14793 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:28.392293 15086 raft_consensus.cc:359] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.392946 15086 raft_consensus.cc:385] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.393232 15086 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.393909 15086 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.402264 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a1be4a55754b9baba160c70df7dc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.404561 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e466470834d346b8a99b98e620844e85. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.410091 15086 ts_tablet_manager.cc:1434] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:04:28.417562 15086 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:28.425570 15086 tablet_bootstrap.cc:654] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.425215 15029 tablet_service.cc:1511] Processing CreateTablet for tablet 060cd1347c834f27a9abc4cf6d5584a9 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:04:28.426522 15029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060cd1347c834f27a9abc4cf6d5584a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.433368 15085 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:28.433851 15085 ts_tablet_manager.cc:1403] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.182s	user 0.033s	sys 0.049s
I20260709 13:04:28.436748 15085 raft_consensus.cc:359] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.437485 15085 raft_consensus.cc:385] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.437783 15085 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.438489 15085 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.440704 15085 ts_tablet_manager.cc:1434] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:28.443187 15043 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.444119 15085 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:28.445221 15111 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:04:28.485684 14958 tablet_service.cc:1511] Processing CreateTablet for tablet 290e1d2493f34d57807c1a358aa0f71e (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:28.487246 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290e1d2493f34d57807c1a358aa0f71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.513389 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 290e1d2493f34d57807c1a358aa0f71e (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:28.514771 15084 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.515493 15084 ts_tablet_manager.cc:1403] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.303s	user 0.018s	sys 0.031s
I20260709 13:04:28.516831 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 290e1d2493f34d57807c1a358aa0f71e (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:04:28.518383 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290e1d2493f34d57807c1a358aa0f71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.514765 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290e1d2493f34d57807c1a358aa0f71e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.520584 14885 tablet_service.cc:1511] Processing CreateTablet for tablet c5af46e976c54b8ba2b6e09ce06690af (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:28.522068 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5af46e976c54b8ba2b6e09ce06690af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.529951 14958 tablet_service.cc:1511] Processing CreateTablet for tablet c5af46e976c54b8ba2b6e09ce06690af (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:28.531629 14958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5af46e976c54b8ba2b6e09ce06690af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.547894 15085 tablet_bootstrap.cc:654] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.552991 15034 tablet_service.cc:1511] Processing CreateTablet for tablet c5af46e976c54b8ba2b6e09ce06690af (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:04:28.554114 15034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5af46e976c54b8ba2b6e09ce06690af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.557160 14953 tablet_service.cc:1511] Processing CreateTablet for tablet 96fa5275273743d0973b36e2f0c784cb (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:28.558410 14953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fa5275273743d0973b36e2f0c784cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.519222 15084 raft_consensus.cc:359] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.562232 15084 raft_consensus.cc:385] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.562613 15084 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.563946 15084 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.566377 14884 tablet_service.cc:1511] Processing CreateTablet for tablet 96fa5275273743d0973b36e2f0c784cb (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:28.567473 14884 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fa5275273743d0973b36e2f0c784cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.570222 15084 ts_tablet_manager.cc:1434] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:04:28.571246 15084 tablet_bootstrap.cc:492] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.574308 15092 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:28.577512 15084 tablet_bootstrap.cc:654] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.583271 14885 tablet_service.cc:1511] Processing CreateTablet for tablet 156c010162bf4cb99b535677eccb2740 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:28.584969 14885 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156c010162bf4cb99b535677eccb2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.585693 14960 tablet_service.cc:1511] Processing CreateTablet for tablet 156c010162bf4cb99b535677eccb2740 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:28.586848 14960 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156c010162bf4cb99b535677eccb2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.591147 15032 tablet_service.cc:1511] Processing CreateTablet for tablet 96fa5275273743d0973b36e2f0c784cb (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:04:28.592278 15032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96fa5275273743d0973b36e2f0c784cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.592831 15086 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:28.593281 15086 ts_tablet_manager.cc:1403] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.176s	user 0.064s	sys 0.048s
I20260709 13:04:28.598644 15086 raft_consensus.cc:359] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.599347 15086 raft_consensus.cc:385] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.599680 15086 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.600442 15086 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.605206 15086 ts_tablet_manager.cc:1434] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:04:28.600502 15025 tablet_service.cc:1511] Processing CreateTablet for tablet 156c010162bf4cb99b535677eccb2740 (DEFAULT_TABLE table=test-workload [id=06e5a638f129436f84e3070b4f75281b]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:04:28.606904 15025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156c010162bf4cb99b535677eccb2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:28.609644 15084 tablet_bootstrap.cc:492] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.610143 15084 ts_tablet_manager.cc:1403] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.039s	user 0.007s	sys 0.004s
I20260709 13:04:28.618222 15086 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:28.627279 15085 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:28.627876 15085 ts_tablet_manager.cc:1403] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.184s	user 0.011s	sys 0.019s
I20260709 13:04:28.627697 15084 raft_consensus.cc:359] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.628540 15084 raft_consensus.cc:385] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.628872 15084 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.629724 15084 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.630681 15086 tablet_bootstrap.cc:654] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.631747 15085 raft_consensus.cc:359] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.632531 15085 raft_consensus.cc:385] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.632920 15085 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.632229 15084 ts_tablet_manager.cc:1434] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.010s
I20260709 13:04:28.634357 15084 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.634819 15085 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.644554 15085 ts_tablet_manager.cc:1434] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.002s
I20260709 13:04:28.645635 15085 tablet_bootstrap.cc:492] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:28.650236 15084 tablet_bootstrap.cc:654] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.655396 15085 tablet_bootstrap.cc:654] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.668921 15086 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:28.669409 15086 ts_tablet_manager.cc:1403] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.014s
I20260709 13:04:28.669670 15084 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.670274 15084 ts_tablet_manager.cc:1403] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.006s
I20260709 13:04:28.671929 15086 raft_consensus.cc:359] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.672714 15086 raft_consensus.cc:385] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.672976 15086 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.672931 15084 raft_consensus.cc:359] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.673738 15084 raft_consensus.cc:385] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.673916 15085 tablet_bootstrap.cc:492] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:28.674046 15084 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.674407 15085 ts_tablet_manager.cc:1403] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.006s
I20260709 13:04:28.674852 15084 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.675648 15086 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.676862 15084 ts_tablet_manager.cc:1434] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:04:28.677439 15085 raft_consensus.cc:359] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.678129 15085 raft_consensus.cc:385] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.678435 15085 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.678635 15086 ts_tablet_manager.cc:1434] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:04:28.679137 15085 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.679647 15086 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:28.681267 15085 ts_tablet_manager.cc:1434] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:28.682157 15084 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.686764 15086 tablet_bootstrap.cc:654] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.688113 15084 tablet_bootstrap.cc:654] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.691634 15085 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:28.699345 15085 tablet_bootstrap.cc:654] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.701496 15086 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:28.702003 15086 ts_tablet_manager.cc:1403] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.005s
I20260709 13:04:28.705436 15086 raft_consensus.cc:359] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.707149 15086 raft_consensus.cc:385] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.707482 15086 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.708377 15085 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:28.708844 15085 ts_tablet_manager.cc:1403] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260709 13:04:28.708451 15086 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.711061 15086 ts_tablet_manager.cc:1434] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:28.712169 15086 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:28.708490 15084 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.715117 15084 ts_tablet_manager.cc:1403] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.033s	user 0.020s	sys 0.005s
I20260709 13:04:28.715894 15092 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.716360 15092 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.717558 15084 raft_consensus.cc:359] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.718091 15086 tablet_bootstrap.cc:654] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.718199 15084 raft_consensus.cc:385] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.718359 15092 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.718549 15084 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.720033 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:28.720670 15043 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:28.720534 15084 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.721818 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:28.722679 15084 ts_tablet_manager.cc:1434] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 13:04:28.724901 15086 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:28.724936 15085 raft_consensus.cc:359] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.725451 15086 ts_tablet_manager.cc:1403] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 13:04:28.725710 15085 raft_consensus.cc:385] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.726065 15085 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.726769 15085 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.727890 15084 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.728077 15086 raft_consensus.cc:359] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.728643 15085 ts_tablet_manager.cc:1434] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:04:28.728749 15086 raft_consensus.cc:385] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.729115 15086 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.729629 15085 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:28.729732 15086 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.731611 15086 ts_tablet_manager.cc:1434] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:28.732010 15111 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.732376 15086 tablet_bootstrap.cc:492] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:28.732359 15111 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.732810 15111 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.734457 15084 tablet_bootstrap.cc:654] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.735132 15085 tablet_bootstrap.cc:654] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.736213 15143 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.736449 15091 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.736698 15143 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.736927 15091 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.738029 15086 tablet_bootstrap.cc:654] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.739044 15091 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.740494 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:28.740818 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:28.741109 14969 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:28.741879 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:28.742213 15007 leader_election.cc:343] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.742673 14892 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:28.743109 15008 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:28.744349 15106 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.744805 15106 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.745231 15106 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.745566 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:28.746343 14969 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:28.749188 15143 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:28.750425 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:04:28.752249 14861 leader_election.cc:343] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.753563 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:28.754426 15106 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.754838 15124 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.755362 15124 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.755841 15124 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.760615 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:28.761374 14969 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.763829 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:28.765348 15007 leader_election.cc:343] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.770816 14969 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:28.771521 15106 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:28.774320 15008 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:28.775811 15106 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.777293 15106 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:28.778373 15106 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.786515 15111 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.790292 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:28.791144 15084 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.791775 15084 ts_tablet_manager.cc:1403] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.064s	user 0.006s	sys 0.038s
I20260709 13:04:28.791062 14892 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.802649 15091 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.794751 15084 raft_consensus.cc:359] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.805644 15084 raft_consensus.cc:385] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.806113 15084 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.807153 15084 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.797175 14792 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:28.810518 15084 ts_tablet_manager.cc:1434] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:04:28.812594 15084 tablet_bootstrap.cc:492] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.811128 14892 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:28.816655 14933 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:28.817500 15092 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.824898 15084 tablet_bootstrap.cc:654] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.840909 15106 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.841631 15106 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.846051 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:28.846900 14969 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:28.848145 15084 tablet_bootstrap.cc:492] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:28.848809 15084 ts_tablet_manager.cc:1403] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.004s
I20260709 13:04:28.848480 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:28.849339 15106 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:28.849735 15143 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.850234 15143 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.850649 15143 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.851495 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:28.852332 14892 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:28.865670 15154 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:28.870973 15106 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:28.871622 15106 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.883169 15084 raft_consensus.cc:359] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.890262 15084 raft_consensus.cc:385] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:28.889532 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:28.891038 14891 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:28.885618 15143 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.892076 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:28.893857 15008 leader_election.cc:343] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:28.894429 15084 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:28.896128 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:28.896869 14969 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.900235 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:28.901314 15090 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:28.901775 15090 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:28.902243 15090 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.894104 15143 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:28.895869 15084 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.908350 15084 ts_tablet_manager.cc:1434] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.005s
I20260709 13:04:28.908427 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:28.909533 14892 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.914340 15084 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:28.927917 14892 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:28.931511 15124 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:28.932040 15007 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:28.933221 15143 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:28.935837 15106 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:28.940110 15111 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.930596 15084 tablet_bootstrap.cc:654] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:28.951326 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:28.952219 15043 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.959544 15124 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:28.967372 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:28.968230 14970 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:28.979547 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:28.980368 15044 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.000355 15150 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.002857 15143 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:29.004042 15143 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.007813 15085 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:29.008450 15085 ts_tablet_manager.cc:1403] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.279s	user 0.047s	sys 0.098s
I20260709 13:04:29.009193 15044 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:28.914386 15090 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.011971 15085 raft_consensus.cc:359] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.012866 15085 raft_consensus.cc:385] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.013145 15085 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.013276 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:29.013823 14892 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.013878 15085 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.015084 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:29.015875 15085 ts_tablet_manager.cc:1434] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:04:29.016711 15085 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
W20260709 13:04:29.016850 15008 leader_election.cc:343] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.017650 15091 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.020637 14892 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:29.021800 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:28.962982 15043 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:29.022647 15085 tablet_bootstrap.cc:654] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.023011 15157 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.023748 15157 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:29.023530 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:29.024386 15090 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:29.024644 15124 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.025410 15124 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:29.028318 15124 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.025368 15092 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:29.031581 15092 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.038074 14970 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:29.040189 14792 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.026628 15157 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.053184 15086 tablet_bootstrap.cc:492] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.053659 15086 ts_tablet_manager.cc:1403] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.321s	user 0.113s	sys 0.194s
I20260709 13:04:29.056309 15086 raft_consensus.cc:359] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.063313 15086 raft_consensus.cc:385] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.063704 15086 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.046372 14969 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:29.067540 15086 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.069749 15086 ts_tablet_manager.cc:1434] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:04:29.070657 15086 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.071594 15084 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.072021 15084 ts_tablet_manager.cc:1403] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.158s	user 0.039s	sys 0.057s
I20260709 13:04:29.076982 15143 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.077566 15143 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.079955 15084 raft_consensus.cc:359] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.080605 15084 raft_consensus.cc:385] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.080753 15085 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:29.080878 15084 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.081401 15085 ts_tablet_manager.cc:1403] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.024s
I20260709 13:04:29.081619 15084 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.084944 15084 ts_tablet_manager.cc:1434] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:04:29.083947 15143 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:29.086671 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:29.076385 14791 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.091055 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:29.091658 15008 leader_election.cc:343] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:29.092252 15007 leader_election.cc:343] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.092682 15007 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:29.093664 15143 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.097759 15085 raft_consensus.cc:359] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.098445 15085 raft_consensus.cc:385] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.098707 15085 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.099323 15085 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.101269 15085 ts_tablet_manager.cc:1434] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.007s
I20260709 13:04:29.102149 15085 tablet_bootstrap.cc:492] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:29.105335 15084 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.106949 15086 tablet_bootstrap.cc:654] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.108912 14790 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.111019 14792 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:29.113292 15084 tablet_bootstrap.cc:654] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.116729 15085 tablet_bootstrap.cc:654] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.117391 15086 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.117856 15086 ts_tablet_manager.cc:1403] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.004s
I20260709 13:04:29.120728 15086 raft_consensus.cc:359] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.121567 15086 raft_consensus.cc:385] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.121889 15086 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.122859 15086 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.124722 15086 ts_tablet_manager.cc:1434] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.007s
I20260709 13:04:29.125550 15086 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.133591 15086 tablet_bootstrap.cc:654] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.148712 15143 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.149464 15143 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.152248 15092 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.153254 15086 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.152891 15092 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.153859 15086 ts_tablet_manager.cc:1403] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.004s
I20260709 13:04:29.157151 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.158012 14892 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:29.159610 15086 raft_consensus.cc:359] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.160245 15086 raft_consensus.cc:385] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.160406 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:29.160493 15086 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.161603 15155 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.162063 15155 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.162397 15155 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.162570 15086 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.163439 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:29.164920 15008 leader_election.cc:343] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.165498 15143 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:29.166803 15092 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.168165 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.168167 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:04:29.169570 15007 leader_election.cc:343] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:29.169687 14936 leader_election.cc:343] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.170006 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:29.171200 15143 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.171290 15155 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.165604 15086 ts_tablet_manager.cc:1434] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:04:29.173202 15086 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.174683 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:29.175271 14892 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.180884 15086 tablet_bootstrap.cc:654] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.181952 14892 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.184381 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.185184 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:04:29.186255 14936 leader_election.cc:343] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.186458 15150 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.187071 15150 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.190361 15150 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.190992 15150 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.191349 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.185802 15155 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.191484 15150 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:29.194550 15150 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.197268 15085 tablet_bootstrap.cc:492] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:29.197729 15085 ts_tablet_manager.cc:1403] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.096s	user 0.043s	sys 0.029s
I20260709 13:04:29.197624 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.198557 14892 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:29.199506 15086 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.199630 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:29.199934 15086 ts_tablet_manager.cc:1403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:04:29.200404 15155 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.200484 15085 raft_consensus.cc:359] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.201191 15085 raft_consensus.cc:385] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.201439 15085 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.202137 15085 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.202414 15086 raft_consensus.cc:359] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.203095 15086 raft_consensus.cc:385] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.203349 15086 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.204658 15086 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.206899 15086 ts_tablet_manager.cc:1434] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:29.207859 15086 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.202455 15084 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.208431 15084 ts_tablet_manager.cc:1403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.103s	user 0.022s	sys 0.034s
I20260709 13:04:29.210171 14792 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.210899 15084 raft_consensus.cc:359] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.211555 15084 raft_consensus.cc:385] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.211804 15084 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.212525 15084 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.214442 15084 ts_tablet_manager.cc:1434] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:29.215521 15084 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.215787 15085 ts_tablet_manager.cc:1434] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:04:29.217031 15086 tablet_bootstrap.cc:654] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.221189 15084 tablet_bootstrap.cc:654] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.221043 15124 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.221731 15124 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.226145 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.226675 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:29.228124 14859 leader_election.cc:343] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.228364 15086 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.228786 15086 ts_tablet_manager.cc:1403] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.006s
I20260709 13:04:29.226769 15043 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:29.230033 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:29.230822 15091 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.231170 15091 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.231554 15091 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.231328 15086 raft_consensus.cc:359] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.232026 15086 raft_consensus.cc:385] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.232306 15086 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.233331 15084 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.233124 15086 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.233773 15084 ts_tablet_manager.cc:1403] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:04:29.235574 15124 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.236466 15084 raft_consensus.cc:359] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.237107 15084 raft_consensus.cc:385] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.237363 15084 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.238163 15084 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.240362 15084 ts_tablet_manager.cc:1434] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:29.240063 15091 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.241254 15084 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.242662 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:29.243883 15155 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:29.244560 14859 leader_election.cc:343] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.245574 15085 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:29.247061 15086 ts_tablet_manager.cc:1434] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:04:29.247970 15086 tablet_bootstrap.cc:492] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.248163 15084 tablet_bootstrap.cc:654] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.250751 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.251312 15043 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.250336 15091 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.255795 15155 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.256680 15085 tablet_bootstrap.cc:654] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.256451 15155 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.258299 15086 tablet_bootstrap.cc:654] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.258473 15155 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.258883 15043 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:29.260401 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:29.260891 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.261799 15091 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.262403 15091 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:29.262349 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.263629 15091 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:29.266999 14933 leader_election.cc:343] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.267320 15085 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:29.267879 15085 ts_tablet_manager.cc:1403] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260709 13:04:29.270117 15084 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.270546 15084 ts_tablet_manager.cc:1403] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:04:29.270452 15085 raft_consensus.cc:359] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.271121 15085 raft_consensus.cc:385] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.263271 15044 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:29.271391 15085 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.272681 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.273841 15155 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.273414 15085 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.274226 15155 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.274652 15155 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.276150 15085 ts_tablet_manager.cc:1434] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:04:29.277177 15085 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:29.282014 15150 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.282503 15150 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.283378 15084 raft_consensus.cc:359] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.284264 15084 raft_consensus.cc:385] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.284737 15086 tablet_bootstrap.cc:492] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.285246 15086 ts_tablet_manager.cc:1403] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.008s
I20260709 13:04:29.285306 14793 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.284600 15084 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.286881 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.286950 15084 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.288015 15111 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.288468 15111 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.289517 15084 ts_tablet_manager.cc:1434] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:04:29.290464 15111 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.290946 15086 raft_consensus.cc:359] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.291574 15086 raft_consensus.cc:385] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.291839 15086 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.292469 15086 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.297427 15086 ts_tablet_manager.cc:1434] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 13:04:29.297829 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:29.297919 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.298269 15086 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.284642 15150 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.287576 15044 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
W20260709 13:04:29.299278 14933 leader_election.cc:343] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.300629 15084 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.300382 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.300422 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:29.302039 14933 leader_election.cc:343] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.304761 15086 tablet_bootstrap.cc:654] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.306490 15084 tablet_bootstrap.cc:654] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.307367 15085 tablet_bootstrap.cc:654] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.307741 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.308660 15143 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.315919 15043 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:29.319826 15084 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.320274 15084 ts_tablet_manager.cc:1403] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 13:04:29.320253 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.321457 15111 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.321825 15111 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.322170 15111 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.303602 15150 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.323768 15150 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.323654 15084 raft_consensus.cc:359] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.324460 15084 raft_consensus.cc:385] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.324448 15150 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.324937 15084 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.282495 15155 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.325739 15084 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.327729 15084 ts_tablet_manager.cc:1434] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:29.327241 15155 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.328588 15084 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.329025 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:29.329569 14891 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.334360 15084 tablet_bootstrap.cc:654] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.341383 15111 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.343914 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.348910 15043 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.351075 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:29.352893 14933 leader_election.cc:343] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.351455 15084 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.353819 15084 ts_tablet_manager.cc:1403] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 13:04:29.351794 14891 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.356614 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:29.357483 15155 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.357939 15155 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:29.358716 15155 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.364116 15111 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.364800 14892 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.365167 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.365214 15084 raft_consensus.cc:359] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.365832 15044 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.365919 15084 raft_consensus.cc:385] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.366267 15084 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.366936 15084 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.368918 15084 ts_tablet_manager.cc:1434] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:04:29.369807 15084 tablet_bootstrap.cc:492] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.372527 15044 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.373831 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.374900 15111 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.363286 15043 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.375576 15111 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:29.376159 15084 tablet_bootstrap.cc:654] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.377353 15111 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.355562 15150 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.406654 15143 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.408620 15085 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:29.409219 15085 ts_tablet_manager.cc:1403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.132s	user 0.022s	sys 0.033s
I20260709 13:04:29.409345 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:29.409366 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.410611 15044 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.413316 15150 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.413013 15085 raft_consensus.cc:359] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.413915 15085 raft_consensus.cc:385] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.414260 15085 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.415072 15085 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.417492 15085 ts_tablet_manager.cc:1434] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.001s
I20260709 13:04:29.418421 15085 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:29.420651 15084 tablet_bootstrap.cc:492] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.421113 15084 ts_tablet_manager.cc:1403] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.051s	user 0.008s	sys 0.024s
I20260709 13:04:29.422263 14892 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.429462 15044 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.429864 15085 tablet_bootstrap.cc:654] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.431118 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:29.432096 15111 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.432446 15091 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.432596 15111 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:29.433632 15111 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.438297 15084 raft_consensus.cc:359] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.439069 15084 raft_consensus.cc:385] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.438798 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.439400 15084 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.441277 15084 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.441444 14792 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.443565 15084 ts_tablet_manager.cc:1434] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.022s	user 0.014s	sys 0.000s
I20260709 13:04:29.444885 15084 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.451308 15084 tablet_bootstrap.cc:654] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.463846 15084 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.464313 15084 ts_tablet_manager.cc:1403] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.002s
I20260709 13:04:29.465178 15086 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.465620 15086 ts_tablet_manager.cc:1403] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.032s
I20260709 13:04:29.467160 15084 raft_consensus.cc:359] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.467854 15084 raft_consensus.cc:385] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.468134 15084 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.467964 15124 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.468952 15084 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.471210 15084 ts_tablet_manager.cc:1434] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:04:29.472169 15084 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.471709 14793 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:29.483878 15084 tablet_bootstrap.cc:654] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.494014 15084 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.494596 15084 ts_tablet_manager.cc:1403] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 13:04:29.497340 15143 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.500027 14892 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.508652 15143 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.509186 15143 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.511258 15143 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:29.512727 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:29.518728 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.519820 14893 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 1: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:04:29.520650 15084 raft_consensus.cc:359] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.521323 15084 raft_consensus.cc:385] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.521605 15084 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.521903 15007 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:29.522254 15084 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.523543 15106 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.524363 15084 ts_tablet_manager.cc:1434] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:04:29.525256 15084 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.530857 15086 raft_consensus.cc:359] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.531555 15086 raft_consensus.cc:385] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.531821 15086 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.532552 15111 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.532469 15086 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.533015 15111 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.535247 15111 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.537675 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.536731 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.539888 15044 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:29.540025 15143 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.544651 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:29.545425 15150 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.546010 15084 tablet_bootstrap.cc:654] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.552047 15143 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.552526 15143 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.552980 15085 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:29.554504 15106 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.556159 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.557020 15150 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.557651 15143 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:04:29.558321 15007 leader_election.cc:343] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.559114 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:29.560362 15008 leader_election.cc:343] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.560825 15085 ts_tablet_manager.cc:1403] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.143s	user 0.037s	sys 0.042s
I20260709 13:04:29.560859 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:29.562012 15143 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.562695 15143 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.562938 15086 ts_tablet_manager.cc:1434] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 13:04:29.563560 15085 raft_consensus.cc:359] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.564254 15085 raft_consensus.cc:385] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.564539 15085 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.565157 15085 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.567148 15086 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.576817 15084 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.577257 15084 ts_tablet_manager.cc:1403] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.002s
I20260709 13:04:29.582281 15086 tablet_bootstrap.cc:654] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.585243 15084 raft_consensus.cc:359] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.585924 15084 raft_consensus.cc:385] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.586174 15084 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.586935 15084 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.587838 15150 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.588336 15150 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.589315 15084 ts_tablet_manager.cc:1434] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:04:29.590387 15150 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.592023 15086 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.592628 15086 ts_tablet_manager.cc:1403] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.002s
I20260709 13:04:29.592705 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.593361 15044 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:29.593806 15084 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.598217 15086 raft_consensus.cc:359] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.598949 15086 raft_consensus.cc:385] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.599207 15086 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.599953 15086 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.600736 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:29.601490 15150 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.601824 15084 tablet_bootstrap.cc:654] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.601854 15150 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.602463 15150 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.602813 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:29.604360 14933 leader_election.cc:343] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.620090 15084 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.620720 15084 ts_tablet_manager.cc:1403] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.008s
I20260709 13:04:29.623142 15155 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.624091 15084 raft_consensus.cc:359] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.624990 15084 raft_consensus.cc:385] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.631736 15084 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.632408 15150 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.632647 15084 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.626538 15086 ts_tablet_manager.cc:1434] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 13:04:29.635329 15084 ts_tablet_manager.cc:1434] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:29.635569 15086 tablet_bootstrap.cc:492] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.635690 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:29.636508 15084 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
W20260709 13:04:29.638154 14933 leader_election.cc:343] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.641206 15143 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.641716 15143 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.645807 15143 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:29.646770 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.649972 15150 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.651561 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.652211 15043 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.655635 15086 tablet_bootstrap.cc:654] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.656625 15084 tablet_bootstrap.cc:654] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:29.662959 15007 leader_election.cc:343] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.665853 15106 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.667547 15106 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.668112 15106 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.668635 15150 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.675230 15155 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.677560 15106 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:29.677795 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:29.679487 15008 leader_election.cc:343] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.682516 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:29.684208 15007 leader_election.cc:343] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.684787 15007 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:29.686093 15106 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.700008 15150 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:29.714499 15084 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.714385 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:29.715122 15084 ts_tablet_manager.cc:1403] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.079s	user 0.026s	sys 0.008s
I20260709 13:04:29.715278 15086 tablet_bootstrap.cc:492] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.715744 15086 ts_tablet_manager.cc:1403] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.021s
W20260709 13:04:29.715690 15008 leader_election.cc:343] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.716197 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:29.717454 15106 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:29.718327 15086 raft_consensus.cc:359] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.719147 15086 raft_consensus.cc:385] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.719486 15086 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.702960 15043 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.720196 15084 raft_consensus.cc:359] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.720350 15086 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.721122 15084 raft_consensus.cc:385] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.721192 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.721499 15084 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.722563 15111 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.722775 15086 ts_tablet_manager.cc:1434] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:29.723155 15111 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:29.724100 15086 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.724146 15111 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.727376 15150 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.727897 15150 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.729910 15084 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.730630 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:29.732024 14933 leader_election.cc:343] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.732184 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.732775 15042 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:29.733287 15150 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.734912 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.736445 15150 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.737078 15150 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.734797 15084 ts_tablet_manager.cc:1434] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:04:29.737471 15150 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.737892 15086 tablet_bootstrap.cc:654] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.740118 15084 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:29.743788 15091 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:29.771453 14933 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:29.775557 15197 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.788158 15155 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:29.785233 15197 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.795984 15084 tablet_bootstrap.cc:654] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.798136 15085 ts_tablet_manager.cc:1434] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.237s	user 0.039s	sys 0.101s
I20260709 13:04:29.799105 15085 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:29.802096 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:29.802822 14970 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:29.805758 15150 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.808035 15124 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.828090 14859 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:29.832237 15124 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.832777 15124 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.833180 15124 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.850644 15086 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:29.840287 15197 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.840736 15150 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.852227 15086 ts_tablet_manager.cc:1403] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.128s	user 0.031s	sys 0.029s
I20260709 13:04:29.858075 15124 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.856348 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:29.858564 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.859196 15042 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:29.863701 14793 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:29.868932 14933 leader_election.cc:343] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.869904 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.870532 15042 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.880232 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:29.881075 15044 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.880978 15086 raft_consensus.cc:359] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.881696 15086 raft_consensus.cc:385] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:29.881556 15155 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:29.881979 15086 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:29.882850 15155 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.883272 15155 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.880731 15085 tablet_bootstrap.cc:654] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:29.887564 15086 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.886374 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:29.891465 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:29.886215 15155 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.898552 15084 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:29.899215 15084 ts_tablet_manager.cc:1403] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.020s
I20260709 13:04:29.892411 15040 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
W20260709 13:04:29.902997 14933 leader_election.cc:343] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:29.908185 15086 ts_tablet_manager.cc:1434] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.001s
I20260709 13:04:29.878655 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:29.909166 15086 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:29.909104 14970 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.896229 15124 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:29.915112 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.916857 15150 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:29.917248 15150 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:29.917567 15150 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:29.948503 15044 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:29.955504 15106 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:29.956115 15106 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:29.958989 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:29.964097 15124 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:29.964704 15042 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:29.964737 15124 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:30.005601 15084 raft_consensus.cc:359] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.007014 15084 raft_consensus.cc:385] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.008249 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:29.953858 15150 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.007318 15084 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.013584 15084 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.015370 15084 ts_tablet_manager.cc:1434] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.000s
I20260709 13:04:30.016223 15084 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.005385 15106 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.010623 15155 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.027016 15212 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:04:30.017843 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.028271 15150 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.025604 15155 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.029259 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.029474 15155 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.032224 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.032807 15043 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.018070 15124 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:30.036362 15213 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.094s	user 0.021s	sys 0.023s
W20260709 13:04:30.044135 15008 leader_election.cc:343] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:30.044708 15007 leader_election.cc:343] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.045279 15007 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.044677 15216 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.059384 15086 tablet_bootstrap.cc:654] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.057475 15216 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.063401 15216 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.064194 15043 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.063305 14970 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:30.066181 15219 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.058372 15217 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.066656 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:30.067736 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.072050 15084 tablet_bootstrap.cc:654] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.070077 15155 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:30.076241 15007 leader_election.cc:343] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.076395 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:30.083746 14933 leader_election.cc:343] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.084986 15219 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.079352 15155 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.086918 15155 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:30.089555 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45441.6us
I20260709 13:04:30.093206 14792 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.093145 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:30.114436 15008 leader_election.cc:343] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.125385 15106 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.132783 15106 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.135666 15106 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.124394 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.136958 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:30.138340 15007 leader_election.cc:343] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.141906 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.136507 15106 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:30.143236 15008 leader_election.cc:343] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.143668 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.144510 15084 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.144945 15084 ts_tablet_manager.cc:1403] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.129s	user 0.008s	sys 0.004s
I20260709 13:04:30.145134 15085 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.145574 15085 ts_tablet_manager.cc:1403] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.347s	user 0.034s	sys 0.008s
I20260709 13:04:30.147459 15106 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.147828 15084 raft_consensus.cc:359] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.149103 15084 raft_consensus.cc:385] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.149516 15084 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.150847 15085 raft_consensus.cc:359] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.151240 15086 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.151624 15085 raft_consensus.cc:385] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.152012 15085 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.151835 15084 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.152701 15085 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.154342 15085 ts_tablet_manager.cc:1434] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 13:04:30.155125 15085 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.154291 14793 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.156062 14793 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.159346 15084 ts_tablet_manager.cc:1434] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:04:30.159770 15086 ts_tablet_manager.cc:1403] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.251s	user 0.023s	sys 0.025s
I20260709 13:04:30.160679 15085 tablet_bootstrap.cc:654] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.181746 15084 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.183012 15086 raft_consensus.cc:359] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.184109 15086 raft_consensus.cc:385] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.184541 15086 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.185424 15086 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.188123 15086 ts_tablet_manager.cc:1434] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.028s	user 0.014s	sys 0.009s
I20260709 13:04:30.189378 15086 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.193602 15124 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.194078 15124 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.197314 15086 tablet_bootstrap.cc:654] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.199934 15124 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.202448 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.203845 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.207729 14859 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:30.212299 15124 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.216065 15084 tablet_bootstrap.cc:654] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.221050 15085 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.221480 15085 ts_tablet_manager.cc:1403] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.066s	user 0.030s	sys 0.026s
I20260709 13:04:30.221664 15086 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.221732 15084 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.222153 15086 ts_tablet_manager.cc:1403] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.006s
I20260709 13:04:30.222430 15084 ts_tablet_manager.cc:1403] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:04:30.224193 15085 raft_consensus.cc:359] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.224885 15085 raft_consensus.cc:385] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.225159 15085 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.225308 15086 raft_consensus.cc:359] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.225243 15084 raft_consensus.cc:359] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.226002 15086 raft_consensus.cc:385] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.226194 15084 raft_consensus.cc:385] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.225896 15085 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.226354 15086 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.226636 15084 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.227097 15086 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.227362 15084 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.229207 15086 ts_tablet_manager.cc:1434] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:04:30.229281 15084 ts_tablet_manager.cc:1434] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:30.230068 15086 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.230209 15084 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.231981 15085 ts_tablet_manager.cc:1434] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:04:30.232843 15085 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.233584 15219 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.236101 15086 tablet_bootstrap.cc:654] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.236857 15084 tablet_bootstrap.cc:654] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.240835 15085 tablet_bootstrap.cc:654] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.245333 15106 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.246016 15106 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.248829 15106 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.249368 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.249840 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:30.250789 15007 leader_election.cc:343] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:30.251259 15008 leader_election.cc:343] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.251695 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.252467 15084 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.252763 15106 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.252940 15084 ts_tablet_manager.cc:1403] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:04:30.255867 15084 raft_consensus.cc:359] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.256553 15085 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.256594 15084 raft_consensus.cc:385] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.257058 15084 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.257071 15085 ts_tablet_manager.cc:1403] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.008s
I20260709 13:04:30.257984 15084 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.260514 15085 raft_consensus.cc:359] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.261126 15085 raft_consensus.cc:385] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.261402 15085 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.261399 14893 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.262518 15086 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.262250 15085 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.262969 15084 ts_tablet_manager.cc:1434] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:30.263499 15086 ts_tablet_manager.cc:1403] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.018s
I20260709 13:04:30.264074 15084 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.265991 15086 raft_consensus.cc:359] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.266662 15086 raft_consensus.cc:385] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.267024 15086 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.267763 15086 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.269122 15085 ts_tablet_manager.cc:1434] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:04:30.269814 15086 ts_tablet_manager.cc:1434] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:30.269985 15085 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.270738 15086 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.275548 15084 tablet_bootstrap.cc:654] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.277058 15086 tablet_bootstrap.cc:654] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.280470 15219 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.282493 15085 tablet_bootstrap.cc:654] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.298756 15106 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.299293 15106 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.301188 15084 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.301265 15106 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.301899 15084 ts_tablet_manager.cc:1403] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260709 13:04:30.303328 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.303095 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:30.304661 15008 leader_election.cc:343] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:30.305106 15007 leader_election.cc:343] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.305601 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.306892 15106 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.305131 15084 raft_consensus.cc:359] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.316288 15084 raft_consensus.cc:385] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.316661 15084 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.317531 15084 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.324528 15084 ts_tablet_manager.cc:1434] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 13:04:30.325781 15084 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.326359 15085 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.326823 15085 ts_tablet_manager.cc:1403] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.057s	user 0.012s	sys 0.001s
I20260709 13:04:30.329295 15085 raft_consensus.cc:359] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.329934 15085 raft_consensus.cc:385] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.330190 15085 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.330755 15085 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.333813 15085 ts_tablet_manager.cc:1434] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.006s
I20260709 13:04:30.335880 15086 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.336313 15086 ts_tablet_manager.cc:1403] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.066s	user 0.027s	sys 0.034s
I20260709 13:04:30.338779 15086 raft_consensus.cc:359] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.339460 15086 raft_consensus.cc:385] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.339744 15086 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.340377 15086 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.342372 15086 ts_tablet_manager.cc:1434] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:30.343171 15085 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.345758 14891 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.349362 15085 tablet_bootstrap.cc:654] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.350942 15086 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.351344 15084 tablet_bootstrap.cc:654] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:30.357354 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:30.359014 15086 tablet_bootstrap.cc:654] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.359822 15085 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.359866 15084 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.360437 15085 ts_tablet_manager.cc:1403] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:04:30.360440 15084 ts_tablet_manager.cc:1403] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.003s
I20260709 13:04:30.363121 15085 raft_consensus.cc:359] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.363796 15085 raft_consensus.cc:385] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.364207 15085 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.363818 15084 raft_consensus.cc:359] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.364739 15084 raft_consensus.cc:385] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.365073 15084 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.364881 15085 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.367375 15085 ts_tablet_manager.cc:1434] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:30.368239 15085 tablet_bootstrap.cc:492] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.365928 15084 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.368762 15106 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.369153 15106 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.371068 15106 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.372115 15221 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.372723 15221 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.372915 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.373809 14970 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:30.374838 15085 tablet_bootstrap.cc:654] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.376304 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.376451 15221 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.376952 14892 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.377183 15106 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.377782 15106 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.375098 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:30.379505 15216 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.379958 15216 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.380381 15216 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.381240 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:30.383030 15007 leader_election.cc:343] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.384351 15197 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.384656 14933 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:30.384999 15197 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.386127 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.386929 15041 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.389199 15155 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.389688 15155 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.390134 15155 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.394049 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.399684 15197 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.399818 15216 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.400700 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.401750 15041 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:04:30.403528 14861 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:30.406440 15084 ts_tablet_manager.cc:1434] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:04:30.409314 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:30.425410 15007 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.414767 15197 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.429231 15217 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.429901 15217 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.434567 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.436661 15217 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.415320 15106 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.418676 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.416126 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.411952 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:30.436780 15221 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.440222 14970 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.440264 15221 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:30.437600 15008 leader_election.cc:343] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:30.444010 15008 leader_election.cc:343] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.444592 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.445606 15106 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.446767 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.447670 14894 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.449108 14933 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:30.451294 15219 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.451752 15219 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.452093 15219 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.453692 15216 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.456126 15150 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.463721 15150 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.466305 15221 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.466430 15150 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.467048 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.468545 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.469334 15043 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
W20260709 13:04:30.469871 14933 leader_election.cc:343] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.469296 15198 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.470607 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.471426 15042 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.471289 15219 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.473332 15219 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.458052 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.475857 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.476421 14892 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.477054 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.477759 15043 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.418427 15155 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.460398 15086 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.478682 15086 ts_tablet_manager.cc:1403] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.128s	user 0.043s	sys 0.060s
I20260709 13:04:30.480823 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.482430 15086 raft_consensus.cc:359] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.484499 15155 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.485211 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.488839 15086 raft_consensus.cc:385] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:30.459515 15007 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.463129 15084 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.489368 15086 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.490603 15086 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.489259 14894 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.493343 15086 ts_tablet_manager.cc:1434] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:04:30.494498 15086 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.498826 14894 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.500073 14892 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
W20260709 13:04:30.500414 15007 leader_election.cc:343] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.501467 15155 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.511732 15155 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.506762 15086 tablet_bootstrap.cc:654] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.508059 15043 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.508790 15197 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.514816 14933 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:30.512125 15155 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.514935 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.518864 15150 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.519909 15221 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.520387 15221 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.522792 15221 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.523315 15085 tablet_bootstrap.cc:492] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.523834 15085 ts_tablet_manager.cc:1403] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.156s	user 0.053s	sys 0.076s
I20260709 13:04:30.515581 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.524834 15150 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.526213 15216 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.525969 15150 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.528023 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:30.528425 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.528771 15221 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.518450 15041 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.530997 15221 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.531829 15221 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.532292 15219 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.535179 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.529050 15043 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.536577 15155 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.561666 15155 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.581434 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.582278 15044 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.541978 14970 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:30.595939 15085 raft_consensus.cc:359] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.596455 15085 raft_consensus.cc:385] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.596669 15085 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.598668 15085 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.600575 15086 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.601085 15086 ts_tablet_manager.cc:1403] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.107s	user 0.036s	sys 0.023s
W20260709 13:04:30.597133 14933 leader_election.cc:343] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.603437 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.604132 15111 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:30.604616 14933 leader_election.cc:343] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.605890 14892 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.591048 15041 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.606449 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.607733 15216 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.608255 15216 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:30.609143 15216 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.613243 15085 ts_tablet_manager.cc:1434] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.000s
I20260709 13:04:30.613191 15086 raft_consensus.cc:359] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.613988 15086 raft_consensus.cc:385] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.614264 15086 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.614275 15085 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.614900 15086 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.622285 15084 tablet_bootstrap.cc:654] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.631033 15086 ts_tablet_manager.cc:1434] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.003s
I20260709 13:04:30.632045 15086 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.635684 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.637334 15155 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.637841 15155 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.638101 15044 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.638190 15155 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.638839 15111 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.651746 15085 tablet_bootstrap.cc:654] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.658380 14793 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:30.629009 14789 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.660418 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.663398 15219 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.665598 15219 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.666392 15219 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.667066 15086 tablet_bootstrap.cc:654] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.667906 15198 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:04:30.667006 15155 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.683818 15084 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.684453 15084 ts_tablet_manager.cc:1403] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.023s
I20260709 13:04:30.687990 15111 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:30.691308 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.693193 15084 raft_consensus.cc:359] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.682241 15155 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.694123 15084 raft_consensus.cc:385] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.694496 15084 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.696460 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.697261 15044 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:30.701560 14933 leader_election.cc:343] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.695355 15084 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.714167 15084 ts_tablet_manager.cc:1434] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:04:30.715116 15084 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.730340 15044 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.733112 15086 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.733578 15086 ts_tablet_manager.cc:1403] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.102s	user 0.009s	sys 0.005s
I20260709 13:04:30.739324 15085 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.739820 15085 ts_tablet_manager.cc:1403] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.126s	user 0.019s	sys 0.020s
I20260709 13:04:30.741722 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.742313 15085 raft_consensus.cc:359] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.743098 15085 raft_consensus.cc:385] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.743352 15085 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.743798 15111 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.744287 15111 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.744207 15085 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.745167 15111 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.746559 15085 ts_tablet_manager.cc:1434] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:30.747529 15085 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.750713 15084 tablet_bootstrap.cc:654] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.755504 15086 raft_consensus.cc:359] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.756479 15086 raft_consensus.cc:385] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.756922 15086 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.757828 15086 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.759070 15085 tablet_bootstrap.cc:654] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.768306 14792 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.770654 15086 ts_tablet_manager.cc:1434] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.003s
I20260709 13:04:30.771970 15086 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:30.773159 15085 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.773610 15085 ts_tablet_manager.cc:1403] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.007s
I20260709 13:04:30.774868 15258 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.775283 15084 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.775821 15084 ts_tablet_manager.cc:1403] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.061s	user 0.013s	sys 0.000s
I20260709 13:04:30.775365 15258 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.776204 15085 raft_consensus.cc:359] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.776855 15085 raft_consensus.cc:385] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.776834 15092 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.777433 15092 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.778290 15258 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.778759 15086 tablet_bootstrap.cc:654] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.778321 15084 raft_consensus.cc:359] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.779165 15084 raft_consensus.cc:385] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.779340 15092 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.779965 15084 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.780395 15085 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.780869 15084 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.781162 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.781195 15085 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:30.782605 14933 leader_election.cc:343] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.783576 15085 ts_tablet_manager.cc:1434] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:04:30.783430 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.784425 15085 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
W20260709 13:04:30.784709 14933 leader_election.cc:343] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.783277 15084 ts_tablet_manager.cc:1434] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:30.786165 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.786511 15084 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.786748 15043 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.788906 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.789594 15043 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.790712 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.791203 15085 tablet_bootstrap.cc:654] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.791711 15092 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.792094 15092 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.792474 15092 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.794986 15106 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.795475 15106 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.797549 15106 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:30.800199 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.800905 15084 tablet_bootstrap.cc:654] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:30.801483 15007 leader_election.cc:343] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.800199 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:30.803385 15008 leader_election.cc:343] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.803843 15008 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:30.805248 15216 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.770509 14792 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.808651 15198 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.809417 15198 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.799754 15092 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.808072 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.811455 15198 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.811748 15219 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.812158 15219 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.812506 15219 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.814177 15085 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.816120 15085 ts_tablet_manager.cc:1403] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.005s
I20260709 13:04:30.818760 15085 raft_consensus.cc:359] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.819377 15085 raft_consensus.cc:385] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.819671 15085 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.819727 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:30.820766 14970 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:30.820456 15085 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.820456 15219 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.823457 15085 ts_tablet_manager.cc:1434] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:04:30.824373 15085 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.824529 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.829959 15085 tablet_bootstrap.cc:654] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.830078 15219 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.835376 15086 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:30.831645 15092 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.835970 15086 ts_tablet_manager.cc:1403] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.008s
I20260709 13:04:30.841604 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:30.846248 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.846333 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:30.844286 15197 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.847893 15086 raft_consensus.cc:359] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.848416 15086 raft_consensus.cc:385] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.848639 15086 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.850744 15041 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.857846 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.861940 15086 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.860031 15043 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.867493 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.869129 15197 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:30.871572 15086 ts_tablet_manager.cc:1434] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.035s	user 0.004s	sys 0.002s
I20260709 13:04:30.872838 15086 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
W20260709 13:04:30.869959 14933 leader_election.cc:343] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:30.876852 14933 leader_election.cc:343] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.864773 15041 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.880779 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.886236 15219 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.886353 15043 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:30.886723 15219 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.887585 15219 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.891831 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:30.892606 15258 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:30.893057 15258 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:30.893818 15258 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.898396 15084 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:30.898867 15084 ts_tablet_manager.cc:1403] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.113s	user 0.034s	sys 0.013s
I20260709 13:04:30.901871 15084 raft_consensus.cc:359] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.902333 15084 raft_consensus.cc:385] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.902541 15084 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.903119 15084 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.905922 15084 ts_tablet_manager.cc:1434] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:30.912094 14789 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:30.917685 15085 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:30.918357 15085 ts_tablet_manager.cc:1403] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.021s
I20260709 13:04:30.918550 15221 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:30.920087 15084 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:30.921986 15085 raft_consensus.cc:359] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.922824 15085 raft_consensus.cc:385] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:30.923532 15085 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:30.924358 15085 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.936936 15085 ts_tablet_manager.cc:1434] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:04:30.938114 15085 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:30.942034 15086 tablet_bootstrap.cc:654] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:30.939320 15219 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.950192 15219 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.950201 15258 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:30.957347 15221 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:30.958797 15258 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.958153 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.960866 14894 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.961952 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:30.962642 15041 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:30.963641 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:30.964607 15221 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:30.955926 15219 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:30.964975 15221 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:30.965385 15221 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.967481 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:30.969056 15085 tablet_bootstrap.cc:654] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:30.969177 14933 leader_election.cc:343] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:30.973623 15221 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:30.977046 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:30.977758 14894 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:30.994643 15258 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.001549 15084 tablet_bootstrap.cc:654] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.003032 15197 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.003932 15221 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.003629 15197 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.004189 14894 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.002799 14789 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.007339 15197 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.007579 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.007090 14789 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.008375 15041 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:04:31.009107 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:04:31.010078 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46504.2us
I20260709 13:04:31.009876 15221 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.014554 15221 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.015859 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.015628 15221 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.016216 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.015869 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.016909 15041 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.017027 15044 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.019659 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:31.022114 15198 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.031970 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.032996 15219 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.033412 15219 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.033830 15219 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.060575 15217 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.061131 15217 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.063838 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.064055 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:31.065250 15007 leader_election.cc:343] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.065377 15217 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:04:31.067158 15008 leader_election.cc:343] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.069566 15198 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.071017 15044 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.071041 15008 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.073099 15217 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.076967 15086 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.077450 15086 ts_tablet_manager.cc:1403] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.205s	user 0.008s	sys 0.014s
I20260709 13:04:31.079514 15219 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.081851 15219 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.082345 15219 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.084028 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.084054 15084 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.085278 15084 ts_tablet_manager.cc:1403] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.165s	user 0.018s	sys 0.033s
I20260709 13:04:31.086306 15086 raft_consensus.cc:359] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.086948 15086 raft_consensus.cc:385] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:31.087030 14933 leader_election.cc:343] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.087594 15150 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.088292 15084 raft_consensus.cc:359] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.088999 15084 raft_consensus.cc:385] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.089269 15084 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.089915 15084 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.091873 15084 ts_tablet_manager.cc:1434] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:31.087319 15086 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.092793 15084 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.093245 15086 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.098317 15084 tablet_bootstrap.cc:654] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.106675 15086 ts_tablet_manager.cc:1434] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 13:04:31.108325 15198 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.109009 15198 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.113304 15198 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.113523 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.114460 15043 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:04:31.113467 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.115218 15044 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.117076 14789 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.122876 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.124727 15086 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.127480 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:31.130273 15085 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.130717 15085 ts_tablet_manager.cc:1403] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.193s	user 0.023s	sys 0.032s
I20260709 13:04:31.131589 15197 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.134377 15150 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.151394 15197 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.151582 15085 raft_consensus.cc:359] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.152736 15085 raft_consensus.cc:385] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.153041 15085 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.153905 15085 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.157790 15086 tablet_bootstrap.cc:654] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.158731 15150 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.160269 15044 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.161640 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.162138 15085 ts_tablet_manager.cc:1434] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:04:31.162384 15155 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.163146 15085 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.163749 15150 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.164249 15150 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.165079 15150 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.170351 15085 tablet_bootstrap.cc:654] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.182741 15084 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.183198 15084 ts_tablet_manager.cc:1403] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.091s	user 0.019s	sys 0.023s
I20260709 13:04:31.185892 15217 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.193856 15084 raft_consensus.cc:359] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.194753 15084 raft_consensus.cc:385] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.203397 15086 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.205144 15086 ts_tablet_manager.cc:1403] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.015s
I20260709 13:04:31.210137 15258 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.215544 14792 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.195089 15084 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.217808 15084 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.220695 15217 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:31.219159 15086 raft_consensus.cc:359] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.223126 15086 raft_consensus.cc:385] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.224566 15086 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.225320 15086 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.226698 15085 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.227217 15085 ts_tablet_manager.cc:1403] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.064s	user 0.032s	sys 0.024s
I20260709 13:04:31.228504 15084 ts_tablet_manager.cc:1434] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 13:04:31.229511 15084 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.230558 15085 raft_consensus.cc:359] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.231834 15086 ts_tablet_manager.cc:1434] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 13:04:31.232564 15085 raft_consensus.cc:385] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.232918 15085 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.233677 15085 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.232789 15086 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.236155 15085 ts_tablet_manager.cc:1434] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:04:31.237118 15085 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.239660 15084 tablet_bootstrap.cc:654] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.243643 15085 tablet_bootstrap.cc:654] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.247170 15086 tablet_bootstrap.cc:654] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.252096 15084 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.252585 15084 ts_tablet_manager.cc:1403] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.005s
I20260709 13:04:31.255100 15084 raft_consensus.cc:359] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.255898 15084 raft_consensus.cc:385] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.256547 15084 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.258594 15085 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.259100 15085 ts_tablet_manager.cc:1403] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.022s	user 0.004s	sys 0.010s
I20260709 13:04:31.258081 15084 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.262408 15084 ts_tablet_manager.cc:1434] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:04:31.263111 15216 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.263332 15084 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.263701 15216 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.266360 15216 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:31.269098 15085 raft_consensus.cc:359] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.269824 15085 raft_consensus.cc:385] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.270118 15085 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.270356 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.271282 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:31.272178 15008 leader_election.cc:343] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.272135 15085 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.278172 15084 tablet_bootstrap.cc:654] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:31.280153 15007 leader_election.cc:343] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.274596 15085 ts_tablet_manager.cc:1434] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:04:31.280777 15007 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.281770 15085 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.282490 15217 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.290366 15085 tablet_bootstrap.cc:654] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.300388 15219 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.301194 15219 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.304206 15219 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.305181 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.306244 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.309530 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.310346 15042 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.312853 15155 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.313467 15155 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.316475 15155 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.319461 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.320374 15042 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.310336 15085 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.322777 15085 ts_tablet_manager.cc:1403] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.006s
I20260709 13:04:31.311615 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:31.328902 15085 raft_consensus.cc:359] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.329993 15155 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.330623 15155 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.331121 15155 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.335233 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.336133 14893 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
W20260709 13:04:31.339327 14933 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:31.325335 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:31.342324 15150 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.342856 15150 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.343293 15150 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.356307 15086 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.356868 15086 ts_tablet_manager.cc:1403] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.124s	user 0.037s	sys 0.065s
I20260709 13:04:31.356768 15150 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.360530 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.361122 14893 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.365293 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.366220 15042 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.370309 15086 raft_consensus.cc:359] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.329981 15085 raft_consensus.cc:385] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.371891 15124 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.375073 15086 raft_consensus.cc:385] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.375217 15085 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.396976 15086 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.396912 15124 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.397966 15086 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.398566 15258 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.399142 15124 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.395306 14893 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.400445 15086 ts_tablet_manager.cc:1434] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.043s	user 0.013s	sys 0.003s
I20260709 13:04:31.363284 15155 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.401587 15086 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.402215 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.402590 15155 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.359350 15150 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:04:31.403729 14859 leader_election.cc:343] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.404771 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.405383 15041 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.407706 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.408300 15043 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:31.409487 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:31.410565 15124 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:04:31.393219 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:31.410917 15124 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.411320 15124 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.412365 15086 tablet_bootstrap.cc:654] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.415877 15041 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.420476 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.422103 14893 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.429276 15085 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.430369 15084 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.430524 15042 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.430866 15084 ts_tablet_manager.cc:1403] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.168s	user 0.035s	sys 0.077s
I20260709 13:04:31.424218 15124 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.432996 14893 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.433961 15084 raft_consensus.cc:359] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.434648 15084 raft_consensus.cc:385] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.434934 15084 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.435859 15084 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.439172 15084 ts_tablet_manager.cc:1434] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:04:31.440387 15084 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.440572 15085 ts_tablet_manager.cc:1434] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260709 13:04:31.441485 15085 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.441742 15086 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.442147 15086 ts_tablet_manager.cc:1403] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.004s
I20260709 13:04:31.422163 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:31.444610 15086 raft_consensus.cc:359] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.444933 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:31.445298 15086 raft_consensus.cc:385] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.445580 15086 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.445780 15150 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.446250 15150 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.446188 15086 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.447114 15150 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.448562 15084 tablet_bootstrap.cc:654] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.448681 15086 ts_tablet_manager.cc:1434] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 13:04:31.451848 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:31.452112 15086 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
W20260709 13:04:31.453012 14859 leader_election.cc:343] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.453459 15155 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.453984 15155 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.454730 15155 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.458925 15124 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.459811 15106 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.460258 15106 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.458915 15086 tablet_bootstrap.cc:654] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.462384 15106 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:04:31.462530 14933 consensus_peers.cc:597] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:31.464613 15085 tablet_bootstrap.cc:654] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.464942 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:31.469242 15007 leader_election.cc:343] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.476595 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.477190 15041 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.481106 15084 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.481604 15084 ts_tablet_manager.cc:1403] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.004s
I20260709 13:04:31.482767 15150 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.483245 15150 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.484217 15084 raft_consensus.cc:359] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.484858 15084 raft_consensus.cc:385] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.485126 15084 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.485281 15150 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.487377 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.489095 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.489261 15041 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:31.489681 15043 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.490629 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:04:31.491228 14933 leader_election.cc:343] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.491395 15124 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.491910 15124 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:31.492687 15124 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.492679 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.495376 15258 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.495733 15258 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.496047 15258 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.487227 15084 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.497536 15084 ts_tablet_manager.cc:1434] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:31.498371 15084 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.489265 15086 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.502707 15086 ts_tablet_manager.cc:1403] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.005s
I20260709 13:04:31.504783 15084 tablet_bootstrap.cc:654] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.509698 15086 raft_consensus.cc:359] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.510650 15086 raft_consensus.cc:385] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.510993 15086 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.516726 15084 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.517205 15084 ts_tablet_manager.cc:1403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.006s
I20260709 13:04:31.519760 15084 raft_consensus.cc:359] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.520412 15084 raft_consensus.cc:385] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.520673 15084 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.521289 15084 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.520885 14792 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.522185 15086 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.524432 15086 ts_tablet_manager.cc:1434] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:04:31.525328 15086 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.528071 14789 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.528955 15085 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.529997 15085 ts_tablet_manager.cc:1403] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.089s	user 0.008s	sys 0.030s
I20260709 13:04:31.531147 15086 tablet_bootstrap.cc:654] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.530614 14789 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.532812 15085 raft_consensus.cc:359] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.533519 15085 raft_consensus.cc:385] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.533871 15085 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.534698 15085 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.536072 15216 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.536545 15216 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.538113 15085 ts_tablet_manager.cc:1434] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:04:31.539280 15085 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.539155 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:31.540661 15007 leader_election.cc:343] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.542017 15216 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:31.542586 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.543284 15086 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.543802 15086 ts_tablet_manager.cc:1403] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.009s
W20260709 13:04:31.543779 15008 leader_election.cc:343] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.544337 15008 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.545666 15216 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.546658 15085 tablet_bootstrap.cc:654] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.546885 15111 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.546993 15086 raft_consensus.cc:359] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.547744 15086 raft_consensus.cc:385] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.548043 15086 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.548867 15086 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.551275 15086 ts_tablet_manager.cc:1434] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:31.552495 15086 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.552912 15258 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.554880 15258 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.487809 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.558632 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.559309 14967 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 1: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:04:31.560137 14933 leader_election.cc:343] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.560554 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.561605 15106 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.561801 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.562922 15086 tablet_bootstrap.cc:654] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.567497 15085 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.568167 15085 ts_tablet_manager.cc:1403] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.013s
I20260709 13:04:31.567345 15106 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.571702 15085 raft_consensus.cc:359] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.572647 15085 raft_consensus.cc:385] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.573005 15085 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.573875 15085 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.574625 15042 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.575843 15086 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.576293 15086 ts_tablet_manager.cc:1403] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.007s
I20260709 13:04:31.576359 15085 ts_tablet_manager.cc:1434] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:04:31.577144 15085 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.578585 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.579123 15084 ts_tablet_manager.cc:1434] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.062s	user 0.006s	sys 0.002s
I20260709 13:04:31.579571 15258 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.579711 15086 raft_consensus.cc:359] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.580482 15086 raft_consensus.cc:385] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.580261 15258 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.580806 15086 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.581897 15086 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.583284 15085 tablet_bootstrap.cc:654] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.584081 15086 ts_tablet_manager.cc:1434] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:31.581828 15258 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.585042 15086 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.580773 15084 tablet_bootstrap.cc:492] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.591750 15086 tablet_bootstrap.cc:654] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.599124 15111 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.610828 15086 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.611275 15086 ts_tablet_manager.cc:1403] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 13:04:31.613754 15086 raft_consensus.cc:359] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.614418 15086 raft_consensus.cc:385] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.614677 15086 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.615312 15086 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.616102 15085 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.616883 15085 ts_tablet_manager.cc:1403] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.006s
I20260709 13:04:31.617087 15086 ts_tablet_manager.cc:1434] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:31.617985 15150 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.620527 15086 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.627938 15086 tablet_bootstrap.cc:654] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.632721 15085 raft_consensus.cc:359] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.633715 15085 raft_consensus.cc:385] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.634054 15085 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.640425 15085 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.645392 15084 tablet_bootstrap.cc:654] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.648770 15106 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.649295 15106 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.650849 15085 ts_tablet_manager.cc:1434] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:04:31.651364 15106 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:31.652544 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.653033 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:31.654448 15008 leader_election.cc:343] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:31.655351 15007 leader_election.cc:343] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.655954 15007 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.657109 15085 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.657321 15106 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.666576 15085 tablet_bootstrap.cc:654] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.670513 15111 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.671013 15111 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.673157 15111 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.674378 15086 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.674527 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.674822 15086 ts_tablet_manager.cc:1403] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.057s	user 0.017s	sys 0.020s
I20260709 13:04:31.675143 14893 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.676525 14933 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:31.677328 15086 raft_consensus.cc:359] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.677734 15219 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.677994 15086 raft_consensus.cc:385] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.678103 15219 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.678290 15086 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.678447 15219 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.678923 15086 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.680928 15086 ts_tablet_manager.cc:1434] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:31.681778 15086 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.681610 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.682269 15042 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.688076 15219 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.690387 15111 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.691192 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.691778 14893 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.711840 15106 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.712189 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.712810 15042 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.712519 15106 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.715716 15086 tablet_bootstrap.cc:654] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.717084 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.719292 15042 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.719923 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.720391 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:31.721256 15155 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:31.721561 15008 leader_election.cc:343] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.721717 15155 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.722985 15155 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.724515 15216 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.725147 15216 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:31.726815 15007 leader_election.cc:343] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.727427 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.728065 15216 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:31.728206 15217 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.729316 15086 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.729808 15086 ts_tablet_manager.cc:1403] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 13:04:31.730201 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:31.731561 15008 leader_election.cc:343] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.729312 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.732653 15086 raft_consensus.cc:359] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.733353 15086 raft_consensus.cc:385] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:04:31.735076 15007 leader_election.cc:343] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.733645 15086 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.735662 14893 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.723052 15219 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.736706 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:31.737854 15258 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.724376 15106 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:31.737985 15217 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.738327 15258 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.741331 15258 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.741539 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:31.742406 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.743076 15042 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
W20260709 13:04:31.743192 14933 leader_election.cc:343] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.737255 15086 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.744303 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.745368 15258 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.745528 15085 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.745771 15086 ts_tablet_manager.cc:1434] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:31.745829 15258 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.746099 15085 ts_tablet_manager.cc:1403] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.006s
I20260709 13:04:31.746459 15258 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.746661 15086 tablet_bootstrap.cc:492] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.750458 15085 raft_consensus.cc:359] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.751065 15085 raft_consensus.cc:385] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.751319 15085 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.751972 15085 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.754930 15258 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.756898 14793 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.760882 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.761902 15044 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.762955 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:31.763573 14933 consensus_peers.cc:597] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:31.764400 14933 leader_election.cc:343] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.764937 15258 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.769608 15084 tablet_bootstrap.cc:492] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:31.770103 15084 ts_tablet_manager.cc:1403] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.190s	user 0.025s	sys 0.022s
I20260709 13:04:31.779608 15086 tablet_bootstrap.cc:654] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.780123 15085 ts_tablet_manager.cc:1434] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.034s	user 0.012s	sys 0.000s
I20260709 13:04:31.781126 15085 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.783612 15044 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.785008 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.786154 15258 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.786836 15258 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.787701 15258 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.788304 15085 tablet_bootstrap.cc:654] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.790848 15086 tablet_bootstrap.cc:492] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.791455 15086 ts_tablet_manager.cc:1403] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.012s
I20260709 13:04:31.796168 15085 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.796504 15085 ts_tablet_manager.cc:1403] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:04:31.798524 15084 raft_consensus.cc:359] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.798638 15086 raft_consensus.cc:359] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.799297 15086 raft_consensus.cc:385] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.799577 15086 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.799960 15085 raft_consensus.cc:359] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.800215 15086 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.800625 15085 raft_consensus.cc:385] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.800894 15085 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.801509 15085 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.802784 15086 ts_tablet_manager.cc:1434] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:31.803442 15085 ts_tablet_manager.cc:1434] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.001s
I20260709 13:04:31.803661 15086 tablet_bootstrap.cc:492] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.804253 15085 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.810155 15086 tablet_bootstrap.cc:654] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.810551 15155 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.810731 15085 tablet_bootstrap.cc:654] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.811043 15155 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.813038 15155 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.814563 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.815178 15044 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.817009 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:31.818574 14933 leader_election.cc:343] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.819278 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.820351 15155 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.820782 15155 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.821180 15155 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.827397 15084 raft_consensus.cc:385] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.827757 15084 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:31.828118 15155 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.828543 15084 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.830464 15124 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.830916 15124 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.832894 15124 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.833014 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.833570 15044 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.834563 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.835186 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.835150 15042 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:31.836436 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.836589 15111 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.836822 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:31.837015 14967 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:31.837656 15124 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.837218 15111 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.838035 15124 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.838410 15124 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:31.840210 14933 leader_election.cc:343] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.840850 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:31.842510 14933 leader_election.cc:343] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.843670 15111 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.845155 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:04:31.846381 14936 leader_election.cc:343] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.846827 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:31.847512 15219 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.855589 15219 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.855999 15219 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.858461 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:31.859720 14933 leader_election.cc:343] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.860823 15219 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.863546 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.864197 15042 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:31.868431 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.869314 15219 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.869735 15219 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.870133 15219 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.871480 15198 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.845125 15124 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.872149 15198 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.874716 15198 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.874940 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:31.875564 14967 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.876600 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.867311 15044 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.877420 15043 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:31.878172 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.878963 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:31.878962 15111 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.880472 15111 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.880883 15197 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:31.881407 15197 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:31.881881 15197 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.881572 15111 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.882328 14967 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:31.883284 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.883841 15042 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.885386 14859 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:31.887814 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.890753 14967 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:31.891460 15124 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.891623 15198 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.892292 15198 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:31.893414 15198 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.901912 15197 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.903358 15042 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:31.904793 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:31.871709 15084 ts_tablet_manager.cc:1434] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.101s	user 0.008s	sys 0.000s
I20260709 13:04:31.905732 14967 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.906291 15084 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:31.910614 15219 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.905414 15085 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:31.911795 15085 ts_tablet_manager.cc:1403] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.108s	user 0.034s	sys 0.058s
I20260709 13:04:31.913108 15219 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.914270 15085 raft_consensus.cc:359] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.914966 15085 raft_consensus.cc:385] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.914525 15155 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.917122 15086 tablet_bootstrap.cc:492] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:31.917541 15086 ts_tablet_manager.cc:1403] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.114s	user 0.022s	sys 0.021s
I20260709 13:04:31.915251 15085 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
W20260709 13:04:31.931851 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45324.6us
I20260709 13:04:31.935115 15084 tablet_bootstrap.cc:654] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.938148 15085 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.929438 14967 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:31.937798 15197 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.946035 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:31.943429 15327 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:31.949560 15155 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.949612 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.950270 15044 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.950500 14793 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.952555 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:31.954217 15326 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.954829 15326 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:31.956139 15326 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.957499 15044 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:31.960999 15086 raft_consensus.cc:359] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.962244 15086 raft_consensus.cc:385] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:31.961764 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:31.963421 15086 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
W20260709 13:04:31.964778 14933 leader_election.cc:343] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:31.964102 15042 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:31.965922 15086 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.968952 15111 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:31.970075 15086 ts_tablet_manager.cc:1434] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.002s
I20260709 13:04:31.970950 15086 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:31.963320 15327 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.973296 15085 ts_tablet_manager.cc:1434] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.061s	user 0.016s	sys 0.008s
I20260709 13:04:31.974241 15085 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:31.974118 14789 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.977612 15042 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:31.978786 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:31.979512 15258 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:31.979557 15327 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:31.980221 15258 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:31.981073 15258 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:31.982918 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:31.985860 15085 tablet_bootstrap.cc:654] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:31.986107 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:31.978976 14789 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:31.987519 14859 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:31.988765 15326 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:31.990626 15111 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:31.993932 14793 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.001024 15155 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.001662 15155 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.005677 15155 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.005872 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.006630 15041 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:32.008011 15086 tablet_bootstrap.cc:654] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.011015 15326 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.033357 14967 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.040457 15326 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.054569 15086 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:32.055084 15086 ts_tablet_manager.cc:1403] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.009s
I20260709 13:04:32.061954 15155 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.062893 14894 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.040149 14789 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.085520 15086 raft_consensus.cc:359] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.096406 15086 raft_consensus.cc:385] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.096678 15086 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.097291 15086 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.099244 15086 ts_tablet_manager.cc:1434] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.044s	user 0.003s	sys 0.000s
I20260709 13:04:32.100410 15086 tablet_bootstrap.cc:492] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:32.104059 15084 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:32.105962 15084 ts_tablet_manager.cc:1403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.200s	user 0.015s	sys 0.000s
I20260709 13:04:32.099109 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:32.110086 15086 tablet_bootstrap.cc:654] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.115752 15327 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.116011 15219 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.116266 15327 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.116601 14933 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.118196 15327 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.118252 15219 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.119271 14891 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.123449 15085 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.123997 15085 ts_tablet_manager.cc:1403] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.150s	user 0.058s	sys 0.064s
I20260709 13:04:32.124933 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.124965 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.128219 15042 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:32.130949 15085 raft_consensus.cc:359] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.131665 15085 raft_consensus.cc:385] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.132015 15085 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.132287 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:32.132638 15085 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.133283 15327 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:32.133639 15327 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.133968 15327 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:32.135069 15085 ts_tablet_manager.cc:1434] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:04:32.135991 15085 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.137734 14793 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.141822 15086 tablet_bootstrap.cc:492] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:32.142266 15086 ts_tablet_manager.cc:1403] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.001s
I20260709 13:04:32.143013 15085 tablet_bootstrap.cc:654] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.147627 15197 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.148283 15197 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.158087 15327 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.196439 15086 raft_consensus.cc:359] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.197114 15086 raft_consensus.cc:385] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.197397 15086 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.199378 15155 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.198997 15086 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.201630 15324 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.203115 15324 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.202131 15084 raft_consensus.cc:359] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.206949 15084 raft_consensus.cc:385] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.208829 15324 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.209239 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:32.209797 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.210414 14967 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:32.203315 15327 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.199247 15258 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.211664 15258 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.213054 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.213574 15258 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.207330 15084 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.217264 15084 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.222090 14892 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.228972 15084 ts_tablet_manager.cc:1434] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.123s	user 0.008s	sys 0.000s
I20260709 13:04:32.220430 14894 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:04:32.230705 15084 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:32.221763 15111 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.221061 15197 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.242766 15111 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.260444 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.274057 15111 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.278231 15086 ts_tablet_manager.cc:1434] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.136s	user 0.017s	sys 0.029s
I20260709 13:04:32.279489 15086 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:32.280675 15085 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.281114 15085 ts_tablet_manager.cc:1403] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.145s	user 0.018s	sys 0.002s
I20260709 13:04:32.282629 15084 tablet_bootstrap.cc:654] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.281138 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:32.289057 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.291679 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.289814 15085 raft_consensus.cc:359] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.292879 15085 raft_consensus.cc:385] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.293139 15085 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.293445 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:32.293758 15085 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.294293 15327 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.294670 15327 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.295312 15085 ts_tablet_manager.cc:1434] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.001s
I20260709 13:04:32.296165 15085 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.294988 15327 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:32.297993 14861 leader_election.cc:343] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.322242 15111 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.323967 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:32.342294 14893 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:32.346894 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49613.9us
I20260709 13:04:32.347559 14894 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.347477 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:32.350412 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.352514 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.354326 15324 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:04:32.354970 14859 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.356187 15324 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.360123 15084 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:32.360801 15084 ts_tablet_manager.cc:1403] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.130s	user 0.013s	sys 0.008s
W20260709 13:04:32.362473 14936 leader_election.cc:343] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:32.363322 14936 leader_election.cc:343] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.365020 15258 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.384418 15086 tablet_bootstrap.cc:654] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.386731 15258 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.387770 15258 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:32.388139 15258 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:32.388859 15258 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.389905 15258 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:04:32.393385 14933 leader_election.cc:343] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.395006 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.393608 15085 tablet_bootstrap.cc:654] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.398520 15084 raft_consensus.cc:359] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.399241 15343 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.399844 15084 raft_consensus.cc:385] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.400188 15084 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
W20260709 13:04:32.400168 14933 leader_election.cc:343] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.401321 14933 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.401327 15150 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.402284 15155 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.403264 15106 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.390930 15327 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.401002 15084 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.403869 15106 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.409528 15084 ts_tablet_manager.cc:1434] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.048s	user 0.000s	sys 0.006s
I20260709 13:04:32.413041 15106 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:32.411141 15084 tablet_bootstrap.cc:492] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:32.416205 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:32.419704 15007 leader_election.cc:343] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.435817 15344 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:04:32.442027 15197 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.423640 15343 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 13:04:32.446564 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:32.455776 14969 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.462591 14969 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:32.463788 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:32.464540 15084 tablet_bootstrap.cc:654] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.464661 15197 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.465265 15197 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:32.472501 15344 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.472379 15197 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.472967 15344 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.478109 15344 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:04:32.480470 14933 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:32.488458 15085 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.491518 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:32.492277 15085 ts_tablet_manager.cc:1403] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.196s	user 0.009s	sys 0.004s
I20260709 13:04:32.496698 15085 raft_consensus.cc:359] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.499469 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.499516 15085 raft_consensus.cc:385] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.500718 15085 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.501718 15085 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.504819 15198 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.505293 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:32.505857 15044 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.502851 15327 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.514616 15044 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:32.504681 15085 ts_tablet_manager.cc:1434] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:32.517400 15085 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
W20260709 13:04:32.521555 14933 leader_election.cc:343] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.536067 15343 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:32.534005 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:32.545382 14936 leader_election.cc:343] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.545825 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.547056 15219 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:04:32.549438 14933 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:04:32.551635 15008 leader_election.cc:343] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.556047 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:32.557130 15217 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.562294 15324 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.576512 15085 tablet_bootstrap.cc:654] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.588587 15324 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:04:32.591185 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:32.591252 14793 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:32.598089 15084 tablet_bootstrap.cc:492] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:32.598609 15084 ts_tablet_manager.cc:1403] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.042s
I20260709 13:04:32.605444 15086 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:32.606021 15086 ts_tablet_manager.cc:1403] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.327s	user 0.016s	sys 0.011s
I20260709 13:04:32.610479 15084 raft_consensus.cc:359] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.611174 15084 raft_consensus.cc:385] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.611487 15084 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.612087 15084 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.614084 15084 ts_tablet_manager.cc:1434] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:04:32.615537 15084 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:32.623289 15086 raft_consensus.cc:359] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.624004 15086 raft_consensus.cc:385] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.624274 15086 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.625398 15086 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.641078 15086 ts_tablet_manager.cc:1434] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:04:32.642011 15086 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:32.644152 15084 tablet_bootstrap.cc:654] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.656502 15085 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.656965 15085 ts_tablet_manager.cc:1403] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.140s	user 0.007s	sys 0.003s
I20260709 13:04:32.661815 15084 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:32.662690 15084 ts_tablet_manager.cc:1403] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260709 13:04:32.664597 15085 raft_consensus.cc:359] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.665315 15085 raft_consensus.cc:385] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.665673 15085 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.665354 15084 raft_consensus.cc:359] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.666325 15084 raft_consensus.cc:385] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.666740 15084 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.667515 15084 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.669847 15084 ts_tablet_manager.cc:1434] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:32.670758 15084 tablet_bootstrap.cc:492] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:32.666378 15085 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.672336 15086 tablet_bootstrap.cc:654] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.672966 15085 ts_tablet_manager.cc:1434] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:04:32.673861 15085 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.677099 15084 tablet_bootstrap.cc:654] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.681205 15085 tablet_bootstrap.cc:654] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.688952 15086 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:32.689422 15086 ts_tablet_manager.cc:1403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.000s
I20260709 13:04:32.705293 15086 raft_consensus.cc:359] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.716332 15084 tablet_bootstrap.cc:492] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:32.717036 15084 ts_tablet_manager.cc:1403] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.010s
I20260709 13:04:32.706264 15086 raft_consensus.cc:385] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.718611 15086 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.719383 15086 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.721401 15086 ts_tablet_manager.cc:1434] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:04:32.723081 15086 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:32.723591 15084 raft_consensus.cc:359] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.724548 15084 raft_consensus.cc:385] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.724809 15084 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.726089 15085 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.726802 15084 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.728354 15326 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.728950 15084 ts_tablet_manager.cc:1434] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:04:32.731561 15085 ts_tablet_manager.cc:1403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.004s
I20260709 13:04:32.729100 15326 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.734493 15084 tablet_bootstrap.cc:492] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:32.735718 15326 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.737171 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.737635 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.738945 15217 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.739521 15217 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.740621 15085 raft_consensus.cc:359] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.741150 15084 tablet_bootstrap.cc:654] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.741425 15085 raft_consensus.cc:385] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.742964 15085 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.743764 15085 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.745715 15085 ts_tablet_manager.cc:1434] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.000s
I20260709 13:04:32.746544 15085 tablet_bootstrap.cc:492] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.749171 15086 tablet_bootstrap.cc:654] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.753865 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.754920 15326 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:32.755120 15085 tablet_bootstrap.cc:654] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.741508 15217 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:32.742597 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.762285 14967 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:32.763736 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:32.742595 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:32.765470 15217 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.766040 15217 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.773123 15371 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.773555 15371 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.773878 15371 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.782617 15085 tablet_bootstrap.cc:492] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.783124 15085 ts_tablet_manager.cc:1403] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.010s
I20260709 13:04:32.785650 15085 raft_consensus.cc:359] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.786283 15085 raft_consensus.cc:385] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.786540 15085 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.787426 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:32.790565 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.791152 14967 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:32.787475 15085 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.792431 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:32.792858 15371 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.793323 15106 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.793807 15106 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.794251 15106 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.796777 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:32.797533 14967 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.793946 15085 ts_tablet_manager.cc:1434] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:04:32.801172 15085 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.806834 15085 tablet_bootstrap.cc:654] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:32.808429 15007 leader_election.cc:343] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:04:32.809376 15007 leader_election.cc:343] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.809497 14967 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:32.811030 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:32.811753 14891 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.813517 15371 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:32.814531 15085 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.814981 15085 ts_tablet_manager.cc:1403] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.004s
I20260709 13:04:32.816128 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:32.816897 15371 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.817456 15085 raft_consensus.cc:359] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.818086 15085 raft_consensus.cc:385] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.818352 15085 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.818956 15085 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.820919 15085 ts_tablet_manager.cc:1434] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:04:32.821749 15085 tablet_bootstrap.cc:492] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.824431 15371 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:32.825410 15371 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.835223 15085 tablet_bootstrap.cc:654] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.845434 15085 tablet_bootstrap.cc:492] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.845928 15085 ts_tablet_manager.cc:1403] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.024s	user 0.001s	sys 0.008s
I20260709 13:04:32.848609 15217 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:32.843209 14891 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:32.852850 15085 raft_consensus.cc:359] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.866787 15085 raft_consensus.cc:385] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.867077 15085 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.856755 15106 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.858676 15330 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.867733 15330 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.869827 15330 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.867758 15085 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.870957 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.871549 14967 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:32.872376 15085 ts_tablet_manager.cc:1434] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 13:04:32.873245 15085 tablet_bootstrap.cc:492] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.874935 15086 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:32.875687 15086 ts_tablet_manager.cc:1403] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.153s	user 0.038s	sys 0.041s
I20260709 13:04:32.876210 15106 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:32.864090 15084 tablet_bootstrap.cc:492] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:32.876962 15084 ts_tablet_manager.cc:1403] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.143s	user 0.024s	sys 0.041s
I20260709 13:04:32.878571 15086 raft_consensus.cc:359] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.879268 15086 raft_consensus.cc:385] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.879748 15086 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.879858 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:32.880404 15086 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.880818 14967 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.881654 15085 tablet_bootstrap.cc:654] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.878674 14791 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:32.883452 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:32.884557 15007 leader_election.cc:343] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.882443 15086 ts_tablet_manager.cc:1434] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:04:32.885902 15086 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:32.882544 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.886914 15041 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:32.888139 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:32.888866 15330 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.889163 15330 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.889492 15330 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.896021 15326 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.896685 15326 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.897637 15330 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.898957 15326 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.899427 15330 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.900076 15085 tablet_bootstrap.cc:492] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:32.900499 15085 ts_tablet_manager.cc:1403] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:04:32.902196 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:32.902714 15042 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.902987 15085 raft_consensus.cc:359] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.903662 15085 raft_consensus.cc:385] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.903942 15085 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.904767 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:32.904561 15085 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.906636 15085 ts_tablet_manager.cc:1434] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:04:32.907488 15085 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:32.908733 15042 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:32.908670 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:32.909614 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:32.910157 14969 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:32.910349 14859 leader_election.cc:343] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.880007 15084 raft_consensus.cc:359] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.913712 15084 raft_consensus.cc:385] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:32.914004 15084 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:32.911810 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:32.914700 15086 tablet_bootstrap.cc:654] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.919476 15198 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.914681 15084 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.924331 15198 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:32.924645 15041 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:32.925303 15198 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.927760 14967 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:32.918259 14969 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:32.932767 15085 tablet_bootstrap.cc:654] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.932842 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:32.933808 15326 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:32.934686 15326 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:32.935191 15326 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:32.937808 15084 ts_tablet_manager.cc:1434] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.004s
I20260709 13:04:32.940548 15084 tablet_bootstrap.cc:492] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:32.969445 15084 tablet_bootstrap.cc:654] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:32.979360 15155 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:32.980106 15155 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.981885 15155 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:32.982506 15330 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:32.983048 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:32.984917 15106 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:32.985335 15106 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:32.986048 15106 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:32.989948 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:32.991323 14933 leader_election.cc:343] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.994335 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:04:32.996275 14936 leader_election.cc:343] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:32.996688 14936 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:32.997473 15219 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.020541 15330 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.030423 14891 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.044114 15330 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.045223 15330 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.047209 14789 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.049621 15330 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.049793 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:33.050400 15043 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:33.051810 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.052019 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.052575 14969 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:33.052959 15330 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.053670 15330 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.054040 15330 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.056012 15197 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.056489 15197 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.058574 15197 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.066576 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.067637 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:33.075657 15197 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.076424 15197 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.079239 15197 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.080242 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:33.080324 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:33.081288 15043 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:33.081907 15197 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.085103 15086 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:33.085564 15086 ts_tablet_manager.cc:1403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.200s	user 0.036s	sys 0.072s
I20260709 13:04:33.086229 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.088006 15086 raft_consensus.cc:359] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.088730 15086 raft_consensus.cc:385] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.088850 15324 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.089079 15086 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.089367 15324 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.089793 15324 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.090076 15326 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.094560 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.095904 14967 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:33.096457 15324 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.097751 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.098894 15324 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.099756 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:33.100440 15042 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.089784 15086 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.103513 15086 ts_tablet_manager.cc:1434] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:04:33.104336 15086 tablet_bootstrap.cc:492] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:33.104696 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:33.105435 15043 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.109968 15086 tablet_bootstrap.cc:654] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.113363 15042 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.114804 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.122294 15327 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.126061 15330 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.130692 15330 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.131050 15086 tablet_bootstrap.cc:492] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:33.131512 15086 ts_tablet_manager.cc:1403] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.000s
I20260709 13:04:33.131922 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:33.132608 15042 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.136592 14891 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.137290 15086 raft_consensus.cc:359] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.138060 15086 raft_consensus.cc:385] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.138383 15086 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.139036 15086 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.147782 15086 ts_tablet_manager.cc:1434] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:33.148852 15327 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:33.148741 15086 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:33.150209 15327 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:33.153568 14859 leader_election.cc:343] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.156217 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.157032 14967 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.175007 15086 tablet_bootstrap.cc:654] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.176507 15042 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.180480 15043 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.183383 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.185146 14969 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.172852 15326 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.184008 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.189976 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:33.191082 15326 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.191782 15326 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:33.192317 15388 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.192818 15388 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:33.193647 15388 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.194660 14969 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.198602 15326 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.200958 15085 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:33.201421 15085 ts_tablet_manager.cc:1403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.294s	user 0.051s	sys 0.077s
I20260709 13:04:33.203627 15084 tablet_bootstrap.cc:492] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:33.207703 15084 ts_tablet_manager.cc:1403] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.267s	user 0.060s	sys 0.083s
I20260709 13:04:33.211153 15084 raft_consensus.cc:359] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.213400 15084 raft_consensus.cc:385] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.213827 15084 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.216169 15084 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.228577 15084 ts_tablet_manager.cc:1434] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 13:04:33.233297 15106 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.233556 14967 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.230965 15085 raft_consensus.cc:359] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.240063 15085 raft_consensus.cc:385] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.240381 15085 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.241042 15085 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.243055 15085 ts_tablet_manager.cc:1434] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.000s
I20260709 13:04:33.245666 15085 tablet_bootstrap.cc:492] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:33.251814 15086 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:33.252267 15086 ts_tablet_manager.cc:1403] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.005s
I20260709 13:04:33.248555 14789 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.254768 15086 raft_consensus.cc:359] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.255419 15086 raft_consensus.cc:385] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.255671 15086 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.258569 15086 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.260846 15086 ts_tablet_manager.cc:1434] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:04:33.262197 15086 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:33.273262 15084 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:33.271951 15341 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.286532 15217 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.281639 15341 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.291178 15341 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.291548 15086 tablet_bootstrap.cc:654] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.291816 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:33.297555 14933 leader_election.cc:343] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.307835 15085 tablet_bootstrap.cc:654] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.312242 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:04:33.313416 14936 leader_election.cc:343] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.313810 14936 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:33.315124 15341 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.322075 15084 tablet_bootstrap.cc:654] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.328024 15326 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.328541 15326 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.330574 15326 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.332825 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:33.333397 15043 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:33.334439 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.335239 15326 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.335625 15326 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.335959 15326 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.336259 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.336870 14967 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:33.337567 15084 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:33.338153 15084 ts_tablet_manager.cc:1403] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.065s	user 0.015s	sys 0.002s
I20260709 13:04:33.341188 15085 tablet_bootstrap.cc:492] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:33.341229 15084 raft_consensus.cc:359] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.342538 15085 ts_tablet_manager.cc:1403] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.097s	user 0.027s	sys 0.001s
I20260709 13:04:33.343190 15084 raft_consensus.cc:385] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.343544 15086 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:33.345779 15326 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.347122 15084 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.346302 15085 raft_consensus.cc:359] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.397374 15085 raft_consensus.cc:385] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.398001 15085 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.399446 15085 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.407552 15086 ts_tablet_manager.cc:1403] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.145s	user 0.013s	sys 0.006s
I20260709 13:04:33.348513 15326 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.392838 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.410380 14967 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.412151 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:33.412985 15043 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.393941 15084 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.418008 15330 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.425320 15043 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.425482 14967 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:33.418910 15086 raft_consensus.cc:359] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.385902 14793 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.450470 15084 ts_tablet_manager.cc:1434] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.112s	user 0.012s	sys 0.000s
I20260709 13:04:33.427711 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:33.463018 15084 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:33.466576 15326 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.467175 15326 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:33.455518 15085 ts_tablet_manager.cc:1434] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.003s
I20260709 13:04:33.461114 15086 raft_consensus.cc:385] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.468317 15086 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.468349 15326 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.469215 15085 tablet_bootstrap.cc:492] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:33.469786 15086 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.473878 14793 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.476271 14793 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.431890 15106 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.049s
W20260709 13:04:33.483381 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:33.495798 15198 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.509830 15084 tablet_bootstrap.cc:654] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.514171 15150 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.514489 15086 ts_tablet_manager.cc:1434] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.106s	user 0.007s	sys 0.003s
I20260709 13:04:33.517907 15086 tablet_bootstrap.cc:492] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:33.528340 15150 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.531569 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:33.531780 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:33.532979 15040 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:33.538857 15085 tablet_bootstrap.cc:654] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.551231 15086 tablet_bootstrap.cc:654] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.541847 15150 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.556691 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:33.562173 15341 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.595830 15341 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.610636 15084 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:33.611061 15084 ts_tablet_manager.cc:1403] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.149s	user 0.007s	sys 0.011s
I20260709 13:04:33.614140 15085 tablet_bootstrap.cc:492] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:33.622529 15085 ts_tablet_manager.cc:1403] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.154s	user 0.007s	sys 0.011s
I20260709 13:04:33.622162 15084 raft_consensus.cc:359] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.622972 15084 raft_consensus.cc:385] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.623298 15084 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.624321 15084 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.627364 15084 ts_tablet_manager.cc:1434] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:04:33.642697 15324 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:33.651934 15084 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:33.654305 14793 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:33.657256 15324 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.659034 15086 tablet_bootstrap.cc:492] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:33.665838 15085 raft_consensus.cc:359] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.666643 15085 raft_consensus.cc:385] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.666913 15085 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.667611 15086 ts_tablet_manager.cc:1403] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.150s	user 0.015s	sys 0.005s
I20260709 13:04:33.673277 15324 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.674351 15106 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.674938 15106 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.677076 15106 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.681593 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.682860 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:33.683506 14892 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:33.679924 15085 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:33.704906 15008 leader_election.cc:343] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.715243 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:04:33.715685 15324 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.716629 15375 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.717160 15375 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.717561 15375 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.707890 15086 raft_consensus.cc:359] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.719545 15086 raft_consensus.cc:385] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.719807 15086 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.722278 15217 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.722777 15217 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.724937 15217 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.726832 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:33.726867 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:04:33.729364 15007 leader_election.cc:343] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.728264 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.741582 15085 ts_tablet_manager.cc:1434] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.115s	user 0.006s	sys 0.002s
I20260709 13:04:33.742019 14968 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:33.743165 15085 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:33.744266 15008 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:33.745405 15217 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.745790 15217 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.746157 15217 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.751542 15086 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.756253 15326 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.756829 15086 ts_tablet_manager.cc:1434] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 13:04:33.757808 15086 tablet_bootstrap.cc:492] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:33.767251 15084 tablet_bootstrap.cc:654] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.764662 15217 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.750957 15375 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.776278 15086 tablet_bootstrap.cc:654] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.782781 15217 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.783824 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.786693 14967 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.787014 15324 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:33.796564 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:33.799851 15007 leader_election.cc:343] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.804836 14967 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:33.807391 15085 tablet_bootstrap.cc:654] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.811658 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:33.814662 15008 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:33.815572 15106 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.816140 15106 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:33.816360 15375 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.815622 15084 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:33.817683 15084 ts_tablet_manager.cc:1403] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.178s	user 0.008s	sys 0.005s
I20260709 13:04:33.812304 14895 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.817855 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.819324 15106 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.818955 14968 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.829597 15084 raft_consensus.cc:359] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.830315 15084 raft_consensus.cc:385] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.830585 15084 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.831375 15084 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.833760 15084 ts_tablet_manager.cc:1434] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:04:33.837774 14891 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.827802 15375 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.842535 15084 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:33.860481 15085 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:33.861044 15085 ts_tablet_manager.cc:1403] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.119s	user 0.012s	sys 0.002s
I20260709 13:04:33.841867 15375 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.867734 15375 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.868659 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:33.870249 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:33.870615 15007 leader_election.cc:343] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.870901 14967 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:33.872826 15008 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:33.874245 15217 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.874614 15217 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.875000 15217 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.880225 15375 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:04:33.880827 15375 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.881152 14968 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:33.882820 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.883787 15085 raft_consensus.cc:359] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.884864 15085 raft_consensus.cc:385] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.887825 15106 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.887701 15085 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.888273 15106 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:33.890511 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:33.891294 14892 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:33.890815 15106 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.885810 15375 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.896243 15085 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.899461 15085 ts_tablet_manager.cc:1434] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 13:04:33.901571 15085 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:33.886663 14895 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:33.899360 15217 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.915172 15086 tablet_bootstrap.cc:492] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:33.915688 15086 ts_tablet_manager.cc:1403] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.019s
I20260709 13:04:33.913101 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.917644 14970 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:04:33.918725 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:33.919469 15084 tablet_bootstrap.cc:654] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.919548 15375 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:33.919986 15375 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:04:33.920379 15375 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:33.920421 15217 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.920550 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:33.921243 14892 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.920115 15086 raft_consensus.cc:359] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.921934 15086 raft_consensus.cc:385] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:33.922259 15086 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:33.924422 15086 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.924535 14793 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.926421 15086 ts_tablet_manager.cc:1434] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:33.928453 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:33.929100 14970 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.930256 15375 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.931489 15341 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.930908 15086 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:33.932790 15341 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.937058 15341 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:33.940231 15085 tablet_bootstrap.cc:654] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:33.941157 14892 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:33.942258 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:33.944378 14933 leader_election.cc:343] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.951287 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:33.953089 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:33.956836 15217 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:33.962450 15106 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:33.963747 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:04:33.964730 14936 leader_election.cc:343] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.967694 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:33.965875 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:33.967073 15106 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.971200 15341 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:33.972396 15106 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.974390 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:33.975016 14968 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:33.975307 14793 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:33.976409 14893 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:33.980235 14967 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:04:33.982463 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:33.970212 15375 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:33.988396 15008 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:04:33.990346 15007 leader_election.cc:343] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:33.986829 15217 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:33.993355 15106 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:33.993732 15106 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:33.994006 15106 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:33.991677 15217 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:33.995790 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:33.998409 14970 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:33.999881 15084 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.000331 15084 ts_tablet_manager.cc:1403] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.158s	user 0.012s	sys 0.009s
I20260709 13:04:33.998430 15418 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:34.002609 15418 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.003508 15418 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.003508 15084 raft_consensus.cc:359] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.005437 15084 raft_consensus.cc:385] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.005715 15084 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.008085 15084 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.009681 15106 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.011569 15106 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.012545 15086 tablet_bootstrap.cc:654] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.020761 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.021833 14970 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.023532 15085 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.024005 15085 ts_tablet_manager.cc:1403] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.123s	user 0.007s	sys 0.006s
I20260709 13:04:34.030388 15084 ts_tablet_manager.cc:1434] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.030s	user 0.010s	sys 0.003s
I20260709 13:04:34.031635 15084 tablet_bootstrap.cc:492] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.028712 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.034332 14970 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
W20260709 13:04:34.035162 15007 leader_election.cc:343] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.036777 15008 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.037720 15423 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.038249 15423 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.039932 15085 raft_consensus.cc:359] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.040638 15085 raft_consensus.cc:385] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.040920 15085 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.040211 15423 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.042743 15084 tablet_bootstrap.cc:654] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.044334 15086 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.044777 15086 ts_tablet_manager.cc:1403] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.114s	user 0.013s	sys 0.009s
I20260709 13:04:34.048748 15085 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.051316 15085 ts_tablet_manager.cc:1434] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.001s
I20260709 13:04:34.056488 15086 raft_consensus.cc:359] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.057220 15086 raft_consensus.cc:385] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.057395 15086 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.060071 15085 tablet_bootstrap.cc:492] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.063297 15086 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.069476 15086 ts_tablet_manager.cc:1434] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:34.070484 15086 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.074087 15197 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.074589 15197 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.079165 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.081120 15084 tablet_bootstrap.cc:492] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.081631 15084 ts_tablet_manager.cc:1403] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.012s
I20260709 13:04:34.081686 15085 tablet_bootstrap.cc:654] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.082127 15086 tablet_bootstrap.cc:654] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.084149 15324 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.085806 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.086700 14970 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 3 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 13:04:34.087646 15084 raft_consensus.cc:359] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.089146 15084 raft_consensus.cc:385] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.089807 15084 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.090758 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.091425 15084 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.071933 14793 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.081657 15197 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.100654 15084 ts_tablet_manager.cc:1434] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:04:34.102694 15084 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.110512 15084 tablet_bootstrap.cc:654] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.117189 15324 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:34.134641 15324 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.152011 15085 tablet_bootstrap.cc:492] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.152503 15085 ts_tablet_manager.cc:1403] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.014s
I20260709 13:04:34.152253 14793 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.155896 15085 raft_consensus.cc:359] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.156651 15085 raft_consensus.cc:385] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.156984 15085 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.162684 15085 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.165051 15085 ts_tablet_manager.cc:1434] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:34.165762 15086 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.154776 14793 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.169373 15086 ts_tablet_manager.cc:1403] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.099s	user 0.051s	sys 0.031s
I20260709 13:04:34.169727 15084 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.170240 15084 ts_tablet_manager.cc:1403] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.068s	user 0.019s	sys 0.006s
I20260709 13:04:34.172719 15086 raft_consensus.cc:359] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.173439 15086 raft_consensus.cc:385] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.173779 15086 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.173484 15084 raft_consensus.cc:359] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.174461 15084 raft_consensus.cc:385] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.174988 15084 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.175858 15084 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.174468 15086 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.177947 15084 ts_tablet_manager.cc:1434] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:34.179032 15084 tablet_bootstrap.cc:492] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.179338 15086 ts_tablet_manager.cc:1434] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260709 13:04:34.186532 15086 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.187551 15084 tablet_bootstrap.cc:654] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.192710 15086 tablet_bootstrap.cc:654] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.200845 15085 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.201390 15086 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.201808 15086 ts_tablet_manager.cc:1403] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:04:34.204595 15086 raft_consensus.cc:359] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.205256 15086 raft_consensus.cc:385] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.205575 15086 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.206198 15086 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.208616 15086 ts_tablet_manager.cc:1434] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:04:34.210186 15086 tablet_bootstrap.cc:492] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.228005 15084 tablet_bootstrap.cc:492] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.228586 15084 ts_tablet_manager.cc:1403] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.003s
I20260709 13:04:34.233273 15085 tablet_bootstrap.cc:654] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.240573 15086 tablet_bootstrap.cc:654] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.242681 15084 raft_consensus.cc:359] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.243937 15084 raft_consensus.cc:385] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.244343 15084 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.246573 15085 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.247018 15085 ts_tablet_manager.cc:1403] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.002s
I20260709 13:04:34.248011 15084 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.249598 15085 raft_consensus.cc:359] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.250288 15084 ts_tablet_manager.cc:1434] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.004s
I20260709 13:04:34.250247 15085 raft_consensus.cc:385] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.250727 15085 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.251968 15084 tablet_bootstrap.cc:492] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.251451 15085 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.252627 15086 tablet_bootstrap.cc:492] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.253924 15217 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.254678 15085 ts_tablet_manager.cc:1434] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:04:34.261026 15217 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.261801 15085 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.263010 15217 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.264480 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:34.266237 15008 leader_election.cc:343] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.267505 15085 tablet_bootstrap.cc:654] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.267529 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.259572 15084 tablet_bootstrap.cc:654] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
W20260709 13:04:34.269109 15007 leader_election.cc:343] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.269513 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:34.270172 15217 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.272454 15086 ts_tablet_manager.cc:1403] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.000s
I20260709 13:04:34.275766 15086 raft_consensus.cc:359] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.277040 15086 raft_consensus.cc:385] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.277431 15086 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.278204 15086 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.279800 15084 tablet_bootstrap.cc:492] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.280239 15084 ts_tablet_manager.cc:1403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.004s
I20260709 13:04:34.281044 15424 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.282552 15084 raft_consensus.cc:359] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.283193 15084 raft_consensus.cc:385] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.284159 15084 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.287765 15085 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.288240 15085 ts_tablet_manager.cc:1403] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.000s
I20260709 13:04:34.285189 15086 ts_tablet_manager.cc:1434] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:04:34.285545 15084 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.292163 15084 ts_tablet_manager.cc:1434] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.002s
I20260709 13:04:34.294737 15084 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.295449 15400 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.295921 15400 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.293553 15085 raft_consensus.cc:359] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.297257 15085 raft_consensus.cc:385] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.297533 15085 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.298105 15400 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.298166 15085 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.299230 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.300290 15085 ts_tablet_manager.cc:1434] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 13:04:34.301275 14936 leader_election.cc:343] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.301492 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:34.303200 14933 leader_election.cc:343] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.303618 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.304849 15150 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.305015 15086 tablet_bootstrap.cc:492] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.311353 15084 tablet_bootstrap.cc:654] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.311622 15086 tablet_bootstrap.cc:654] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.301312 15085 tablet_bootstrap.cc:492] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.321568 15217 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.322700 15085 tablet_bootstrap.cc:654] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.322934 15086 tablet_bootstrap.cc:492] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.323369 15086 ts_tablet_manager.cc:1403] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.006s
I20260709 13:04:34.328123 15086 raft_consensus.cc:359] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.328987 15086 raft_consensus.cc:385] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.329320 15086 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.330098 15086 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.332515 15086 ts_tablet_manager.cc:1434] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:04:34.333499 15086 tablet_bootstrap.cc:492] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.340576 15084 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.341097 15084 ts_tablet_manager.cc:1403] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.047s	user 0.005s	sys 0.011s
I20260709 13:04:34.342557 15086 tablet_bootstrap.cc:654] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.344244 15084 raft_consensus.cc:359] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.344978 15084 raft_consensus.cc:385] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.345257 15084 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.345950 15084 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.346513 15085 tablet_bootstrap.cc:492] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.346920 15085 ts_tablet_manager.cc:1403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.046s	user 0.004s	sys 0.008s
I20260709 13:04:34.348039 15084 ts_tablet_manager.cc:1434] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:04:34.349001 15084 tablet_bootstrap.cc:492] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.349758 15085 raft_consensus.cc:359] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.350570 15085 raft_consensus.cc:385] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.350834 15085 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.351130 15086 tablet_bootstrap.cc:492] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.351786 15086 ts_tablet_manager.cc:1403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.002s
I20260709 13:04:34.351583 15085 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.354653 15086 raft_consensus.cc:359] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.355343 15086 raft_consensus.cc:385] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.355754 15086 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.356226 15084 tablet_bootstrap.cc:654] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.356437 15086 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.358554 15086 ts_tablet_manager.cc:1434] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:34.359696 15086 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.359776 15085 ts_tablet_manager.cc:1434] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 13:04:34.361169 15085 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.362246 15330 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.362736 15330 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.364840 15330 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.366108 15086 tablet_bootstrap.cc:654] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.367333 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.367249 15217 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:04:34.368001 15044 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:34.368393 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.369011 14970 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:34.369097 14891 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.370059 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:34.370760 15326 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.371093 15326 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.371371 15326 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.376762 15217 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.383667 15217 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.384311 15217 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.389554 15085 tablet_bootstrap.cc:654] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.391487 15330 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:04:34.392192 15330 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.396166 15084 tablet_bootstrap.cc:492] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.396867 15084 ts_tablet_manager.cc:1403] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.008s
I20260709 13:04:34.399544 15084 raft_consensus.cc:359] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.400194 15084 raft_consensus.cc:385] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.400462 15084 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.401510 15424 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.402155 15424 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.403537 15084 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.405659 15084 ts_tablet_manager.cc:1434] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:04:34.405692 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.405936 15326 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.406394 14967 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.406653 15084 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.407779 15424 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.408847 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.409189 15217 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.409935 15217 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.410377 15217 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.410800 15217 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.411739 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.416051 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.416776 14967 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.418292 15150 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.418924 15150 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.420924 15388 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.421293 15150 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.421386 15388 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.422025 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.422224 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.423074 15418 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.423461 15418 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:04:34.423630 14933 leader_election.cc:343] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.423863 15418 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.424528 15330 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.424418 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.425249 15197 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.425709 15197 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.426427 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.427800 15197 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.428452 15084 tablet_bootstrap.cc:654] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.429664 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.430194 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.430764 15044 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:34.433496 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:34.423343 15388 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.433970 15044 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.437286 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.439574 15111 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.439899 15111 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.439949 15326 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.440240 15111 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.440754 15044 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:34.441954 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.443576 15388 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.443739 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.444052 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.444473 14969 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:34.444968 14966 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:34.447966 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.448714 14966 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.449121 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:34.449966 14859 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.450330 15197 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.450672 15197 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.451156 15330 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.450992 15197 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:34.454787 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53717.5us
W20260709 13:04:34.456701 15007 leader_election.cc:343] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.459074 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.444061 15388 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:34.464330 15111 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.464797 15388 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.467172 15111 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.467809 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.469722 15330 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.466854 15217 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.472179 15197 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.472954 15042 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:34.475250 15197 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.475152 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.475858 14968 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.475152 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:34.477166 15424 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.477629 15044 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:34.477643 15424 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.479496 15217 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:04:34.479871 14933 leader_election.cc:343] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.481534 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.482115 14967 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.487612 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:34.485946 15086 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.488166 15044 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.488348 15086 ts_tablet_manager.cc:1403] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.129s	user 0.019s	sys 0.020s
I20260709 13:04:34.488566 15008 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.492879 15086 raft_consensus.cc:359] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.495702 15086 raft_consensus.cc:385] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.496047 15086 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.497181 15084 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.497076 15086 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.497642 15084 ts_tablet_manager.cc:1403] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.016s
I20260709 13:04:34.498643 15086 ts_tablet_manager.cc:1434] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:04:34.499639 15086 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.501856 15375 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.502422 15375 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.502767 15375 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.505672 15086 tablet_bootstrap.cc:654] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.510455 15084 raft_consensus.cc:359] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.511178 15084 raft_consensus.cc:385] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.511479 15084 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.512641 15084 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.494903 15044 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:34.495177 14968 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:34.479831 15424 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.512645 14859 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.518872 15084 ts_tablet_manager.cc:1434] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:04:34.519830 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.523932 15424 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.526280 15424 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.526584 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.527647 14968 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:34.528867 15424 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.529240 15106 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.529981 15106 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.531530 15084 tablet_bootstrap.cc:492] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
I20260709 13:04:34.530920 15106 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.534317 15424 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.536183 15424 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.538177 15424 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.538734 15197 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:34.539100 14793 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.542315 15375 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.546733 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.547879 14892 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:34.471055 15418 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.549463 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.550405 14891 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:34.545693 15330 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.551476 14966 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:34.554850 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.555116 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.556489 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.565300 15418 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:04:34.564235 15007 leader_election.cc:343] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.551664 15330 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.567353 15375 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.567509 14895 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.568233 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.568460 15330 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.568754 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.569499 14966 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.569753 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.570374 15044 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:34.571624 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:04:34.567166 15007 leader_election.cc:343] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.573843 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.574414 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.574995 14970 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.576380 15085 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.565361 15424 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:04:34.576547 15084 tablet_bootstrap.cc:654] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.577818 15423 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.577298 15086 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
I20260709 13:04:34.578187 15423 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.578526 15086 ts_tablet_manager.cc:1403] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.079s	user 0.037s	sys 0.018s
I20260709 13:04:34.578580 15423 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.565281 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.580180 15111 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.580612 15111 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:34.581398 15111 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.582312 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.582906 14968 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.578631 15085 ts_tablet_manager.cc:1403] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.218s	user 0.033s	sys 0.025s
I20260709 13:04:34.584360 15086 raft_consensus.cc:359] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.585054 15086 raft_consensus.cc:385] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.585371 15086 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.585947 15085 raft_consensus.cc:359] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.586616 15086 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.590510 15341 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.590973 15341 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.592866 15341 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.593611 14970 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
W20260709 13:04:34.596053 15007 leader_election.cc:343] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.596593 14969 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:34.597517 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.598338 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:04:34.598762 14933 leader_election.cc:343] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.598938 14966 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.601475 14968 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:34.602315 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.602507 15326 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.586575 15085 raft_consensus.cc:385] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.603048 15326 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.603562 15326 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.608778 15086 ts_tablet_manager.cc:1434] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 13:04:34.602550 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.609757 15086 tablet_bootstrap.cc:492] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Bootstrap starting.
I20260709 13:04:34.609639 15388 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.603075 15085 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.611680 15085 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.613770 15085 ts_tablet_manager.cc:1434] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.030s	user 0.003s	sys 0.001s
I20260709 13:04:34.596881 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.615803 15106 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.616289 15106 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.617254 15106 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.621765 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.615970 15326 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.622411 14967 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 0.
I20260709 13:04:34.625352 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:34.625852 15326 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:04:34.626744 15007 leader_election.cc:343] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.627789 15086 tablet_bootstrap.cc:654] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.615319 15423 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.629364 15044 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:34.635480 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.636476 15375 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:34.638211 15375 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.638660 15375 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.639088 15375 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.641618 15111 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.642055 15111 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.648065 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.648881 14967 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.650161 15111 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.653867 15423 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.660264 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.659940 14791 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.661127 14889 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:34.664471 14894 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:34.659962 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:34.670433 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.670560 15217 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:04:34.670758 14933 leader_election.cc:343] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.671034 15044 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 0.
I20260709 13:04:34.672075 15085 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.673331 15008 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.698904 15423 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.699440 15423 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.700564 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.700350 15423 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.702855 15217 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.711594 14967 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:04:34.713369 15084 tablet_bootstrap.cc:492] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.713946 15084 ts_tablet_manager.cc:1403] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.183s	user 0.036s	sys 0.042s
I20260709 13:04:34.713946 15375 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.717254 15084 raft_consensus.cc:359] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.718135 15084 raft_consensus.cc:385] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.718484 15084 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.719228 15084 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.720569 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.721256 14967 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 1: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:04:34.727246 15375 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.728866 15084 ts_tablet_manager.cc:1434] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:04:34.731338 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:34.733410 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.734448 14968 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.734525 15423 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.736652 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.738458 15341 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.739045 15341 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.739705 15341 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.733647 15106 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:04:34.745433 14968 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:34.737710 15084 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Bootstrap starting.
W20260709 13:04:34.752799 14936 leader_election.cc:343] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.752744 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.755926 15085 tablet_bootstrap.cc:654] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.755390 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.752826 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:34.760375 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:34.763207 15375 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.763705 15375 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.766517 15086 tablet_bootstrap.cc:492] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: No bootstrap required, opened a new log
W20260709 13:04:34.766677 15007 leader_election.cc:343] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.766964 15086 ts_tablet_manager.cc:1403] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Time spent bootstrapping tablet: real 0.157s	user 0.040s	sys 0.030s
I20260709 13:04:34.768718 15375 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.753405 14936 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.771042 15111 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.772179 15423 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.757874 15341 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.787317 15217 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.787832 15217 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.790531 15217 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.791244 15341 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.791515 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.792075 15084 tablet_bootstrap.cc:654] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.793243 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:34.794625 14933 leader_election.cc:343] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.813249 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.823256 15086 raft_consensus.cc:359] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.824012 15086 raft_consensus.cc:385] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.824278 15086 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.824900 15086 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.829481 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:04:34.831192 15007 leader_election.cc:343] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.835209 15086 ts_tablet_manager.cc:1434] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 13:04:34.837106 14968 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:34.838389 15197 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.839028 15197 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:34.840059 15197 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.847007 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.847955 15423 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:34.848318 15423 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:34.848660 15423 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.853605 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:34.854142 15044 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:04:34.862846 14841 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:04:34.881541 15085 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.882087 15085 ts_tablet_manager.cc:1403] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.210s	user 0.016s	sys 0.011s
I20260709 13:04:34.884713 15044 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:04:34.885318 15084 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: No bootstrap required, opened a new log
I20260709 13:04:34.885890 15084 ts_tablet_manager.cc:1403] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Time spent bootstrapping tablet: real 0.148s	user 0.023s	sys 0.010s
I20260709 13:04:34.876734 14791 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.899724 14791 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:34.905855 15423 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.908775 15423 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:34.910193 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:34.910915 14968 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.911233 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:04:34.912701 15007 leader_election.cc:343] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:04:34.910013 15084 raft_consensus.cc:359] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.913355 15084 raft_consensus.cc:385] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.913710 15084 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.914530 15084 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.917897 15084 ts_tablet_manager.cc:1434] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.002s
I20260709 13:04:34.920440 15085 raft_consensus.cc:359] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.919086 14968 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:34.922343 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.923712 15423 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:04:34.923719 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48704.4us
I20260709 13:04:34.924460 15423 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:34.925278 15423 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.926085 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:04:34.928395 15471 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:34.929055 15471 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:34.929877 15471 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.937517 15324 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.941879 15085 raft_consensus.cc:385] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.942255 15085 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.942893 15085 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.944100 15326 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:34.948640 15085 ts_tablet_manager.cc:1434] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.000s
I20260709 13:04:34.949971 15085 tablet_bootstrap.cc:492] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.955943 14792 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 0 to 1, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:34.970762 15085 tablet_bootstrap.cc:654] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.979677 15197 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:34.980217 15197 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.980665 15085 tablet_bootstrap.cc:492] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:34.981105 15085 ts_tablet_manager.cc:1403] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.011s
I20260709 13:04:34.982482 15197 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:34.983084 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:34.983836 14968 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:34.983991 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:34.985711 15085 raft_consensus.cc:359] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.986222 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:34.986388 15085 raft_consensus.cc:385] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:34.986790 15085 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:34.987488 15085 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:34.986951 15197 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:34.990159 15085 ts_tablet_manager.cc:1434] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:04:34.992128 15085 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:34.994704 15197 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:34.997006 15085 tablet_bootstrap.cc:654] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:34.989833 14791 catalog_manager.cc:5697] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:35.002887 14792 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.011813 15085 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:35.012300 15085 ts_tablet_manager.cc:1403] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.020s	user 0.018s	sys 0.000s
I20260709 13:04:35.015324 15085 raft_consensus.cc:359] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.016022 15085 raft_consensus.cc:385] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.016294 15085 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.017006 15085 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.018915 15085 ts_tablet_manager.cc:1434] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:35.019831 15085 tablet_bootstrap.cc:492] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:35.026837 15085 tablet_bootstrap.cc:654] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.032006 15085 tablet_bootstrap.cc:492] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:35.032393 15085 ts_tablet_manager.cc:1403] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 13:04:35.034761 15085 raft_consensus.cc:359] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.035385 15085 raft_consensus.cc:385] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.035701 15085 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.036242 15085 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.038033 15085 ts_tablet_manager.cc:1434] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:04:35.039300 15085 tablet_bootstrap.cc:492] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:35.044368 15085 tablet_bootstrap.cc:654] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.048823 15085 tablet_bootstrap.cc:492] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:35.049283 15085 ts_tablet_manager.cc:1403] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 13:04:35.052508 15085 raft_consensus.cc:359] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.053081 15085 raft_consensus.cc:385] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.053293 15085 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.053900 15085 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.055907 15085 ts_tablet_manager.cc:1434] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:35.056799 15085 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Bootstrap starting.
I20260709 13:04:35.058588 15423 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.061789 15471 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.062371 15085 tablet_bootstrap.cc:654] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Neither blocks nor log segments found. Creating new log.
I20260709 13:04:35.069809 15326 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.070307 15326 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.073841 15326 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:35.106706 15197 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.107169 15197 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.108994 15197 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:35.110318 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:35.112520 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:35.113281 15044 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:04:35.114840 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:35.121043 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:35.121786 14966 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 1: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:04:35.122205 15217 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.122685 14893 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.126763 15085 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: No bootstrap required, opened a new log
I20260709 13:04:35.127243 15085 ts_tablet_manager.cc:1403] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.000s
I20260709 13:04:35.129694 15085 raft_consensus.cc:359] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.130239 15085 raft_consensus.cc:385] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:04:35.130481 15085 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Initialized, Role: FOLLOWER
I20260709 13:04:35.131258 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:35.131141 15085 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.133517 15326 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.134151 15085 ts_tablet_manager.cc:1434] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:04:35.134079 15217 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.140647 14890 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.142403 15326 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.146311 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:35.148036 15197 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.153354 15471 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:04:35.161514 15197 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:04:35.164537 15423 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.168664 15375 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.175686 15326 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.176116 15423 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.176254 15326 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.184769 15326 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:35.185935 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:35.192354 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:35.196457 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:35.209132 15462 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:35.236085 15423 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:35.236584 15423 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.238993 15423 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:35.243578 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:35.244036 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:35.244283 14968 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:35.244663 14890 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 0.
I20260709 13:04:35.245455 15008 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:35.246234 15423 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:04:35.246630 15423 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:04:35.247009 15423 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.253110 15423 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.254518 15423 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:35.255450 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:35.255973 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:35.256021 14968 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.256481 14893 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.261018 14968 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:35.261116 14893 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:35.262104 15008 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:35.262929 15423 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:04:35.263396 15423 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:35.264098 15423 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:35.274757 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:04:35.283797 15197 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.288153 14893 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:04:35.294556 15106 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.294808 15197 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.302237 15106 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.395627 15423 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.406054 15423 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.482412 15471 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.492179 15150 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.678985 15423 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:35.688849 15375 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:04:37.014690 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:04:37.045581 15504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:37.045902 15505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:04:37.045920 15507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:04:37.047262 13792 server_base.cc:1061] running on GCE node
I20260709 13:04:37.048525 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:04:37.048803 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:04:37.049038 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602277049018 us; error 0 us; skew 500 ppm
I20260709 13:04:37.049659 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:04:37.052450 13792 webserver.cc:533] Webserver started at http://127.13.120.4:35265/ using document root <none> and password file <none>
I20260709 13:04:37.052946 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:04:37.053180 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:04:37.053555 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:04:37.054817 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root/instance:
uuid: "58ee9fe38eb8453098f6d964e7675e79"
format_stamp: "Formatted at 2026-07-09 13:04:37 on dist-test-slave-mcck"
I20260709 13:04:37.059763 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:04:37.063370 15512 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:37.064260 13792 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 13:04:37.064550 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root
uuid: "58ee9fe38eb8453098f6d964e7675e79"
format_stamp: "Formatted at 2026-07-09 13:04:37 on dist-test-slave-mcck"
I20260709 13:04:37.064824 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:04:37.082495 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:04:37.084364 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:04:37.086403 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:04:37.090068 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:04:37.090353 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:37.090665 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:04:37.090893 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:04:37.149047 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.4:39473
I20260709 13:04:37.149149 15574 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.4:39473 every 8 connection(s)
I20260709 13:04:37.155074 13792 auto_leader_rebalancer-test.cc:384] add a tserver: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:37.164815 15575 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42905
I20260709 13:04:37.165378 15575 heartbeater.cc:461] Registering TS with master...
I20260709 13:04:37.166311 15575 heartbeater.cc:507] Master 127.13.120.62:42905 requested a full tablet report, sending...
I20260709 13:04:37.168541 14792 ts_manager.cc:194] Registered new tserver with Master: 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:04:37.169950 14792 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60458
I20260709 13:04:38.063581 15043 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.070570 14968 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.072593 14890 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.073268 15579 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.075259 15217 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:38.086024 15010 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8de39bcda9f4437d8538be04713851b1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.086196 15579 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.089895 14890 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.091985 14968 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.106756 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.138199 14968 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.149639 15043 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.157368 15581 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.161162 14890 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.163173 15471 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.172279 15575 heartbeater.cc:499] Master 127.13.120.62:42905 was elected leader, sending a full tablet report...
I20260709 13:04:38.175356 15581 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.183607 15044 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.184823 14890 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:04:38.193807 14936 consensus_peers.cc:597] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1ecb36ffe5e640f88b50155fa361883d. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.207518 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.210011 14966 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.222908 14890 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.224298 15581 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:38.228183 14936 consensus_peers.cc:597] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a86ee695370844fcbe0c2c00edd26e73. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.229871 15044 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.231751 15595 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.234746 15471 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.251422 14890 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.255466 15044 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.271292 14793 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:38.305948 14893 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.315371 15044 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.316829 15580 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.320927 14966 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:38.322435 15605 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:38.330914 15605 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:04:38.338264 14861 consensus_peers.cc:597] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ebef2badb7124b9fa530c8877d638abe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:38.333053 15044 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.339097 14966 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.354390 14791 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:38.509001 15610 ts_tablet_manager.cc:933] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:38.512531 15610 tablet_copy_client.cc:323] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:04:38.524748 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 8de39bcda9f4437d8538be04713851b1 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:04:38.525388 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 8de39bcda9f4437d8538be04713851b1 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-8de39bcda9f4437d8538be04713851b1
I20260709 13:04:38.530736 15054 tablet_copy_source_session.cc:215] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:38.534291 15610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8de39bcda9f4437d8538be04713851b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.551512 15610 tablet_copy_client.cc:806] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:38.552299 15610 tablet_copy_client.cc:670] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:38.558089 15610 tablet_copy_client.cc:538] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:38.567502 15610 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:38.591323 15610 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:38.592408 15610 tablet_bootstrap.cc:492] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:38.593084 15610 ts_tablet_manager.cc:1403] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.003s
I20260709 13:04:38.595909 15610 raft_consensus.cc:359] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.596774 15610 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:38.597446 15610 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.600988 15610 ts_tablet_manager.cc:1434] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.007s
I20260709 13:04:38.605134 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-8de39bcda9f4437d8538be04713851b1 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:04:38.605614 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-8de39bcda9f4437d8538be04713851b1 on tablet 8de39bcda9f4437d8538be04713851b1 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:38.611069 15610 ts_tablet_manager.cc:933] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:38.620296 15610 tablet_copy_client.cc:323] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:38.631865 14980 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 1ecb36ffe5e640f88b50155fa361883d from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:38.632460 14980 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 1ecb36ffe5e640f88b50155fa361883d from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-1ecb36ffe5e640f88b50155fa361883d
I20260709 13:04:38.639652 14980 tablet_copy_source_session.cc:215] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:38.643128 15610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ecb36ffe5e640f88b50155fa361883d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.661109 15610 tablet_copy_client.cc:806] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:38.662099 15610 tablet_copy_client.cc:670] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:38.667758 15610 tablet_copy_client.cc:538] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:38.674407 15610 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:38.695950 15610 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:38.697355 15610 tablet_bootstrap.cc:492] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:38.698113 15610 ts_tablet_manager.cc:1403] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.004s
I20260709 13:04:38.701257 15610 raft_consensus.cc:359] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.702188 15610 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:38.702910 15610 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.708894 15610 ts_tablet_manager.cc:1434] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:04:38.711827 14980 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-1ecb36ffe5e640f88b50155fa361883d received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:38.712303 14980 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-1ecb36ffe5e640f88b50155fa361883d on tablet 1ecb36ffe5e640f88b50155fa361883d with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:38.713641 15617 ts_tablet_manager.cc:933] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:38.718480 15617 tablet_copy_client.cc:323] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:38.720152 14980 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet a86ee695370844fcbe0c2c00edd26e73 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:38.720677 14980 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet a86ee695370844fcbe0c2c00edd26e73 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-a86ee695370844fcbe0c2c00edd26e73
I20260709 13:04:38.726446 15610 ts_tablet_manager.cc:933] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:38.737221 15610 tablet_copy_client.cc:323] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:04:38.738008 14980 tablet_copy_source_session.cc:215] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:38.741689 15617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a86ee695370844fcbe0c2c00edd26e73. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.751394 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet ebef2badb7124b9fa530c8877d638abe from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:04:38.752053 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet ebef2badb7124b9fa530c8877d638abe from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-ebef2badb7124b9fa530c8877d638abe
I20260709 13:04:38.757226 14905 tablet_copy_source_session.cc:215] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:38.758767 15617 tablet_copy_client.cc:806] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:38.760069 15617 tablet_copy_client.cc:670] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:38.762411 15610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebef2badb7124b9fa530c8877d638abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:38.766665 15617 tablet_copy_client.cc:538] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:38.777031 15617 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:38.779877 15610 tablet_copy_client.cc:806] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:38.780531 15610 tablet_copy_client.cc:670] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:38.784569 15610 tablet_copy_client.cc:538] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:38.794476 15610 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:38.806566 15617 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:38.807729 15617 tablet_bootstrap.cc:492] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:38.808439 15617 ts_tablet_manager.cc:1403] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.032s	user 0.020s	sys 0.009s
I20260709 13:04:38.811292 15617 raft_consensus.cc:359] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.818248 15617 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:38.819000 15617 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.821451 15617 ts_tablet_manager.cc:1434] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:04:38.823297 14980 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-a86ee695370844fcbe0c2c00edd26e73 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:38.823757 14980 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-a86ee695370844fcbe0c2c00edd26e73 on tablet a86ee695370844fcbe0c2c00edd26e73 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:38.826776 15610 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:38.827706 15610 tablet_bootstrap.cc:492] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:38.828351 15610 ts_tablet_manager.cc:1403] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.014s
I20260709 13:04:38.831503 15610 raft_consensus.cc:359] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.832280 15610 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:38.833036 15610 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:38.835534 15610 ts_tablet_manager.cc:1434] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:04:38.837106 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-ebef2badb7124b9fa530c8877d638abe received from {username='slave'} at 127.0.0.1:51176
I20260709 13:04:38.837514 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-ebef2badb7124b9fa530c8877d638abe on tablet ebef2badb7124b9fa530c8877d638abe with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:39.076890 15550 raft_consensus.cc:1217] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:39.091938 15550 raft_consensus.cc:1217] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:39.137880 15550 raft_consensus.cc:1217] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:39.248343 15550 raft_consensus.cc:1217] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:39.578366 15579 raft_consensus.cc:1064] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:39.581092 15579 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:39.589359 15550 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.589656 15602 raft_consensus.cc:1064] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:39.590978 15626 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.593333 14966 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.596772 14890 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.597141 15602 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:39.597811 15628 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.600277 15628 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.610658 15628 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.613404 15550 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.614710 15471 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.618780 14890 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.644651 14970 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.629878 15043 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.633846 15549 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.635198 14893 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.693435 14793 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.697836 15624 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:39.717557 15622 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.733769 15624 raft_consensus.cc:1064] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:39.753244 15624 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:39.771611 15622 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.778331 15041 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.785022 15550 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.786223 15043 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.787910 15602 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.789718 15602 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.804087 14890 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.808281 15549 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.822365 14893 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.821419 15639 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.823078 15550 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.829159 15605 raft_consensus.cc:1064] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:39.831794 15605 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:39.835294 15595 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.838371 15041 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:39.846946 14792 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:39.859157 15548 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:39.856241 14893 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.860746 15579 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:39.868920 15043 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.875607 14890 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:39.880633 14970 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:39.890755 15548 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:39.890616 15635 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:39.892000 15626 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.898289 15471 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:39.899343 15044 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:39.901235 15471 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:39.906111 15549 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.909015 15044 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.912518 14970 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:39.912024 14793 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.914566 15623 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:04:39.917835 15580 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:04:39.926885 15623 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:39.943367 15043 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.976243 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8de39bcda9f4437d8538be04713851b1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:40.010963 15623 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.006510 14893 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.937281 15602 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.039990 14970 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:39.957345 15547 raft_consensus.cc:2955] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.050380 14791 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:40.058856 15548 raft_consensus.cc:2955] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.061403 15041 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.068598 14792 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.107867 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:04:40.119355 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 78687.1us
I20260709 13:04:40.120106 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a86ee695370844fcbe0c2c00edd26e73 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:40.133842 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 8de39bcda9f4437d8538be04713851b1 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:40.143092 15549 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.151207 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet a86ee695370844fcbe0c2c00edd26e73 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:40.156840 15654 tablet_replica.cc:333] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:40.158197 15654 raft_consensus.cc:2243] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.159019 15654 raft_consensus.cc:2272] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.165375 14890 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:40.169207 15654 ts_tablet_manager.cc:1916] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:40.172614 14970 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:40.173998 15549 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:40.175742 15650 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:40.177804 15580 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:40.178843 15655 tablet_replica.cc:333] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:40.179919 15655 raft_consensus.cc:2243] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.180577 15655 raft_consensus.cc:2272] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.183924 15655 ts_tablet_manager.cc:1916] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:40.186270 15648 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.191531 15548 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.198936 14970 raft_consensus.cc:2955] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.207064 14791 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.222113 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet ebef2badb7124b9fa530c8877d638abe with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:04:40.223346 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ebef2badb7124b9fa530c8877d638abe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:40.224282 15654 ts_tablet_manager.cc:1929] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:40.226181 15654 log.cc:1199] T 8de39bcda9f4437d8538be04713851b1 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/8de39bcda9f4437d8538be04713851b1
I20260709 13:04:40.231472 15655 ts_tablet_manager.cc:1929] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:40.232031 15655 log.cc:1199] T a86ee695370844fcbe0c2c00edd26e73 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/a86ee695370844fcbe0c2c00edd26e73
I20260709 13:04:40.233744 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet a86ee695370844fcbe0c2c00edd26e73 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:40.237046 15656 tablet_replica.cc:333] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:04:40.237226 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 8de39bcda9f4437d8538be04713851b1 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:40.238265 15656 raft_consensus.cc:2243] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.239068 15656 raft_consensus.cc:2272] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.243700 15656 ts_tablet_manager.cc:1916] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:40.266314 15656 ts_tablet_manager.cc:1929] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:40.267707 15656 log.cc:1199] T ebef2badb7124b9fa530c8877d638abe P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/ebef2badb7124b9fa530c8877d638abe
I20260709 13:04:40.269647 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet ebef2badb7124b9fa530c8877d638abe (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:40.388545 14970 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:40.393337 15548 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:40.394454 14894 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:40.395174 15602 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:40.396080 15471 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:40.405143 15471 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.407857 15548 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.411553 14894 raft_consensus.cc:2955] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:40.417989 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1ecb36ffe5e640f88b50155fa361883d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:40.423764 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:40.435073 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 1ecb36ffe5e640f88b50155fa361883d with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:04:40.436075 15656 tablet_replica.cc:333] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:04:40.436981 15656 raft_consensus.cc:2243] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:40.437618 15656 raft_consensus.cc:2272] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:40.441012 15656 ts_tablet_manager.cc:1916] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:40.452406 15656 ts_tablet_manager.cc:1929] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:40.452750 15656 log.cc:1199] T 1ecb36ffe5e640f88b50155fa361883d P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/1ecb36ffe5e640f88b50155fa361883d
I20260709 13:04:40.454149 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 1ecb36ffe5e640f88b50155fa361883d (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:41.501396 14890 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:41.511176 15041 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.513028 15650 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:41.513895 14861 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1b0b2aff5c14c50aac568802fb9aa6c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:41.513028 14968 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.515887 15650 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.520949 15659 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.522203 15041 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.534325 14968 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:41.538882 14966 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.539359 14789 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.542284 15041 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.543617 15471 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:41.546227 14936 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 022fa149e13b44eeae0eb2555eb6eb80. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:41.548218 14890 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.551399 15602 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.561378 15471 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.572233 14890 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.576282 15040 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:41.576649 15043 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:04:41.592466 15010 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 410c57dd04b546f3be0269aecdb13719. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:41.594144 14966 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.595850 14890 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.596350 15626 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.601027 15628 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.604768 14791 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.626271 15675 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.640430 14966 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.650283 14893 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.653657 14968 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:41.666623 14789 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.671123 14894 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:41.671728 14936 consensus_peers.cc:597] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ac8b7ea8eec4d01847e30ae2626afd0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:41.672578 15602 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.672619 15043 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:41.676357 15602 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:41.684819 15602 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.686353 14893 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.690340 15043 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:41.711695 14789 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:41.903735 15681 ts_tablet_manager.cc:933] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:41.909582 15681 tablet_copy_client.cc:323] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:04:41.911273 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet b1b0b2aff5c14c50aac568802fb9aa6c from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:04:41.911795 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet b1b0b2aff5c14c50aac568802fb9aa6c from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-b1b0b2aff5c14c50aac568802fb9aa6c
I20260709 13:04:41.916618 14905 tablet_copy_source_session.cc:215] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:41.919740 15681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b0b2aff5c14c50aac568802fb9aa6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:41.931363 15681 tablet_copy_client.cc:806] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:41.932067 15681 tablet_copy_client.cc:670] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:41.935899 15681 tablet_copy_client.cc:538] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:41.945986 15681 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:41.952582 15683 ts_tablet_manager.cc:933] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:41.957433 15683 tablet_copy_client.cc:323] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:41.959307 14980 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 022fa149e13b44eeae0eb2555eb6eb80 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:41.959976 14980 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 022fa149e13b44eeae0eb2555eb6eb80 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-022fa149e13b44eeae0eb2555eb6eb80
I20260709 13:04:41.966985 15681 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:41.967641 14980 tablet_copy_source_session.cc:215] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:41.968061 15681 tablet_bootstrap.cc:492] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:41.968801 15681 ts_tablet_manager.cc:1403] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.005s
I20260709 13:04:41.972227 15681 raft_consensus.cc:359] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:41.971068 15683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 022fa149e13b44eeae0eb2555eb6eb80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:41.976706 15681 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:41.977530 15681 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:41.980484 15681 ts_tablet_manager.cc:1434] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:04:41.982973 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-b1b0b2aff5c14c50aac568802fb9aa6c received from {username='slave'} at 127.0.0.1:51176
I20260709 13:04:41.983389 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-b1b0b2aff5c14c50aac568802fb9aa6c on tablet b1b0b2aff5c14c50aac568802fb9aa6c with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:41.998885 15683 tablet_copy_client.cc:806] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:41.999502 15683 tablet_copy_client.cc:670] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:42.003324 15683 tablet_copy_client.cc:538] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:42.013316 15683 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:42.034024 15683 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.034991 15683 tablet_bootstrap.cc:492] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:42.035660 15683 ts_tablet_manager.cc:1403] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.005s
I20260709 13:04:42.036684 15681 ts_tablet_manager.cc:933] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:42.038503 15681 tablet_copy_client.cc:323] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:04:42.038532 15683 raft_consensus.cc:359] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:42.039484 15683 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:42.040166 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 410c57dd04b546f3be0269aecdb13719 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:04:42.040112 15683 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:42.040726 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 410c57dd04b546f3be0269aecdb13719 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-410c57dd04b546f3be0269aecdb13719
I20260709 13:04:42.042551 15683 ts_tablet_manager.cc:1434] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:04:42.044691 14980 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-022fa149e13b44eeae0eb2555eb6eb80 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:42.045121 14980 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-022fa149e13b44eeae0eb2555eb6eb80 on tablet 022fa149e13b44eeae0eb2555eb6eb80 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:42.050555 15054 tablet_copy_source_session.cc:215] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:42.053866 15681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 410c57dd04b546f3be0269aecdb13719. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:42.069538 15681 tablet_copy_client.cc:806] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:42.070183 15681 tablet_copy_client.cc:670] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:42.073611 15681 tablet_copy_client.cc:538] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:42.081223 15681 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:42.105396 15681 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.106304 15681 tablet_bootstrap.cc:492] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:42.106972 15681 ts_tablet_manager.cc:1403] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.010s
I20260709 13:04:42.109827 15681 raft_consensus.cc:359] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:42.110646 15681 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:42.111297 15681 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:42.113667 15681 ts_tablet_manager.cc:1434] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:04:42.126327 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-410c57dd04b546f3be0269aecdb13719 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:04:42.126782 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-410c57dd04b546f3be0269aecdb13719 on tablet 410c57dd04b546f3be0269aecdb13719 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:42.199015 15681 ts_tablet_manager.cc:933] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:42.200799 15681 tablet_copy_client.cc:323] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:42.202514 14980 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 3ac8b7ea8eec4d01847e30ae2626afd0 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:42.203069 14980 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 3ac8b7ea8eec4d01847e30ae2626afd0 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-3ac8b7ea8eec4d01847e30ae2626afd0
I20260709 13:04:42.209913 14980 tablet_copy_source_session.cc:215] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:42.212924 15681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ac8b7ea8eec4d01847e30ae2626afd0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:42.226387 15681 tablet_copy_client.cc:806] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:42.226897 15681 tablet_copy_client.cc:670] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:42.230786 15681 tablet_copy_client.cc:538] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:42.237573 15681 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:42.253543 15681 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:42.254264 15681 tablet_bootstrap.cc:492] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:42.254914 15681 ts_tablet_manager.cc:1403] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.002s
I20260709 13:04:42.257568 15681 raft_consensus.cc:359] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:42.258322 15681 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:42.258876 15681 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:42.260855 15681 ts_tablet_manager.cc:1434] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:04:42.262522 14980 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-3ac8b7ea8eec4d01847e30ae2626afd0 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:42.262928 14980 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-3ac8b7ea8eec4d01847e30ae2626afd0 on tablet 3ac8b7ea8eec4d01847e30ae2626afd0 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:42.325917 15548 raft_consensus.cc:1217] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:42.329517 15548 raft_consensus.cc:1217] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:42.456358 15548 raft_consensus.cc:1217] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:42.810011 15548 raft_consensus.cc:1217] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:42.841513 15660 raft_consensus.cc:1064] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:42.844264 15660 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:42.865002 15040 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:42.868458 15548 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:42.870018 15692 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.870783 14966 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:42.871970 15660 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.874722 15660 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.888684 15669 raft_consensus.cc:1064] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:42.891651 15669 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:42.898518 15659 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:42.904399 15043 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:42.905853 15548 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:42.921515 14792 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:42.925310 15040 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:42.927556 15548 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:42.932775 14894 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:42.936319 15602 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.937144 15667 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:42.938982 15667 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:42.970147 14968 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.024449 15674 raft_consensus.cc:1064] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:43.029279 15674 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:43.069487 14894 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:43.074326 15669 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.077944 15043 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.079980 14968 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:43.104202 15548 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:43.080039 15704 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:04:43.112231 15705 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.113142 15707 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.119956 15548 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.148293 15626 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.151517 14890 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.162375 14968 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.166128 15548 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.181789 14792 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.193322 14890 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:43.201406 15548 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.202891 15660 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.203310 15043 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.204744 15659 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.197446 14894 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.222497 14791 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.214884 15041 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.244537 15548 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.250664 14967 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:43.213263 15660 raft_consensus.cc:2955] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.259189 15043 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:43.269829 15549 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.269944 15040 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.273350 15669 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.275354 15698 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.280874 15549 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.283617 14894 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.283382 15705 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.285029 15626 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.287218 15602 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.291150 15040 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.294454 15547 raft_consensus.cc:2955] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.294605 15704 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.302273 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 022fa149e13b44eeae0eb2555eb6eb80 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.302989 15549 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.312333 14894 raft_consensus.cc:2955] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.314500 14789 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.316120 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 410c57dd04b546f3be0269aecdb13719 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.317726 14793 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:43.329943 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1b0b2aff5c14c50aac568802fb9aa6c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.343010 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b0b2aff5c14c50aac568802fb9aa6c with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:43.347550 15716 tablet_replica.cc:333] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:43.348587 15716 raft_consensus.cc:2243] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:43.349416 15716 raft_consensus.cc:2272] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.351747 14791 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.353072 15716 ts_tablet_manager.cc:1916] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.358350 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 022fa149e13b44eeae0eb2555eb6eb80 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:43.362182 15717 tablet_replica.cc:333] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:43.371694 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 410c57dd04b546f3be0269aecdb13719 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:43.371830 15716 ts_tablet_manager.cc:1929] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:43.373353 15716 log.cc:1199] T b1b0b2aff5c14c50aac568802fb9aa6c P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/b1b0b2aff5c14c50aac568802fb9aa6c
I20260709 13:04:43.373325 15717 raft_consensus.cc:2243] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:43.374320 15717 raft_consensus.cc:2272] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.375983 15716 tablet_replica.cc:333] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:43.376009 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet b1b0b2aff5c14c50aac568802fb9aa6c (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:43.377161 15716 raft_consensus.cc:2243] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:43.377589 15717 ts_tablet_manager.cc:1916] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.377954 15716 raft_consensus.cc:2272] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.386080 15716 ts_tablet_manager.cc:1916] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.393374 15717 ts_tablet_manager.cc:1929] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:43.393853 15717 log.cc:1199] T 022fa149e13b44eeae0eb2555eb6eb80 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/022fa149e13b44eeae0eb2555eb6eb80
I20260709 13:04:43.395584 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 022fa149e13b44eeae0eb2555eb6eb80 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:43.400440 15716 ts_tablet_manager.cc:1929] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:43.400940 15716 log.cc:1199] T 410c57dd04b546f3be0269aecdb13719 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/410c57dd04b546f3be0269aecdb13719
I20260709 13:04:43.402467 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 410c57dd04b546f3be0269aecdb13719 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:43.409267 15698 raft_consensus.cc:1064] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:43.411270 15698 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:43.418183 15043 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:43.418382 15549 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:43.419802 14890 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:43.420286 15669 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.423208 15698 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:04:43.426714 15669 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:43.436878 15698 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.438688 14890 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.450366 15043 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.458714 14793 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:43.479308 15549 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.496004 14968 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:43.502355 15549 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.507843 15602 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:43.517634 14890 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:43.519028 15667 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:43.520846 15602 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.528401 15549 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.576083 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ac8b7ea8eec4d01847e30ae2626afd0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:43.584575 14793 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.591727 14890 raft_consensus.cc:2955] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:43.626633 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ac8b7ea8eec4d01847e30ae2626afd0 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:04:43.645126 15723 tablet_replica.cc:333] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:04:43.685137 15723 raft_consensus.cc:2243] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:43.686419 15723 raft_consensus.cc:2272] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:43.690073 15723 ts_tablet_manager.cc:1916] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:43.701278 15723 ts_tablet_manager.cc:1929] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:43.701756 15723 log.cc:1199] T 3ac8b7ea8eec4d01847e30ae2626afd0 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/3ac8b7ea8eec4d01847e30ae2626afd0
I20260709 13:04:43.704017 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 3ac8b7ea8eec4d01847e30ae2626afd0 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:44.744416 15040 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:44.751137 14890 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.751667 14968 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.753090 15708 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:44.754101 15010 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3da3e723e874330b684997f3ab5385e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.754012 15727 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:44.764802 14890 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.766121 14968 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.763043 15727 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.782255 14793 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.788039 14890 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:44.797977 15040 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.799575 14968 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.799681 15660 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:04:44.801230 14861 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0d3b63f39d444317899acc30914f8801. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.803568 15660 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.836611 15659 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.841349 15043 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.843997 14967 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.852099 14968 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:44.868286 15040 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:44.869922 14936 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 146ff3031af843e3a501710c2301a015. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.871162 15602 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:44.867159 14792 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:44.872068 14890 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.874310 15724 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.879948 15471 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.880924 15043 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.884783 14894 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.893957 14968 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:44.899286 14793 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:44.909955 14936 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6a698f3a4fb348b4a13de15324682404. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:44.911651 15040 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.912935 15724 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:44.915848 14893 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:44.917574 15471 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:44.924614 15724 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.926210 15040 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.929108 14894 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:44.941890 14791 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:45.134625 15747 ts_tablet_manager.cc:933] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:45.137394 15747 tablet_copy_client.cc:323] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:04:45.139742 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet a3da3e723e874330b684997f3ab5385e from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:04:45.140414 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet a3da3e723e874330b684997f3ab5385e from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-a3da3e723e874330b684997f3ab5385e
I20260709 13:04:45.147877 15054 tablet_copy_source_session.cc:215] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.151342 15747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3da3e723e874330b684997f3ab5385e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.163015 15747 tablet_copy_client.cc:806] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.163621 15747 tablet_copy_client.cc:670] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.168040 15747 tablet_copy_client.cc:538] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:45.176326 15747 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:45.196378 15747 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:45.197225 15747 tablet_bootstrap.cc:492] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:45.197878 15747 ts_tablet_manager.cc:1403] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:04:45.200872 15747 raft_consensus.cc:359] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.201711 15747 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:45.202389 15747 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.205523 15747 ts_tablet_manager.cc:1434] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:04:45.209384 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-a3da3e723e874330b684997f3ab5385e received from {username='slave'} at 127.0.0.1:44388
I20260709 13:04:45.209836 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-a3da3e723e874330b684997f3ab5385e on tablet a3da3e723e874330b684997f3ab5385e with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:45.264938 15747 ts_tablet_manager.cc:933] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:45.267616 15747 tablet_copy_client.cc:323] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:45.275511 14980 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 146ff3031af843e3a501710c2301a015 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:45.276060 14980 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 146ff3031af843e3a501710c2301a015 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-146ff3031af843e3a501710c2301a015
I20260709 13:04:45.282045 14980 tablet_copy_source_session.cc:215] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.284652 15747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 146ff3031af843e3a501710c2301a015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.298235 15752 ts_tablet_manager.cc:933] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:45.301323 15747 tablet_copy_client.cc:806] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.301959 15747 tablet_copy_client.cc:670] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.302644 15752 tablet_copy_client.cc:323] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:45.304518 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 6a698f3a4fb348b4a13de15324682404 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:45.304983 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 6a698f3a4fb348b4a13de15324682404 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-6a698f3a4fb348b4a13de15324682404
I20260709 13:04:45.305552 15747 tablet_copy_client.cc:538] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:45.312518 14979 tablet_copy_source_session.cc:215] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.314268 15747 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:45.315599 15752 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a698f3a4fb348b4a13de15324682404. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.333070 15752 tablet_copy_client.cc:806] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.333686 15752 tablet_copy_client.cc:670] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.346640 15752 tablet_copy_client.cc:538] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:45.355082 15755 ts_tablet_manager.cc:933] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:45.362807 15752 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:45.375187 15755 tablet_copy_client.cc:323] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:04:45.377990 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 0d3b63f39d444317899acc30914f8801 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:04:45.378526 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 0d3b63f39d444317899acc30914f8801 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-0d3b63f39d444317899acc30914f8801
I20260709 13:04:45.391880 14905 tablet_copy_source_session.cc:215] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:45.396720 15755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d3b63f39d444317899acc30914f8801. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:45.418597 15752 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:45.424783 15752 tablet_bootstrap.cc:492] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:45.425101 15755 tablet_copy_client.cc:806] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:45.425498 15747 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:45.426059 15755 tablet_copy_client.cc:670] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:45.426610 15752 ts_tablet_manager.cc:1403] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.064s	user 0.026s	sys 0.017s
I20260709 13:04:45.426502 15747 tablet_bootstrap.cc:492] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:45.429045 15747 ts_tablet_manager.cc:1403] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.029s
I20260709 13:04:45.430570 15752 raft_consensus.cc:359] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.431921 15755 tablet_copy_client.cc:538] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:45.432087 15752 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:45.432902 15752 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.435251 15752 ts_tablet_manager.cc:1434] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.005s
I20260709 13:04:45.439231 15747 raft_consensus.cc:359] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.440112 15747 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:45.440737 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-6a698f3a4fb348b4a13de15324682404 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:45.441228 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-6a698f3a4fb348b4a13de15324682404 on tablet 6a698f3a4fb348b4a13de15324682404 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:45.440728 15747 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.444785 15747 ts_tablet_manager.cc:1434] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:04:45.446277 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-146ff3031af843e3a501710c2301a015 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:45.446628 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-146ff3031af843e3a501710c2301a015 on tablet 146ff3031af843e3a501710c2301a015 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:45.447054 15755 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:45.466435 15755 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:45.467267 15755 tablet_bootstrap.cc:492] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:45.467840 15755 ts_tablet_manager.cc:1403] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.007s
I20260709 13:04:45.470520 15755 raft_consensus.cc:359] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.471298 15755 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:45.471897 15755 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:45.473934 15755 ts_tablet_manager.cc:1434] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:04:45.475443 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-0d3b63f39d444317899acc30914f8801 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:04:45.475835 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-0d3b63f39d444317899acc30914f8801 on tablet 0d3b63f39d444317899acc30914f8801 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:45.566435 15549 raft_consensus.cc:1217] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:45.721777 15549 raft_consensus.cc:1217] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:45.823369 15549 raft_consensus.cc:1217] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:45.868198 15549 raft_consensus.cc:1217] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:46.004477 15730 raft_consensus.cc:1064] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:46.007025 15730 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.013010 15549 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.013139 14967 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.015019 14894 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.014886 15727 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.015964 15725 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.033324 15725 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.052747 15727 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.055668 14968 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.066151 14893 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.073894 14791 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.081795 15549 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.110800 15043 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.114688 15549 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.114681 14967 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.115820 15762 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.116604 15727 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.123458 15761 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.124995 15549 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.134816 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a3da3e723e874330b684997f3ab5385e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:46.134744 14967 raft_consensus.cc:2955] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.143926 14792 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.161808 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet a3da3e723e874330b684997f3ab5385e with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:46.164307 15770 tablet_replica.cc:333] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:46.165364 15770 raft_consensus.cc:2243] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.166049 15770 raft_consensus.cc:2272] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.169606 15770 ts_tablet_manager.cc:1916] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:46.180438 15770 ts_tablet_manager.cc:1929] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:46.180794 15770 log.cc:1199] T a3da3e723e874330b684997f3ab5385e P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/a3da3e723e874330b684997f3ab5385e
I20260709 13:04:46.182224 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet a3da3e723e874330b684997f3ab5385e (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:46.263996 15724 raft_consensus.cc:1064] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:46.265902 15724 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.272230 15549 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.272823 15043 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.273697 14893 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.274823 15471 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.275810 15724 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.276654 15744 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:46.299464 15744 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.302256 14894 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.333109 15549 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.333256 15040 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.337466 14793 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.437249 14968 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.442842 15549 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.442972 15043 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.444082 15778 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.445645 15778 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.446941 15777 raft_consensus.cc:1064] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:46.450790 15777 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.454573 15549 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.452976 15043 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.452054 15744 raft_consensus.cc:2955] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.473975 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6a698f3a4fb348b4a13de15324682404 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:46.476838 14792 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.482282 14968 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.482414 15547 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.484967 15039 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.486552 15777 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.488346 15777 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.489420 15660 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.498502 15781 raft_consensus.cc:1064] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:46.500921 15781 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.502794 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 6a698f3a4fb348b4a13de15324682404 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:46.503688 15770 tablet_replica.cc:333] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:46.504678 15770 raft_consensus.cc:2243] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.505359 15770 raft_consensus.cc:2272] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.509028 15770 ts_tablet_manager.cc:1916] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:46.526026 15777 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.545753 14967 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.555613 14793 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.557874 14894 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.544847 15549 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.559227 15744 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.560310 15547 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.564885 15744 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.567076 15770 ts_tablet_manager.cc:1929] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:46.567627 15770 log.cc:1199] T 6a698f3a4fb348b4a13de15324682404 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/6a698f3a4fb348b4a13de15324682404
I20260709 13:04:46.560374 15040 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:46.569718 15724 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:46.570837 15040 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.584620 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 6a698f3a4fb348b4a13de15324682404 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:46.603785 15724 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.620884 15547 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.626343 14894 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.632598 15043 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.634227 15777 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.644693 15787 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.651285 15548 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.654987 15777 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.657541 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0d3b63f39d444317899acc30914f8801 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:46.662257 14791 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.673956 14793 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:46.678074 15549 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.678431 14894 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.686342 15039 raft_consensus.cc:2955] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.691464 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 0d3b63f39d444317899acc30914f8801 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:46.694593 14966 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:46.704981 15547 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.706221 14890 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:46.697710 15043 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.708490 15778 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:46.709573 15776 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:46.718467 15791 tablet_replica.cc:333] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:46.719676 15791 raft_consensus.cc:2243] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.720391 15791 raft_consensus.cc:2272] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.721804 15744 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.723107 14890 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.736101 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 146ff3031af843e3a501710c2301a015 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:46.741782 15549 raft_consensus.cc:2955] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:46.734861 15791 ts_tablet_manager.cc:1916] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:46.747234 14791 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:46.763397 15791 ts_tablet_manager.cc:1929] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:46.763947 15791 log.cc:1199] T 0d3b63f39d444317899acc30914f8801 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/0d3b63f39d444317899acc30914f8801
I20260709 13:04:46.765926 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 0d3b63f39d444317899acc30914f8801 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:46.768097 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 146ff3031af843e3a501710c2301a015 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:04:46.772755 15792 tablet_replica.cc:333] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:04:46.773741 15792 raft_consensus.cc:2243] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:46.774441 15792 raft_consensus.cc:2272] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:46.778690 15792 ts_tablet_manager.cc:1916] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:46.789664 15792 ts_tablet_manager.cc:1929] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:46.789990 15792 log.cc:1199] T 146ff3031af843e3a501710c2301a015 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/146ff3031af843e3a501710c2301a015
I20260709 13:04:46.791352 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 146ff3031af843e3a501710c2301a015 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:47.840448 14966 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:04:47.846863 14936 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1040e321bc7c46f79cd0ad55259aba21. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:47.847297 14894 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:47.847297 15043 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:47.848732 15794 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.849655 15744 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:47.857867 15744 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:47.859170 14894 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:47.869678 15043 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:47.873935 14894 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:47.913524 14793 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:48.120635 15039 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:48.121855 15804 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.135810 15793 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.148061 15039 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.179843 14966 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.205199 14969 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:48.207535 14861 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c487d6b8fcd4ff280fa6c3c4a5ac8ab. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.227968 15793 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.226686 14791 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.248047 14893 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:48.249564 15807 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.257741 15039 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:48.265587 14966 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.270931 15799 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:04:48.272138 14936 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5ae8a41be2704a038fb65d4e543a826c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.272768 14893 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.280710 15744 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.286820 14893 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.292007 14792 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.296907 15039 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.302556 15043 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:48.304050 15787 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:48.305881 14861 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80a1bdc86202444db87b94ea818eedd5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:48.309540 14966 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:48.311153 15787 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:48.320705 15804 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.325372 15039 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.328622 14966 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.339427 15821 ts_tablet_manager.cc:933] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:48.346268 15821 tablet_copy_client.cc:323] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:48.345791 14791 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:48.347858 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 1040e321bc7c46f79cd0ad55259aba21 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:48.348390 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 1040e321bc7c46f79cd0ad55259aba21 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-1040e321bc7c46f79cd0ad55259aba21
I20260709 13:04:48.355811 14979 tablet_copy_source_session.cc:215] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:48.360015 15821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1040e321bc7c46f79cd0ad55259aba21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.375263 15821 tablet_copy_client.cc:806] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:48.375952 15821 tablet_copy_client.cc:670] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:48.379967 15821 tablet_copy_client.cc:538] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:48.385814 15821 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:48.402593 15821 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.403276 15821 tablet_bootstrap.cc:492] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:48.403837 15821 ts_tablet_manager.cc:1403] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.003s
I20260709 13:04:48.405820 15821 raft_consensus.cc:359] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.406416 15821 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:48.406925 15821 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.411531 15821 ts_tablet_manager.cc:1434] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:04:48.413394 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-1040e321bc7c46f79cd0ad55259aba21 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:48.413851 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-1040e321bc7c46f79cd0ad55259aba21 on tablet 1040e321bc7c46f79cd0ad55259aba21 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:48.647279 15821 ts_tablet_manager.cc:933] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:48.649008 15821 tablet_copy_client.cc:323] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:04:48.650629 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:04:48.651098 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-7c487d6b8fcd4ff280fa6c3c4a5ac8ab
I20260709 13:04:48.656044 14905 tablet_copy_source_session.cc:215] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:48.658679 15821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.672058 15821 tablet_copy_client.cc:806] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:48.672626 15821 tablet_copy_client.cc:670] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:48.676318 15821 tablet_copy_client.cc:538] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:48.684974 15821 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:48.710430 15827 ts_tablet_manager.cc:933] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:48.713086 15827 tablet_copy_client.cc:323] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:04:48.714773 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 80a1bdc86202444db87b94ea818eedd5 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:04:48.715317 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 80a1bdc86202444db87b94ea818eedd5 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-80a1bdc86202444db87b94ea818eedd5
I20260709 13:04:48.716768 15821 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.717521 15821 tablet_bootstrap.cc:492] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:48.718109 15821 ts_tablet_manager.cc:1403] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.007s
I20260709 13:04:48.720715 15821 raft_consensus.cc:359] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.721351 15821 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:48.721979 15821 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.722782 14905 tablet_copy_source_session.cc:215] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:48.724711 15821 ts_tablet_manager.cc:1434] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 13:04:48.735459 15550 raft_consensus.cc:1217] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:48.744939 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7c487d6b8fcd4ff280fa6c3c4a5ac8ab received from {username='slave'} at 127.0.0.1:51176
I20260709 13:04:48.745534 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7c487d6b8fcd4ff280fa6c3c4a5ac8ab on tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:48.746336 15827 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80a1bdc86202444db87b94ea818eedd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.757516 15821 ts_tablet_manager.cc:933] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:48.759871 15821 tablet_copy_client.cc:323] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:48.761668 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 5ae8a41be2704a038fb65d4e543a826c from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:48.762183 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 5ae8a41be2704a038fb65d4e543a826c from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-5ae8a41be2704a038fb65d4e543a826c
I20260709 13:04:48.769982 14979 tablet_copy_source_session.cc:215] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:48.770506 15827 tablet_copy_client.cc:806] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:48.771166 15827 tablet_copy_client.cc:670] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:48.775540 15821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ae8a41be2704a038fb65d4e543a826c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:48.776152 15827 tablet_copy_client.cc:538] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:48.802505 15821 tablet_copy_client.cc:806] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:48.802759 15827 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:48.803086 15821 tablet_copy_client.cc:670] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:48.815079 15821 tablet_copy_client.cc:538] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:48.823169 15821 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:48.824764 15827 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.825717 15827 tablet_bootstrap.cc:492] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:48.826402 15827 ts_tablet_manager.cc:1403] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.006s
I20260709 13:04:48.959229 15827 raft_consensus.cc:359] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.960117 15827 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:48.961210 15827 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.969089 15827 ts_tablet_manager.cc:1434] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.142s	user 0.011s	sys 0.035s
I20260709 13:04:48.971618 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-80a1bdc86202444db87b94ea818eedd5 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:04:48.972018 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-80a1bdc86202444db87b94ea818eedd5 on tablet 80a1bdc86202444db87b94ea818eedd5 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:48.979712 15821 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:48.980650 15821 tablet_bootstrap.cc:492] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:48.981304 15821 ts_tablet_manager.cc:1403] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.158s	user 0.018s	sys 0.006s
I20260709 13:04:48.985214 15821 raft_consensus.cc:359] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.989823 15821 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:48.990371 15821 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:48.994467 15821 ts_tablet_manager.cc:1434] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:04:48.999302 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-5ae8a41be2704a038fb65d4e543a826c received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:48.999728 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-5ae8a41be2704a038fb65d4e543a826c on tablet 5ae8a41be2704a038fb65d4e543a826c with peer 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:04:49.029847 14824 debug-util.cc:398] Leaking SignalData structure 0x7b080003a140 after lost signal to thread 13795
W20260709 13:04:49.030854 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800091a20 after lost signal to thread 14827
W20260709 13:04:49.031761 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800306840 after lost signal to thread 14919
W20260709 13:04:49.032771 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6fe0 after lost signal to thread 14994
W20260709 13:04:49.033740 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002f33c0 after lost signal to thread 15068
W20260709 13:04:49.034677 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002ec8c0 after lost signal to thread 15574
I20260709 13:04:49.124955 15550 raft_consensus.cc:1217] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:49.172510 15550 raft_consensus.cc:1217] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:49.242547 15550 raft_consensus.cc:1217] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:49.612550 15787 raft_consensus.cc:1064] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:49.625962 15787 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:49.629977 15793 raft_consensus.cc:1064] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:49.632464 15793 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:04:49.734643 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61293.7us
W20260709 13:04:49.743791 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50922.4us
I20260709 13:04:49.751552 15841 raft_consensus.cc:1064] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:49.752189 15039 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:49.759672 14970 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:49.773757 15550 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:49.756424 15793 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:04:49.776639 15836 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:49.777549 15837 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:49.777810 15841 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:49.811317 15834 raft_consensus.cc:1064] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:49.814894 15834 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:49.832602 15547 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:49.831655 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 77360.9us
I20260709 13:04:50.034548 15834 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:50.078987 15547 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.083913 15838 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:50.085000 15547 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.088294 15837 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:50.096457 15043 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.099534 15793 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:50.105185 14895 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.106093 14893 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.123136 15038 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.125200 15038 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.126438 15744 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:50.126892 15799 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:50.133498 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 336141us
I20260709 13:04:50.170771 15787 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.177336 15841 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.180100 14969 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:50.181696 15800 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.185009 15835 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:50.197116 15546 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.198184 15851 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.210875 15043 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.216516 14888 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.219383 14791 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.228340 15550 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.228955 14894 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:04:50.242976 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 57843.3us
I20260709 13:04:50.243251 15040 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.258486 15835 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:50.263110 14793 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.274416 15549 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.301141 15547 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:04:50.344164 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 71558.1us
I20260709 13:04:50.346661 15039 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.382897 14789 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.398267 14793 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.422514 15040 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.434249 14969 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:50.444869 15550 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.446561 15799 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.454376 15864 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.457800 15549 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.463635 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5ae8a41be2704a038fb65d4e543a826c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:50.469378 14890 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:50.471503 14888 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.473981 14894 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:50.474247 15799 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.478685 15549 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.478965 14793 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.485193 14888 raft_consensus.cc:2955] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.487670 15851 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.490496 15043 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.493538 15040 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.494185 15549 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.502456 15868 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:50.502905 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5ae8a41be2704a038fb65d4e543a826c with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:04:50.504446 15836 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:04:50.507493 15851 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.531965 15043 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.524863 15804 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.557721 15549 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.541231 15868 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.542284 15874 tablet_replica.cc:333] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:04:50.564342 15874 raft_consensus.cc:2243] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.565019 15874 raft_consensus.cc:2272] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.547254 15040 raft_consensus.cc:2955] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.554100 15550 raft_consensus.cc:2955] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.575934 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:50.576767 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80a1bdc86202444db87b94ea818eedd5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:50.577966 15874 ts_tablet_manager.cc:1916] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:50.595634 14793 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:50.604621 14791 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.621470 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:50.628502 15875 tablet_replica.cc:333] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:50.632557 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 80a1bdc86202444db87b94ea818eedd5 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:50.636175 15874 ts_tablet_manager.cc:1929] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:50.636644 15874 log.cc:1199] T 5ae8a41be2704a038fb65d4e543a826c P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/5ae8a41be2704a038fb65d4e543a826c
I20260709 13:04:50.639154 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 5ae8a41be2704a038fb65d4e543a826c (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:50.647092 15875 raft_consensus.cc:2243] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.647832 15875 pending_rounds.cc:70] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Trying to abort 1 pending ops.
I20260709 13:04:50.651638 15744 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:04:50.652133 15744 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:50.654013 15744 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:50.655076 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:04:50.658308 14991 debug-util.cc:398] Leaking SignalData structure 0x7b080014d8e0 after lost signal to thread 13795
W20260709 13:04:50.659381 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08001fcf60 after lost signal to thread 14827
W20260709 13:04:50.660627 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3740 after lost signal to thread 14919
I20260709 13:04:50.661069 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:50.663731 14933 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:50.665139 15864 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:50.678133 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3240 after lost signal to thread 14994
W20260709 13:04:50.685042 14991 debug-util.cc:398] Leaking SignalData structure 0x7b0800288960 after lost signal to thread 15068
W20260709 13:04:50.686311 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08002887e0 after lost signal to thread 15574
I20260709 13:04:50.648208 15875 pending_rounds.cc:77] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305634978328477696 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } } }
I20260709 13:04:50.704421 15875 raft_consensus.cc:2917] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:04:50.704952 15875 raft_consensus.cc:2889] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:04:50.709398 14969 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:50.705325 15875 raft_consensus.cc:2272] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.714882 15549 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.720395 15043 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:50.721719 15744 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:50.732503 15864 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:50.734062 15875 ts_tablet_manager.cc:1916] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:50.747505 15842 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.771960 15549 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.807091 15039 raft_consensus.cc:2955] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.828888 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1040e321bc7c46f79cd0ad55259aba21 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:50.830232 14793 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:50.880272 15875 ts_tablet_manager.cc:1929] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:50.880779 15875 log.cc:1199] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/7c487d6b8fcd4ff280fa6c3c4a5ac8ab
I20260709 13:04:50.882488 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 7c487d6b8fcd4ff280fa6c3c4a5ac8ab (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:50.887225 15875 tablet_replica.cc:333] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:50.888266 15875 raft_consensus.cc:2243] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.888971 15875 raft_consensus.cc:2272] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.891698 15875 ts_tablet_manager.cc:1916] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:50.896835 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 1040e321bc7c46f79cd0ad55259aba21 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:50.898759 15876 tablet_replica.cc:333] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:50.899998 15876 raft_consensus.cc:2243] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:50.900866 15876 raft_consensus.cc:2272] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:50.904498 15876 ts_tablet_manager.cc:1916] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:50.908464 15875 ts_tablet_manager.cc:1929] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 13:04:50.908921 15875 log.cc:1199] T 80a1bdc86202444db87b94ea818eedd5 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/80a1bdc86202444db87b94ea818eedd5
I20260709 13:04:50.910506 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 80a1bdc86202444db87b94ea818eedd5 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:50.923076 15876 ts_tablet_manager.cc:1929] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:50.923676 15876 log.cc:1199] T 1040e321bc7c46f79cd0ad55259aba21 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/1040e321bc7c46f79cd0ad55259aba21
I20260709 13:04:50.926960 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 1040e321bc7c46f79cd0ad55259aba21 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
W20260709 13:04:51.138585 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08000d6960 after lost signal to thread 13795
W20260709 13:04:51.139576 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800299640 after lost signal to thread 14827
W20260709 13:04:51.140578 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002c8f80 after lost signal to thread 14919
W20260709 13:04:51.141367 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002d47c0 after lost signal to thread 14994
W20260709 13:04:51.142138 15571 debug-util.cc:398] Leaking SignalData structure 0x7b080030e2a0 after lost signal to thread 15068
W20260709 13:04:51.143164 15571 debug-util.cc:398] Leaking SignalData structure 0x7b080015ab00 after lost signal to thread 15574
W20260709 13:04:51.807475 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44769.9us
I20260709 13:04:52.029148 14969 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:52.051008 15043 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.052055 14888 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:52.053372 14936 consensus_peers.cc:597] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfa2777cd48541b3b2bcf2ed038ac645. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:52.055742 15744 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.057917 15744 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.079749 15744 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.085109 14888 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.114858 14970 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:52.121933 14793 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:04:52.157275 15879 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:04:52.165071 15043 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.191476 14894 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.193116 15776 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:52.191915 14936 consensus_peers.cc:597] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4db89b17bfcd40e0a2e2d53f7cf21079. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:52.191565 15039 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.204752 15776 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.257579 15800 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.311527 15043 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:52.322552 14888 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.333612 15039 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:04:52.430941 15010 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 83edd178ff3943b58ccf199ddc331aec. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:52.433390 14969 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.434875 15811 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.443118 14888 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.447134 15877 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:52.480250 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 52286.7us
I20260709 13:04:52.482301 15811 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.487885 14890 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.508505 14790 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.521567 15043 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:04:52.526783 15890 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:04:52.570009 14969 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.601969 14791 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:52.618177 15894 ts_tablet_manager.cc:933] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:04:52.634366 15010 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2287a0d46a894be29150ebdc058fcfb6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:52.637784 15894 tablet_copy_client.cc:323] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:52.638258 14970 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.639354 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet cfa2777cd48541b3b2bcf2ed038ac645 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:52.639957 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet cfa2777cd48541b3b2bcf2ed038ac645 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-cfa2777cd48541b3b2bcf2ed038ac645
I20260709 13:04:52.640498 15877 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.643980 14890 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:52.646469 15811 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:52.653721 14979 tablet_copy_source_session.cc:215] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:52.658658 15894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfa2777cd48541b3b2bcf2ed038ac645. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.670951 15811 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.680526 14970 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.685380 14888 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.705852 14791 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:52.719136 15894 tablet_copy_client.cc:806] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:52.719837 15894 tablet_copy_client.cc:670] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:52.723843 15894 tablet_copy_client.cc:538] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:52.744585 15894 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:52.807247 15894 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:52.808157 15894 tablet_bootstrap.cc:492] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:52.808809 15894 ts_tablet_manager.cc:1403] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.003s
I20260709 13:04:52.824119 15894 raft_consensus.cc:359] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:52.824957 15894 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:52.829897 15894 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:52.862102 15901 ts_tablet_manager.cc:933] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:52.876663 15901 tablet_copy_client.cc:323] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:52.878398 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 4db89b17bfcd40e0a2e2d53f7cf21079 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:52.878931 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 4db89b17bfcd40e0a2e2d53f7cf21079 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-4db89b17bfcd40e0a2e2d53f7cf21079
I20260709 13:04:52.890705 15894 ts_tablet_manager.cc:1434] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.001s
I20260709 13:04:52.893296 14980 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-cfa2777cd48541b3b2bcf2ed038ac645 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:52.893754 14980 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-cfa2777cd48541b3b2bcf2ed038ac645 on tablet cfa2777cd48541b3b2bcf2ed038ac645 with peer 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:04:52.910501 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45684.8us
I20260709 13:04:52.919951 15905 ts_tablet_manager.cc:933] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:52.919983 14979 tablet_copy_source_session.cc:215] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:52.942032 15905 tablet_copy_client.cc:323] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:04:52.949301 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4db89b17bfcd40e0a2e2d53f7cf21079. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:52.995042 15901 tablet_copy_client.cc:806] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:52.996220 15901 tablet_copy_client.cc:670] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:52.997910 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 83edd178ff3943b58ccf199ddc331aec from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:04:52.998456 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 83edd178ff3943b58ccf199ddc331aec from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-83edd178ff3943b58ccf199ddc331aec
I20260709 13:04:53.005570 15901 tablet_copy_client.cc:538] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:53.010066 15054 tablet_copy_source_session.cc:215] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:53.014418 15905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 83edd178ff3943b58ccf199ddc331aec. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:04:53.016585 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49779.2us
I20260709 13:04:53.017752 15901 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:53.045039 15905 tablet_copy_client.cc:806] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:53.045678 15905 tablet_copy_client.cc:670] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:53.052065 15905 tablet_copy_client.cc:538] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:53.059376 15901 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:53.060274 15901 tablet_bootstrap.cc:492] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:53.060912 15901 ts_tablet_manager.cc:1403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.008s
I20260709 13:04:53.076078 15901 raft_consensus.cc:359] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:53.076932 15901 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:53.077584 15901 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:53.092705 15901 ts_tablet_manager.cc:1434] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260709 13:04:53.096308 15550 raft_consensus.cc:1217] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:53.103111 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-4db89b17bfcd40e0a2e2d53f7cf21079 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:53.103598 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-4db89b17bfcd40e0a2e2d53f7cf21079 on tablet 4db89b17bfcd40e0a2e2d53f7cf21079 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:53.115489 15905 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:53.132215 15901 ts_tablet_manager.cc:933] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:53.134620 15901 tablet_copy_client.cc:323] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:04:53.136238 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 2287a0d46a894be29150ebdc058fcfb6 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:04:53.136751 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 2287a0d46a894be29150ebdc058fcfb6 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-2287a0d46a894be29150ebdc058fcfb6
I20260709 13:04:53.149720 15054 tablet_copy_source_session.cc:215] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:53.153347 15901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2287a0d46a894be29150ebdc058fcfb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:53.165921 15905 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:53.172326 15905 tablet_bootstrap.cc:492] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:53.173079 15905 ts_tablet_manager.cc:1403] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.058s	user 0.023s	sys 0.007s
I20260709 13:04:53.176059 15905 raft_consensus.cc:359] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:53.176936 15905 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:53.177606 15905 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:53.180261 15905 ts_tablet_manager.cc:1434] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:04:53.181887 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-83edd178ff3943b58ccf199ddc331aec received from {username='slave'} at 127.0.0.1:44388
I20260709 13:04:53.182296 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-83edd178ff3943b58ccf199ddc331aec on tablet 83edd178ff3943b58ccf199ddc331aec with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:53.182507 15901 tablet_copy_client.cc:806] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:53.183151 15901 tablet_copy_client.cc:670] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:53.187227 15901 tablet_copy_client.cc:538] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:53.199581 15901 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:53.235805 15901 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:53.237210 15901 tablet_bootstrap.cc:492] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:53.237954 15901 ts_tablet_manager.cc:1403] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.010s
I20260709 13:04:53.240952 15901 raft_consensus.cc:359] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:53.258133 15901 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:53.258893 15901 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:53.264979 15901 ts_tablet_manager.cc:1434] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 13:04:53.270675 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-2287a0d46a894be29150ebdc058fcfb6 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:04:53.271128 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-2287a0d46a894be29150ebdc058fcfb6 on tablet 2287a0d46a894be29150ebdc058fcfb6 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:53.413919 15549 raft_consensus.cc:1217] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:53.496829 15549 raft_consensus.cc:1217] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:53.593367 15910 raft_consensus.cc:1064] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:53.596946 15910 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:53.601523 15549 raft_consensus.cc:1217] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:53.642204 15549 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:53.644351 15908 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:53.656352 14888 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:53.659499 15800 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:53.661070 15039 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:53.665210 15909 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:53.751953 15039 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:53.724610 15909 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:53.788728 14890 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:53.833688 15549 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:53.926047 15908 raft_consensus.cc:1064] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:53.930325 15908 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:53.936619 14792 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.000203 15550 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:54.023859 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 172837us
I20260709 13:04:54.044839 15909 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:54.056527 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 115305us
W20260709 13:04:54.090276 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 103166us
I20260709 13:04:54.098295 14893 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:54.130999 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 132372us
I20260709 13:04:54.159292 15039 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.196499 15920 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:54.213075 15898 raft_consensus.cc:1064] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:54.222393 15898 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:54.240422 15920 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:04:54.243754 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49047.4us
I20260709 13:04:54.253978 15877 raft_consensus.cc:1064] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:54.259819 15877 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:54.267876 14970 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.269240 15898 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.269649 14891 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.271296 15811 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:54.272539 15549 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.281620 14970 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:54.287979 15549 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.289484 15920 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.298748 15933 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.334848 15039 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.338730 14969 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.344296 15877 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.344754 14893 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.336174 15550 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.358976 15546 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:54.363253 15931 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.374877 15908 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.364727 15898 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:04:54.379122 14792 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.381335 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfa2777cd48541b3b2bcf2ed038ac645 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:54.384567 14891 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.389472 15924 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:04:54.397667 15926 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.401311 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet cfa2777cd48541b3b2bcf2ed038ac645 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:54.403203 15811 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:54.425817 14970 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.440874 14893 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.449885 15040 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.452020 15549 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.452872 15043 raft_consensus.cc:2955] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.513204 15942 tablet_replica.cc:333] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:54.514461 15942 raft_consensus.cc:2243] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.523671 15898 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.526521 14792 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.534274 15547 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.536175 15942 raft_consensus.cc:2272] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.548375 14791 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:54.551623 15942 ts_tablet_manager.cc:1916] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:54.561774 14967 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.569931 15942 ts_tablet_manager.cc:1929] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:54.570575 15942 log.cc:1199] T cfa2777cd48541b3b2bcf2ed038ac645 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/cfa2777cd48541b3b2bcf2ed038ac645
I20260709 13:04:54.572594 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet cfa2777cd48541b3b2bcf2ed038ac645 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:54.570883 14970 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:54.586440 15549 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.587321 14895 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.587975 15800 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:04:54.588824 15908 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.596040 15932 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.600494 15546 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.607774 15549 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.625430 14791 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.649695 14895 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.656117 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4db89b17bfcd40e0a2e2d53f7cf21079 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:54.659436 14892 raft_consensus.cc:2955] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.688369 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4db89b17bfcd40e0a2e2d53f7cf21079 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:04:54.731292 14792 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:54.747294 15945 tablet_replica.cc:333] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:04:54.754130 15945 raft_consensus.cc:2243] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.755177 15945 raft_consensus.cc:2272] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.761353 15945 ts_tablet_manager.cc:1916] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:54.797379 15945 ts_tablet_manager.cc:1929] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:54.798010 15945 log.cc:1199] T 4db89b17bfcd40e0a2e2d53f7cf21079 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/4db89b17bfcd40e0a2e2d53f7cf21079
I20260709 13:04:54.817968 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 4db89b17bfcd40e0a2e2d53f7cf21079 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:54.826416 15043 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:54.834293 15549 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.835517 14970 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.837590 15926 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.840116 15926 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.839314 15043 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:54.847126 15924 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.852744 14970 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.856758 14893 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.858366 15877 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.860836 15547 raft_consensus.cc:2955] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.865031 15877 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.870446 15549 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:04:54.872941 15898 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:04:54.877817 14893 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.881402 14792 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.906811 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 2287a0d46a894be29150ebdc058fcfb6 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:04:54.907713 15942 tablet_replica.cc:333] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:04:54.908689 15942 raft_consensus.cc:2243] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.909439 15942 raft_consensus.cc:2272] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.882225 15549 raft_consensus.cc:2955] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.915239 15942 ts_tablet_manager.cc:1916] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:54.929757 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2287a0d46a894be29150ebdc058fcfb6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:54.931325 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 83edd178ff3943b58ccf199ddc331aec with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:04:54.952615 14792 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:54.958976 15942 ts_tablet_manager.cc:1929] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:54.959473 15942 log.cc:1199] T 2287a0d46a894be29150ebdc058fcfb6 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/2287a0d46a894be29150ebdc058fcfb6
I20260709 13:04:54.961335 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 2287a0d46a894be29150ebdc058fcfb6 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:54.967330 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 83edd178ff3943b58ccf199ddc331aec with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:04:54.978116 15947 tablet_replica.cc:333] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:04:54.981343 15947 raft_consensus.cc:2243] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:04:54.987112 15947 raft_consensus.cc:2272] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:04:54.990645 15947 ts_tablet_manager.cc:1916] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:04:55.015110 15947 ts_tablet_manager.cc:1929] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:04:55.015645 15947 log.cc:1199] T 83edd178ff3943b58ccf199ddc331aec P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/83edd178ff3943b58ccf199ddc331aec
I20260709 13:04:55.017477 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 83edd178ff3943b58ccf199ddc331aec (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:04:56.200346 14970 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:04:56.215556 14936 consensus_peers.cc:597] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b9511e929bc448349baf940df42e2a22. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.218592 15040 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.220372 14895 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.222609 15908 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.224814 15908 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:56.251600 15908 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.254763 14895 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.251588 15040 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.296136 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.304876 14970 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:56.341595 14892 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.343318 15885 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:04:56.354295 15040 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.361202 15885 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:56.362275 14936 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b9af86494f14821b5b88018dbe4a1c2. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.390085 15952 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.399050 14892 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.394906 15043 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.439896 14892 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:56.477422 14791 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:56.545161 15043 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.546967 15946 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:04:56.558008 14861 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d441a969a644366b3cb4d386d7273e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.560927 14970 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.562842 15946 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.578038 15948 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.584990 15043 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.590888 14970 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.620151 14791 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.627285 15040 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:56.640898 15964 ts_tablet_manager.cc:933] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:56.659353 14970 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:04:56.660398 15010 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 060cd1347c834f27a9abc4cf6d5584a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:04:56.661504 15898 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.673902 14892 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:04:56.675434 15877 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:04:56.688448 15964 tablet_copy_client.cc:323] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:56.690896 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet b9511e929bc448349baf940df42e2a22 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:56.691591 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet b9511e929bc448349baf940df42e2a22 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-b9511e929bc448349baf940df42e2a22
I20260709 13:04:56.706274 14979 tablet_copy_source_session.cc:215] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:56.708455 15877 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.711320 14970 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.716267 14893 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.754920 14791 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:04:56.783203 15964 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b9511e929bc448349baf940df42e2a22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:56.812494 15969 ts_tablet_manager.cc:933] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:56.828464 15969 tablet_copy_client.cc:323] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:04:56.830302 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 8b9af86494f14821b5b88018dbe4a1c2 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:04:56.830847 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 8b9af86494f14821b5b88018dbe4a1c2 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-8b9af86494f14821b5b88018dbe4a1c2
I20260709 13:04:56.841008 14979 tablet_copy_source_session.cc:215] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:56.844089 15969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9af86494f14821b5b88018dbe4a1c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:56.905418 15964 tablet_copy_client.cc:806] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:56.906055 15964 tablet_copy_client.cc:670] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:56.913420 15969 tablet_copy_client.cc:806] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:56.913971 15969 tablet_copy_client.cc:670] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:56.936923 15964 tablet_copy_client.cc:538] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:56.947826 15969 tablet_copy_client.cc:538] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:56.948679 15964 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:57.005069 15969 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:57.126539 15973 ts_tablet_manager.cc:933] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:04:57.150604 15972 ts_tablet_manager.cc:933] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:57.158597 15973 tablet_copy_client.cc:323] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:04:57.161846 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 7d441a969a644366b3cb4d386d7273e1 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:04:57.162397 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 7d441a969a644366b3cb4d386d7273e1 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-7d441a969a644366b3cb4d386d7273e1
I20260709 13:04:57.175037 14905 tablet_copy_source_session.cc:215] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:57.180609 15972 tablet_copy_client.cc:323] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:04:57.183444 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:57.184684 15973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d441a969a644366b3cb4d386d7273e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:57.188526 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 060cd1347c834f27a9abc4cf6d5584a9 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:04:57.189114 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 060cd1347c834f27a9abc4cf6d5584a9 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-060cd1347c834f27a9abc4cf6d5584a9
I20260709 13:04:57.199103 15054 tablet_copy_source_session.cc:215] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:04:57.205471 15972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 060cd1347c834f27a9abc4cf6d5584a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:04:57.217084 15964 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:57.218042 15964 tablet_bootstrap.cc:492] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:57.218710 15964 ts_tablet_manager.cc:1403] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.270s	user 0.029s	sys 0.036s
I20260709 13:04:57.222189 15972 tablet_copy_client.cc:806] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:57.222782 15972 tablet_copy_client.cc:670] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:57.227016 15972 tablet_copy_client.cc:538] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:57.230518 15964 raft_consensus.cc:359] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.234887 15964 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:57.239671 15969 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:57.240641 15969 tablet_bootstrap.cc:492] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:57.241333 15969 ts_tablet_manager.cc:1403] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.237s	user 0.016s	sys 0.007s
I20260709 13:04:57.244444 15969 raft_consensus.cc:359] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.245291 15969 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:57.235798 15964 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.245978 15969 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.241381 15972 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:57.265861 15969 ts_tablet_manager.cc:1434] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:04:57.267791 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-8b9af86494f14821b5b88018dbe4a1c2 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:57.268265 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-8b9af86494f14821b5b88018dbe4a1c2 on tablet 8b9af86494f14821b5b88018dbe4a1c2 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.270076 15973 tablet_copy_client.cc:806] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:04:57.271497 15973 tablet_copy_client.cc:670] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:04:57.284413 15973 tablet_copy_client.cc:538] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:04:57.307260 15973 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:04:57.333232 15972 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:57.342073 15964 ts_tablet_manager.cc:1434] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.123s	user 0.011s	sys 0.010s
I20260709 13:04:57.348675 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-b9511e929bc448349baf940df42e2a22 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:04:57.363998 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-b9511e929bc448349baf940df42e2a22 on tablet b9511e929bc448349baf940df42e2a22 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.343541 15972 tablet_bootstrap.cc:492] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:57.366963 15972 ts_tablet_manager.cc:1403] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.126s	user 0.024s	sys 0.004s
I20260709 13:04:57.376142 15972 raft_consensus.cc:359] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.377126 15972 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:57.377905 15972 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.397220 15972 ts_tablet_manager.cc:1434] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:04:57.398790 15549 raft_consensus.cc:1217] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:57.398991 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-060cd1347c834f27a9abc4cf6d5584a9 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:04:57.399502 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-060cd1347c834f27a9abc4cf6d5584a9 on tablet 060cd1347c834f27a9abc4cf6d5584a9 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.413282 15973 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:04:57.414294 15973 tablet_bootstrap.cc:492] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:04:57.415702 15973 ts_tablet_manager.cc:1403] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.109s	user 0.017s	sys 0.010s
I20260709 13:04:57.420678 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:04:57.422451 14970 raft_consensus.cc:606] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.462038 15973 raft_consensus.cc:359] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.465739 15973 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:04:57.469574 15973 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:57.484109 15973 ts_tablet_manager.cc:1434] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.060s	user 0.005s	sys 0.002s
I20260709 13:04:57.488914 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7d441a969a644366b3cb4d386d7273e1 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:04:57.489369 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7d441a969a644366b3cb4d386d7273e1 on tablet 7d441a969a644366b3cb4d386d7273e1 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.490088 15885 raft_consensus.cc:993] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:04:57.490559 15800 raft_consensus.cc:1081] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:04:57.494864 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "338c720b04aa4c14b53937055c254e24"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:04:57.495591 15043 raft_consensus.cc:606] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:04:57.496572 15549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:04:57.498215 15549 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.498594 15549 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.506186 15549 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.515618 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:04:57.516175 14970 raft_consensus.cc:606] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:04:57.517848 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:57.521575 14893 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.521037 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:04:57.527688 14970 raft_consensus.cc:606] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.531468 14967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:04:57.531994 14967 raft_consensus.cc:606] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:04:57.534479 14967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:04:57.534970 14967 raft_consensus.cc:606] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:04:57.536019 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:04:57.537680 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:04:57.538096 15800 raft_consensus.cc:993] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:04:57.538617 15800 raft_consensus.cc:1081] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:04:57.538777 14893 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:04:57.548816 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:57.550412 14967 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.552057 14967 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:57.550652 15547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:04:57.553210 15547 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.552841 14967 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.553586 15547 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.554039 14967 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.557994 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:57.558892 15979 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.559347 15979 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:04:57.560895 15979 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.585842 14967 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:04:57.587921 15955 raft_consensus.cc:993] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:04:57.588833 15955 raft_consensus.cc:1081] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:04:57.592523 15546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:04:57.593065 15546 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.593421 15546 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.595110 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:57.605547 15547 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.612540 15545 raft_consensus.cc:1217] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:57.620399 15546 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.625763 15549 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:57.650836 15800 raft_consensus.cc:993] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:04:57.651352 15800 raft_consensus.cc:1081] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:04:57.657956 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:04:57.658661 14893 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.663954 14892 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:04:57.664496 14892 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.664827 14892 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.666872 14893 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:04:57.656654 15547 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:57.663630 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:57.675256 14969 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.675619 14969 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:57.676609 15549 raft_consensus.cc:1217] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:57.678211 14969 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.680672 14969 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.681849 15549 raft_consensus.cc:1217] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:04:57.685012 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:04:57.693465 15980 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.693969 15980 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:04:57.694888 15980 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.716042 14969 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:04:57.706442 14892 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:57.736534 14892 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:57.756628 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:57.757543 14970 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.757957 14970 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:57.765895 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:57.766693 14969 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:57.766983 14969 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:57.767895 14969 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.768889 14969 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.766821 15546 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:57.759034 14970 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:57.772857 14970 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.772773 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:57.773789 15039 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.785562 14969 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:04:57.803711 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:04:57.804986 15979 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.878074 15990 raft_consensus.cc:993] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:04:57.881605 15984 raft_consensus.cc:1081] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:04:57.884455 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "338c720b04aa4c14b53937055c254e24"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:04:57.885264 14893 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.885764 14893 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.924885 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:57.925486 15043 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.932791 15043 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:04:57.948522 15955 raft_consensus.cc:993] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:04:57.949347 15885 raft_consensus.cc:1081] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:04:57.951679 14895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:04:57.952298 14895 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:04:57.952689 14895 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:57.952623 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:57.953648 15804 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:57.954094 15804 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:57.954861 15804 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:57.983487 15800 raft_consensus.cc:1064] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:57.986078 15800 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:57.998072 14969 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:58.003854 15980 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:58.009243 14970 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:04:57.938266 15039 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:04:58.018086 14893 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:58.026108 14792 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.055092 15979 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:04:58.056377 15979 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:58.075632 14895 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:58.090014 14893 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:58.097522 14891 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.130515 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:58.132160 15039 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.137363 15043 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.141453 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:58.143263 14967 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.144815 15039 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:04:58.145772 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:58.133471 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:04:58.148360 15038 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.148694 15038 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:04:58.148842 14895 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:58.149533 15038 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:58.150660 15038 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.152107 15546 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.116348 15955 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:04:58.160768 15800 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:58.161558 14970 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:58.162961 15885 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:58.164489 15993 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.164631 15980 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:58.165089 15993 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:58.166064 15993 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:58.172966 14967 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:04:58.178025 15987 raft_consensus.cc:1064] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:58.179527 14891 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:58.180581 15987 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:58.200970 15038 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:04:58.202934 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:58.220994 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:04:58.221580 14969 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:04:58.221869 14969 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:04:58.227990 15804 raft_consensus.cc:1064] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:58.230417 15804 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:58.206322 15979 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:04:58.232522 16003 raft_consensus.cc:1064] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:04:58.234983 16003 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:58.237602 14792 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.244622 14969 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:58.247864 14792 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:04:58.283458 14969 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:58.340088 15800 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:04:58.384366 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 116379us
I20260709 13:04:58.388616 16008 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:04:58.410511 14969 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
W20260709 13:04:58.401638 16011 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:04:58.430595 15547 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.516665 14969 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:58.519325 14969 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:58.520756 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 181551us
I20260709 13:04:58.518030 16008 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:04:58.540037 15549 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:58.548949 14791 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:04:58.571139 14969 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.575251 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:58.569557 15038 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:58.593967 15039 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.597383 15548 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:58.596001 15039 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:04:58.612192 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44512.8us
I20260709 13:04:58.613780 15804 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:04:58.616839 15980 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:58.595288 15946 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:04:58.639093 16023 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:04:58.602453 16008 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:04:58.735756 16016 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260709 13:04:58.791055 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 212935us
I20260709 13:04:58.865950 16029 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
W20260709 13:04:58.913162 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 126822us
W20260709 13:04:58.905905 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 310605us
I20260709 13:04:58.974692 15993 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:04:58.995150 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 402634us
I20260709 13:04:58.997272 14791 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:59.012852 14891 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:04:59.019248 15039 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:04:59.048539 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 188550us
W20260709 13:04:59.054823 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 313662us
I20260709 13:04:59.071132 14890 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:59.121526 16038 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:04:59.108707 15995 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:04:59.157543 15545 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:04:59.190099 16040 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 13:04:59.199919 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.022s
W20260709 13:04:59.201071 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.000s	sys 0.022s
W20260709 13:04:59.201701 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 565014us
I20260709 13:04:59.333487 15040 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:59.336208 16023 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:04:59.336735 16023 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:59.304297 15993 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:04:59.351733 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:04:59.370054 14964 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.369839 16044 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:04:59.356624 16000 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:04:59.359460 15993 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:04:59.480031 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 119099us
I20260709 13:04:59.453162 15990 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.496124 14892 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:59.450485 16000 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:04:59.455251 16047 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:04:59.497506 15990 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:59.538797 16041 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 13:04:59.554503 16051 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:04:59.560599 16006 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:04:59.560997 14895 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:04:59.561143 16006 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:04:59.593973 16049 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:04:59.616767 15993 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:04:59.633997 16055 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:04:59.575218 16024 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:04:59.640591 15990 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:59.667191 16045 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:04:59.581683 16000 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:04:59.709359 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 140790us
I20260709 13:04:59.714461 15990 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:04:59.723492 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 144075us
I20260709 13:04:59.711746 16056 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:04:59.734400 16036 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:04:59.734975 16036 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:59.729478 16056 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:59.733889 16006 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:04:59.737964 16036 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:59.745127 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.745775 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:04:59.738610 16056 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:59.739599 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.746157 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:59.740130 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.722378 15990 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:59.750451 15990 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:59.729426 16017 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:59.756903 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:59.757704 15800 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:04:59.758157 15800 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:59.760486 15800 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:04:59.764590 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.761171 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:59.766378 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.768064 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:04:59.768918 16043 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:04:59.769459 15800 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:04:59.770020 15800 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:59.769451 16043 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:04:59.772490 15800 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:59.774296 14965 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:04:59.776985 16050 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.292s	user 0.002s	sys 0.000s
I20260709 13:04:59.777971 16056 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:04:59.774592 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.776338 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.789878 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.783293 16023 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:04:59.791478 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.794243 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.799636 15996 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:04:59.795694 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.803960 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.808825 16043 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:04:59.808234 14962 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:59.823045 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:04:59.827498 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:04:59.828483 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:59.832088 14967 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:04:59.834815 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:59.840687 15800 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:04:59.843947 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:59.862862 15885 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.802733 16061 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:04:59.882036 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:04:59.806655 15996 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:04:59.871783 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:04:59.859565 16024 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 13:04:59.900563 16056 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:04:59.900605 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46885.3us
I20260709 13:04:59.910992 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 112) took 1052 ms. Trace:
I20260709 13:04:59.911497 14791 rpcz_store.cc:276] 0709 13:04:58.859054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:58.859192 (+   138us) service_pool.cc:224] Handling call
0709 13:04:59.910907 (+1051715us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:04:59.020578 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:04:59.072708 (+ 52130us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:04:59.073828 (+  1120us) write_op.cc:435] Acquired schema lock
0709 13:04:59.075986 (+  2158us) tablet.cc:662] Decoding operations
0709 13:04:59.130977 (+ 54991us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:04:59.131038 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 13:04:59.131079 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:04:59.131325 (+   246us) tablet.cc:701] Row locks acquired
0709 13:04:59.131367 (+    42us) write_op.cc:260] PREPARE: finished
0709 13:04:59.131560 (+   193us) write_op.cc:270] Start()
0709 13:04:59.131722 (+   162us) write_op.cc:276] Timestamp: P: 1783602299131506 usec, L: 0
0709 13:04:59.131755 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:04:59.174065 (+ 42310us) log.cc:844] Serialized 594 byte log entry
0709 13:04:59.443667 (+269602us) op_driver.cc:464] REPLICATION: finished
0709 13:04:59.597993 (+154326us) write_op.cc:301] APPLY: starting
0709 13:04:59.598098 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:04:59.598229 (+   131us) tablet.cc:1370] finished BulkCheckPresence
0709 13:04:59.598382 (+   153us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:04:59.598642 (+   260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:04:59.598882 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:04:59.598950 (+    68us) write_op.cc:312] APPLY: finished
0709 13:04:59.599193 (+   243us) log.cc:844] Serialized 22 byte log entry
0709 13:04:59.599396 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:59.599511 (+   115us) write_op.cc:454] Released schema lock
0709 13:04:59.599562 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 13:04:59.599954 (+   392us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:04:59.599994 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":150576,"apply.run_cpu_time_us":1963,"apply.run_wall_time_us":1964,"num_ops":1,"prepare.queue_time_us":144,"prepare.run_cpu_time_us":3643,"prepare.run_wall_time_us":160114,"replication_time_us":233928,"thread_start_us":84633,"threads_started":1}]]}
W20260709 13:04:59.937777 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 107791us
W20260709 13:04:59.946817 16046 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.686s	user 0.000s	sys 0.012s
I20260709 13:04:59.939023 15007 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:04:59.952154 15984 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:04:59.952564 15984 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:04:59.952906 15984 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:04:59.958343 15007 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:59.939934 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:04:59.966410 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:04:59.974488 15988 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:04:59.979893 16018 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:04:59.971128 16023 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.000428 15984 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:00.029029 15546 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.031186 15549 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.034058 15984 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:00.034619 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:00.035202 14890 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.064625 15984 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.065296 15984 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:00.067667 15984 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:00.070873 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:00.115758 16029 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:00.116279 16029 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:00.119233 15987 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:00.125603 14790 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.140969 14890 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:00.136677 16056 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:00.142277 16056 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.142643 15037 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.145581 15035 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:00.149032 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:00.156150 15007 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:00.120096 15987 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.151638 16056 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:00.170812 16023 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.178548 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:00.200932 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:00.202301 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:00.201560 14968 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.207844 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:00.196451 16023 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:00.215837 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:00.217428 16029 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:00.218499 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:00.239250 14894 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.253561 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:00.279271 15987 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:00.274667 15042 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:00.309324 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48868.9us
I20260709 13:05:00.284926 15980 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.311338 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:00.294063 16023 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:00.313208 14933 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:00.298537 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56509us
I20260709 13:05:00.312467 16006 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.330566 16044 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.330622 16060 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:00.344548 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:00.352840 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:00.354410 16008 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.351606 16017 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.354386 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:00.358789 16006 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.360448 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:00.366210 16006 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.394789 14890 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
W20260709 13:05:00.433159 16074 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.211s	user 0.000s	sys 0.004s
I20260709 13:05:00.443781 15996 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:00.409991 16036 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:05:00.446131 16036 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.446602 16036 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:00.447726 16077 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 13:05:00.448450 16072 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:05:00.458902 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:00.425505 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 110105us
I20260709 13:05:00.476509 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:00.477034 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:00.477196 15804 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.493013 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:00.499889 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:00.495715 16028 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.544773 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:00.560371 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:00.504601 16036 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.584511 14790 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 210) took 1246 ms. Trace:
I20260709 13:05:00.590739 14792 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.594066 15036 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: [1.3-1.3]
I20260709 13:05:00.607358 16019 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:00.548627 15990 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:00.625155 14969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:00.625751 14969 raft_consensus.cc:606] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:00.628115 16083 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.628855 16083 consensus_queue.cc:1243] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 13:05:00.631006 16088 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:05:00.643699 16036 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.655308 14965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:00.658579 14965 raft_consensus.cc:606] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:00.671983 14793 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.673067 16045 raft_consensus.cc:993] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:00.673574 16045 raft_consensus.cc:1081] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:00.677635 15547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:00.678138 15547 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.678515 15547 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.687302 15547 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.690168 15547 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:00.692821 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:00.693424 15038 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.697693 14969 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.702930 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:00.703584 14965 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.703887 14965 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:00.584946 14790 rpcz_store.cc:276] 0709 13:04:59.358637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:04:59.363616 (+  4979us) service_pool.cc:224] Handling call
0709 13:04:59.785327 (+421711us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:05:00.584456 (+799129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:00.258990 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:00.259499 (+   509us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:00.265750 (+  6251us) write_op.cc:435] Acquired schema lock
0709 13:05:00.270078 (+  4328us) tablet.cc:662] Decoding operations
0709 13:05:00.272118 (+  2040us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:00.272190 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:00.272225 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:00.272394 (+   169us) tablet.cc:701] Row locks acquired
0709 13:05:00.272412 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:00.272553 (+   141us) write_op.cc:270] Start()
0709 13:05:00.272661 (+   108us) write_op.cc:276] Timestamp: P: 1783602300272512 usec, L: 0
0709 13:05:00.272683 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:00.273365 (+   682us) log.cc:844] Serialized 537 byte log entry
0709 13:05:00.312274 (+ 38909us) op_driver.cc:464] REPLICATION: finished
0709 13:05:00.501950 (+189676us) write_op.cc:301] APPLY: starting
0709 13:05:00.504099 (+  2149us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:00.504228 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:00.504377 (+   149us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:00.530329 (+ 25952us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:00.558531 (+ 28202us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:00.558586 (+    55us) write_op.cc:312] APPLY: finished
0709 13:05:00.558767 (+   181us) log.cc:844] Serialized 22 byte log entry
0709 13:05:00.558934 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:00.559008 (+    74us) write_op.cc:454] Released schema lock
0709 13:05:00.559044 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:00.559345 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:00.559378 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":129097,"reported_tablets":2,"spinlock_wait_cycles":426222976,"child_traces":[["op",{"apply.queue_time_us":182475,"apply.run_cpu_time_us":1971,"apply.run_wall_time_us":60557,"num_ops":1,"prepare.queue_time_us":122297,"prepare.run_cpu_time_us":2593,"prepare.run_wall_time_us":14685,"replication_time_us":39449,"spinlock_wait_cycles":224640,"thread_start_us":207256,"threads_started":2}]]}
I20260709 13:05:00.704633 14965 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.716362 14965 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.716555 14791 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:00.736150 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:00.736773 15042 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:00.747315 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:00.747891 15042 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:00.730777 15038 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
W20260709 13:05:00.751343 14780 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for b9511e929bc448349baf940df42e2a22 already in progress
I20260709 13:05:00.751753 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:00.754169 16087 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.754839 16087 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:00.755692 16087 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.757513 15545 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:00.758596 15042 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:00.760342 16045 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.762496 16036 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.778667 16045 raft_consensus.cc:993] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:00.780646 14970 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:05:00.781438 14970 pending_rounds.cc:85] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 2
I20260709 13:05:00.781699 14970 pending_rounds.cc:107] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:05:00.782198 14970 raft_consensus.cc:2917] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:05:00.781539 16045 raft_consensus.cc:1081] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:00.788489 14970 raft_consensus.cc:2889] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:00.797330 14965 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:00.801688 15042 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.804171 15547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:00.805222 15547 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.805509 15547 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.818420 14888 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:00.807858 15984 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:05:00.835642 15990 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:00.836685 15547 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.841845 15547 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:00.844834 14888 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:00.848031 16062 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.848353 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:00.850919 15037 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.852073 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:00.852605 14969 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:00.852869 14969 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:00.857250 16036 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.866226 14969 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.869408 14969 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.872768 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:00.873299 15042 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Received request to transfer leadership
I20260709 13:05:00.882017 14893 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:00.885955 14969 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:00.887053 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:00.886770 16033 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:00.887904 16087 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:00.888406 16087 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:00.889714 14888 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:00.903245 14841 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
I20260709 13:05:00.907516 16087 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:00.906102 14841 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for b9511e929bc448349baf940df42e2a22 already in progress
W20260709 13:05:00.912215 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for b9511e929bc448349baf940df42e2a22 already in progress
I20260709 13:05:00.919133 15546 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:00.919481 14969 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:05:00.903664 16101 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:05:00.928323 15547 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:00.933595 15988 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:00.960129 14791 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:05:00.956699 16102 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:05:00.927635 15037 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:00.967873 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b9af86494f14821b5b88018dbe4a1c2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:00.981809 16019 raft_consensus.cc:993] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:00.982300 15987 raft_consensus.cc:1081] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:00.994678 14888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:00.996421 14888 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:00.997373 15545 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:00.997596 14888 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:01.001590 15546 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.010177 15996 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:01.011590 14888 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:01.022564 14888 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:01.022182 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 060cd1347c834f27a9abc4cf6d5584a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:01.027499 16039 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:01.032754 14793 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.038465 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:01.043083 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:01.043664 14970 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:01.054098 14892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:01.054740 14892 raft_consensus.cc:606] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:01.059506 15043 raft_consensus.cc:2955] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.062391 14970 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:01.071806 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:01.085817 14969 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:01.087983 15988 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:01.088387 15549 raft_consensus.cc:2955] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.092332 14792 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.088232 15042 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:01.094585 15042 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:01.096212 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:01.096810 14970 raft_consensus.cc:606] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:01.101564 15993 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:01.102092 15993 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:01.104063 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:01.104562 14970 raft_consensus.cc:606] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:01.107903 14968 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.102957 15993 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:01.115345 15804 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.126156 15545 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 13:05:01.126585 15545 pending_rounds.cc:85] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 2
I20260709 13:05:01.126824 15545 pending_rounds.cc:107] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 13:05:01.127089 15545 raft_consensus.cc:2917] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 13:05:01.095343 15042 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:01.132102 15042 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:01.144035 15549 raft_consensus.cc:2955] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.153406 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:01.154042 14970 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:01.154333 14970 raft_consensus.cc:614] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:01.148669 15545 raft_consensus.cc:2889] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:01.170584 15042 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
W20260709 13:05:01.187579 15988 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:05:01.162182 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 060cd1347c834f27a9abc4cf6d5584a9 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:05:01.198113 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:01.198740 15042 raft_consensus.cc:606] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:01.204849 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d441a969a644366b3cb4d386d7273e1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:01.205199 16036 raft_consensus.cc:993] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:01.212719 15955 raft_consensus.cc:993] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:01.213187 16042 raft_consensus.cc:1081] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:01.219573 15546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:01.220197 15546 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:01.220587 15546 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.235740 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:05:01.237373 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:01.239882 16036 raft_consensus.cc:1081] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:01.242794 15547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:01.243357 15547 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:01.243750 15547 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.252950 15547 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.269559 15042 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:01.253252 14791 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.270938 16056 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:05:01.273959 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:01.274801 14970 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:01.275085 14970 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:01.275820 14970 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.276777 14970 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.285355 15547 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:01.284911 14970 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:01.288767 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:01.290074 16107 tablet_replica.cc:333] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:05:01.291044 16107 raft_consensus.cc:2243] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.298218 16056 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:01.298768 16056 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:01.299923 15804 raft_consensus.cc:993] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:01.299608 16056 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.300506 15804 raft_consensus.cc:1081] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:01.302744 14970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:01.303309 14970 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:01.305852 14970 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.310386 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:01.311108 15038 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.318567 16107 raft_consensus.cc:2272] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.317641 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.320080 14792 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.328212 14965 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:01.330361 16056 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.287341 15546 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.339479 15036 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:01.341070 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 133956us
I20260709 13:05:01.345743 16087 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.347254 15038 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:01.350494 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d441a969a644366b3cb4d386d7273e1 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:01.350729 14970 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:01.353984 14970 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:01.355849 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:01.356463 14892 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:01.356848 14892 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:01.359220 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:01.359795 15043 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.357843 14892 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:01.361049 14892 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.375106 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 8b9af86494f14821b5b88018dbe4a1c2 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:05:01.377125 14792 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.388338 14892 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:01.392449 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:01.391999 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:01.393973 15043 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:01.403343 15546 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:01.405153 16107 ts_tablet_manager.cc:1916] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:01.395882 16036 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:01.407742 16036 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:01.408989 16036 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:01.415997 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:01.416630 15038 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.422310 16103 raft_consensus.cc:993] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:01.422858 16062 raft_consensus.cc:1081] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:01.424224 14962 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:01.427546 16106 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.434163 16112 tablet_replica.cc:333] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:05:01.440719 14970 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:01.441216 14970 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:01.457882 14970 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.463721 16112 raft_consensus.cc:2243] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.464607 16112 raft_consensus.cc:2272] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.442324 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34568
I20260709 13:05:01.468591 14962 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:01.469094 14962 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.469214 14970 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.468675 16112 ts_tablet_manager.cc:1916] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:01.486274 14970 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:01.487298 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:01.510430 16113 tablet_replica.cc:333] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:05:01.511703 16113 raft_consensus.cc:2243] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:01.512563 16113 raft_consensus.cc:2272] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:01.501567 16056 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:01.538540 16113 ts_tablet_manager.cc:1916] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:01.557107 14962 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:01.568940 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:01.569048 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:01.569628 14893 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.569753 15036 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:01.570163 15036 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:01.570909 15036 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:01.572023 15036 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:01.577569 14893 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:01.581079 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:01.581810 16083 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:01.582338 16083 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:01.583292 16083 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:01.559185 14962 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:01.604640 16107 ts_tablet_manager.cc:1929] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:01.605145 16107 log.cc:1199] T 060cd1347c834f27a9abc4cf6d5584a9 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/060cd1347c834f27a9abc4cf6d5584a9
I20260709 13:05:01.606791 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 060cd1347c834f27a9abc4cf6d5584a9 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:01.623025 15038 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:01.626605 16056 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:01.650276 15547 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Advancing to term 3
I20260709 13:05:01.654780 14963 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:01.656446 16024 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:01.640863 14791 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.685139 15547 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:01.685776 16056 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.686642 15804 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:01.720928 14791 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:01.710741 15036 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:01.770051 16112 ts_tablet_manager.cc:1929] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:01.770577 16112 log.cc:1199] T 7d441a969a644366b3cb4d386d7273e1 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/7d441a969a644366b3cb4d386d7273e1
I20260709 13:05:01.774907 14792 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:01.740087 14963 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:01.785248 15038 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:01.785840 16119 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.787096 15804 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:01.798085 16113 ts_tablet_manager.cc:1929] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:01.798552 16113 log.cc:1199] T 8b9af86494f14821b5b88018dbe4a1c2 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/8b9af86494f14821b5b88018dbe4a1c2
I20260709 13:05:01.799422 15037 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:01.801195 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 7d441a969a644366b3cb4d386d7273e1 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:01.802700 16119 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.803296 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 8b9af86494f14821b5b88018dbe4a1c2 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:01.824106 15804 raft_consensus.cc:1064] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:01.826617 15804 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.840652 16024 raft_consensus.cc:1027] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: attempt to promote peer 58ee9fe38eb8453098f6d964e7675e79: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 13:05:01.851766 15546 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:01.841536 15037 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:01.858883 16028 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.859651 14963 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:01.860519 15804 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:05:01.871104 16028 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:01.902537 16024 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.906745 14963 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.932161 15037 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.945920 14791 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.950289 15546 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:01.969566 14892 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:01.976480 15546 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:01.976688 14970 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:01.978281 16126 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:01.979391 16024 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:01.989370 16125 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:02.002398 15036 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.004186 16036 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.007210 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b9511e929bc448349baf940df42e2a22 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:02.009693 14970 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:02.011216 14892 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.011775 15546 raft_consensus.cc:2955] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:02.012933 16041 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.058614 14888 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.063997 16089 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.069314 15037 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:02.070891 16119 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:02.084266 15038 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:02.085953 14962 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:02.088472 16083 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.105423 16119 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:02.178990 14791 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 5 to 6, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:02.201273 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet b9511e929bc448349baf940df42e2a22 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:02.202195 16112 tablet_replica.cc:333] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:05:02.203220 16112 raft_consensus.cc:2243] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:02.204061 16112 raft_consensus.cc:2272] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:02.209633 16112 ts_tablet_manager.cc:1916] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:02.238591 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.305230 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:02.323776 16112 ts_tablet_manager.cc:1929] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 13:05:02.324334 16112 log.cc:1199] T b9511e929bc448349baf940df42e2a22 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/b9511e929bc448349baf940df42e2a22
I20260709 13:05:02.330936 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet b9511e929bc448349baf940df42e2a22 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:02.364238 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:02.364895 14893 raft_consensus.cc:606] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:02.368034 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:02.368654 14962 raft_consensus.cc:606] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:02.380584 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:02.381219 14962 raft_consensus.cc:606] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:02.387045 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:02.387672 14893 raft_consensus.cc:606] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:02.393337 15037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:02.393975 15037 raft_consensus.cc:606] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:02.396775 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:02.397337 14962 raft_consensus.cc:606] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:02.398811 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:05:02.400451 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:02.451813 16125 raft_consensus.cc:993] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:02.452404 16125 raft_consensus.cc:1081] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:02.454404 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:02.454983 14962 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.455380 14962 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.463639 14962 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:02.470830 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:02.471496 14893 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.471812 14893 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:02.474458 14962 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:02.475507 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:02.476202 15038 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.491590 14893 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:02.507475 14893 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.533696 15036 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:02.634063 15038 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:02.637713 16041 raft_consensus.cc:993] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:02.638242 16041 raft_consensus.cc:1081] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:02.642866 14893 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:02.687197 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:02.692256 16083 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:02.692790 16083 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:02.693747 16083 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:02.694150 15546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:02.694772 15546 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.695129 15546 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.698342 16089 raft_consensus.cc:993] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:02.704661 15546 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:02.698944 16089 raft_consensus.cc:1081] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
W20260709 13:05:02.734969 15010 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 156c010162bf4cb99b535677eccb2740. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:02.738524 15036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:05:02.739589 15036 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.740240 15036 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.744345 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:02.744985 14892 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.747465 15546 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:02.748024 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:02.748602 14970 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:02.748898 14970 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:02.751206 14892 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:02.752211 14970 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:02.752562 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:02.753412 16087 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:02.753887 16087 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:02.754755 16087 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:02.765270 14893 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:02.765954 14970 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.771078 16019 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:02.778153 14962 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:02.789412 14970 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:02.794960 16139 raft_consensus.cc:993] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:02.795495 16139 raft_consensus.cc:1081] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:02.795239 16062 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:02.802057 14888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:02.802834 14888 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:02.803298 14888 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.812354 16089 raft_consensus.cc:993] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:02.813730 16089 raft_consensus.cc:1081] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:02.820205 14790 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:02.831363 16125 raft_consensus.cc:993] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:02.831929 16028 raft_consensus.cc:1081] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:02.833714 14963 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:02.865833 15036 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:02.830296 14888 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:02.879762 14888 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:02.880818 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:02.881490 15546 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:02.893190 15546 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:02.895862 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:02.908236 16125 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:02.908818 16125 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:02.909897 16125 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:02.885807 15036 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:03.084656 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:03.085316 15042 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.085644 15042 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:03.086403 15042 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:03.091758 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:03.092393 14892 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.101150 14892 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:03.110332 15035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:05:03.111076 15035 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.111755 15035 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.113044 14963 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:03.113507 14963 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.116861 15042 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.126031 15036 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:03.131731 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 315901us
I20260709 13:05:03.132427 15007 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:03.133679 16143 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.134156 16143 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:03.137468 16146 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.139451 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:03.140000 14968 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.140272 14968 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:03.140998 14968 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.142033 14968 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.135071 16143 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:03.147431 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 362007us
I20260709 13:05:03.154418 14791 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.170557 14893 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.156334 14790 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.181805 14968 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:03.198307 14888 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.199008 15042 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:03.213056 14963 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.218780 16136 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.220712 14888 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:03.223141 14963 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:03.228783 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:03.229468 14891 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.229866 14891 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:03.229720 14790 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.230741 14891 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.233397 14891 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.239477 14791 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.246165 15042 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:03.250864 16039 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.255784 14963 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:05:03.257694 14861 consensus_peers.cc:597] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 46876532b5b6444ba4fbaa536a316857. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.258265 16039 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:03.264971 14968 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.218784 15035 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.275220 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:03.275970 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:03.275969 15040 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.276551 14893 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.285902 14893 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:03.287458 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:03.291254 16146 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.291788 16146 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:03.292659 16146 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.296379 14891 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:03.300839 15040 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:03.308502 14893 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:03.310494 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:03.315511 16161 ts_tablet_manager.cc:933] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:03.314678 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:03.307982 15035 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:03.323056 14968 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:03.316244 16041 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:03.328794 14962 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:03.333899 14962 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:03.334772 14962 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.335970 14962 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:03.340471 16041 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:03.326361 16106 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:05:03.345475 16039 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.347500 16119 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:03.343019 16041 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:03.359503 15042 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.370281 15036 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.386597 16134 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:05:03.416849 16161 tablet_copy_client.cc:323] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:05:03.423164 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 156c010162bf4cb99b535677eccb2740 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:05:03.426414 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.425352 14791 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:03.374585 14963 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.443823 15545 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:03.445202 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 156c010162bf4cb99b535677eccb2740 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-156c010162bf4cb99b535677eccb2740
I20260709 13:05:03.454953 14962 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:03.458076 15036 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:03.459797 16028 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:03.491533 16151 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:03.492949 14968 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:05:03.500968 16166 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:05:03.527117 14790 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.541256 15054 tablet_copy_source_session.cc:215] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:03.555339 16161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156c010162bf4cb99b535677eccb2740. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:03.554698 14792 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:03.575168 14888 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.581537 16139 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:03.587567 16170 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:05:03.602174 14962 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.604012 16143 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.627921 16161 tablet_copy_client.cc:806] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:03.631204 16161 tablet_copy_client.cc:670] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:03.652606 16161 tablet_copy_client.cc:538] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:03.655153 15042 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:03.656582 16134 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:05:03.668219 14936 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9648bab22a13442a81e0775163508e93. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:03.698236 14888 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:03.706120 16083 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:03.710546 16161 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:03.733482 16089 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.735458 15042 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.741261 14894 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.762462 14789 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:03.771227 16161 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:03.772277 16161 tablet_bootstrap.cc:492] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:03.772962 16161 ts_tablet_manager.cc:1403] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.063s	user 0.015s	sys 0.012s
I20260709 13:05:03.783221 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:03.801534 14894 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:03.801936 16161 raft_consensus.cc:359] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:03.871897 14962 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.887710 16161 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:03.889214 16161 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:03.892179 16019 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.909475 14888 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.911741 14888 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:03.913797 16134 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.923197 16019 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:05:03.931977 14965 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:03.938578 16151 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:03.940588 15036 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:03.945042 16152 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:03.946214 16161 ts_tablet_manager.cc:1434] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.173s	user 0.005s	sys 0.008s
W20260709 13:05:03.947182 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08001d20c0 after lost signal to thread 13795
W20260709 13:05:03.949012 14916 debug-util.cc:398] Leaking SignalData structure 0x7b0800098100 after lost signal to thread 14827
I20260709 13:05:03.949486 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-156c010162bf4cb99b535677eccb2740 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:05:03.950212 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-156c010162bf4cb99b535677eccb2740 on tablet 156c010162bf4cb99b535677eccb2740 with peer 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:03.950780 14916 debug-util.cc:398] Leaking SignalData structure 0x7b080035eb80 after lost signal to thread 14919
W20260709 13:05:03.967185 14916 debug-util.cc:398] Leaking SignalData structure 0x7b080036cbe0 after lost signal to thread 14994
W20260709 13:05:03.968942 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8580 after lost signal to thread 15068
W20260709 13:05:03.970836 14916 debug-util.cc:398] Leaking SignalData structure 0x7b080033bae0 after lost signal to thread 15574
I20260709 13:05:04.001209 15037 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:04.016732 14861 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b35154b94cb40bc8e8f780311834ad6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:04.030066 16036 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:04.026170 16161 ts_tablet_manager.cc:933] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:05:04.073297 16024 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:04.103567 16186 ts_tablet_manager.cc:933] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:04.112655 15547 raft_consensus.cc:1217] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:04.122560 14962 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:04.225980 16186 tablet_copy_client.cc:323] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:05:04.229655 15040 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:04.235975 16161 tablet_copy_client.cc:323] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:05:04.237541 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 9648bab22a13442a81e0775163508e93 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:05:04.238157 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 9648bab22a13442a81e0775163508e93 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-9648bab22a13442a81e0775163508e93
I20260709 13:05:04.253959 14979 tablet_copy_source_session.cc:215] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:04.265777 14792 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:04.284385 16186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9648bab22a13442a81e0775163508e93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:04.315912 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 46876532b5b6444ba4fbaa536a316857 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:05:04.316603 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 46876532b5b6444ba4fbaa536a316857 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-46876532b5b6444ba4fbaa536a316857
I20260709 13:05:04.420444 14905 tablet_copy_source_session.cc:215] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:04.423864 16161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46876532b5b6444ba4fbaa536a316857. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:04.431102 16186 tablet_copy_client.cc:806] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:04.431795 16186 tablet_copy_client.cc:670] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:04.452586 16186 tablet_copy_client.cc:538] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:05:04.456307 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 150149us
I20260709 13:05:04.478502 16201 ts_tablet_manager.cc:933] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:05:04.482714 16186 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:04.550133 16161 tablet_copy_client.cc:806] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:04.573434 16201 tablet_copy_client.cc:323] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:05:04.576519 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 7b35154b94cb40bc8e8f780311834ad6 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:05:04.577122 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 7b35154b94cb40bc8e8f780311834ad6 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-7b35154b94cb40bc8e8f780311834ad6
I20260709 13:05:04.567119 16161 tablet_copy_client.cc:670] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:04.602142 16186 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:04.604671 16186 tablet_bootstrap.cc:492] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:04.605342 16161 tablet_copy_client.cc:538] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:04.623584 14905 tablet_copy_source_session.cc:215] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:04.625759 16186 ts_tablet_manager.cc:1403] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.143s	user 0.023s	sys 0.006s
I20260709 13:05:04.627139 16201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b35154b94cb40bc8e8f780311834ad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:04.637796 16196 raft_consensus.cc:1064] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:04.641217 16196 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:04.645377 16161 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:04.631193 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:04.650519 14962 raft_consensus.cc:606] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:04.629283 16186 raft_consensus.cc:359] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:04.656620 15546 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:04.658373 16146 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.652014 16186 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:04.659969 16186 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:04.661209 14968 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:04.662446 16186 ts_tablet_manager.cc:1434] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:05:04.671734 14894 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:04.685055 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-9648bab22a13442a81e0775163508e93 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:05:04.685536 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-9648bab22a13442a81e0775163508e93 on tablet 9648bab22a13442a81e0775163508e93 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:04.683434 16196 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:05:04.691177 16146 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:04.737295 16201 tablet_copy_client.cc:806] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:04.738057 16201 tablet_copy_client.cc:670] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:04.742213 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:04.743686 14894 raft_consensus.cc:606] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:04.786443 16201 tablet_copy_client.cc:538] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:04.791499 16196 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:04.782712 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:04.795748 14894 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:04.820326 16201 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:04.829183 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:04.829845 15035 raft_consensus.cc:606] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:04.831593 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:04.833209 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:04.839156 16036 raft_consensus.cc:993] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:04.839751 16036 raft_consensus.cc:1081] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:04.848147 14894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:05:04.848790 14894 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:04.849413 14894 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.863907 15546 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:04.856856 14894 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:04.887290 14790 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:04.876060 14962 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:04.908227 14894 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:04.915840 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:04.929383 14970 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:04.929721 14970 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:04.930433 14970 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:04.932720 14970 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.926755 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:04.945705 14970 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:04.946098 15035 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:04.947103 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:04.948402 16197 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:04.948899 16197 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:04.949757 16197 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:04.953395 15035 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:04.953572 14893 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:04.970369 16161 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.016074 16161 tablet_bootstrap.cc:492] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:05.016939 16161 ts_tablet_manager.cc:1403] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.372s	user 0.022s	sys 0.020s
I20260709 13:05:05.020355 16161 raft_consensus.cc:359] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:05:05.020969 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50201.5us
I20260709 13:05:05.053341 16161 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:05.054097 16161 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:05.056169 16201 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:05.056691 16161 ts_tablet_manager.cc:1434] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:05:05.058338 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-46876532b5b6444ba4fbaa536a316857 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:05:05.058764 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-46876532b5b6444ba4fbaa536a316857 on tablet 46876532b5b6444ba4fbaa536a316857 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:05.060948 16201 tablet_bootstrap.cc:492] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:05.061757 16201 ts_tablet_manager.cc:1403] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.242s	user 0.025s	sys 0.007s
I20260709 13:05:05.077802 16201 raft_consensus.cc:359] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:05.078766 16201 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:05.079654 16201 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:05.089247 16201 ts_tablet_manager.cc:1434] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:05:05.090996 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7b35154b94cb40bc8e8f780311834ad6 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:05:05.091434 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7b35154b94cb40bc8e8f780311834ad6 on tablet 7b35154b94cb40bc8e8f780311834ad6 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:05.091604 16151 raft_consensus.cc:993] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:05.092149 16151 raft_consensus.cc:1081] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:05.098958 14970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:05.099526 14970 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.099893 14970 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.110036 14970 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:05.112269 14970 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:05.113076 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:05.113662 14893 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:05.113957 14893 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:05.114881 15546 raft_consensus.cc:1217] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:05.114683 14893 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:05.115839 14893 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.123636 14893 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:05.125075 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:05.126226 16198 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.126718 16198 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:05.127648 16198 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:05.133047 14789 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.136240 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:05.136932 15036 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.192495 15036 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:05.229941 15036 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.231616 14791 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.244501 15546 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:05.246201 14893 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:05.246590 16019 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.247927 16146 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.255883 16195 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.261765 14894 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.264802 15547 raft_consensus.cc:2955] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.272655 16019 raft_consensus.cc:993] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:05.273399 16139 raft_consensus.cc:1081] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:05.275887 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:05.276552 14893 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.276968 14893 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.286029 15546 raft_consensus.cc:1217] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:05.298305 16039 raft_consensus.cc:993] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:05.298908 16039 raft_consensus.cc:1081] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:05.302210 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:05.302727 14962 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:05.303056 14962 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.321749 14962 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.324033 14791 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.335621 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 156c010162bf4cb99b535677eccb2740 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:05:05.411783 14780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 76290.5us
I20260709 13:05:05.364455 15035 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:05.413757 16151 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.430229 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 156c010162bf4cb99b535677eccb2740 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:05:05.433130 14962 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:05.433696 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:05.434341 14894 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:05.439317 14894 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:05.456611 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:05.457237 15547 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.464068 14893 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:05:05.470542 14894 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.467911 15547 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:05.473627 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:05.474221 14962 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.474504 14893 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:05.474677 14894 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:05.489982 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:05.492985 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:05.494084 16136 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:05.494582 16136 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:05.500516 16136 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.508739 16218 tablet_replica.cc:333] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:05:05.508549 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:05.509912 16218 raft_consensus.cc:2243] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:05.519994 14962 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:05.524938 14962 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:05.524295 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:05.529157 16153 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:05.522830 15035 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:05.530027 16218 raft_consensus.cc:2272] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:05.540295 14962 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:05.546653 16218 ts_tablet_manager.cc:1916] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:05.547070 16216 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:05.532889 15035 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:05.550832 15035 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:05:05.552269 15035 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:05.555773 16198 raft_consensus.cc:1064] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:05.558449 16198 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.576318 15547 raft_consensus.cc:1217] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:05.531458 16197 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
W20260709 13:05:05.630414 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 59672.6us
I20260709 13:05:05.607023 15035 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:05.635694 15036 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:05.640534 15547 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:05.637491 16036 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 13:05:05.637269 14893 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:05.648339 16036 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:05.647399 16153 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:05.647436 16195 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:05:05.658308 15036 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.662909 16036 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.668982 16153 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } }
I20260709 13:05:05.653898 16198 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 13:05:05.694626 14890 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:05.696357 16136 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:05.701306 14789 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 3 to 4, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.778110 16218 ts_tablet_manager.cc:1929] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:05.780588 16218 log.cc:1199] T 156c010162bf4cb99b535677eccb2740 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/156c010162bf4cb99b535677eccb2740
I20260709 13:05:05.783209 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 156c010162bf4cb99b535677eccb2740 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:05.789557 16227 raft_consensus.cc:1064] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:05.803299 16227 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.829121 16198 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.834268 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:05.835544 14893 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.838584 14789 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:05.904861 14789 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:05.905531 15546 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.931236 16233 raft_consensus.cc:1064] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:05.934228 16233 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.961010 15042 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:05.961678 15547 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:05.962591 16222 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:05.964586 14890 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:05.965997 16136 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:05.967840 16222 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:05.976709 15040 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:05.978391 16233 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:05.979117 15546 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:05.980095 15037 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:05.983006 14962 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:05.983500 16227 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:05:05.999315 14968 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:06.001212 16227 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.001641 14962 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:06.004037 15040 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.005028 16227 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.007865 15546 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.020694 15547 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.023675 16153 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.030697 16222 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:06.030933 16198 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.033478 15040 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.022199 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:06.033587 15545 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.037310 14790 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.040418 15037 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.030715 15547 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:05:06.079640 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49798.4us
I20260709 13:05:06.080523 16198 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.093842 14789 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.122786 14968 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.124017 14890 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:06.139912 16198 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:06.155222 16136 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.165292 15546 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.167994 16233 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.174173 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9648bab22a13442a81e0775163508e93 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:06.180202 15040 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:06.211817 16248 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.016s
I20260709 13:05:06.218448 16233 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:06.223703 16226 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.058s	user 0.002s	sys 0.006s
I20260709 13:05:06.223191 15546 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.226626 15037 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:05:06.232406 16222 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:06.230125 14789 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 1 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.287228 15037 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.289163 16222 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:06.234591 14962 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.309448 14968 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:06.300143 15036 raft_consensus.cc:2955] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.320573 15547 raft_consensus.cc:2955] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.332875 14968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:06.333617 14968 raft_consensus.cc:606] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:06.392974 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 90798.1us
W20260709 13:05:06.402490 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46688.3us
W20260709 13:05:06.409225 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 94661.7us
W20260709 13:05:06.419648 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 87371.8us
I20260709 13:05:06.427802 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:06.428650 14893 raft_consensus.cc:606] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:06.466416 16250 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:05:06.432798 16230 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
W20260709 13:05:06.528231 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 98337.5us
W20260709 13:05:06.528759 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 100354us
W20260709 13:05:06.559183 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 130000us
I20260709 13:05:06.563046 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b35154b94cb40bc8e8f780311834ad6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 13:05:06.565204 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 132847us
I20260709 13:05:06.573854 16266 raft_consensus.cc:993] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:06.574538 16136 raft_consensus.cc:1081] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
W20260709 13:05:06.584344 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 176647us
I20260709 13:05:06.583037 14890 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:06.599013 15037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:05:06.599608 15037 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.599961 15037 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.606479 15037 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:06.608294 15037 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:06.619753 14791 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:06.644363 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:06.645035 14970 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:06.645368 14970 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:06.646039 14970 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:06.647082 14970 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:06.661752 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b35154b94cb40bc8e8f780311834ad6 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34560
I20260709 13:05:06.664588 16270 tablet_replica.cc:333] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:05:06.673527 14970 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:06.681555 14968 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:06.697175 16270 raft_consensus.cc:2243] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.698096 16270 raft_consensus.cc:2272] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.701992 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:06.712033 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 9648bab22a13442a81e0775163508e93 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38784
I20260709 13:05:06.711159 16252 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:06.714598 16252 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:06.715564 16252 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:06.716079 16270 ts_tablet_manager.cc:1916] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:06.717411 16151 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:06.733915 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 299394us
I20260709 13:05:06.744005 15547 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:06.731609 16219 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.756170 14969 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.763823 14963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9648bab22a13442a81e0775163508e93"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:06.764464 14963 raft_consensus.cc:606] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:06.780702 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:06.774926 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:06.787134 15042 raft_consensus.cc:606] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:06.789968 14890 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:06.886797 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44234.2us
I20260709 13:05:06.884928 16270 ts_tablet_manager.cc:1929] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:06.888440 16270 log.cc:1199] T 7b35154b94cb40bc8e8f780311834ad6 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/7b35154b94cb40bc8e8f780311834ad6
W20260709 13:05:06.899452 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 68851.8us
I20260709 13:05:06.930801 16255 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:06.935004 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 46876532b5b6444ba4fbaa536a316857 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:06.910425 16271 tablet_replica.cc:333] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:05:06.936689 16271 raft_consensus.cc:2243] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:06.937444 16271 raft_consensus.cc:2272] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:06.942163 16264 raft_consensus.cc:993] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:06.942636 16264 raft_consensus.cc:1081] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:06.944036 15545 raft_consensus.cc:2955] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:06.948870 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:06.949386 14962 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:06.949705 14962 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.954383 16271 ts_tablet_manager.cc:1916] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:06.960255 14962 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:06.962090 14962 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:06.962481 14890 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:06.971331 14791 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:06.976758 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:06.977481 15036 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:06.988559 15036 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:07.011664 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 7b35154b94cb40bc8e8f780311834ad6 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:07.020159 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:07.021821 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:07.022508 15036 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:07.034760 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:07.037338 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:07.042361 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 140523us
I20260709 13:05:07.033341 16233 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 13:05:07.048564 16134 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:07.049098 16134 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:07.049952 16134 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:07.053217 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 46876532b5b6444ba4fbaa536a316857 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45040
W20260709 13:05:07.086033 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44338.9us
I20260709 13:05:07.092712 16265 raft_consensus.cc:993] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:07.092806 14890 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:07.093268 14890 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:07.093353 16265 raft_consensus.cc:1081] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:07.094108 14890 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:07.096426 16281 raft_consensus.cc:993] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:07.097050 16281 raft_consensus.cc:1081] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:07.099182 15545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9648bab22a13442a81e0775163508e93"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:07.099786 15545 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.100198 15545 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.109021 14791 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.095328 14890 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:07.124961 14890 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
W20260709 13:05:07.125515 16233 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 13:05:07.127858 14891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:07.128461 14891 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:07.129014 14891 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.137854 14962 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.139561 16237 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.166188 14891 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:07.168038 14891 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:07.169026 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:07.169597 15037 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.169900 15037 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:07.170655 15037 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:07.171602 16271 ts_tablet_manager.cc:1929] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:07.172030 16271 log.cc:1199] T 9648bab22a13442a81e0775163508e93 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/9648bab22a13442a81e0775163508e93
I20260709 13:05:07.185034 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:07.185662 14965 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.193907 15037 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.205691 15545 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:07.198000 14965 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:07.209683 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:07.213083 15036 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.210933 16283 tablet_replica.cc:333] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:05:07.212415 15037 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:07.217481 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:07.218192 16153 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.218736 16153 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:07.219566 16153 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:07.214532 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:07.221247 14968 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:07.221519 14968 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:07.222172 14968 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:07.223146 14968 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:07.225605 15036 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:07.232486 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:07.211721 15545 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:07.174489 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 9648bab22a13442a81e0775163508e93 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:07.235567 16268 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:07.238194 16283 raft_consensus.cc:2243] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:05:07.256688 14777 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 81967.2us
I20260709 13:05:07.256964 16268 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:07.256693 14968 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:07.258147 16268 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:07.260152 16283 raft_consensus.cc:2272] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:07.263345 16283 ts_tablet_manager.cc:1916] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:07.269795 14891 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.273141 16279 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.283564 14791 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 3 to 4, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.305501 14790 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:07.309471 14792 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:07.364454 16283 ts_tablet_manager.cc:1929] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:05:07.364949 16283 log.cc:1199] T 46876532b5b6444ba4fbaa536a316857 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/46876532b5b6444ba4fbaa536a316857
I20260709 13:05:07.373423 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 46876532b5b6444ba4fbaa536a316857 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:07.508692 14890 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:07.510878 16134 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:07.537756 15036 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:07.539400 16136 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:07.708379 15036 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:07.710341 16220 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:07.754431 14968 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:07.755885 16261 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:07.823276 15036 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.828392 16222 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:07.844100 14965 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:07.848912 16153 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.022764 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.102532 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:08.246352 15036 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:08.248943 14965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:08.249549 14965 raft_consensus.cc:606] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:08.253125 14965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:08.253755 14965 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:08.256793 14891 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:05:08.256847 15010 consensus_peers.cc:597] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66e4432ba29a43668db5483ebef3b522. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.259086 15036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:08.258947 16279 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:08.259706 15036 raft_consensus.cc:606] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:08.262564 14965 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:08.264550 16279 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.267702 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:08.268394 14890 raft_consensus.cc:606] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:08.271335 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:08.272986 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:08.302764 16281 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.317032 14968 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.351102 14891 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.360569 16153 raft_consensus.cc:993] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:08.368667 16153 raft_consensus.cc:1081] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:08.366277 14890 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:08.372188 14965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:08.373188 14965 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.373574 14965 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.384303 14790 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.399205 14965 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:08.402968 14965 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:08.404347 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:08.404949 15546 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.409127 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:08.409688 14893 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.409992 14893 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:08.410769 14893 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:08.412468 14893 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.421451 15546 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:08.422655 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:08.423987 16136 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.424481 16136 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:08.425351 16136 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:08.495774 16266 raft_consensus.cc:993] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:08.496281 16266 raft_consensus.cc:1081] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:08.498607 15545 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52844
I20260709 13:05:08.499166 15545 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.499507 15545 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:08.513190 14893 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:08.523339 15545 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:08.527150 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:08.527897 14965 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:08.528298 14965 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:08.530068 15545 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:08.532296 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:08.532851 14891 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:08.529317 14965 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:08.537926 14965 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:08.538682 16300 raft_consensus.cc:993] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:08.539152 16300 raft_consensus.cc:1081] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:08.540716 14894 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:08.541190 14894 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.541503 14894 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.551652 14894 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:08.554292 14894 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:08.554680 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:08.555361 14968 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.554841 14891 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:08.559013 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:08.560001 15036 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.560161 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:08.561056 16261 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:08.561514 16261 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:08.562323 16261 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:08.558625 14965 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:08.563542 14968 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:08.564663 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:08.565510 16222 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.566026 16222 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:08.566895 16222 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:08.579061 16257 raft_consensus.cc:993] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:08.579572 16257 raft_consensus.cc:1081] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:08.581429 15037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:05:08.581966 15037 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:08.582294 15037 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.560345 15036 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:08.585968 15036 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:08.587201 15036 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.589135 15037 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:08.592203 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:08.592818 14891 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.592988 15037 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:08.594719 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:08.595227 14965 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:08.595523 14965 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:08.596174 14965 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:08.597267 14965 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:08.601912 14891 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:08.602010 15036 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:08.603425 14965 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:08.626418 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:08.620733 14962 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:05:08.621407 14861 consensus_peers.cc:597] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf48bf0f29ee4f8fabd84185b8cc6a88. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.623862 15042 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:08.627337 16299 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:08.628332 16299 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:08.629261 16299 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:08.633080 16307 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:08.640888 16307 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.662403 14962 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.660935 16153 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.700340 14791 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 4 to 5, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 5 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.710347 15042 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.728060 14788 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.725006 14891 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:08.735083 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:08.736238 14788 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.785130 16314 ts_tablet_manager.cc:933] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:08.791000 15042 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:08.792778 16153 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.797261 14790 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:08.800304 14861 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7933f8a0325b4bf7a8bafc99c9284091. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.802733 14962 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:05:08.804271 16267 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.806656 16314 tablet_copy_client.cc:323] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:05:08.808161 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 66e4432ba29a43668db5483ebef3b522 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:05:08.808599 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 66e4432ba29a43668db5483ebef3b522 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-66e4432ba29a43668db5483ebef3b522
I20260709 13:05:08.813076 16307 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.816429 15054 tablet_copy_source_session.cc:215] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:08.822307 14891 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:08.827718 16314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66e4432ba29a43668db5483ebef3b522. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:08.831759 16257 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:08.842824 15036 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:08.833984 14962 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:05:08.869731 15010 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 67571e95c6f547b989f85aa109da10a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:08.870152 14968 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:08.872721 16281 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.884511 14894 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:05:08.886312 16279 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:08.910246 15036 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.930902 16279 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.932176 14792 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 2, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.952673 14891 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.957103 14965 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:08.961112 14790 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:08.968394 15545 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:08.969934 16136 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:08.971573 15042 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:08.976333 16222 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:08.977439 16314 tablet_copy_client.cc:806] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:08.978044 16314 tablet_copy_client.cc:670] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:08.990788 16314 tablet_copy_client.cc:538] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:09.006493 16314 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:09.030625 14962 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.037068 16267 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:09.047438 16328 ts_tablet_manager.cc:933] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:05:09.084481 14891 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:05:09.086758 16261 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:09.094436 14965 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:05:09.096779 16261 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:09.105721 16328 tablet_copy_client.cc:323] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:05:09.108568 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet cf48bf0f29ee4f8fabd84185b8cc6a88 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:05:09.109301 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet cf48bf0f29ee4f8fabd84185b8cc6a88 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-cf48bf0f29ee4f8fabd84185b8cc6a88
I20260709 13:05:09.198082 14965 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.200278 16299 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.211225 14893 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:09.212783 16299 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:09.217777 14905 tablet_copy_source_session.cc:215] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 13:05:09.222615 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 67323.9us
I20260709 13:05:09.244990 16328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf48bf0f29ee4f8fabd84185b8cc6a88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.273809 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:09.321645 16344 ts_tablet_manager.cc:933] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:09.330996 16328 tablet_copy_client.cc:806] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:09.341516 16328 tablet_copy_client.cc:670] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:09.344540 16314 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.367558 16345 ts_tablet_manager.cc:933] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:05:09.372437 16314 tablet_bootstrap.cc:492] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:09.374493 16314 ts_tablet_manager.cc:1403] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.368s	user 0.017s	sys 0.017s
I20260709 13:05:09.381062 16345 tablet_copy_client.cc:323] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:05:09.377106 16344 tablet_copy_client.cc:323] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:05:09.382731 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 7933f8a0325b4bf7a8bafc99c9284091 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:05:09.383315 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 7933f8a0325b4bf7a8bafc99c9284091 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-7933f8a0325b4bf7a8bafc99c9284091
I20260709 13:05:09.384063 16328 tablet_copy_client.cc:538] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:09.395577 14905 tablet_copy_source_session.cc:215] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:09.399780 16345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7933f8a0325b4bf7a8bafc99c9284091. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.404919 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 67571e95c6f547b989f85aa109da10a9 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:05:09.405450 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 67571e95c6f547b989f85aa109da10a9 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-67571e95c6f547b989f85aa109da10a9
I20260709 13:05:09.411392 16328 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:09.413374 15054 tablet_copy_source_session.cc:215] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:09.404508 16314 raft_consensus.cc:359] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.424698 16314 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:09.425554 16344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67571e95c6f547b989f85aa109da10a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:09.425731 16314 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.424206 16345 tablet_copy_client.cc:806] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:09.431181 16345 tablet_copy_client.cc:670] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:09.442281 16314 ts_tablet_manager.cc:1434] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260709 13:05:09.448378 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:09.454897 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-66e4432ba29a43668db5483ebef3b522 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:05:09.455396 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-66e4432ba29a43668db5483ebef3b522 on tablet 66e4432ba29a43668db5483ebef3b522 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:09.460435 16345 tablet_copy_client.cc:538] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:09.476709 16344 tablet_copy_client.cc:806] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:09.477461 16344 tablet_copy_client.cc:670] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:09.477821 16345 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:09.487231 16344 tablet_copy_client.cc:538] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:09.498493 16344 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:09.559130 16328 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.560161 16328 tablet_bootstrap.cc:492] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:09.560881 16328 ts_tablet_manager.cc:1403] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.150s	user 0.022s	sys 0.026s
I20260709 13:05:09.564061 16328 raft_consensus.cc:359] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.565158 16328 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:09.565879 16328 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.575745 16328 ts_tablet_manager.cc:1434] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:05:09.577699 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-cf48bf0f29ee4f8fabd84185b8cc6a88 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:05:09.578188 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-cf48bf0f29ee4f8fabd84185b8cc6a88 on tablet cf48bf0f29ee4f8fabd84185b8cc6a88 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:09.578408 15546 raft_consensus.cc:1217] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:09.577286 16344 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.586567 16344 tablet_bootstrap.cc:492] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:09.587338 16344 ts_tablet_manager.cc:1403] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.089s	user 0.028s	sys 0.004s
I20260709 13:05:09.590626 16344 raft_consensus.cc:359] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.595547 16344 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:09.596273 16344 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.606339 16344 ts_tablet_manager.cc:1434] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 13:05:09.608350 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-67571e95c6f547b989f85aa109da10a9 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:05:09.608754 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-67571e95c6f547b989f85aa109da10a9 on tablet 67571e95c6f547b989f85aa109da10a9 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:09.612847 16345 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:09.613848 16345 tablet_bootstrap.cc:492] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:09.631934 16345 ts_tablet_manager.cc:1403] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.156s	user 0.022s	sys 0.004s
I20260709 13:05:09.636560 16345 raft_consensus.cc:359] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.638821 16345 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:09.639638 16345 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.642525 16345 ts_tablet_manager.cc:1434] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:05:09.647095 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7933f8a0325b4bf7a8bafc99c9284091 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:05:09.647605 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7933f8a0325b4bf7a8bafc99c9284091 on tablet 7933f8a0325b4bf7a8bafc99c9284091 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:09.662431 15547 raft_consensus.cc:1217] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:09.671792 14965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:09.672385 14965 raft_consensus.cc:606] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:09.679868 15037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:09.680439 15037 raft_consensus.cc:606] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:09.681005 15547 raft_consensus.cc:1217] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:05:09.686178 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:09.686719 14893 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:09.690255 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:09.690775 14893 raft_consensus.cc:606] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:09.692728 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:09.694264 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:09.716372 15547 raft_consensus.cc:1217] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:05:09.882115 16257 raft_consensus.cc:993] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:09.882668 16257 raft_consensus.cc:1081] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:09.905784 15037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:05:09.906380 15037 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.906723 15037 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.913940 15037 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:09.916972 16352 raft_consensus.cc:993] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:09.918762 16341 raft_consensus.cc:1081] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:09.922612 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:09.923130 14893 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.923502 14893 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:09.928192 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48578.5us
I20260709 13:05:09.928418 15037 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:09.931988 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:09.932502 14962 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:09.932797 14962 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:09.933491 14962 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:09.934597 14962 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.941598 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:09.942236 14891 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:09.951124 14891 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:09.951014 14962 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:09.957381 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:09.958716 16341 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:09.959182 16341 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:09.960796 16341 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:09.964578 14893 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:09.970329 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:09.970857 14965 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:09.981670 16307 raft_consensus.cc:993] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:09.982180 16307 raft_consensus.cc:1081] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:05:09.986562 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:05:09.987124 14962 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:09.987471 14962 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.001444 14962 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:10.008947 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:10.009529 15042 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:10.009838 15042 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:10.010161 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:10.010690 15037 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.010547 15042 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:10.011783 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:10.012316 14890 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:10.012584 14890 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:10.013247 14890 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:10.014197 14890 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.017232 15037 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:10.018601 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:10.019343 16355 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:10.022929 16355 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:10.023324 15042 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:10.023999 16355 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:10.004843 14965 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:10.007689 14893 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:10.029436 14890 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:10.035166 14859 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:10.038015 16307 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:10.038481 16307 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:10.038333 14790 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:10.039373 16307 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:10.045781 14962 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:10.046785 16267 raft_consensus.cc:1064] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:10.049113 16222 raft_consensus.cc:993] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:10.049520 16222 raft_consensus.cc:1081] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:10.049422 16267 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.051087 15037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45060
I20260709 13:05:10.051607 15037 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.051941 15037 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.078040 15037 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.083397 15042 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:10.094820 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:10.095422 15547 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.100988 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:10.101572 14890 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:10.101848 14890 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:10.102524 14890 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.103348 15037 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:10.104319 14890 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:10.103842 14788 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.103072 15547 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:10.106998 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:10.108366 16341 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:10.109361 16341 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:10.109236 14791 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.112572 16341 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.129331 15037 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:10.131748 15546 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:10.133152 16320 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.133992 14965 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:10.135887 16320 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.136106 14890 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:10.141419 16267 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.199975 16267 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.202080 16222 raft_consensus.cc:1064] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:10.204464 16222 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.213433 15037 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.223035 16353 raft_consensus.cc:1064] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:10.231688 16353 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.254798 14962 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.260164 14790 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.264616 14790 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.276001 14891 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:10.277954 15037 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:10.278195 15547 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:10.278784 15546 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:10.281616 16320 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:10.282781 14962 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:05:10.284662 16341 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.284703 15546 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.286389 16341 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.291939 14962 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:05:10.291895 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38784
I20260709 13:05:10.292570 14890 raft_consensus.cc:606] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:05:10.297714 16365 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:10.300511 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38784
I20260709 13:05:10.301029 14890 raft_consensus.cc:606] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Received request to transfer leadership
W20260709 13:05:10.303149 14777 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 66e4432ba29a43668db5483ebef3b522 already in progress
I20260709 13:05:10.298524 16341 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 13:05:10.304334 16267 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:10.359197 14893 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.368500 16299 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.369704 16267 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.372731 14962 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.373449 14890 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.379824 14968 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:10.381412 16371 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:10.393046 16307 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.398039 14791 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.398887 15547 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:10.395598 14962 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.401525 15042 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.394636 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38784
I20260709 13:05:10.403632 14893 raft_consensus.cc:606] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Received request to transfer leadership
I20260709 13:05:10.402037 14788 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:10.408643 14841 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:05:10.409072 14841 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 66e4432ba29a43668db5483ebef3b522 already in progress
W20260709 13:05:10.409394 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 66e4432ba29a43668db5483ebef3b522 already in progress
I20260709 13:05:10.415860 15546 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.420693 14968 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.429016 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf48bf0f29ee4f8fabd84185b8cc6a88 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:10.429595 16299 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.420626 14965 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.454831 15042 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:10.454668 15545 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.460595 16222 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:10.467619 16371 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.477510 15547 raft_consensus.cc:2955] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:10.493476 14893 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.495397 16299 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:10.501420 15546 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Advancing to term 3
I20260709 13:05:10.512655 14790 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 4 to 5, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 2 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:10.520025 15546 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:10.522882 16365 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:10.534227 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet cf48bf0f29ee4f8fabd84185b8cc6a88 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:10.538314 15545 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:10.538018 15037 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:10.539726 16352 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 13:05:10.570322 16222 raft_consensus.cc:993] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:10.570868 16222 raft_consensus.cc:1081] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:05:10.577298 15545 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:10.585979 15037 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.587924 16355 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:10.592674 14969 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:05:10.593482 15037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45060
I20260709 13:05:10.594167 15037 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:10.594568 15037 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.597764 16279 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:05:10.609156 14891 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:10.611315 16353 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:10.600952 16365 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 13:05:10.629668 15037 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:10.657055 15037 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:10.658898 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:10.659557 14969 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.664913 16385 tablet_replica.cc:333] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:05:10.668123 16385 raft_consensus.cc:2243] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:10.669175 16385 raft_consensus.cc:2272] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:10.675629 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:10.676388 14890 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:10.676738 14890 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:10.677601 14890 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:10.679327 14890 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:10.695128 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:10.697435 16385 ts_tablet_manager.cc:1916] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:10.702623 14969 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:10.703924 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:10.705413 16281 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:10.708011 14969 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:10.705998 16281 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:10.731978 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100345us
I20260709 13:05:10.759056 14969 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 13:05:10.743340 16299 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:05:10.778005 16281 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:10.829762 14890 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:10.968122 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 84987.4us
I20260709 13:05:10.970605 14892 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:10.973057 14788 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 3 to 4, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:10.977830 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:11.021358 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 314995us
W20260709 13:05:11.032148 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49756.2us
I20260709 13:05:11.057343 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:11.065788 14891 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:11.069607 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67244.1us
W20260709 13:05:11.070565 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 82614.1us
W20260709 13:05:11.076102 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 118816us
W20260709 13:05:11.095819 16387 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:05:11.119728 16352 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:11.147046 14962 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:05:11.148404 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 72813.2us
I20260709 13:05:11.155479 16365 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:11.179798 15546 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:05:11.209468 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 137456us
W20260709 13:05:11.232705 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 227817us
I20260709 13:05:11.296546 16355 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:11.367247 16391 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:05:11.417205 14965 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:11.419463 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 135773us
I20260709 13:05:11.422508 16385 ts_tablet_manager.cc:1929] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:05:11.422937 16385 log.cc:1199] T cf48bf0f29ee4f8fabd84185b8cc6a88 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/cf48bf0f29ee4f8fabd84185b8cc6a88
W20260709 13:05:11.416229 16376 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260709 13:05:11.490553 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 81359.8us
I20260709 13:05:11.557075 15545 raft_consensus.cc:2955] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:05:11.560839 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:11.580534 16403 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:11.648157 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89167.3us
W20260709 13:05:11.793360 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 144074us
I20260709 13:05:11.981796 16405 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:11.982605 16405 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:11.985291 16405 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.115483 16371 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.116380 16371 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.119096 16371 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.120321 16371 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.120996 16371 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.126605 16307 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.127308 16307 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.129794 16307 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:12.238538 14891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.006s	sys 0.016s
W20260709 13:05:12.238967 14891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.016s
I20260709 13:05:12.272830 16307 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.273758 16307 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.276443 16307 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.278203 16299 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.278904 16299 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.281428 16299 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.387058 16299 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.387840 16299 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.390347 16299 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.445883 16299 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.446628 16299 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.449285 16299 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.465309 16428 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:12.466069 16428 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.475376 16307 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.476307 16307 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.479223 16307 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.571167 16429 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.572217 16429 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.574983 16429 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.717096 16429 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.593071 16428 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.598567 16307 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.718967 16307 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.721609 16307 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.643326 16430 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.723111 16430 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.725714 16430 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.738807 16299 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.739681 16299 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.742146 16299 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.743047 16307 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.743896 16307 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.746395 16307 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.760313 16431 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.761154 16431 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.765005 16299 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:12.765589 16299 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.768342 16299 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.777439 16371 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.780305 16432 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.781440 16432 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.784129 16432 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.717995 16429 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.817059 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1849) took 1017 ms. Trace:
I20260709 13:05:12.818706 16430 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.821626 14888 rpcz_store.cc:276] 0709 13:05:11.799663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.816154 (+1016491us) service_pool.cc:224] Handling call
0709 13:05:12.816543 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.816722 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.816747 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.816787 (+    40us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:12.816814 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.816863 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.816992 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.820269 16433 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.822789 16429 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.818729 16431 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.823211 16433 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:12.824672 14891 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.000s	sys 0.000s
W20260709 13:05:12.825008 14891 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.000s	sys 0.000s
I20260709 13:05:12.825052 16429 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.825330 16433 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.825661 16429 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.821870 16430 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.828872 16430 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.834333 16431 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.834949 16431 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.837534 16431 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.853740 16438 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.854331 16438 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.855163 16439 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.864507 16433 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.864915 16439 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.865178 16433 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.856199 16440 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.867796 16440 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.870292 16440 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.871757 16439 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.872413 16439 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.872516 16436 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.872985 16439 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.874094 16437 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.874981 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1845) took 1310 ms. Trace:
I20260709 13:05:12.861045 16428 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:12.876713 16428 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:12.856501 16429 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.861986 16434 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.878379 16434 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.878954 16428 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.879593 16428 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.880112 16428 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.880559 16434 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.862636 16355 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.863232 16432 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.881378 16432 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.882212 16428 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.861850 16351 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.882822 16351 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.883281 16432 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.863924 16430 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.884017 16430 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.884871 16351 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.872985 16436 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.874632 16437 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.886801 16436 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.887315 16436 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.887728 16437 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.887792 16436 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.867839 16433 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.885936 16430 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.858610 16299 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.890388 16436 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.898442 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.890264 16299 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.876130 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1847) took 1077 ms. Trace:
I20260709 13:05:12.888304 16437 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.891155 16355 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.875180 16439 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.899147 15037 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:12.900741 14894 rpcz_store.cc:276] 0709 13:05:11.799009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.875152 (+1076143us) service_pool.cc:224] Handling call
0709 13:05:12.875523 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:12.875729 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:12.875767 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:12.875822 (+    55us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.875867 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.875934 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.876062 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:12.906239 16445 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.896132 14891 rpcz_store.cc:276] 0709 13:05:11.564712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.565212 (+   500us) service_pool.cc:224] Handling call
0709 13:05:11.565535 (+   323us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:11.565920 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:11.565962 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:11.566494 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 13:05:12.239334 (+672840us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:12.825468 (+586134us) log.cc:844] Serialized 14 byte log entry
0709 13:05:12.874665 (+ 49197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:12.874737 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:12.874781 (+    44us) raft_consensus.cc:1685] finished
0709 13:05:12.874791 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:12.874903 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8776,"prepare.queue_time_us":155520,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":31546,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":188,"thread_start_us":1306998,"threads_started":4,"wal-append.queue_time_us":126954,"wal-append.run_cpu_time_us":1608,"wal-append.run_wall_time_us":1001629}
I20260709 13:05:12.911305 16448 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.912629 16436 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.913203 16441 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.919560 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.923111 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:12.900080 16351 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:12.900393 16430 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.930104 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.932742 15037 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:12.905377 16428 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:12.922108 16448 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.914098 16450 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.917179 16440 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:12.917795 16439 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.922216 16436 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.920770 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.912634 16449 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.945502 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.914467 16437 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.943838 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:12.947615 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.951646 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:12.952010 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47017us
I20260709 13:05:12.919548 16445 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.956476 15549 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:12.942014 16455 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.931977 16441 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.972144 16455 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.973750 16441 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.974232 16445 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:12.974586 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.974752 16445 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.975216 16445 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.975844 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.977481 16445 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.978724 16455 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.984477 15546 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:12.939126 16430 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.944001 16438 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.950881 15035 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:12.946358 16452 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.939616 16351 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.968225 16433 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.979416 16455 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.990705 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.991044 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:12.992447 15040 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:12.971235 16429 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:12.993463 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:12.993741 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:12.942823 16428 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.943904 16440 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.948307 16439 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:12.951479 16449 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.946781 16450 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.002848 16453 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.004411 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.003360 16453 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.007544 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.008102 14891 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.014205 16446 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.016685 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.000356 16438 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.023835 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.021762 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1848) took 1222 ms. Trace:
I20260709 13:05:13.023938 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:12.996495 16445 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.005201 16351 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:12.992645 16455 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.026428 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.015077 16307 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:12.995304 16433 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:12.996407 16452 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.024717 14893 rpcz_store.cc:276] 0709 13:05:11.799315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.020806 (+1221491us) service_pool.cc:224] Handling call
0709 13:05:13.021165 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.021376 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.021413 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.021467 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:13.021511 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.021580 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.021701 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.017210 16441 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.028836 16442 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.031908 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.029042 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:13.032636 16448 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.033140 16436 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.030097 16437 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.041129 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:13.016455 16450 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:12.999044 16429 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.027637 16438 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.044423 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:13.048002 15008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.487s	user 0.006s	sys 0.029s
I20260709 13:05:13.014804 16446 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.034098 16355 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:13.062191 15008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.502s	user 0.007s	sys 0.030s
I20260709 13:05:13.034045 16299 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.060964 15548 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:13.064482 16448 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.064725 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.066191 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:13.042217 16351 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.040607 16459 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.043912 16436 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.034021 16445 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.036075 16307 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.065153 16449 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.074432 16455 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.088016 16437 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.088598 16447 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.088692 16437 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.048282 16441 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.064893 16444 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.048522 16442 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.080618 16436 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.110579 16460 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.131222 14891 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:13.111869 16453 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.112375 16433 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.112334 16462 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.080862 16299 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.112890 16428 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.113667 16440 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.078315 16351 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.115621 16437 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.115792 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.116346 14968 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:13.116536 16439 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.124327 16469 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.141397 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.142203 14893 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:13.116420 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.116971 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.117264 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.117709 16465 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:13.118395 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52277.4us
I20260709 13:05:13.118547 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.118801 16463 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.119684 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.120244 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.143204 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.123139 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.124027 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.126420 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.126518 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.124804 16468 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.127058 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.127126 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.127519 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.127945 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.125334 16464 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.067198 16448 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.186192 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.186717 16448 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.137161 14894 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.138353 16440 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.089469 16447 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.160406 16470 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.160181 14895 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.121421 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.191512 14969 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:13.181758 16429 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.206552 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.210845 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.212589 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.213622 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1846) took 1415 ms. Trace:
I20260709 13:05:13.211534 14962 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:13.131258 16444 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:13.217237 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 55525.8us
I20260709 13:05:13.218464 16444 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.189699 16442 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.139008 16299 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.162752 14893 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:13.079581 16459 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.164518 14970 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:13.182000 16452 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.182158 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.244673 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.233873 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.245422 14895 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:13.182323 16454 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.161177 16456 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.214071 14890 rpcz_store.cc:276] 0709 13:05:11.798664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.212798 (+1414134us) service_pool.cc:224] Handling call
0709 13:05:13.213100 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.213270 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.213295 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.213354 (+    59us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:13.213385 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.213439 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.213557 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:13.161764 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.240352 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.183800 16430 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.185040 16450 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.187642 16441 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.204479 16351 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.173152 16463 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.134375 16460 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.165431 16465 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.239784 16470 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.138298 16462 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.189837 16469 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.246187 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.289841 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:11.425009 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet cf48bf0f29ee4f8fabd84185b8cc6a88 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:13.183506 14963 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:13.187234 14886 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:13.188834 16307 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:13.333555 14780 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 1.90812e+06us
W20260709 13:05:13.332576 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 86454us
I20260709 13:05:13.209164 16438 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.306239 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:13.255522 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.322062 14790 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 167) took 2045 ms. Trace:
I20260709 13:05:13.336287 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.340304 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.207508 16440 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.364693 14790 rpcz_store.cc:276] 0709 13:05:11.257340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.257506 (+   166us) service_pool.cc:224] Handling call
0709 13:05:13.303093 (+2045587us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":459376,"reported_tablets":1,"spinlock_wait_cycles":68736}
I20260709 13:05:13.340427 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.338920 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 67571e95c6f547b989f85aa109da10a9 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:13.364880 14893 raft_consensus.cc:2410] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 13:05:13.340245 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.371337 14890 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
W20260709 13:05:13.254268 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 246237us
I20260709 13:05:13.375684 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.381067 14888 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:13.264851 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.331333 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.365736 16479 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:13.292016 16445 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.386065 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.400269 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.402746 16462 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.331478 16394 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.387100 14889 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:13.336403 16450 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.387907 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:13.391094 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 84928.2us
I20260709 13:05:13.408511 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:13.407869 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 278414us
I20260709 13:05:13.397910 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.392588 14936 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.207556 16468 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.407622 16462 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.408764 15550 raft_consensus.cc:1813] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Handling vote request from an unknown peer e4938453819c469599f515b22d92fe27
I20260709 13:05:13.409193 14895 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:13.336146 16463 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.415691 15550 raft_consensus.cc:2410] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:05:13.410027 16472 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.385408 16307 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.424409 16460 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.212402 16464 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.324633 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.460243 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.460351 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.403719 16439 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.410560 16477 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:13.405300 16428 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:13.381577 16454 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.370530 16456 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.463292 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.464471 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:13.291296 16473 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.148s
I20260709 13:05:13.324349 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:13.466776 16371 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.474581 16470 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.474900 16371 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.466886 16476 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.461707 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.457968 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.459002 16447 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.406376 16479 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.415207 16394 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.420197 16445 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.424656 16440 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.466223 14964 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:13.412045 16436 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.460103 16446 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.533807 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.473474 16477 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.448047 16462 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.466495 16428 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.463549 16307 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.528067 16299 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.480670 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.536315 15044 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.477403 16453 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.545708 16469 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.539685 16479 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.574644 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.473225 16439 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.559531 16428 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.535275 16476 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.540917 16447 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.465910 16472 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.591796 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.592489 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.606331 16464 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.540938 14886 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:13.609717 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.612176 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.612401 16439 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.613317 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.614377 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.615697 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.615947 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.616142 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.618309 15547 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Advancing to term 4
I20260709 13:05:13.574534 16453 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.565644 16477 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.544292 16445 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.597759 16394 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.596324 16476 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.595863 16469 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.634807 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.638686 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.639261 14970 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.644052 16454 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.645414 16468 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.645872 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:13.620654 16453 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.623935 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.664808 16463 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.636395 16459 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.669972 16459 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.670624 16459 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.673448 16459 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.674889 16463 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.675699 15543 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:13.607467 16447 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.679039 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.741685 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.742614 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.743253 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
W20260709 13:05:13.744170 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 121337us
I20260709 13:05:13.653126 16450 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.748052 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.750000 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.750788 14967 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:13.655344 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.758626 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:13.759421 15548 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:13.757520 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:13.762326 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 281847us
I20260709 13:05:13.640946 16469 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.761525 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.765722 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.767766 14970 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.766352 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.772992 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.773629 14970 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:13.779083 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.758962 16371 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.766160 16446 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:13.773954 16441 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:13.780782 14889 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:13.791733 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.792037 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.792791 14966 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:05:13.788868 16482 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:13.798990 15571 debug-util.cc:398] Leaking SignalData structure 0x7b080031b720 after lost signal to thread 13795
W20260709 13:05:13.800017 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800312dc0 after lost signal to thread 14827
I20260709 13:05:13.780534 16472 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.803496 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.803851 16456 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:13.804148 14961 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:13.810206 15547 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:13.769160 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.820915 16462 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:13.825639 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56557us
I20260709 13:05:13.786000 16465 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.795076 16482 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:13.820536 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 74136.6us
I20260709 13:05:13.828332 16433 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:13.825459 16441 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:13.829068 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 83141.3us
I20260709 13:05:13.830963 16462 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:13.849428 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.854246 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.857787 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.858461 14888 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:13.859536 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.859279 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:13.863217 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.866065 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.863844 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.866585 16441 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.864547 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.866999 16441 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.868026 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.867441 16474 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:13.868911 16472 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:13.864714 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.838250 16428 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.832834 16433 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:13.835362 16459 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.854056 16453 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.867449 16441 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.875972 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.893740 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.897136 14962 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:13.899070 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:13.899550 14962 raft_consensus.cc:1813] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Handling vote request from an unknown peer eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.900050 14962 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:05:13.901011 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.902233 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:13.902321 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:13.902937 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53571.4us
I20260709 13:05:13.903218 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:13.908136 14967 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:13.909092 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 443577us
I20260709 13:05:13.909150 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:13.912788 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.914657 14968 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:13.922017 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.922966 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.878701 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.908583 16472 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.924489 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.911605 16436 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.927919 14888 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:13.923918 14894 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:13.904537 16447 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.911975 16451 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.925638 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.931608 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.916865 16456 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.878181 16462 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:13.924556 16452 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:13.939922 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.894124 16459 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:13.917009 14961 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:13.941244 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.943851 15044 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:13.944738 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.925964 16469 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.944618 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.945277 15044 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
W20260709 13:05:13.948518 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08001bcba0 after lost signal to thread 14919
W20260709 13:05:13.948879 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08001fd960 after lost signal to thread 14920
I20260709 13:05:13.949137 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:13.950037 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002910c0 after lost signal to thread 14994
I20260709 13:05:13.929958 16483 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:13.950330 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800291080 after lost signal to thread 14995
I20260709 13:05:13.950475 16483 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.950912 16483 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.934417 16436 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.947448 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:13.982493 16436 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.946569 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.927583 16472 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.941421 16484 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:05:13.934973 16430 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:13.951341 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002a8d40 after lost signal to thread 15068
W20260709 13:05:13.984416 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44551us
W20260709 13:05:13.989500 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800328500 after lost signal to thread 15069
I20260709 13:05:13.936270 16451 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.986706 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:13.988328 16299 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:13.938508 16465 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.986099 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 459) took 1073 ms. Trace:
I20260709 13:05:13.939805 16456 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:13.990594 15571 debug-util.cc:398] Leaking SignalData structure 0x7b080010a940 after lost signal to thread 15574
I20260709 13:05:13.944221 16482 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:13.944660 16428 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.992278 16299 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:13.991750 16487 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:05:13.986531 16472 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.940425 16452 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:13.986393 16447 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:13.996971 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:13.993212 15545 rpcz_store.cc:276] 0709 13:05:12.912471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.320393 (+407922us) service_pool.cc:224] Handling call
0709 13:05:13.985622 (+665229us) spinlock_profiling.cc:243] Waited 2.1 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:13.985786 (+   164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.985909 (+   123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.985924 (+    15us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.985947 (+    23us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:13.985964 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.985994 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:13.986059 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4836736}
I20260709 13:05:13.989425 16430 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:13.991801 16451 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:13.982538 16491 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.000144 16299 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:13.997445 16456 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.005079 16452 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.004434 16447 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.006754 16430 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.001822 16465 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.011567 16491 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.012652 16447 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.011967 16459 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.014127 16453 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:13.938436 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.053124 14889 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
W20260709 13:05:14.070952 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 158028us
W20260709 13:05:14.076152 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 79077.5us
I20260709 13:05:14.076647 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.136734 15008 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.137746 16465 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.022269 16462 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.022644 16477 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.139865 16482 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.140854 16482 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:14.142269 16477 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:14.142342 16482 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.076810 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.084785 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1358) took 2784 ms. Trace:
I20260709 13:05:14.025581 16483 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.082799 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:14.109206 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.111505 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.120194 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.122260 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.024566 16476 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.124516 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.128342 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:14.130395 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 278) took 3160 ms. Trace:
I20260709 13:05:14.020311 16479 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.104344 16484 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.144907 14892 rpcz_store.cc:276] 0709 13:05:11.300585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.299550 (+1998965us) service_pool.cc:224] Handling call
0709 13:05:13.865106 (+565556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.865252 (+   146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.865275 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.865312 (+    37us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:13.865342 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:13.865390 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.084306 (+218916us) spinlock_profiling.cc:243] Waited 565 ms on lock 0x7b54003877d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:14.084533 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1299569920}
I20260709 13:05:14.153015 16484 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.153410 15548 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:14.153731 16484 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:14.146144 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 69763.5us
I20260709 13:05:14.146627 16459 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.149598 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 402) took 1156 ms. Trace:
I20260709 13:05:14.156845 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.164332 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.156046 16459 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.147984 16482 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.165938 15036 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.170768 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.171104 16476 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.166936 16483 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.178560 15039 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:14.183008 16479 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.167282 16459 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.185235 16445 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.181490 15042 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:14.156152 15541 rpcz_store.cc:276] 0709 13:05:12.993384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.001516 (+  8132us) service_pool.cc:224] Handling call
0709 13:05:14.003538 (+1002022us) spinlock_profiling.cc:243] Waited 1.53 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:14.149479 (+145941us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3530496}
I20260709 13:05:14.192819 16462 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:14.190557 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62720.3us
I20260709 13:05:14.190563 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.194312 16462 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.194868 16462 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.201944 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.208662 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.210487 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:14.212653 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:14.213018 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.215595 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.215934 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.216917 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.218591 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.216048 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.223724 16453 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.224200 16453 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.224274 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.226311 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 461) took 1313 ms. Trace:
I20260709 13:05:14.226790 15546 rpcz_store.cc:276] 0709 13:05:12.913062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:12.922885 (+  9823us) service_pool.cc:224] Handling call
0709 13:05:14.225963 (+1303078us) spinlock_profiling.cc:243] Waited 60.6 ms on lock 0x7b540071e654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:14.226143 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139392384}
I20260709 13:05:14.230191 16453 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.150276 14788 rpcz_store.cc:276] 0709 13:05:10.969531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:10.969656 (+   125us) service_pool.cc:224] Handling call
0709 13:05:14.130076 (+3160420us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:11.000203 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:11.085544 (+ 85341us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:11.085583 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:05:11.085604 (+    21us) tablet.cc:662] Decoding operations
0709 13:05:11.085995 (+   391us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:11.086053 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:11.086084 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:11.086280 (+   196us) tablet.cc:701] Row locks acquired
0709 13:05:11.086299 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:05:11.086447 (+   148us) write_op.cc:270] Start()
0709 13:05:11.086558 (+   111us) write_op.cc:276] Timestamp: P: 1783602311086401 usec, L: 0
0709 13:05:11.086583 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:05:11.087198 (+   615us) log.cc:844] Serialized 595 byte log entry
0709 13:05:11.423298 (+336100us) op_driver.cc:464] REPLICATION: finished
0709 13:05:11.513922 (+ 90624us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f5531c6c0ac 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f55387acef0
0709 13:05:11.676724 (+162802us) write_op.cc:301] APPLY: starting
0709 13:05:11.676819 (+    95us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:11.676923 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:11.676944 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:11.677186 (+   242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:11.677352 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:11.677412 (+    60us) write_op.cc:312] APPLY: finished
0709 13:05:11.677608 (+   196us) log.cc:844] Serialized 23 byte log entry
0709 13:05:11.677757 (+   149us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:11.677833 (+    76us) write_op.cc:454] Released schema lock
0709 13:05:11.677875 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:11.678611 (+   736us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:11.678642 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1624174,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":253177,"apply.run_cpu_time_us":1503,"apply.run_wall_time_us":1858,"num_ops":1,"prepare.queue_time_us":91,"prepare.run_cpu_time_us":2884,"prepare.run_wall_time_us":102782,"replication_time_us":318725,"spinlock_wait_cycles":8241920,"thread_start_us":247508,"threads_started":1}]]}
I20260709 13:05:14.244081 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.244364 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.244622 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1239) took 1118 ms. Trace:
I20260709 13:05:14.228964 16492 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.247659 15037 rpcz_store.cc:276] 0709 13:05:13.125159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:13.125540 (+   381us) service_pool.cc:224] Handling call
0709 13:05:13.125823 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:13.130190 (+  4367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:13.130233 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:13.130276 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:13.130304 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:14.242845 (+1112541us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b54001f3bd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:14.242954 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:14.243207 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9640576}
I20260709 13:05:14.252983 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 276) took 3098 ms. Trace:
I20260709 13:05:14.253741 14791 rpcz_store.cc:276] 0709 13:05:11.154523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.154676 (+   153us) service_pool.cc:224] Handling call
0709 13:05:14.252782 (+3098106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":936154,"reported_tablets":7}
I20260709 13:05:14.262320 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.253659 16436 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.265148 16307 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.265106 16481 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.272341 16481 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.272760 16481 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.267181 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.277195 16476 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.277879 16476 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.278460 16476 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.272365 16428 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.286823 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.287496 16428 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.291848 16428 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.289040 16447 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.300525 16433 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:14.302142 16491 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.302769 16474 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:38784 (request call id 81) took 3188 ms. Trace:
I20260709 13:05:14.274356 16492 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.285265 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:14.300722 15043 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:14.292809 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.306322 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.302090 16447 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.305580 14861 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:14.316032 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64628.7us
I20260709 13:05:14.306339 16492 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:14.321235 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 108762us
I20260709 13:05:14.319275 16432 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.322746 16432 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.323179 16432 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.326462 16482 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.304483 16453 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.303238 16474 rpcz_store.cc:276] 0709 13:05:11.057322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:11.057951 (+   629us) service_pool.cc:224] Handling call
0709 13:05:11.068093 (+ 10142us) log.cc:844] Serialized 494 byte log entry
0709 13:05:14.220053 (+3151960us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":682,"raft.queue_time_us":971,"raft.run_cpu_time_us":826,"raft.run_wall_time_us":4606}
I20260709 13:05:14.329993 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.331244 16436 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.329501 16442 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.333478 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7933f8a0325b4bf7a8bafc99c9284091 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:05:14.343135 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.346626 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.346472 16299 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.346403 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.351048 16299 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.351769 16451 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.354681 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.355087 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.367666 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.354717 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.367869 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.369199 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.369426 16441 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.370419 14961 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.358769 16428 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.352808 14895 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:14.361964 15549 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:14.362882 16394 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.721s	user 0.000s	sys 0.015s
I20260709 13:05:14.363373 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:14.363919 16452 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.364786 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:14.366420 14933 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.377787 16431 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.387884 16431 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.389235 16431 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.389652 16433 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:14.393783 15038 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:14.395862 15044 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.398644 16476 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.399801 16456 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.402462 16456 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:14.405462 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56823us
I20260709 13:05:14.406250 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:14.382952 16459 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.407836 14968 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:14.410508 16500 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:05:14.412076 15541 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.415972 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:14.384701 16472 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.417479 16434 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.417930 16434 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:14.419325 16434 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.419548 15548 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.414063 16484 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.371244 16481 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.415975 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:14.428186 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52498.4us
I20260709 13:05:14.391770 16432 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.427994 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.435523 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.427906 16436 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.441375 14886 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.441699 16436 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.442595 16299 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.443267 16299 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.443925 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:14.444497 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76807.7us
I20260709 13:05:14.446835 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.437510 16465 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.443609 16430 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.443137 16491 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.444319 16456 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.391880 16394 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.425063 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.457832 16487 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.458451 16487 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:14.461665 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 76239.1us
I20260709 13:05:14.464200 16487 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.468869 16484 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.469854 15042 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.466010 16430 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.467880 16491 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.482951 16491 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.474644 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.484788 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.486225 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:14.486409 16437 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.487707 16450 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.488092 16450 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.488453 16450 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.474874 16432 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.458443 16299 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.492465 16447 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.478729 14886 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.479228 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:14.479794 16465 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.480846 16428 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:14.488821 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50451.9us
I20260709 13:05:14.490563 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.487397 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:14.491142 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 82974.5us
I20260709 13:05:14.494540 16456 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.456830 16453 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.490012 16441 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.493502 16482 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.498626 16456 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:14.510046 15040 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.507475 16471 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.512130 16432 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:14.516388 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 43818.3us
I20260709 13:05:14.497398 16492 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.509146 16447 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.499717 16454 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:05:14.511448 16456 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.510713 16476 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.521474 16442 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.529366 16442 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.529359 16299 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:14.530846 16299 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.530436 16442 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.531208 16299 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.531823 16442 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.521795 14969 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:14.522452 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 71633.9us
I20260709 13:05:14.518627 16447 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.535316 16447 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.517997 16472 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.538609 16434 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.539598 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:14.540742 16434 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:14.540853 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:14.541391 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47694us
I20260709 13:05:14.541661 16491 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.542472 16491 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.542492 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.544122 16491 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.545849 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:14.515887 16432 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.548713 16432 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.548842 16465 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:14.549315 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62014.1us
I20260709 13:05:14.512641 16471 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.511106 16451 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:14.553253 16481 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.546851 14788 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 1 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:14.550762 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.558899 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.559492 16459 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.559826 16465 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.560204 16465 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.560581 16465 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.560673 16394 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.532238 16299 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.523073 16492 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.562711 16436 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.559389 16452 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.532652 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.552016 16471 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.520987 14961 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:14.547247 16431 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.569010 16433 raft_consensus.cc:2764] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:14.569684 16459 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:14.582208 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.583082 16458 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.583529 16458 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.582226 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.585325 14886 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:14.585485 16299 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.571717 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.586376 14887 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:14.587949 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59239us
I20260709 13:05:14.588348 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.589673 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.575841 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.574172 16454 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:05:14.577932 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.579486 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.582203 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.584357 16458 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.575881 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.593542 16454 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.593988 16454 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.594128 16458 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.593598 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:14.571502 16481 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.592428 14893 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:14.597185 16433 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.598623 16433 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.599746 16433 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.582966 16462 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.600745 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.567124 16491 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:14.603336 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57607.2us
I20260709 13:05:14.603677 16451 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.606026 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.606206 16451 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.605433 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.607558 16492 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.604053 16487 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.607975 16492 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.610541 16492 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.602444 16394 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.615213 16459 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.617131 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:14.619228 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.619957 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.621064 16454 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.628046 16454 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.621912 16464 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.625015 16447 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.630278 14892 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:14.615723 16459 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.636313 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.631560 16453 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:05:14.638201 16449 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:14.639178 16453 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.639289 16448 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.639619 16453 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:14.639776 16448 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:14.640586 16453 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.640740 16448 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.642035 16448 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.641994 16453 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.642297 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.633364 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.647029 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.649242 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.650847 14891 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.651757 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:14.652477 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 153744us
I20260709 13:05:14.651261 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.654013 16452 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.654460 16452 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.654884 16452 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.655140 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.656487 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.659535 16477 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.656453 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.662963 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.633167 16394 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:14.649204 16504 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:05:14.652087 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.671253 16462 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.674099 16456 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:14.675161 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 70313.7us
I20260709 13:05:14.677021 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:14.687198 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:14.690212 16444 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:14.690621 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.691351 16444 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.691434 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.691862 16444 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.692224 15040 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:14.692798 16487 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.698647 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.699820 14961 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.699800 16459 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.692793 16444 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.709709 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.710314 16444 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.710527 14961 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.702220 16394 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:14.712811 16394 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.712913 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.713626 14963 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.713886 16394 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:14.710243 16477 consensus_queue.cc:1175] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e4938453819c469599f515b22d92fe27" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:05:14.723676 16436 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.724174 15044 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.724304 16436 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.724818 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.715772 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.724066 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.726542 16436 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.696691 16451 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.693265 14887 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:14.728335 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:14.729485 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:14.727136 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.702165 16459 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.732820 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.731133 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.740865 15040 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:14.743609 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.732995 16491 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:05:14.748154 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.748426 16447 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:14.748714 16436 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.728024 16492 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.749262 16436 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.751734 16436 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.733148 16474 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:14.752532 16492 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.754061 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.749140 14964 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:14.756156 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:14.758426 14963 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:14.760897 15040 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:14.761925 16474 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.762310 16474 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.765399 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.696808 16450 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.768834 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:14.765162 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.773604 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:14.772272 16477 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:14.779008 15040 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.775923 16491 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.784189 16440 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:14.784586 16491 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.784854 16440 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.785799 16440 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.779007 16436 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.776522 16456 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:14.760955 16471 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.781726 16487 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:14.793462 16487 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:14.793902 16487 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:14.779173 16431 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.796141 16477 raft_consensus.cc:1064] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:14.792482 16445 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:05:14.796984 16488 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:05:14.774927 16474 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.805290 16474 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.799197 16450 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.807003 16477 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.812064 16433 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.813167 14969 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.812875 16432 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.814210 16433 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.815088 16432 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.814983 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.785552 16491 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.818050 15035 raft_consensus.cc:606] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:14.819733 16488 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.820585 16445 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.823990 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.825174 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:14.826893 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 264897us
I20260709 13:05:14.802186 16471 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.848726 15042 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.848301 15035 raft_consensus.cc:614] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:14.852813 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:14.861752 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:14.861951 15040 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.853729 16445 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.859956 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:14.867050 14961 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:14.868019 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.868750 16445 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.852192 16488 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.870719 16436 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.870559 16488 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.871703 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:14.880321 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.867255 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.873194 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.885232 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.886394 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.890591 15043 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:14.871788 16488 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.898242 15042 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.900537 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.902279 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:14.903112 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.904786 16452 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.906093 15541 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:14.907828 16452 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.866272 16465 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.924607 15038 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:14.925535 16465 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.881320 16487 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.927932 16487 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:14.928201 16454 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.928797 16454 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:14.930923 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65033.1us
I20260709 13:05:14.931797 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:14.933025 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.934227 15514 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:14.935068 16463 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.935467 16463 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:14.935832 16463 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.937974 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:14.938925 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.939582 16472 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:14.940409 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.941000 14969 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.941911 14966 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.943209 14964 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.943886 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.939622 16437 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:14.944605 16437 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:14.944998 16437 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.946327 15546 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
W20260709 13:05:14.947665 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:14.947981 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:14.900048 16436 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:14.923646 15543 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:14.930994 16454 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:14.918109 14894 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:14.945480 14963 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:14.951073 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.951671 15042 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.954734 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.953672 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:14.955396 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.959648 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.959456 16445 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.969965 16452 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:14.971271 16452 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.971078 16447 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:14.971644 16452 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:14.972232 16447 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:14.972632 16447 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:14.972518 16452 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:14.973810 16452 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.973551 16447 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.974967 16447 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.975634 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:14.952585 16442 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:05:14.977975 16454 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:14.975009 14964 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:14.978333 16454 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:14.965514 14969 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:14.958688 14961 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:14.980985 16454 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:14.982817 16454 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:14.985205 14886 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:14.968384 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.986944 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.968945 14966 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:14.991583 15036 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:14.999459 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:15.019186 16484 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:15.021667 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53387.2us
I20260709 13:05:15.022426 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.023803 16450 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.028861 14933 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:15.029632 16453 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.030140 16453 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:14.958303 16491 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:14.952247 16436 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:15.031072 16453 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.031641 16436 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.036068 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:15.043171 15039 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:15.047304 15040 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
W20260709 13:05:15.047667 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 97284.8us
W20260709 13:05:15.049801 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62946.6us
I20260709 13:05:15.050076 15036 raft_consensus.cc:606] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:15.051247 15036 raft_consensus.cc:614] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:15.051628 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:15.050531 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:14.896551 16432 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:05:15.058036 16432 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.058382 16432 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.059711 16432 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.060921 16432 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.064929 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.065922 16463 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.066267 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.069092 15043 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:15.072621 16479 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.073453 14968 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:15.074505 15549 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:15.079162 15541 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.080191 16463 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:15.080834 15541 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.074504 16484 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.082043 16484 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.082993 16484 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.084331 15544 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.076016 16477 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.076373 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.077111 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.077785 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.090915 16488 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.092315 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.095146 15545 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:05:15.099164 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.101485 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.102840 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:15.103611 14886 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:15.078248 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:15.078868 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.104411 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:15.105769 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.106531 16488 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.107134 16477 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.107445 16433 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:15.107666 16477 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.108052 16433 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.108572 16477 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.110071 16433 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:15.110572 16433 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:15.111037 16433 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.114794 16433 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:15.111477 16488 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.116338 16488 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.114732 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:15.120957 15545 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.132211 14966 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.132437 16491 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.133637 16447 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.133992 16447 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.134855 16447 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.138919 16479 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:15.140177 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.148263 16479 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.148626 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.149292 16479 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.152308 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.149677 16479 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.154318 14966 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.154522 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.154894 14895 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:15.154955 16479 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.155834 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.156340 16479 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.155156 14969 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:15.157824 14888 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.158732 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:15.159442 14895 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:15.160459 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:15.160506 14966 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:15.163679 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:49674
I20260709 13:05:15.165205 14886 raft_consensus.cc:606] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:15.165571 14886 raft_consensus.cc:614] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:15.166453 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:15.166702 16470 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.167001 15042 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.173054 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.167454 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:15.166280 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:15.178289 15041 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.142359 16437 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.184024 15545 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.180895 15040 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:15.181793 16487 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:15.188203 14966 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.188004 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.189319 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.187644 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.190300 16465 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.190728 16465 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.190770 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.192044 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.191708 16465 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.192651 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.192948 16465 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.193480 15545 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:15.193645 16447 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.194702 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.196296 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.196671 14969 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.199064 16445 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.199477 16445 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.200455 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.200387 16445 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.201370 16442 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.201640 16445 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.201825 16484 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:15.202203 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.202608 16484 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.202775 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.203656 16442 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.203824 16484 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.207861 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.208505 15040 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:15.209278 14966 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:15.211424 15042 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:15.186672 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:15.213059 14966 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.215195 16488 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.215740 16488 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.216795 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.212157 16442 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:05:15.218333 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.219058 16442 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.219434 16442 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:15.219063 15041 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.220301 16442 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.220814 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.220489 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.222170 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.223420 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.223742 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.221539 15043 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.223443 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:15.224618 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.226315 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.226903 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.228041 15543 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.229380 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.230015 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:15.229413 15041 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:15.234486 15546 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.235730 16463 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.223904 15545 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.238816 15546 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.238973 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.236744 16452 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.244091 16431 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.244328 16452 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.244892 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.242666 16440 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.245940 16459 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.246302 16474 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.247025 16465 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.246357 16459 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:15.247573 16465 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.243280 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.248750 16465 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.248610 16459 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.249663 16471 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.250169 16459 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.246471 14961 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.246274 14968 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.241902 14966 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.253579 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.254325 16450 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.244861 16431 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:15.257911 16452 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.259023 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:15.261057 15038 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:15.261202 15044 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:15.242353 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.264741 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.221537 16442 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.210899 16477 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:05:15.266860 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.265537 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:15.265154 16299 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.268110 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.268560 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.271555 14966 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.271800 15044 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.273406 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.259349 16452 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.271281 16450 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.307437 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.307838 16450 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.308820 16450 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.274973 16431 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.312091 16431 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.312985 16431 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.317446 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.318517 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.319880 16442 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.320976 16454 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.322079 16454 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.322414 16454 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:15.323567 16470 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.276728 16479 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.276969 16463 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:15.279822 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.325145 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.324858 16463 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.280336 16299 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.326640 16299 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.326390 16463 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.282721 16453 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.328009 16453 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.328405 16453 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.329267 16453 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.324913 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:15.330413 16453 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.284265 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.332096 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.288357 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:15.335934 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47641.1us
I20260709 13:05:15.336624 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.292936 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.338232 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.339460 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.340350 14968 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.341249 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.342478 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.290970 16484 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:05:15.290565 16488 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.295506 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.295946 16465 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:15.296633 16436 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.347365 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.347681 15543 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.348812 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.295754 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.349300 16436 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:15.349774 14961 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:15.298425 16491 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.298527 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.350085 16436 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.350625 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.350803 16491 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.299268 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.351269 16491 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.351753 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.297204 16447 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.299973 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.352221 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.352537 14961 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.352748 14970 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:15.352243 16491 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.353052 14963 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.353410 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.301193 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.353883 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.354772 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:15.300057 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.355391 14962 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.355659 16456 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:15.355836 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.301537 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.356084 16456 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.351150 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.353650 16491 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.324568 16479 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.353456 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.300719 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.276285 16437 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:15.305339 16464 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.323803 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.323156 16454 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.318601 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:15.386170 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67634.3us
W20260709 13:05:15.386593 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.383569 16470 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.364872 14966 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:15.370445 14970 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:15.387748 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51203.8us
W20260709 13:05:15.373052 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.388761 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.381321 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:15.389586 14968 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.350793 16436 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:15.391067 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.391762 14964 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.384008 14963 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.395001 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:15.398489 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59670us
I20260709 13:05:15.394912 14965 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.400067 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.383687 16440 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:15.357033 16456 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.407624 16440 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.408551 16456 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.409732 16440 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:15.393006 16436 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:15.411250 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.411830 16436 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.398439 14967 raft_consensus.cc:2955] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:15.397344 16479 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.417639 14886 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
W20260709 13:05:15.402314 16517 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:05:15.406454 16454 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:15.402623 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 83448.9us
I20260709 13:05:15.406972 14965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:15.404148 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.391865 16437 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.422516 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.422866 14965 raft_consensus.cc:606] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:15.394025 16482 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:05:15.432252 14962 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.435738 14894 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:15.437557 14859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.527s (SENT) [suppressed 1 similar messages]
I20260709 13:05:15.396679 16448 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:15.370536 16299 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.403098 16394 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:15.424474 16464 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:15.441409 16448 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:15.441911 16437 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.445322 16433 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:15.445634 16463 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.477123 15040 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.474787 16448 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:15.488097 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 65704.9us
I20260709 13:05:15.448238 16432 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:05:15.476307 16452 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.494338 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:15.494828 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 93484.2us
I20260709 13:05:15.485246 16463 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:15.512001 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.514698 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54432.9us
I20260709 13:05:15.521627 15041 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.522607 16437 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.512171 16433 raft_consensus.cc:2764] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:05:15.530290 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:15.531077 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:15.541947 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.554587 16519 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:15.557936 16526 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.558415 16526 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.537061 16432 raft_consensus.cc:2764] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:15.529109 16440 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 13:05:15.568473 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.575836 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 175795us
I20260709 13:05:15.570482 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:05:15.577225 16487 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.577656 16487 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.561926 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.578817 16479 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.580639 16442 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.559249 16526 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.586441 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.587153 16436 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.588060 14969 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:15.589349 16436 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:15.590078 16431 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.589900 16448 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:15.590813 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 59823us
I20260709 13:05:15.558887 16463 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.592288 16448 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:15.591997 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.583158 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:05:15.597970 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.598600 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 161042us
I20260709 13:05:15.599665 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:15.602937 15543 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:15.607077 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:15.610251 14964 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.610566 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.611778 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:15.613864 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.614490 16453 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.615543 16453 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.616168 16453 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.619603 16492 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.620851 16433 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.621204 16433 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.601223 16431 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.622641 14965 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:15.626394 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.627456 14969 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:15.628034 14894 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.630525 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.634016 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.634557 15546 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:15.634671 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:15.635277 16448 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.635942 16448 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.637391 16447 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.637606 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:15.638692 16431 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.639761 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.640098 16431 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.640645 16431 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.640954 16431 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:15.641927 16431 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.643739 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.644040 16431 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.645841 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:15.646518 15036 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:15.646520 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.647447 16534 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.649364 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.651863 16534 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.652899 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.653221 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:15.654275 16534 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.655356 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.657938 16534 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:15.658218 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.660791 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.661559 16448 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:15.663906 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.662698 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.666770 16448 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.667840 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.668644 16448 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.669418 15038 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:15.674319 15037 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:15.676057 15043 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:15.679096 16535 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.680896 14888 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:15.682121 14962 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:15.680939 16535 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.686327 16535 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.687623 16535 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.688653 16448 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:15.690346 16432 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:15.690709 16432 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:15.700434 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.622125 16433 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.705273 16464 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:05:15.715786 16453 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.718815 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.629858 16470 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.075s
I20260709 13:05:15.721910 16470 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:15.722302 16470 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:15.719462 16442 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:15.718811 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:15.720335 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45842.8us
I20260709 13:05:15.630784 16454 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 13:05:15.724892 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.725550 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.723307 16440 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.743913 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.754769 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.760917 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.754422 16523 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:05:15.767047 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.744657 16433 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.757316 16459 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.742719 16545 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:15.762295 16544 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.777462 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.724766 16470 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.779219 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:15.767912 16547 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.768793 16523 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:15.782646 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.783658 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:15.780212 16492 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.791051 16492 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.791584 16492 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.792394 16492 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.787653 14894 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.780133 16535 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:15.788520 16470 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.789264 15544 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:15.789458 16544 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:15.785292 16546 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:15.805550 16544 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.806551 16544 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.789847 16487 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.840529 14894 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:15.843639 16440 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:15.844148 16440 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.846149 16440 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:15.849381 16541 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:05:15.850806 16526 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.856315 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:15.858129 14894 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.813758 16524 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:05:15.843025 16523 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:15.863129 15041 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:15.866762 16452 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:15.866817 16432 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.868039 16432 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:15.868556 15544 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:15.870275 16523 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.878835 14895 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:15.879665 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:15.881789 16465 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:15.889354 15044 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:15.890074 14895 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:15.911381 14969 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.922235 14962 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.922499 14967 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:15.923678 15039 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:15.921985 16477 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:15.925072 16524 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:05:15.926926 14791 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 4 to 5, term changed from 2 to 3, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to <none>, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 3 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:15.930094 16474 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:15.930835 16474 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:15.931895 16474 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.938939 16487 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:15.945314 14894 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:15.945734 16547 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.947733 16445 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:15.951640 15544 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:15.945343 16526 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:05:15.953591 16477 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:15.952003 16547 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.956147 15039 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:05:15.974347 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 248855us
I20260709 13:05:15.967306 16445 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:05:15.927770 16484 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:05:15.983518 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:15.987007 16545 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:15.946863 16524 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
W20260709 13:05:16.004650 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:15.990657 16545 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:15.992238 16440 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.027274 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.028901 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.034488 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:16.037446 16539 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 13:05:16.031487 16442 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.032881 16454 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.055907 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 277) took 1524 ms. Trace:
W20260709 13:05:16.057332 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:16.069681 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet 7933f8a0325b4bf7a8bafc99c9284091 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45040
I20260709 13:05:16.043146 16440 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.072350 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:16.073215 16440 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.069186 15541 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:16.087962 14859 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.056463 14788 rpcz_store.cc:276] 0709 13:05:14.529392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:14.529571 (+   179us) service_pool.cc:224] Handling call
0709 13:05:16.051342 (+1521771us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:15.091920 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:15.094153 (+  2233us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:15.094199 (+    46us) write_op.cc:435] Acquired schema lock
0709 13:05:15.094220 (+    21us) tablet.cc:662] Decoding operations
0709 13:05:15.094611 (+   391us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:15.094720 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:15.094758 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:15.095997 (+  1239us) tablet.cc:701] Row locks acquired
0709 13:05:15.096057 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:05:15.096257 (+   200us) write_op.cc:270] Start()
0709 13:05:15.096429 (+   172us) write_op.cc:276] Timestamp: P: 1783602315096191 usec, L: 0
0709 13:05:15.096474 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:05:15.184518 (+ 88044us) log.cc:844] Serialized 533 byte log entry
0709 13:05:15.498394 (+313876us) op_driver.cc:464] REPLICATION: finished
0709 13:05:15.569602 (+ 71208us) write_op.cc:301] APPLY: starting
0709 13:05:15.569724 (+   122us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:15.569871 (+   147us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:15.570035 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:15.570320 (+   285us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:15.570593 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:15.570649 (+    56us) write_op.cc:312] APPLY: finished
0709 13:05:15.611373 (+ 40724us) log.cc:844] Serialized 23 byte log entry
0709 13:05:15.611596 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:15.611689 (+    93us) write_op.cc:454] Released schema lock
0709 13:05:15.611750 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:15.612136 (+   386us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:15.612166 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8239,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":53297,"apply.run_cpu_time_us":2432,"apply.run_wall_time_us":42534,"num_ops":1,"prepare.queue_time_us":190464,"prepare.run_cpu_time_us":6821,"prepare.run_wall_time_us":218970,"raft.queue_time_us":76149,"raft.run_cpu_time_us":11099,"raft.run_wall_time_us":16875,"replication_time_us":401758,"thread_start_us":200558,"threads_started":4,"wal-append.queue_time_us":191179}]]}
I20260709 13:05:16.088291 16474 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.118098 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.108853 16442 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.127157 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.094218 16526 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:05:16.125713 16530 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:16.104372 16431 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:05:16.134935 16442 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.131335 14963 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:16.174702 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.136330 14961 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:16.199381 16459 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.192999 16442 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.203135 16440 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:16.212054 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80748.6us
I20260709 13:05:16.223672 16442 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:16.245539 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 66901.9us
I20260709 13:05:16.251332 16454 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.251873 16454 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.253770 16454 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:16.245612 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49141.2us
I20260709 13:05:16.257516 14895 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.257977 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:16.258836 14890 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.260519 14887 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:16.265232 16463 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:05:16.266215 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51397.2us
I20260709 13:05:16.267449 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:16.267685 16453 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.025s	sys 0.030s
I20260709 13:05:16.267593 16431 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:05:16.268150 16453 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.025s	sys 0.030s
I20260709 13:05:16.270387 16459 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:16.272183 16459 raft_consensus.cc:2764] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:05:16.288854 16487 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:16.289763 16487 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.299048 16487 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:16.299067 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:16.310930 15040 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.040s
W20260709 13:05:16.319911 15040 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.009s	sys 0.040s
W20260709 13:05:16.315039 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.023s
W20260709 13:05:16.316450 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 198954us
I20260709 13:05:16.324594 16521 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:16.341583 16574 tablet_replica.cc:333] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:05:16.266916 16463 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 13:05:16.322556 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.000s	sys 0.023s
W20260709 13:05:16.343534 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.350927 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 567216us
I20260709 13:05:16.351735 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:16.352659 16560 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.353322 16560 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:16.354904 16440 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.354555 16560 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.355535 16440 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.357048 16442 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:16.357604 16442 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.358814 16440 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:16.360771 16442 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:16.363675 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:16.364337 15039 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:16.367031 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:16.368026 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:16.368860 15041 raft_consensus.cc:1813] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Handling vote request from an unknown peer e4938453819c469599f515b22d92fe27
I20260709 13:05:16.370186 15041 raft_consensus.cc:2410] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 13:05:16.368247 16442 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:16.375721 16442 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.376091 16442 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:16.346786 14962 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.356406 16474 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:16.379762 16474 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.380347 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:16.382596 16474 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:16.383653 15010 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:16.385329 16447 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.389266 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:16.391479 14891 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.396668 15035 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:16.348503 16579 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:05:16.407022 16539 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:16.407867 16539 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.422870 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:16.423552 15541 raft_consensus.cc:1813] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Handling vote request from an unknown peer e4938453819c469599f515b22d92fe27
I20260709 13:05:16.424126 15541 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:16.420296 14892 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.422119 14893 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:16.433017 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 79664.4us
I20260709 13:05:16.433043 14861 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.442818 14888 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:16.444502 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:16.445080 14892 raft_consensus.cc:1813] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Handling vote request from an unknown peer eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:16.449095 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77024.9us
I20260709 13:05:16.449712 14892 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 13:05:16.452829 14894 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.459800 16574 raft_consensus.cc:2243] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:16.472121 16477 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:16.461020 14889 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 3 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:16.448973 16440 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.471483 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:16.478497 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:16.479772 16574 raft_consensus.cc:2272] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:16.456756 16445 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 13:05:16.482681 14967 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:16.490784 14892 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.492095 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:16.494087 16574 ts_tablet_manager.cc:1916] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:16.473928 16482 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:05:16.497908 16558 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.450219 16394 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:05:16.450346 16447 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 13:05:16.469544 16452 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:05:16.516233 16537 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:16.517391 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.517748 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:16.524677 16545 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:16.528375 14892 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.535429 16545 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:16.536684 16545 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.511739 16558 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:16.501111 16539 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:16.571816 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54166.2us
I20260709 13:05:16.573599 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:16.585763 14893 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:16.577332 16432 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.593014 16534 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:16.593575 16534 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:16.594599 16534 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.596998 16574 ts_tablet_manager.cc:1929] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:05:16.598088 16574 log.cc:1199] T 7933f8a0325b4bf7a8bafc99c9284091 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/7933f8a0325b4bf7a8bafc99c9284091
I20260709 13:05:16.606477 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.608491 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.614164 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.617201 16454 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.618152 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.618991 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.618822 14962 raft_consensus.cc:2376] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3. Re-sending same reply.
I20260709 13:05:16.629056 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.604291 16432 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:16.634037 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:16.617887 16454 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.637660 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.610479 16547 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:05:16.656729 16454 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:16.657546 15035 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:16.646642 14968 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:16.647295 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.648197 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.649026 16442 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.637451 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.651872 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:16.670387 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 197376us
I20260709 13:05:16.652520 14887 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.662647 14893 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:16.664357 16590 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:05:16.628206 16558 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.665268 16442 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:16.666445 16432 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.678025 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:16.679945 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.671527 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.672482 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:16.681046 15041 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:16.681226 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.674599 16474 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.680559 14968 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:16.685111 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.687080 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:16.694222 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.696875 15041 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:16.698278 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:16.686466 16560 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:16.683877 16465 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.691637 16442 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.682415 16545 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:05:16.699679 16440 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.703787 16544 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.691939 16433 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:16.726433 16470 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.726951 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.709451 16559 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:16.735975 16559 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:16.737432 16559 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.727444 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet 7933f8a0325b4bf7a8bafc99c9284091 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:05:16.739292 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 168) took 1479 ms. Trace:
I20260709 13:05:16.742317 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:16.708587 16459 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.726996 16470 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.751219 16440 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:16.759426 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.708214 16601 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.741678 14791 rpcz_store.cc:276] 0709 13:05:15.259443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.259615 (+   172us) service_pool.cc:224] Handling call
0709 13:05:16.739219 (+1479604us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:16.331402 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:16.331959 (+   557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:16.331987 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:05:16.332007 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:16.332326 (+   319us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:16.332402 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:16.332428 (+    26us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:05:16.332613 (+   185us) tablet.cc:701] Row locks acquired
0709 13:05:16.332631 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:16.332750 (+   119us) write_op.cc:270] Start()
0709 13:05:16.332868 (+   118us) write_op.cc:276] Timestamp: P: 1783602316332711 usec, L: 0
0709 13:05:16.332890 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:05:16.333499 (+   609us) log.cc:844] Serialized 499 byte log entry
0709 13:05:16.431706 (+ 98207us) op_driver.cc:464] REPLICATION: finished
0709 13:05:16.649820 (+218114us) write_op.cc:301] APPLY: starting
0709 13:05:16.649947 (+   127us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:16.650087 (+   140us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:16.650262 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:16.650594 (+   332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:16.650830 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:05:16.650891 (+    61us) write_op.cc:312] APPLY: finished
0709 13:05:16.651141 (+   250us) log.cc:844] Serialized 23 byte log entry
0709 13:05:16.651370 (+   229us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:16.665389 (+ 14019us) write_op.cc:454] Released schema lock
0709 13:05:16.665442 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:16.665805 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:16.665841 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":373282,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":216607,"apply.run_cpu_time_us":2120,"apply.run_wall_time_us":15994,"num_ops":1,"prepare.queue_time_us":333081,"prepare.run_cpu_time_us":2415,"prepare.run_wall_time_us":55320,"replication_time_us":98673,"thread_start_us":522515,"threads_started":2}]]}
I20260709 13:05:16.756553 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.761586 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.791287 14967 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:16.729945 16433 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:16.745677 16487 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:16.712641 16465 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.813295 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:16.814520 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53009.8us
I20260709 13:05:16.814097 15546 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:16.810633 16470 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:16.822431 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:16.800009 16433 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.796272 16601 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.827780 16440 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:16.832289 16440 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.832899 16601 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:16.834488 16440 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:16.837350 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:16.838114 15546 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:16.834695 16465 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:16.840274 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:16.810995 16487 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.842427 16440 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:16.854421 16440 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:16.856650 16487 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:16.857386 16433 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:16.840914 16470 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:16.861274 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 67571e95c6f547b989f85aa109da10a9 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38784
I20260709 13:05:16.852109 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.853854 16465 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:16.882480 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:16.883457 15040 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:16.860186 16470 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.908416 16470 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:16.864363 14792 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 3 to 2, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:16.862353 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:16.861917 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:16.910755 14792 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:16.928123 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 239178us
I20260709 13:05:16.904505 16465 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:16.929093 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:16.931546 15040 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.927604 15541 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:16.949528 16442 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:16.929760 16465 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:16.953042 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:16.961508 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 456507us
I20260709 13:05:16.980995 15041 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:16.987076 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.016001 16433 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:17.017812 16440 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:17.032882 16445 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.041636 16394 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:17.040325 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:17.104626 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 94877.1us
I20260709 13:05:17.060364 16445 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.091028 14961 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.118983 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:17.106109 16487 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.116982 16437 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.108618 16530 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:17.140550 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.147780 14962 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:17.084865 16394 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.145210 16601 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:17.149480 16601 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.129580 16447 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:17.156577 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.159955 14966 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:17.156253 16484 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.171020 16484 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.171653 16601 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.172701 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:17.174088 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.177384 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:17.162489 16447 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.164842 16556 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:17.228472 16447 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.161747 16610 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:17.147998 16487 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:17.189079 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 80947.2us
I20260709 13:05:17.192880 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:17.152117 16437 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.173166 16484 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.239528 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:17.272696 14894 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
W20260709 13:05:17.271680 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 342588us
I20260709 13:05:17.178417 16482 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.277281 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:17.310207 16482 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.228680 16556 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.229277 16432 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.233147 16394 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.210731 16604 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.275240 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 352562us
I20260709 13:05:17.229676 16433 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 13:05:17.272452 16558 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 13:05:17.317144 16477 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.271052 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 92889.7us
I20260709 13:05:17.270378 16610 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:17.345880 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 168771us
I20260709 13:05:17.328958 16431 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:17.347656 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:17.361047 16437 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.355180 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:17.355002 16445 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.348083 16477 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.340598 16604 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:17.389143 16607 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 13:05:17.386276 16618 tablet_replica.cc:333] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:05:17.384112 16484 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.412372 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97890us
I20260709 13:05:17.363597 16470 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.403093 16612 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:17.442517 16622 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:17.420893 16484 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.407368 15035 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:17.449075 16487 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:17.450150 16604 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.407765 16445 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:17.388238 16551 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.117s
I20260709 13:05:17.450227 16610 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.450508 14888 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:17.418514 16619 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:05:17.447749 16482 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:17.335748 16432 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.452981 14961 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:17.455721 16556 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:17.475988 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 142988us
I20260709 13:05:17.481083 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:17.486155 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 142630us
I20260709 13:05:17.487151 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:17.488965 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 133427us
I20260709 13:05:17.515295 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.516279 14967 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:17.521099 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:17.526368 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.478991 16487 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.471859 16465 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.534298 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.470956 16447 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.519594 16629 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.542718 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.545536 14966 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:17.529910 16454 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:17.525195 16437 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.558640 15546 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:17.560520 16465 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:17.561218 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:17.546307 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:17.535316 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:17.580940 15039 raft_consensus.cc:2368] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4.
I20260709 13:05:17.470196 16612 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.545552 16482 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.584113 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:17.585286 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.579072 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:17.542397 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:17.584206 16482 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.588150 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:17.535735 16487 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.578596 16454 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:17.589423 14889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.038s
I20260709 13:05:17.762912 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:17.763589 15037 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
W20260709 13:05:17.690320 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 164643us
I20260709 13:05:17.580350 16627 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:17.670969 15544 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:17.685297 14961 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:17.577895 16551 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.773907 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:17.583446 16437 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:17.762996 14889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.823s	user 0.000s	sys 0.039s
I20260709 13:05:17.561347 16629 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:17.766441 15038 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:17.774497 15546 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:17.761767 16459 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:17.765895 16465 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:17.785459 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 197403us
I20260709 13:05:17.786198 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:17.786432 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 218145us
I20260709 13:05:17.766135 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:17.765376 16454 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:17.782933 15044 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:05:17.768671 16516 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:05:17.825763 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 243905us
I20260709 13:05:17.825726 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:17.783464 16523 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.786047 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:17.800469 16465 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:17.843667 16634 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:17.843719 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:17.844592 14963 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.847297 16620 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:17.841907 16465 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:17.849820 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:17.843873 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:17.851536 14968 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:17.857883 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:17.858197 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 81780.1us
I20260709 13:05:17.826488 16627 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:17.841181 16623 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:17.909716 16445 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:17.912698 16534 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:17.910174 16465 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.783155 16551 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.911274 16627 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:17.859395 16612 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:17.915112 16445 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:17.988473 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 202308us
I20260709 13:05:18.006613 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:17.971717 14968 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:17.859438 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 172) took 1288 ms. Trace:
I20260709 13:05:17.901325 16484 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:18.172256 16551 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:17.901125 16432 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:17.841079 16523 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.174984 16523 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:18.175680 16523 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:18.176433 16523 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:18.177007 16523 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.179024 16432 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:18.179561 14891 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:18.179582 16432 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.184163 16432 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:17.900585 16447 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:18.045048 16474 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:18.106114 16636 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:18.196456 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 189881us
I20260709 13:05:18.197476 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:18.199698 16623 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:18.203306 16465 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:18.205996 16647 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.195001 16474 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.216702 16649 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:18.225564 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1439) took 1368 ms. Trace:
I20260709 13:05:18.211886 14963 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:18.212031 16487 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:18.248708 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 345146us
I20260709 13:05:18.206264 16636 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.259449 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.242576 16437 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:18.242130 14890 rpcz_store.cc:276] 0709 13:05:16.857476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.861994 (+  4518us) service_pool.cc:224] Handling call
0709 13:05:16.881058 (+ 19064us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.881406 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.881442 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.903517 (+ 22075us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.275790 (+372273us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:17.318568 (+ 42778us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.319803 (+  1235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.319904 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.225292 (+905388us) raft_consensus.cc:1685] finished
0709 13:05:18.225321 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.225496 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21254,"prepare.queue_time_us":42585,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2219,"raft.queue_time_us":33810,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":7449,"thread_start_us":346116,"threads_started":1,"wal-append.queue_time_us":484235}
I20260709 13:05:18.248096 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:18.246766 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46036us
I20260709 13:05:18.268445 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:18.269006 14965 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.260370 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:18.270916 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.268986 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:18.271591 16643 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:18.272163 16643 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:18.272269 16642 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.272610 16643 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:18.272778 16642 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.274955 16642 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:18.271577 14968 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:18.283557 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.290374 16558 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:18.292848 15038 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:18.297523 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:18.315361 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.334831 14965 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:18.337947 15040 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:18.401427 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:18.382432 14935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.028s	sys 0.033s
I20260709 13:05:18.408622 16656 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:18.179237 16523 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:18.258350 16487 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.390106 16551 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.409509 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1949) took 1524 ms. Trace:
W20260709 13:05:18.290445 16638 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.300s	user 0.000s	sys 0.000s
I20260709 13:05:18.417191 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:18.412519 14935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.028s	sys 0.033s
W20260709 13:05:18.413241 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 140524us
I20260709 13:05:18.261205 16649 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.390741 16629 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:18.411902 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:18.242082 16647 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.260582 16454 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.424237 14894 rpcz_store.cc:276] 0709 13:05:16.885474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.278551 (+393077us) service_pool.cc:224] Handling call
0709 13:05:18.408850 (+1130299us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:18.409047 (+   197us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.409205 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:18.409241 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:18.409285 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:18.409311 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.409359 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.409458 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48890112}
I20260709 13:05:18.429848 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:18.436370 16523 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:18.336848 16432 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260709 13:05:18.417093 16618 raft_consensus.cc:2243] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:05:18.442041 16652 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:18.447084 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.460270 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:18.463588 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:18.423702 16445 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:18.427714 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:18.468950 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.437830 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:18.479733 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:18.497634 15042 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:18.480695 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:18.480840 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.500046 14962 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:18.442550 16657 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:18.462670 16629 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:18.457135 16465 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:18.428158 16487 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:18.625803 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 145177us
I20260709 13:05:18.462182 16627 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:18.434829 16551 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.424166 16643 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.483253 16642 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:18.463945 16523 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.621485 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:18.486963 15543 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:18.486630 14887 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:18.694113 16652 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:18.839234 16642 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.842553 16432 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:18.865861 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163891us
I20260709 13:05:18.792536 16447 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.691766 15544 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:18.437866 16649 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.712393 16545 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.864243 16644 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.930722 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1440) took 2073 ms. Trace:
I20260709 13:05:18.931277 14893 rpcz_store.cc:276] 0709 13:05:16.857774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.862061 (+  4287us) service_pool.cc:224] Handling call
0709 13:05:16.905882 (+ 43821us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.318359 (+412477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.318409 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.338332 (+ 19923us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.760877 (+422545us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:17.781485 (+ 20608us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.781692 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.781766 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:18.930453 (+1148687us) raft_consensus.cc:1685] finished
0709 13:05:18.930479 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:18.930652 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12181,"prepare.queue_time_us":20879,"prepare.run_cpu_time_us":7976,"prepare.run_wall_time_us":25977,"raft.queue_time_us":13162,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":46277,"thread_start_us":598765,"threads_started":2,"wal-append.queue_time_us":489175}
I20260709 13:05:18.155439 14889 rpcz_store.cc:276] 0709 13:05:16.571041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.573194 (+  2153us) service_pool.cc:224] Handling call
0709 13:05:16.577977 (+  4783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:16.583915 (+  5938us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:16.919070 (+335155us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.453620 (+534550us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18003fdb40. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:17.787634 (+334014us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:17.803005 (+ 15371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:17.834619 (+ 31614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.840644 (+  6025us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:17.859322 (+ 18678us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":340169,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":7102,"raft.queue_time_us":18080,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":79,"spinlock_wait_cycles":7653760,"thread_start_us":1176018,"threads_started":2}
I20260709 13:05:18.865269 16445 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:18.868319 16627 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:18.869103 16653 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.923108 16658 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.873376 16618 raft_consensus.cc:2272] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:05:18.837949 16465 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.877660 16642 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.873595 16474 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:18.877336 16648 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:18.839694 16657 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.876091 14961 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
W20260709 13:05:18.945521 14935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.013s
I20260709 13:05:18.934106 16646 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:18.956488 14935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.011s	sys 0.013s
I20260709 13:05:18.920284 16447 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.898443 16432 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.936084 16545 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.959444 16636 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:18.958461 16474 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.940812 16445 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.956990 16629 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:18.942008 16644 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.978477 16669 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:18.965160 16646 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:18.939977 16627 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:18.974355 16664 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.953394 16653 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.003320 16636 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.011116 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.011369 16671 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:18.997087 16645 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.037602 15041 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:19.040139 16636 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.041759 16618 ts_tablet_manager.cc:1916] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:05:18.974884 16454 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:18.998129 16647 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.041018 16629 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:18.998885 16474 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.041080 16653 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:18.999099 16524 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.005623 16646 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:18.998282 16667 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:18.956648 16658 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.076670 16487 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:18.959918 16652 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:19.086735 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.002s	sys 0.023s
I20260709 13:05:19.093413 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:19.097615 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.003s	sys 0.023s
I20260709 13:05:19.080344 16551 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.102666 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.103423 15042 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:18.967540 16648 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.087493 16523 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.109338 16675 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:19.093014 16643 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.111330 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:19.116578 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79766.7us
I20260709 13:05:19.117285 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:19.009441 16669 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.024477 16664 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.122462 16664 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.107151 16454 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.127187 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:19.116936 16487 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.152559 16681 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:19.166886 16644 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.167788 16644 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:19.168380 16644 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:19.129614 16465 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.128566 16523 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.132220 16649 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.100018 16667 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.180222 16672 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.156574 16447 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.109947 16675 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.082104 16671 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.146998 16454 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.093883 16524 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.178889 16673 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.175127 16645 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:19.181638 16649 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.171100 16487 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.186874 16667 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.188192 16432 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:19.205484 15541 consensus_meta.cc:287] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.613s	user 0.009s	sys 0.004s
I20260709 13:05:19.193255 16627 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.182468 16668 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:19.207904 16661 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 13:05:19.208078 16667 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:19.208227 16659 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:05:19.208745 16536 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:19.208962 16678 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:19.199993 16662 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.118s	user 0.001s	sys 0.000s
I20260709 13:05:19.210613 16658 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:19.210750 16621 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.798s	user 0.018s	sys 0.014s
I20260709 13:05:19.179493 16523 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.187598 16674 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:19.220526 16627 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.183724 16681 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.211242 15541 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:19.220008 16474 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.213486 16679 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.207520 16649 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.224715 16636 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.209396 16682 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.209879 16673 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.231838 16678 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.200150 16670 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.229607 16667 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.227731 16536 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.250253 16686 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.190593 16672 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.255579 16454 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:19.250793 15541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 482) took 1755 ms (client timeout 2148 ms). Trace:
I20260709 13:05:19.309245 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.310783 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.311896 14965 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:19.312019 14894 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:19.276727 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.226650 16668 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.274233 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1907) took 1513 ms. Trace:
I20260709 13:05:19.313504 15044 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:19.300731 16675 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.301204 16487 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.304311 16537 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.306042 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.306248 16463 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:19.307145 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.307823 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.308066 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.308633 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:19.309687 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.313961 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.313966 15043 rpcz_store.cc:276] 0709 13:05:17.760611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.761050 (+   439us) service_pool.cc:224] Handling call
0709 13:05:17.766375 (+  5325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.946387 (+180012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.946432 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:17.973698 (+ 27266us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.469990 (+496292us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:18.470040 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:18.470114 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.273959 (+803845us) raft_consensus.cc:1685] finished
0709 13:05:19.273986 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.274160 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":141020,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":307020,"threads_started":2,"wal-append.queue_time_us":774389}
I20260709 13:05:19.309990 16523 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.237146 16627 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.269726 16470 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.248270 16674 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.359470 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1441) took 2489 ms. Trace:
I20260709 13:05:19.373253 14962 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:19.372954 14969 raft_consensus.cc:2368] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3.
I20260709 13:05:19.319329 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:19.359963 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.377704 14965 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:19.355532 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:19.382527 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.383335 14962 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:19.318869 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.384558 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.386974 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.385910 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.374866 14895 rpcz_store.cc:276] 0709 13:05:16.858064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.858594 (+   530us) service_pool.cc:224] Handling call
0709 13:05:16.858946 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.860304 (+  1358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.860332 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.860715 (+   383us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.178384 (+317669us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:17.233536 (+ 55152us) log.cc:844] Serialized 14 byte log entry
0709 13:05:17.233754 (+   218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.233879 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.208914 (+1975035us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:19.346874 (+137960us) raft_consensus.cc:1685] finished
0709 13:05:19.346971 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.347113 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13660,"prepare.queue_time_us":55454,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":9086,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":34235,"spinlock_wait_cycles":5714816,"thread_start_us":268289,"threads_started":1,"wal-append.queue_time_us":480851}
I20260709 13:05:19.310509 16681 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.388211 14965 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
W20260709 13:05:19.389683 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 158174us
I20260709 13:05:19.410717 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.346926 16658 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.335845 16454 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:19.389585 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 262413us
I20260709 13:05:19.411371 14890 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:19.413985 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.417713 15043 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:19.374784 16524 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:19.310221 15541 rpcz_store.cc:269] 0709 13:05:17.493047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.493949 (+   902us) service_pool.cc:224] Handling call
0709 13:05:19.248403 (+1754454us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:19.387560 16523 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.319633 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:19.387924 14964 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:19.430979 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:19.380421 16463 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.319108 16686 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.347541 16537 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.461076 16673 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.314426 16679 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.288141 16682 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.257318 16645 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.417426 16658 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.462249 14886 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.514830 16678 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.426394 16454 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.526453 16539 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:19.531121 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100880us
I20260709 13:05:19.533607 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:19.535192 16674 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.535187 16679 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.312974 16670 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.522086 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.529295 16667 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.540067 16524 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:19.552214 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 138888us
I20260709 13:05:19.530565 16693 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.550016 16674 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.528895 16539 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.551981 16627 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.558494 16524 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.557309 14889 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:19.575237 16690 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.582882 16524 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.574262 16536 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:19.634943 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69683.2us
I20260709 13:05:19.641855 16703 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.642009 16537 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.616667 16672 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.649493 16668 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.639381 16627 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.650609 16627 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.653257 16627 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.622325 16686 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.640478 16463 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.671145 16670 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.570791 16693 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.624006 16690 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.657922 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.668252 16658 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.674012 16454 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.684147 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:19.687034 15548 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.661327 16703 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:19.689397 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53030.4us
I20260709 13:05:19.689759 16539 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.696729 16693 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:19.697350 16689 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:05:19.682899 14889 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:19.688678 16682 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.692584 16463 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.709061 15548 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:19.710728 16690 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.711289 16482 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:19.713747 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 288182us
W20260709 13:05:19.716269 16642 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.005s
I20260709 13:05:19.717384 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.719515 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 285) took 4402 ms. Trace:
W20260709 13:05:19.695549 16646 consensus_meta.cc:287] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.596s	user 0.006s	sys 0.006s
W20260709 13:05:19.726598 15548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 378) took 1951 ms (client timeout 2071 ms). Trace:
W20260709 13:05:19.728484 15548 rpcz_store.cc:269] 0709 13:05:17.774177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.775129 (+   952us) service_pool.cc:224] Handling call
0709 13:05:19.683952 (+1908823us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:19.725019 (+ 41067us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5107072}
I20260709 13:05:19.724624 14792 rpcz_store.cc:276] 0709 13:05:15.316227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.318965 (+  2738us) service_pool.cc:224] Handling call
0709 13:05:19.718520 (+4399555us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:17.414192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:17.452476 (+ 38284us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:17.452515 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:05:17.452534 (+    19us) tablet.cc:662] Decoding operations
0709 13:05:17.453005 (+   471us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:17.453061 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:17.453089 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:05:17.453444 (+   355us) tablet.cc:701] Row locks acquired
0709 13:05:17.453464 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:05:17.453612 (+   148us) write_op.cc:270] Start()
0709 13:05:17.453720 (+   108us) write_op.cc:276] Timestamp: P: 1783602317453556 usec, L: 0
0709 13:05:17.453743 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:05:17.454443 (+   700us) log.cc:844] Serialized 918 byte log entry
0709 13:05:18.975535 (+1521092us) op_driver.cc:464] REPLICATION: finished
0709 13:05:19.124562 (+149027us) write_op.cc:301] APPLY: starting
0709 13:05:19.127634 (+  3072us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:19.149882 (+ 22248us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:19.171821 (+ 21939us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:19.198974 (+ 27153us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:19.211755 (+ 12781us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:05:19.221703 (+  9948us) write_op.cc:312] APPLY: finished
0709 13:05:19.227997 (+  6294us) log.cc:844] Serialized 29 byte log entry
0709 13:05:19.230649 (+  2652us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.233822 (+  3173us) write_op.cc:454] Released schema lock
0709 13:05:19.233876 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:19.253911 (+ 20035us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:19.257213 (+  3302us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":122746,"apply.run_cpu_time_us":2597,"apply.run_wall_time_us":123492,"num_ops":2,"prepare.queue_time_us":467247,"prepare.run_cpu_time_us":3018,"prepare.run_wall_time_us":50776,"replication_time_us":1508082,"thread_start_us":375256,"threads_started":2}]]}
I20260709 13:05:19.745496 14841 placement_policy_util.cc:248] tablet 67571e95c6f547b989f85aa109da10a9: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260709 13:05:19.741602 16646 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.750141 15044 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3.
I20260709 13:05:19.722911 14886 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:19.752285 14889 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:19.756034 16477 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.728384 16463 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.730928 16642 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.769788 16690 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.773579 16690 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.776144 16463 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.776651 16703 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.765223 16646 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.770021 16523 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:19.786448 16609 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 2.453s	user 0.005s	sys 0.021s
I20260709 13:05:19.772792 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:19.788472 16655 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.766s	user 0.004s	sys 0.006s
I20260709 13:05:19.790630 16683 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.783141 16544 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.791157 16683 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.792804 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.795965 16544 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.799575 16544 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.799688 16669 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.800103 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.800853 16642 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.796159 16690 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.801275 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.801911 14889 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:19.802824 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.803386 14889 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:19.804348 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.804904 14889 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:19.805045 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.805789 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.806269 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.806870 14895 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:19.807140 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.810608 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.811678 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.811939 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.812683 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.812856 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.813315 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.813807 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.814421 14965 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:19.814443 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.809120 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:19.793011 14886 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:19.819830 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.820748 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.822726 16545 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.822680 16624 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.825906 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:19.828460 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.830508 15043 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:19.833045 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.807847 14889 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:19.833473 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.824637 16624 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.835845 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1940) took 3172 ms. Trace:
I20260709 13:05:19.836180 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:19.837531 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:19.840457 14892 rpcz_store.cc:276] 0709 13:05:16.663689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.668497 (+  4808us) service_pool.cc:224] Handling call
0709 13:05:16.668800 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:16.680055 (+ 11255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:16.680094 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:16.680582 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 13:05:17.108266 (+427684us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:17.108305 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:17.108370 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:19.781390 (+2673020us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:19.833963 (+ 52573us) raft_consensus.cc:1685] finished
0709 13:05:19.833986 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.835789 (+  1803us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4757,"raft.queue_time_us":8459,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4807,"spinlock_wait_cycles":12707072,"thread_start_us":421619,"threads_started":1,"wal-append.queue_time_us":584139}
I20260709 13:05:19.841398 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:19.832311 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:19.842969 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:19.843745 15043 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:19.843945 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:19.844614 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.847764 16645 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:19.848237 16645 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:19.848641 16645 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.839840 16477 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:19.853684 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:19.854743 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:19.857815 16545 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.857952 16703 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:19.858610 16703 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.858544 16545 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.859647 16668 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.860139 16668 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.860603 16668 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.861207 16545 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.845623 16559 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:19.862172 16559 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:19.862600 16559 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.864265 16482 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:19.864895 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1392) took 2327 ms. Trace:
I20260709 13:05:19.836773 16669 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:19.865702 16669 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.866443 16669 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:19.865404 14967 rpcz_store.cc:276] 0709 13:05:17.537349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.537537 (+   188us) service_pool.cc:224] Handling call
0709 13:05:19.178371 (+1640834us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b5800003098. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:19.178555 (+   184us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:19.187090 (+  8535us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.187135 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:19.187190 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:19.187233 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.864588 (+677355us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b54003e6a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:19.864656 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:19.864801 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":30108288}
W20260709 13:05:19.868206 15040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 1914) took 1571 ms (client timeout 1644 ms). Trace:
W20260709 13:05:19.868742 15040 rpcz_store.cc:269] 0709 13:05:18.297107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.297241 (+   134us) service_pool.cc:224] Handling call
0709 13:05:19.867976 (+1570735us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54001f4ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:19.868107 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91230080}
W20260709 13:05:19.872501 16613 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 2.561s	user 0.004s	sys 0.008s
I20260709 13:05:19.872252 16524 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.874339 16524 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.876488 16650 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.876972 16650 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.879374 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.879876 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.878885 16650 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.880486 14963 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:19.880688 16650 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:19.880874 16477 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:19.881189 16650 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.881359 16477 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:19.859246 16703 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:19.882298 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.882851 14966 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:19.883196 16650 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.883628 16678 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:19.845119 15043 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:19.890612 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.883879 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.885543 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.885617 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.892360 16649 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.884332 14859 leader_election.cc:400] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3.
I20260709 13:05:19.891263 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.903378 14968 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:19.929788 14859 leader_election.cc:403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:19.887341 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:19.930752 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 43492us
I20260709 13:05:19.931488 14969 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:19.899956 16683 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.931771 16559 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.933643 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.934499 16559 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:19.934892 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:19.892269 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.935570 14966 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:19.936373 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.937616 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.938185 14886 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:19.864898 16482 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:19.940316 16482 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:19.941817 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:19.944088 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59943.4us
I20260709 13:05:19.947033 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:19.905845 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.890311 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.903448 16678 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:19.888101 14790 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.012238 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:19.939069 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.007642 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1445) took 2523 ms. Trace:
I20260709 13:05:20.009217 14966 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:20.014405 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.014895 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.015666 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:20.010293 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:19.931268 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.018011 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:20.009647 14965 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.012456 14790 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:19.886093 16674 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.019249 14790 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.022512 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:20.013988 14888 rpcz_store.cc:276] 0709 13:05:17.484196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.048071 (+563875us) service_pool.cc:224] Handling call
0709 13:05:18.048362 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:18.048565 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:18.151971 (+103406us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.824788 (+1672817us) spinlock_profiling.cc:243] Waited 82.1 ms on lock 0x7b18002e19e0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f553491623a 00007f5534d80a2a
0709 13:05:20.007258 (+182470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.007314 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:20.007357 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.007460 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.007588 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":257,"prepare.queue_time_us":103080,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1549,"raft.queue_time_us":3648,"spinlock_wait_cycles":188741376,"thread_start_us":116576,"threads_started":1}
I20260709 13:05:20.023370 14790 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 3, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:19.885921 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:19.883386 16477 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:19.885215 16624 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:19.892302 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.026635 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.058192 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:20.035089 14790 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 3, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
W20260709 13:05:20.056771 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125534us
I20260709 13:05:20.060477 14790 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 3, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:20.027506 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:20.064929 14891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1449) took 2527 ms (client timeout 1960 ms). Trace:
W20260709 13:05:20.065869 15039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 1902) took 2779 ms (client timeout 2148 ms). Trace:
W20260709 13:05:20.065336 14891 rpcz_store.cc:269] 0709 13:05:17.528203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.785738 (+257535us) service_pool.cc:224] Handling call
0709 13:05:20.055476 (+2269738us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540024f9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:20.055607 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":794920704}
W20260709 13:05:20.066308 15039 rpcz_store.cc:269] 0709 13:05:17.276901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.277061 (+   160us) service_pool.cc:224] Handling call
0709 13:05:20.055855 (+2778794us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54001ccd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:20.056022 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608262400}
I20260709 13:05:20.063597 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:20.010160 16683 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.072304 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.010632 16652 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.010354 16545 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.024986 16672 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:20.016785 16637 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:20.072978 14890 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:20.011408 16559 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.020277 16678 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.060114 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.025182 16684 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.015120 16650 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.106191 14891 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:20.072477 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet 376f02b12a354291b7600c9c176e3885: Illegal state: Replica eb4a5ac9f0c5425b92051187b939860f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:20.079679 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.015327 16433 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.011210 16646 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.025483 16634 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.021718 16544 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.149303 15043 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:20.056874 16682 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.027549 16674 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.068156 16470 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:20.119062 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.102803 16624 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.165988 14888 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.063342 16454 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:20.122545 16671 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:20.122644 14961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1185) took 1678 ms (client timeout 2004 ms). Trace:
I20260709 13:05:20.123827 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1908) took 2362 ms. Trace:
I20260709 13:05:20.111063 16649 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.129884 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:20.132004 15514 connection.cc:256] RPC call timeout handler was delayed by -1.2807763509998722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1512s for a response
W20260709 13:05:20.176942 15514 connection.cc:256] RPC call timeout handler was delayed by -1.2753763509998635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260709 13:05:20.132124 14887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1451) took 2592 ms (client timeout 2227 ms). Trace:
I20260709 13:05:20.133342 16646 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.134630 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.168645 16454 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.010962 16614 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.139266 14968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:05:20.174731 15036 rpcz_store.cc:276] 0709 13:05:17.761511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.761648 (+   137us) service_pool.cc:224] Handling call
0709 13:05:17.762030 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:17.951810 (+189780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:17.951856 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:18.049252 (+ 97396us) log.cc:844] Serialized 26 byte log entry
0709 13:05:18.458840 (+409588us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:18.956047 (+497207us) log.cc:844] Serialized 14 byte log entry
0709 13:05:19.086696 (+130649us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.720620 (+633924us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:20.123472 (+402852us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b540014a5d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:20.123536 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.123587 (+    51us) raft_consensus.cc:1685] finished
0709 13:05:20.123603 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.123741 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5186,"prepare.queue_time_us":541215,"prepare.run_cpu_time_us":9213,"prepare.run_wall_time_us":50353,"raft.queue_time_us":266703,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":6729,"spinlock_wait_cycles":51407616,"thread_start_us":828027,"threads_started":4,"wal-append.queue_time_us":737802}
I20260709 13:05:20.165164 16470 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.104072 16545 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.106716 16652 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:20.164325 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 108661us
I20260709 13:05:20.103433 16637 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.105428 16672 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.171303 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 441) took 1746 ms. Trace:
I20260709 13:05:20.174386 16452 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:20.119829 16684 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:20.178273 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 150914us
I20260709 13:05:20.138711 16634 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.158706 16682 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.200495 14892 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:20.137372 16691 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.608s	user 0.003s	sys 0.000s
I20260709 13:05:20.163527 16674 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.103770 16683 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.140868 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:20.170136 16624 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:20.231177 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 90390.9us
I20260709 13:05:20.147164 14965 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:20.208139 16454 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.221022 15545 rpcz_store.cc:276] 0709 13:05:18.417922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.418047 (+   125us) service_pool.cc:224] Handling call
0709 13:05:20.163579 (+1745532us) spinlock_profiling.cc:243] Waited 1.74 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:20.163784 (+   205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.163987 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:20.164015 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.164060 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:20.164097 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:20.164167 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.164289 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3994368}
I20260709 13:05:20.138273 16695 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.222189 16637 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.162367 16433 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.167469 16544 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.196887 14964 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.228658 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.070809 16642 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.240862 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.233917 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:20.256610 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.256914 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.234445 14892 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.235765 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.218487 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:20.226456 16684 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.229686 16634 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.235842 14888 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.231947 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:20.268566 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 1921) took 1137 ms. Trace:
I20260709 13:05:20.216838 16470 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.157560 16650 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.232753 16624 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.209583 16614 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.247316 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:20.247848 16713 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:05:20.232357 16682 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.248131 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.220896 16521 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.225382 16672 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.261106 15546 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:20.197245 16649 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.263873 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:20.174533 14961 rpcz_store.cc:269] 0709 13:05:18.443742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.459683 (+ 15941us) service_pool.cc:224] Handling call
0709 13:05:20.122389 (+1662706us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b54003ec454. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:20.122547 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19588480}
I20260709 13:05:20.266160 16715 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.238080 16711 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.269102 15044 rpcz_store.cc:276] 0709 13:05:19.131509 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.319109 (+187600us) service_pool.cc:224] Handling call
0709 13:05:20.268318 (+949209us) spinlock_profiling.cc:243] Waited 374 ms on lock 0x7b54001cbe54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:20.268490 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":860698368}
I20260709 13:05:20.237944 16536 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:20.279475 14968 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:20.300697 14968 raft_consensus.cc:614] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:20.271584 16394 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.281864 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.303763 15548 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:20.243971 16695 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:20.181282 14887 rpcz_store.cc:269] 0709 13:05:17.539600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:17.849519 (+309919us) service_pool.cc:224] Handling call
0709 13:05:20.131916 (+2282397us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54000ae1d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:20.132046 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1431033600}
I20260709 13:05:20.231210 16452 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:20.312963 16712 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 13:05:20.313844 16452 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.300791 16711 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.314628 16711 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.273701 16551 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:20.239130 16669 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.290853 15545 raft_consensus.cc:2376] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3. Re-sending same reply.
I20260709 13:05:20.300843 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1917) took 1865 ms. Trace:
W20260709 13:05:20.323173 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57610.4us
I20260709 13:05:20.322120 15037 rpcz_store.cc:276] 0709 13:05:18.435186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:18.618019 (+182833us) service_pool.cc:224] Handling call
0709 13:05:18.835631 (+217612us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:19.081644 (+246013us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:19.081687 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:19.084627 (+  2940us) log.cc:844] Serialized 26 byte log entry
0709 13:05:19.303446 (+218819us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:19.303480 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:19.303541 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:20.137045 (+833504us) spinlock_profiling.cc:243] Waited 4.81 ms on lock 0x7b24002005e8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531b0f9c4 00007f5531b0dacb 00007f5531cc8dc9 00007f5531cc8a55 00007f5531cc809d 00007f55348fa10e 00007f553491188c 00007f5534910bb6 00007f55349107d8 00007f553491a221
0709 13:05:20.283769 (+146724us) raft_consensus.cc:1685] finished
0709 13:05:20.283798 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:20.300780 (+ 16982us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24717,"raft.queue_time_us":28123,"spinlock_wait_cycles":30605952,"thread_start_us":412004,"threads_started":2,"wal-append.queue_time_us":345490}
I20260709 13:05:20.257318 16618 ts_tablet_manager.cc:1929] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:05:20.275507 16671 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:20.304170 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.306891 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.342995 15549 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:20.306622 16394 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.310002 16646 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.311810 16695 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.345934 16394 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.308298 16536 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.298142 16521 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.347849 16536 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.316154 14886 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.349112 16521 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.350167 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.285039 14963 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:20.285753 16716 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.337064 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.300616 16715 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.358837 16715 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.275641 16642 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.350363 16433 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.291198 16702 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:20.366119 15035 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:20.338076 16544 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.357092 16667 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:20.366285 16702 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.318178 16551 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.344786 16618 log.cc:1199] T 67571e95c6f547b989f85aa109da10a9 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/67571e95c6f547b989f85aa109da10a9
I20260709 13:05:20.382916 14892 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:05:20.360738 16671 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:20.399770 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 142889us
I20260709 13:05:20.400831 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:20.359884 16716 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.383665 16551 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:20.410063 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 153513us
I20260709 13:05:20.409816 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:20.383236 16702 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.416009 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.403311 14964 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:20.420284 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.421048 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:20.421455 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83647.7us
W20260709 13:05:20.427186 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 89922.1us
I20260709 13:05:20.412228 16716 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:20.430647 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 198727us
I20260709 13:05:20.430647 14962 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:20.433568 14970 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:20.411723 16723 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.415599 16482 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:20.454995 16650 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.460007 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:20.463133 14859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 2.004s (SENT) [suppressed 25 similar messages]
I20260709 13:05:20.465225 16684 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.424443 16492 raft_consensus.cc:2764] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:20.470834 16394 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.471794 16454 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.435845 16440 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.419088 16545 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.418817 16646 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:20.465243 16715 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.487854 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:20.481389 16703 consensus_meta.cc:287] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.005s
W20260709 13:05:20.489171 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 56534.6us
I20260709 13:05:20.508378 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:20.433172 16618 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:38784 (request call id 82) took 3583 ms. Trace:
I20260709 13:05:20.431200 16657 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.527801 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:20.529426 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:20.485476 16652 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.490769 16440 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.535830 14964 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:20.536176 16440 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.537580 16682 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.538744 16394 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.539248 16547 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:20.525825 16703 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:20.540339 16721 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:05:20.540570 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.541698 16703 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.541836 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.543002 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.539680 16727 raft_consensus.cc:2764] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 13:05:20.526628 14886 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:20.564119 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.564944 15044 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:20.565438 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.565755 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.566421 16684 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.565755 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.568301 14961 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:20.569325 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.436180 16671 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.525383 16646 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:20.489473 16624 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.528517 16649 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.574091 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.574623 15037 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:20.563462 16714 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.575304 16454 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:20.532438 16669 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.576674 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.644788 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.645411 15044 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:20.533028 16559 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3.
I20260709 13:05:20.641655 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.649505 14890 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.539717 16547 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.651382 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:20.653815 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:20.649592 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1458) took 1333 ms. Trace:
I20260709 13:05:20.655093 14892 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:20.658851 14894 rpcz_store.cc:276] 0709 13:05:19.312768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.317180 (+  4412us) service_pool.cc:224] Handling call
0709 13:05:20.576508 (+1259328us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:20.645805 (+ 69297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5206912}
I20260709 13:05:20.646225 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.662770 14887 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:20.604463 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.663807 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:20.664278 14961 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:20.666177 16559 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:20.666710 16559 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:20.667644 16559 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.562372 16672 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.646548 16714 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.675513 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.563076 16470 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.681826 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.682492 14893 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:20.682963 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1456) took 1372 ms. Trace:
I20260709 13:05:20.683271 14893 rpcz_store.cc:276] 0709 13:05:19.310186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.310314 (+   128us) service_pool.cc:224] Handling call
0709 13:05:20.681674 (+1371360us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:20.682904 (+  1230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6555008}
I20260709 13:05:20.687387 15039 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:20.656353 16547 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:20.674824 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.691036 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:20.693056 16648 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.693464 16634 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.679725 16445 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.682045 16631 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:05:20.677709 16714 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.694799 14886 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.695631 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:20.699877 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.683251 16669 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:20.716837 14969 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:20.717842 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:20.719362 16545 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.719655 16445 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:20.719810 16545 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:20.720067 16445 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.720211 16545 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.720496 16445 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.722674 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:20.699347 16645 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.850s	user 0.011s	sys 0.001s
I20260709 13:05:20.524188 16618 rpcz_store.cc:276] 0709 13:05:16.843852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.861042 (+ 17190us) service_pool.cc:224] Handling call
0709 13:05:17.348160 (+487118us) ts_tablet_manager.cc:1151] Deleting tablet 67571e95c6f547b989f85aa109da10a9
0709 13:05:17.354581 (+  6421us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:05:19.836238 (+2481657us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:20.246049 (+409811us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:20.425092 (+179043us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":687574,"tablet-delete.queue_time_us":477604,"thread_start_us":300046,"threads_started":1}
W20260709 13:05:20.713714 16678 consensus_meta.cc:287] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.002s
I20260709 13:05:20.728075 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:20.729691 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.733317 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.699084 16651 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.734278 14895 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:20.738605 16672 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.753626 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.755045 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.755610 14895 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.724257 16669 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.731220 16730 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:20.716382 16551 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.742811 16651 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.760255 16667 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.711527 16646 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.725077 16711 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.765697 16669 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:20.781141 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.766172 16648 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:20.761966 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 67571e95c6f547b989f85aa109da10a9 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
W20260709 13:05:20.773388 16668 consensus_meta.cc:287] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.912s	user 0.010s	sys 0.002s
I20260709 13:05:20.751539 16678 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.732087 16645 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.784873 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.789616 14936 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3.
I20260709 13:05:20.790912 14965 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:20.778457 16651 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.791072 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.790514 14936 leader_election.cc:403] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:05:20.788564 16470 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:20.779917 16667 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:20.752019 16724 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 13:05:20.783226 16624 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.732647 16727 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:05:20.782982 14886 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:20.804260 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.805218 14891 raft_consensus.cc:2410] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:20.789637 16668 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:20.807771 16735 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:05:20.807689 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:20.808315 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:20.809237 16551 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:20.799165 16738 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:05:20.812151 14889 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:20.812829 16695 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.794032 16667 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:20.813400 16711 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.786397 16648 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.810220 16634 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:20.826745 14895 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:20.818185 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:20.829313 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.814901 14891 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:20.840389 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:20.816540 16521 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:20.792953 16631 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:05:20.814628 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:20.844050 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.809834 16716 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.814666 16445 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.849597 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.989943 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:20.990476 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:20.991526 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:20.991725 14969 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:20.822300 16470 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:20.867812 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.951292 16651 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:20.897733 14890 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:20.993003 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:20.993607 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.993710 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.993964 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:20.857168 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:20.994961 14892 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
W20260709 13:05:20.995399 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 138363us
I20260709 13:05:20.995796 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.996402 14892 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:20.997218 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:20.997130 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:20.996692 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 152698us
I20260709 13:05:20.997936 14892 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:20.995669 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:20.998299 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:20.813956 16742 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3.
I20260709 13:05:20.998798 14969 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:20.998688 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:21.032497 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 217925us
I20260709 13:05:21.032632 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:21.032123 14892 raft_consensus.cc:2410] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:21.033614 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:20.841260 16676 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:05:20.847834 16740 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.077s	user 0.002s	sys 0.000s
I20260709 13:05:20.841104 16672 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:21.038645 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:20.852385 16624 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.041210 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.047606 14892 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.001067 16634 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.034461 16647 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.035035 16733 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.053548 14969 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:21.051581 16637 consensus_meta.cc:287] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.790s	user 0.004s	sys 0.006s
I20260709 13:05:21.040275 16640 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:20.947700 16681 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.057269 14892 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:21.057683 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.069586 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.046137 16695 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.060071 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:21.036597 16470 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.061543 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.049842 16631 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:21.063689 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 73276.2us
I20260709 13:05:21.044912 16454 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.067658 14891 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:21.070153 14892 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.038923 16524 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:20.951324 16714 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.070524 14890 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:21.053936 16634 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.083087 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.085767 16648 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.086877 14886 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:21.108278 16746 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:21.108711 16746 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.064009 16640 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:21.109031 16746 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.109189 16640 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:21.088629 16723 consensus_meta.cc:287] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.004s
I20260709 13:05:21.088932 16667 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.081542 16631 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:21.045639 16742 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:05:21.092206 16716 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.093520 16681 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.093138 16743 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.060842 16637 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:20.999002 16521 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.054788 16724 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.105259 14969 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.112082 16524 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:21.083662 16470 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.110730 14892 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:21.111531 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.155864 15547 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:21.156802 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 111139us
W20260709 13:05:21.116374 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 70258.1us
I20260709 13:05:21.106318 16634 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.105190 16645 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.121888 14966 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:21.114404 16723 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.061245 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.116230 16631 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.121927 16668 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.158820 14892 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:21.117321 16676 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:21.168215 16676 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.125804 14961 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:21.178421 14969 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:21.178966 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.179641 14892 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.187772 14892 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:21.189170 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.192318 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.192934 14969 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.166352 16672 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:21.220265 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.220809 15040 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
W20260709 13:05:21.223775 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 140849us
I20260709 13:05:21.218420 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:21.190936 16559 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.226769 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.150552 16743 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.227644 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:21.250118 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.193974 16545 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.260362 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:21.228130 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.231834 16668 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:21.251801 16645 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:21.276454 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58767.6us
I20260709 13:05:21.271766 16672 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:21.282580 16747 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:21.257491 16646 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:05:21.231727 16559 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.225725 16524 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.263697 16676 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:21.276372 16714 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.300614 16683 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.300482 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.298532 16667 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.290781 16521 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.310499 16521 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.312477 16521 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.306109 16637 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.319669 16521 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.321065 14964 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:21.304952 14969 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:21.323382 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.295169 16681 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.324087 14969 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.308565 16470 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.345432 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 1935) took 1228 ms. Trace:
I20260709 13:05:21.346058 15039 rpcz_store.cc:276] 0709 13:05:20.117424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.118792 (+  1368us) service_pool.cc:224] Handling call
0709 13:05:21.345162 (+1226370us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54001f4ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:21.345350 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1199935744}
I20260709 13:05:21.353379 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.354399 15039 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:05:21.355613 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.356650 15039 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.357805 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:21.362449 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 136549us
I20260709 13:05:21.370249 16631 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.373732 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:21.374251 16752 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:05:21.375252 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:21.375762 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.376415 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.377308 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.378518 16631 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.378718 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.379793 16523 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.380247 16523 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.380633 16523 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.383599 16690 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.383679 16743 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.384146 16690 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.384596 16690 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.386251 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.388057 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.388765 15547 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:21.409345 14969 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:21.411811 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.431180 15039 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.432557 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.398658 16454 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:21.401440 16669 consensus_meta.cc:287] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.614s	user 0.000s	sys 0.011s
W20260709 13:05:21.423003 16547 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.000s
W20260709 13:05:21.427639 16757 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:21.434324 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.433660 14969 raft_consensus.cc:2368] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:21.400806 16750 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:21.436183 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 76250.3us
I20260709 13:05:21.437196 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.437955 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.438476 15547 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.438788 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.439294 15546 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.439826 16746 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.441682 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.441850 16746 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.445648 15547 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:21.445724 15546 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:21.436728 15039 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:21.437500 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.447463 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.448048 14969 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:21.433075 16559 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.448140 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.481985 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.482918 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.483829 14890 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:21.451984 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.455511 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.457973 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.446543 16743 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:21.487021 14969 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.541242 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.542459 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.542321 16523 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:21.459733 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 93791.5us
W20260709 13:05:21.488119 16674 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.243s	user 0.009s	sys 0.005s
I20260709 13:05:21.485114 15549 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:21.488865 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.485458 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.485185 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.504932 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.526644 15039 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:21.527621 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.529048 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.532878 16454 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:21.533108 14889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 1967) took 1736 ms (client timeout 2115 ms). Trace:
I20260709 13:05:21.533942 16690 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.434964 16545 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.443624 16547 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.456476 14964 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:21.436697 16669 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.535739 16640 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.588302 16690 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.589107 14892 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:21.583629 14889 rpcz_store.cc:269] 0709 13:05:19.796664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.007207 (+210543us) service_pool.cc:224] Handling call
0709 13:05:21.532889 (+1525682us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003d54d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:21.533043 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1560023424}
I20260709 13:05:21.590873 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:21.559320 16674 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.594624 15036 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.596788 16614 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.540438 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.543959 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:21.605517 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61642.5us
I20260709 13:05:21.546633 16682 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.459580 16634 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.558802 16544 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:05:21.548740 14969 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:21.552075 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1427) took 1537 ms. Trace:
I20260709 13:05:21.554263 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.558212 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:21.555853 16743 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.608917 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.561218 16770 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 13:05:21.612598 14967 rpcz_store.cc:276] 0709 13:05:20.014397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.063228 (+ 48831us) service_pool.cc:224] Handling call
0709 13:05:20.063508 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.255216 (+191708us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:20.255266 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:20.255340 (+    74us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:20.255418 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.551811 (+1296393us) spinlock_profiling.cc:243] Waited 191 ms on lock 0x7b54000b77d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:21.551858 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.551996 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440208256}
I20260709 13:05:21.614450 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.613649 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:21.615986 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57848us
I20260709 13:05:21.618906 14888 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:21.582804 15545 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
W20260709 13:05:21.548535 16766 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.059s	user 0.005s	sys 0.000s
I20260709 13:05:21.620648 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:21.622077 16702 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.559368 15550 raft_consensus.cc:2376] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3. Re-sending same reply.
I20260709 13:05:21.591096 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.622807 16669 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.557400 16647 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:21.561332 16724 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 13:05:21.560261 15546 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:21.587028 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.598477 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.597293 16768 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:21.616017 16660 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:21.601402 14964 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:21.602725 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1481) took 1179 ms. Trace:
I20260709 13:05:21.597550 16674 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.561165 15541 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
I20260709 13:05:21.628185 14895 rpcz_store.cc:276] 0709 13:05:20.423058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.827350 (+404292us) service_pool.cc:224] Handling call
0709 13:05:21.602130 (+774780us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:21.602298 (+   168us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.602445 (+   147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.602467 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:21.602505 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:21.602535 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.602583 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.602677 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14801280}
I20260709 13:05:21.629648 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.630631 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.608105 15040 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.631430 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.632036 14967 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:21.618579 14933 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.561479 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.607836 16545 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.615358 16634 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.612676 16773 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:21.624325 14890 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.600525 16678 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.625063 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.634687 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.638041 14888 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:21.636106 16702 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.638603 16702 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:21.616657 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.639611 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.639762 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.639475 16702 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.640551 16702 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.640950 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.640980 16682 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:21.641891 16682 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:21.642547 14964 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:21.642676 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.642733 16682 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.643800 16445 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:21.628054 16647 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.645076 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.647198 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.647866 15541 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
W20260709 13:05:21.648061 16696 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 2.107s	user 0.004s	sys 0.002s
I20260709 13:05:21.626240 15036 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:21.648783 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.616155 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.649544 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.650043 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.626296 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.650516 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.650744 15550 raft_consensus.cc:2376] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4. Re-sending same reply.
I20260709 13:05:21.651587 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.651808 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.652580 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.653215 16523 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.653569 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.654104 15550 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.654384 16770 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.653275 15544 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:21.656039 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.656622 15544 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:21.657511 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.623075 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.658936 16711 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:21.659349 16711 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:21.659612 15545 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:21.633009 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.660202 16711 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.633352 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.661149 16711 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.661715 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.662609 16544 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:21.662642 14963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1411) took 1781 ms (client timeout 1666 ms). Trace:
I20260709 13:05:21.663131 16544 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:21.663717 16544 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.667297 16770 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:21.667733 16770 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:21.668228 16770 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.669128 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 321) took 1022 ms. Trace:
I20260709 13:05:21.634140 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.673061 14895 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:21.635782 16547 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.617007 16640 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.641145 16678 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.643579 16768 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:21.669566 14970 rpcz_store.cc:276] 0709 13:05:20.646399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.796045 (+149646us) service_pool.cc:224] Handling call
0709 13:05:21.667608 (+871563us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.667777 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:21.667807 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:21.667849 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:21.667879 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.667940 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.668938 (+   998us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54003e6550. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:21.669069 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1968469248}
I20260709 13:05:21.543641 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:21.706378 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44736.7us
I20260709 13:05:21.706593 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.707358 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.707527 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.708663 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:21.708725 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.709635 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:21.710115 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.626535 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.712276 14859 leader_election.cc:400] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:21.712229 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:21.712863 14859 leader_election.cc:403] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:21.713115 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:21.717062 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.718421 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.717502 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.708614 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.720281 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.716537 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:21.740800 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.743369 15547 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.741564 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.741737 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.744753 15036 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:21.746032 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.740145 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:21.754062 15549 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:21.718007 16773 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:21.711530 16678 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:21.716569 16547 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:21.697394 16768 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:21.717651 16771 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.719795 16730 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:21.663169 14963 rpcz_store.cc:269] 0709 13:05:19.881402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.885686 (+  4284us) service_pool.cc:224] Handling call
0709 13:05:21.662433 (+1776747us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54003e6554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:21.662550 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":496110336}
W20260709 13:05:21.772693 14936 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Timed out: RequestConsensusVote RPC to 127.13.120.3:46271 timed out after 1.644s (SENT)
I20260709 13:05:21.755443 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.723618 16523 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.805485 16523 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:21.795243 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.806622 16523 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:21.813300 14965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 311) took 1379 ms (client timeout 1518 ms). Trace:
W20260709 13:05:21.813678 14965 rpcz_store.cc:269] 0709 13:05:20.433478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.435854 (+  2376us) service_pool.cc:224] Handling call
0709 13:05:21.813124 (+1377270us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002175d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:21.813248 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":691759360}
I20260709 13:05:21.814808 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57192 (request call id 20) took 1703 ms. Trace:
I20260709 13:05:21.810559 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:21.788543 16612 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.015s	sys 0.045s
I20260709 13:05:21.793743 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.820399 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:21.820174 16612 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.014s	user 0.015s	sys 0.045s
I20260709 13:05:21.821517 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.822511 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.825573 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.826123 14891 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:21.827212 14891 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:21.748382 16640 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.843647 16640 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:21.844079 16640 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.788319 16547 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:21.845182 16547 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.746907 16642 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.722259 16614 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:21.801055 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.849475 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1982) took 1012 ms. Trace:
I20260709 13:05:21.849920 14892 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.757517 16753 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.803092 16743 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.742540 16534 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.111s
I20260709 13:05:21.757386 16690 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:05:21.803725 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:21.804345 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.855036 16534 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:21.855381 16534 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:21.858256 14892 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:21.827796 16773 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:21.829420 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.742770 16556 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:21.747350 16634 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:05:21.788683 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.820255 16647 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:21.834434 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:21.879019 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44651.9us
I20260709 13:05:21.836229 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.838367 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.839958 16678 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.815160 14968 rpcz_store.cc:276] 0709 13:05:20.111191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.139141 (+ 27950us) service_pool.cc:224] Handling call
0709 13:05:21.814642 (+1675501us) spinlock_profiling.cc:243] Waited 73.5 ms on lock 0x7b54003089d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d70853 00007f5539d3e60a 00007f55332c47d4 00007f55332c4762 00007f55332c4691 00007f55332c460c 00007f55332c38c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:21.814736 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169098112}
I20260709 13:05:21.849884 14891 rpcz_store.cc:276] 0709 13:05:20.836826 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.826766 (+989940us) service_pool.cc:224] Handling call
0709 13:05:21.827022 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:21.849238 (+ 22216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.849424 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:21.720052 16746 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:21.851168 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.852633 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.852866 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:21.801748 16768 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.855995 14890 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:21.721185 16724 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:21.912837 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:21.912842 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 203272us
I20260709 13:05:21.864454 15038 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
W20260709 13:05:21.832011 16775 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:05:21.880833 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.804647 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:21.894130 14964 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:21.894474 16556 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:21.895313 16690 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:21.897603 16665 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:21.888967 16746 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:21.902637 16711 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:21.919269 15547 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:21.864178 16773 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.934868 16773 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.935567 16556 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:21.936694 16770 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.939545 16770 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:21.942390 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.942749 14890 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.944257 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.946216 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.946549 14890 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:21.933436 16711 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:21.949039 16711 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.950798 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1433) took 1529 ms. Trace:
I20260709 13:05:21.951327 14961 rpcz_store.cc:276] 0709 13:05:20.421269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.664946 (+243677us) service_pool.cc:224] Handling call
0709 13:05:20.665260 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.171707 (+506447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.950531 (+778824us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b5400420254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:21.950726 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1037159296}
W20260709 13:05:21.952473 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 692144us
I20260709 13:05:21.931172 16690 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:21.953862 16690 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:21.955549 16668 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:21.918224 15550 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:21.932842 16746 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:21.959453 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.956825 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:21.924129 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:21.926518 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.958120 14890 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:21.961326 15038 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.958190 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:21.939875 14887 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:21.962954 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.964082 15547 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:21.967239 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.968456 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:21.969141 15038 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.971253 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.971849 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1981) took 1135 ms. Trace:
I20260709 13:05:21.972349 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:21.972332 14886 rpcz_store.cc:276] 0709 13:05:20.836564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.804038 (+967474us) service_pool.cc:224] Handling call
0709 13:05:21.804335 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.804529 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:21.804826 (+   297us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.971389 (+166563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:21.971469 (+    80us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:21.971514 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:21.971578 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:21.971794 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2254,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":73,"raft.run_cpu_time_us":65,"raft.run_wall_time_us":65,"thread_start_us":161942,"threads_started":1}
I20260709 13:05:21.979882 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:21.980573 15041 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:21.969878 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.982545 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:21.983517 15040 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:21.989228 15040 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:21.964592 16690 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.992570 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.994673 15040 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:21.995112 14895 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:21.956645 16645 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:21.993422 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:21.966482 16755 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:21.999619 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:21.997102 15038 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:21.995615 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.002349 15040 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.003705 15041 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:22.002655 15038 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.004588 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.005170 14890 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:21.968065 16470 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:21.925441 16534 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.011705 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.013761 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.014874 15038 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.004588 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:22.006958 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.017520 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:22.018666 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.020110 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:22.021111 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet cbe1d22f90c742fd86d8bd93e5d59e59: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:22.039637 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:21.990846 16697 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:05:22.057832 14892 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:22.045923 15040 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
W20260709 13:05:22.018280 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.057611 14890 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:22.061717 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:21.991000 16780 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:05:22.072535 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:22.078104 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62238.5us
I20260709 13:05:22.078898 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:22.079455 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:22.043381 16521 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:22.080621 14890 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:22.018368 16642 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.089193 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.082026 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.082945 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:22.041654 16771 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.019606 16754 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.087177 14890 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.077800 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:22.065356 16534 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.014277 16470 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.058284 16781 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:22.083750 16755 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.076581 15542 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:22.114073 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.093415 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:22.124118 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44950.7us
I20260709 13:05:22.085124 16521 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.023849 16668 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.133297 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.136322 15039 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.131892 14968 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:22.116660 16698 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:22.145030 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.116411 16781 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:22.089066 16751 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 13:05:22.124984 16556 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 13:05:22.126528 16682 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.092044 16744 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 13:05:22.175182 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.147845 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.177920 15042 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:22.143198 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.137157 16754 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:05:22.181155 16676 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:22.189790 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 132653us
W20260709 13:05:22.193943 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 154399us
I20260709 13:05:22.206302 16556 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.110723 16642 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.139828 16660 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:22.207397 14966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1445) took 1250 ms (client timeout 1502 ms). Trace:
I20260709 13:05:22.211724 16771 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.200407 14891 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.129146 16445 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260709 13:05:22.128809 16645 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.145367 16698 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:22.217939 15040 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:22.132814 16521 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:22.219369 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44321.6us
W20260709 13:05:22.153611 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.219301 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:22.180176 16781 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:05:22.220113 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 72355.2us
I20260709 13:05:22.229641 16556 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.137998 16640 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.230640 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:22.232072 14966 rpcz_store.cc:269] 0709 13:05:20.956748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.991279 (+ 34531us) service_pool.cc:224] Handling call
0709 13:05:22.207114 (+1215835us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b540031bd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:22.207305 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297894144}
I20260709 13:05:22.250222 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:22.132709 16544 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.236006 16771 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.218004 16682 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.221349 15039 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:22.252996 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
W20260709 13:05:22.253741 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.262109 16782 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:05:22.254683 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.254787 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:22.255435 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.270243 15548 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:22.256516 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:22.257294 16784 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:05:22.259373 16702 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.618s	user 0.013s	sys 0.002s
I20260709 13:05:22.236171 14961 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.233194 16744 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.232015 16722 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.231554 16524 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.264515 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.252303 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:22.284482 16637 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.284981 16637 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.285566 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.249516 16698 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.285787 16794 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:22.285848 16637 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.287021 16781 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.288969 16781 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.268170 15042 raft_consensus.cc:606] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.290140 16669 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.272112 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 218) took 2433 ms. Trace:
I20260709 13:05:22.278610 14895 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.291364 15042 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:05:22.292379 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:22.292882 15042 raft_consensus.cc:606] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.294132 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:05:22.294858 15035 rpcz_store.cc:276] 0709 13:05:19.839103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:19.857033 (+ 17930us) service_pool.cc:224] Handling call
0709 13:05:19.857379 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:20.369372 (+511993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.267166 (+1897794us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b54000898d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:22.272056 (+  4890us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1168219520}
I20260709 13:05:22.296862 14895 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:22.268802 16754 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.229693 16755 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.253437 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:22.298372 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44998.3us
I20260709 13:05:22.300669 16751 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:22.301193 16751 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:22.301668 16751 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.300385 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:22.303681 16641 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:22.304225 16641 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:22.304718 16641 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.304975 16754 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.303891 16794 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:22.294801 15042 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.297109 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.311810 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.312780 16676 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.313446 16676 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.314131 16676 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:22.314509 15541 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:22.310994 16641 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.319672 16790 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:05:22.326116 15042 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:22.320466 16785 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 13:05:22.321547 16544 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:22.322021 16786 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:22.294765 16698 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.323855 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.324167 16681 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.328047 14968 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:05:22.331812 16783 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:05:22.311542 16751 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.281801 16744 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.337872 16681 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:22.361774 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 45376.8us
I20260709 13:05:22.343153 16697 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.281613 16556 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.345237 15035 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.334065 16676 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:22.346184 16781 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:05:22.380203 16547 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.535s	user 0.006s	sys 0.003s
I20260709 13:05:22.380739 16781 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.380609 16547 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.381199 16781 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.382632 16681 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.384883 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.385998 16711 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.387383 16789 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.387782 16789 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.388515 16789 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.389663 16789 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.390525 14968 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
W20260709 13:05:22.375079 16798 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:05:22.395051 16556 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.402202 16470 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:22.403719 15044 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.403424 16521 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.404109 16682 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.404286 16790 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:22.404812 16792 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:22.346887 16722 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:05:22.409365 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.328639 16771 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.410986 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:22.428082 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.411098 15044 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.419577 15548 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:05:22.426308 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.382475 16781 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.434414 14893 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:22.438181 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.450457 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.475049 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1948) took 1413 ms. Trace:
I20260709 13:05:22.412202 16697 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:05:22.439517 16682 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.434724 16640 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.485298 14965 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:22.485774 14965 pending_rounds.cc:85] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 1
I20260709 13:05:22.474447 16771 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.472463 16678 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:22.472410 16790 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:22.442000 16754 consensus_queue.cc:1175] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:22.476961 16781 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.477293 16523 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.490093 16433 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.491830 16678 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.437966 16773 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.478919 16711 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.486078 14965 pending_rounds.cc:107] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:22.508122 14965 raft_consensus.cc:2889] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:22.501611 16802 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:05:22.437057 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:22.470739 16702 consensus_queue.cc:1175] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e4938453819c469599f515b22d92fe27" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:05:22.486971 16803 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:05:22.516079 16521 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.517917 16521 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.519048 16521 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.495407 16790 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:22.494804 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 92953.5us
I20260709 13:05:22.487309 16746 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.500010 16641 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.500170 16433 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.493697 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.502818 16698 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.505640 16678 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.508160 16715 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.525620 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.508549 16751 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.527540 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.532330 16433 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.532781 15546 raft_consensus.cc:2376] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4. Re-sending same reply.
I20260709 13:05:22.532613 16790 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.533701 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.533812 16790 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.534771 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.535805 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.536777 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.527750 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.522753 15543 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.529889 15035 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.530139 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.530782 15547 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:22.529922 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.538760 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.528290 16523 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.539323 15550 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.523496 16744 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.544451 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.545135 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.545445 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:22.540959 16682 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.547647 16682 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.550068 16773 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:22.550645 15550 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:22.550891 16746 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.551381 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:22.552224 14964 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:22.552824 16642 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:22.536788 16547 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.554103 15548 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:22.541712 16640 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.564968 16651 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.568990 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.570199 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.570952 16690 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:22.571691 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.572376 16690 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.572667 16523 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.572871 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 187) took 1320 ms. Trace:
I20260709 13:05:22.573303 14892 rpcz_store.cc:276] 0709 13:05:21.252388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.859708 (+607320us) service_pool.cc:224] Handling call
0709 13:05:21.860023 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.058897 (+198874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.572648 (+513751us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54003d54d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:22.572819 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454403456}
W20260709 13:05:22.573865 16768 consensus_meta.cc:287] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.672s	user 0.003s	sys 0.010s
I20260709 13:05:22.574416 14963 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:22.573462 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.575482 14861 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:22.575786 14861 leader_election.cc:403] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:22.556591 16521 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.576650 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.577345 16690 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:22.577695 16690 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.578076 16690 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.475492 15037 rpcz_store.cc:276] 0709 13:05:21.061426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.973161 (+911735us) service_pool.cc:224] Handling call
0709 13:05:21.973448 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:22.060091 (+ 86643us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:22.060124 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:22.066761 (+  6637us) log.cc:844] Serialized 26 byte log entry
0709 13:05:22.248378 (+181617us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:22.465750 (+217372us) log.cc:844] Serialized 14 byte log entry
0709 13:05:22.474706 (+  8956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.474826 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:22.474869 (+    43us) raft_consensus.cc:1685] finished
0709 13:05:22.474879 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.474997 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131520,"prepare.queue_time_us":90248,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":72,"raft.queue_time_us":99872,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":11033,"thread_start_us":335758,"threads_started":2,"wal-append.queue_time_us":231741}
I20260709 13:05:22.582370 16640 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:22.583029 16640 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.583912 14969 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.585172 14969 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.586035 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:22.574276 16768 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.556859 16792 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:05:22.588585 15544 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:22.589128 16792 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.589516 16792 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.589401 16642 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:22.575084 16678 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.591202 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 189) took 1317 ms. Trace:
I20260709 13:05:22.591576 14891 rpcz_store.cc:276] 0709 13:05:21.274300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.885981 (+611681us) service_pool.cc:224] Handling call
0709 13:05:21.886318 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.236126 (+349808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.590996 (+354870us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54000cba54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:22.591146 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721697664}
I20260709 13:05:22.592131 16678 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.592854 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1944) took 1534 ms. Trace:
I20260709 13:05:22.592686 16792 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.593825 16792 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.593197 15043 rpcz_store.cc:276] 0709 13:05:21.058127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.058282 (+   155us) service_pool.cc:224] Handling call
0709 13:05:21.058530 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.157072 (+ 98542us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:21.258527 (+101455us) log.cc:844] Serialized 14 byte log entry
0709 13:05:21.968263 (+709736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:21.968307 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:21.968343 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.592668 (+624325us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b54001cbbd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:22.592708 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:22.592806 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":685407,"prepare.queue_time_us":121774,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":627019,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":7942,"spinlock_wait_cycles":226087808,"thread_start_us":193320,"threads_started":2,"wal-append.queue_time_us":178028}
I20260709 13:05:22.597167 15547 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:22.597500 16780 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:22.597918 16780 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.598969 15550 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:22.602063 16492 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.602459 16492 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.598414 16794 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:05:22.604493 16794 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.604825 16794 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.604838 15545 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.605175 14970 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.605703 16794 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.607813 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.609054 14966 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:22.615283 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.620536 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.638267 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.634704 14788 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 3 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:22.589326 16768 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.619156 16641 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:05:22.608873 16722 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:22.618281 16672 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.598971 16780 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.625411 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.603220 16492 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.653834 16492 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.654017 16521 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.644598 16523 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.659205 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:22.660014 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 178) took 1470 ms. Trace:
I20260709 13:05:22.660434 16722 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.626734 16678 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:22.628348 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.661355 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:22.662498 16715 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.662626 16676 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.662927 16804 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:22.663334 16672 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.663390 16676 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:22.662941 16715 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.665634 16672 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:22.665388 16715 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.666553 15546 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
W20260709 13:05:22.632351 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.634516 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:22.668293 16521 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:22.642787 14788 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:22.669782 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 403) took 1141 ms. Trace:
I20260709 13:05:22.670145 15545 rpcz_store.cc:276] 0709 13:05:21.528030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.660358 (+132328us) service_pool.cc:224] Handling call
0709 13:05:22.604627 (+944269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.605435 (+   808us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.669608 (+ 64173us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540056ead0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:22.669731 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2170715392}
I20260709 13:05:22.670100 14788 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:22.633968 14790 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 279) took 7043 ms. Trace:
I20260709 13:05:22.673391 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:22.661255 16722 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:22.608927 16814 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.671417 14790 rpcz_store.cc:276] 0709 13:05:15.590899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:15.591153 (+   254us) service_pool.cc:224] Handling call
0709 13:05:22.633896 (+7042743us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:20.386823 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:20.523158 (+136335us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:20.523200 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:05:20.523220 (+    20us) tablet.cc:662] Decoding operations
0709 13:05:20.604342 (+ 81122us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:20.604418 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:20.604445 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:05:20.660623 (+ 56178us) tablet.cc:701] Row locks acquired
0709 13:05:20.660657 (+    34us) write_op.cc:260] PREPARE: finished
0709 13:05:20.678333 (+ 17676us) write_op.cc:270] Start()
0709 13:05:20.683098 (+  4765us) write_op.cc:276] Timestamp: P: 1783602320676375 usec, L: 0
0709 13:05:20.687857 (+  4759us) op_driver.cc:348] REPLICATION: starting
0709 13:05:20.697931 (+ 10074us) log.cc:844] Serialized 2459 byte log entry
0709 13:05:21.052165 (+354234us) op_driver.cc:464] REPLICATION: finished
0709 13:05:21.216638 (+164473us) write_op.cc:301] APPLY: starting
0709 13:05:21.218304 (+  1666us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:21.228732 (+ 10428us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:21.264502 (+ 35770us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:21.312103 (+ 47601us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:21.312310 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:05:21.312356 (+    46us) write_op.cc:312] APPLY: finished
0709 13:05:21.312619 (+   263us) log.cc:844] Serialized 53 byte log entry
0709 13:05:21.312823 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:21.312929 (+   106us) write_op.cc:454] Released schema lock
0709 13:05:21.312974 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:21.313323 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:21.313352 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":313005,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":138719,"apply.run_cpu_time_us":4224,"apply.run_wall_time_us":120483,"num_ops":6,"prepare.queue_time_us":187190,"prepare.run_cpu_time_us":27924,"prepare.run_wall_time_us":415465,"raft.queue_time_us":230729,"raft.run_cpu_time_us":10754,"raft.run_wall_time_us":72980,"replication_time_us":363624,"thread_start_us":370713,"threads_started":4,"wal-append.queue_time_us":120984,"wal-append.run_cpu_time_us":33341,"wal-append.run_wall_time_us":1498022}]]}
I20260709 13:05:22.666632 16715 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.676811 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.660524 16646 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:22.677714 16646 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.677924 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:22.678591 14788 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:22.680781 16780 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:22.681623 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:22.682147 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:22.682855 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.683424 16722 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.681216 16646 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.606906 16794 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.660317 14888 rpcz_store.cc:276] 0709 13:05:21.189622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.638654 (+449032us) service_pool.cc:224] Handling call
0709 13:05:22.659057 (+1020403us) spinlock_profiling.cc:243] Waited 69.4 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:22.659961 (+   904us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":159610240}
I20260709 13:05:22.606938 16690 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:22.692476 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.686133 15040 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.639045 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.687855 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:22.691483 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.695734 15043 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:22.698493 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.699671 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:22.701045 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 62053.4us
I20260709 13:05:22.702044 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.711673 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 1991) took 1412 ms. Trace:
I20260709 13:05:22.712457 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.713075 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.712153 14887 rpcz_store.cc:276] 0709 13:05:21.299332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.894701 (+595369us) service_pool.cc:224] Handling call
0709 13:05:21.894990 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:21.966239 (+ 71249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:22.693341 (+727102us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b540024f4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:22.711608 (+ 18267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102674816}
I20260709 13:05:22.714599 16534 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:22.716416 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:22.716908 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.693552 16665 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.717482 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:22.717854 16665 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.719154 16751 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:22.719710 16751 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.720093 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:22.720508 16665 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.721815 16751 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:22.723870 16678 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.725584 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:22.728076 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.695842 16672 raft_consensus.cc:2764] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:22.731339 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.687579 16722 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.732386 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:22.733395 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.733269 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.724992 16814 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.729147 16523 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:22.696969 16695 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:05:22.729660 16646 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:22.729933 16642 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.734673 16558 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 13:05:22.746166 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.734766 16682 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:05:22.735747 16470 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.738518 16492 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.752337 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:22.736539 16477 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.735870 16804 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.744015 16695 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.739384 16665 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.763674 16697 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.764081 16697 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.764921 16697 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.766110 16697 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.766321 16523 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.770793 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.759218 16669 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:22.773487 16722 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.761288 16547 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.770543 16492 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.783658 16547 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.761766 16695 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:22.786752 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 56834us
I20260709 13:05:22.774452 16558 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:22.791118 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:22.773116 16660 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.794036 14891 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:22.791762 14892 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:22.788552 16665 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:05:22.801712 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.785517 16804 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.805819 16665 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:22.808964 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.811374 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:22.795512 16669 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.808063 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.813055 16547 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.845865 16547 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.846774 16814 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.804152 16682 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:22.850318 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.851248 14894 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.852520 14968 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:22.843997 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.855728 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.856283 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.857311 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.857311 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:22.858228 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 126737us
I20260709 13:05:22.866608 14887 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:22.867959 14887 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.872341 16534 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.858825 16682 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.867976 14893 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.876552 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.879150 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:22.880251 15044 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:22.880997 15548 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.810055 16665 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:22.882809 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:22.883338 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.883427 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:22.883431 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:22.885932 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:22.875391 16792 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.811774 16558 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.813308 16650 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.887899 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.875186 16682 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.889744 14893 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:22.808681 16492 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.903905 16651 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:22.904893 16727 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.905256 16727 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:22.849076 16690 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:22.876037 16744 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:22.906385 16744 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:22.905987 16727 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.906816 16744 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:22.886504 16791 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.893759 14964 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:22.878991 16719 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:22.894394 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:22.894930 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:22.910725 14962 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:22.894869 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.894805 14894 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:22.896106 16671 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:22.897419 14887 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:22.882171 16556 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:22.916168 16556 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.918154 16556 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:22.886814 16534 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.918511 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:22.919368 14964 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:22.899736 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:22.886579 16813 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:05:22.855177 16695 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.920714 16813 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:22.920864 16695 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.921155 16813 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.922356 16433 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.922132 16813 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.907513 16727 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.923735 16813 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.900655 14963 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:22.924687 14966 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.840166 16669 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.900882 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:22.901059 14886 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.854853 16804 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:22.902132 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1321) took 1740 ms. Trace:
I20260709 13:05:22.931792 15036 rpcz_store.cc:276] 0709 13:05:21.162176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.788436 (+626260us) service_pool.cc:224] Handling call
0709 13:05:22.901920 (+1113484us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54001f4ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:22.902078 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1428318080}
I20260709 13:05:22.902642 14969 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:22.949275 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:22.949918 15546 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:22.908524 16828 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.908331 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.908095 16791 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:22.913859 14893 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.953300 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:22.952700 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:22.914856 14894 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:22.915125 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.927225 14965 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:22.927608 16671 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:05:22.967535 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52479us
I20260709 13:05:22.927917 16637 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.968801 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.969928 16637 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:22.964888 16814 raft_consensus.cc:2764] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:22.970299 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.971160 16492 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:22.971578 16492 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:22.971956 16492 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.972048 15542 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:22.928078 16646 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:22.954273 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.929903 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:22.929809 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:22.950695 16754 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:22.812053 16660 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:05:22.958371 16665 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:22.974532 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66265us
I20260709 13:05:22.955806 16755 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:22.984804 15038 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:22.986485 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.994760 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.970281 16637 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:22.970288 16751 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:22.976536 16722 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.001806 14936 consensus_peers.cc:597] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 37a7135d72784bd590fd05aeda0ea3b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:22.996515 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:22.998288 16711 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.002446 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.995177 16791 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:22.967334 16640 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:05:23.003691 16690 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.003998 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.004580 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.002760 16711 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.004786 16791 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:22.996955 16814 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.005596 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:22.981367 16825 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:23.006453 14890 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:22.981027 16827 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:05:22.997418 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:22.979357 16682 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:23.020370 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:22.997334 16828 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:22.980585 16728 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:05:23.011449 14886 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:23.005535 16792 consensus_queue.cc:1175] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25b8f0cc46f748468395543b8b174bf4" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:05:23.031153 15547 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:23.024672 16637 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.025125 16660 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:23.026189 16719 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:22.985488 16715 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:23.027204 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.028165 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:23.035949 16715 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.033706 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.036921 16637 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:22.987237 16754 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.040195 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:23.039296 16780 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:22.982227 16558 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.043439 15548 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:23.002400 16744 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.026988 16770 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.045549 16544 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.045851 16547 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.046283 16547 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.047143 16547 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.048372 16547 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.034303 16523 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:23.022440 16755 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:05:23.019630 16725 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
W20260709 13:05:23.081741 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.066334 16711 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:23.066390 16827 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.067598 16770 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 13:05:23.076723 16523 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:23.075203 16433 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:05:23.087061 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:23.107362 16833 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:05:23.107592 16832 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 13:05:23.093900 16838 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:05:23.099968 16492 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.079869 16660 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 13:05:23.083303 16544 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:05:23.115052 16492 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:23.112679 15541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 453) took 1482 ms (client timeout 1897 ms). Trace:
I20260709 13:05:23.091879 16827 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.118657 16827 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:23.119498 16523 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.120399 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:23.121428 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:23.122120 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:23.116297 15541 rpcz_store.cc:269] 0709 13:05:21.629785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:21.648544 (+ 18759us) service_pool.cc:224] Handling call
0709 13:05:23.100642 (+1452098us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b54006a1154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:23.111668 (+ 11026us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393775488}
W20260709 13:05:23.127597 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44467.3us
I20260709 13:05:23.128602 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:23.134183 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.143510 16838 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:23.148132 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:23.096772 16690 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:05:23.166693 14888 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:23.168118 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:23.169622 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:23.151081 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:23.180058 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:23.182617 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.150106 16814 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:05:23.185114 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:23.151693 16682 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:05:23.189575 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:23.193456 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.194769 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1952) took 1229 ms. Trace:
I20260709 13:05:23.204818 16681 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.204897 16474 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.183436 16843 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.193536 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.195175 15038 rpcz_store.cc:276] 0709 13:05:21.965551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.017156 (+ 51605us) service_pool.cc:224] Handling call
0709 13:05:22.018757 (+  1601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.987675 (+968918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.194530 (+206855us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b5400404cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:23.194707 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220997376}
I20260709 13:05:23.208500 14968 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:23.190063 16690 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.191736 16697 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:23.219101 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.220050 16764 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:23.221175 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:23.226660 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:23.221866 14886 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:23.230183 14886 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:05:23.231904 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 495) took 2938 ms. Trace:
I20260709 13:05:23.189878 16715 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:05:23.226343 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:23.206063 16650 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.240587 14966 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.221839 16780 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.211596 16474 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:23.254284 16492 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:05:23.256256 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.218273 16690 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:23.264850 16690 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.266270 16690 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.253626 16697 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.232321 15543 rpcz_store.cc:276] 0709 13:05:20.283487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:20.284591 (+  1104us) service_pool.cc:224] Handling call
0709 13:05:21.830205 (+1545614us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51eee 0000000000375939 00007f5539cc51e0 00007f5539d8e0c4 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:21.830394 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:22.540997 (+710603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:23.202880 (+661883us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b54005d1bd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:23.221883 (+ 19003us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1593052800}
I20260709 13:05:23.252007 16744 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:23.251873 16534 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.272858 16534 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.274855 16754 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:23.271800 16474 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.278533 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.279378 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:23.280894 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:23.281690 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.285935 15043 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:23.287393 15035 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:23.300356 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:23.301951 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65187.7us
I20260709 13:05:23.303996 16544 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:23.304695 16544 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.309188 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.309983 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:23.242363 16650 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.254271 16558 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.323892 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 103566us
I20260709 13:05:23.338989 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:23.292760 16682 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.302052 16828 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.375000 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 148641us
I20260709 13:05:23.379779 16754 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.349857 16474 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.346858 16838 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.380527 16754 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.394659 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.396340 15041 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:23.402275 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 95268.6us
I20260709 13:05:23.408177 16770 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:23.415304 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:23.417379 14891 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:23.354020 16813 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:23.420770 16835 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:05:23.389981 14889 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:23.347051 16558 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.355175 16828 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.473726 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.474525 14888 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:23.475569 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:23.442503 16785 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.059s	user 0.001s	sys 0.001s
W20260709 13:05:23.464566 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.349097 16682 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.376798 16814 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:05:23.447764 16770 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.463882 16651 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:23.467029 16847 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.069s	user 0.000s	sys 0.009s
W20260709 13:05:23.503337 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.516510 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:23.517099 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:23.517884 15550 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:23.520619 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:23.445411 16827 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:23.466019 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:23.479424 16433 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.525822 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:23.531246 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:23.532018 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:23.534783 15550 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:23.536525 14963 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:23.538513 15545 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:23.428364 16650 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:23.526556 16815 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:05:23.510604 16534 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:23.546844 15550 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.488322 16660 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 13:05:23.500224 16728 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:23.535637 15544 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.465509 16544 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.589110 15549 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:23.550367 16842 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:23.588511 15514 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:23.522462 16651 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.603791 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:23.604524 15549 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:23.591064 16433 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:23.546200 16838 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:05:23.616250 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.605978 16791 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:23.614625 16664 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:05:23.642982 16547 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260709 13:05:23.644582 16828 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:23.645300 16853 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 13:05:23.613070 16433 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:23.659866 16637 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 13:05:23.691135 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:23.695969 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 164782us
I20260709 13:05:23.684029 16433 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:23.666857 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:23.702016 15549 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.702702 15039 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:23.703917 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:23.703913 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.693948 16754 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:23.716029 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:23.716524 14970 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:23.718963 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:23.709087 16558 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:23.721699 16660 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:23.729115 16682 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:23.731465 15043 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:05:23.731511 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.723553 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:23.741847 15043 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.744532 16665 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.762465 16744 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:23.763031 16744 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.763943 16744 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.765853 16640 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:23.764366 16433 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.767838 16640 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.740852 16651 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:23.781430 16770 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.800766 16433 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:23.800951 16492 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:23.803822 15543 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.804533 16770 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:23.805574 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:23.807392 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:23.809293 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:23.813994 16719 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:23.814626 16791 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:23.821012 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:23.823489 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.825594 16874 ts_tablet_manager.cc:933] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:23.823930 16728 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:23.818312 16556 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.830163 16474 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:23.832597 14961 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:23.832922 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.851084 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.834616 16842 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.853757 16869 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.828459 16719 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.854255 16869 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.845410 14892 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:23.860544 16869 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:23.845770 14890 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:23.847357 14888 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:23.855049 16719 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.864459 16719 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:23.842417 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 252134us
I20260709 13:05:23.856689 16828 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:23.857071 16814 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:23.849298 16474 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:23.857621 16843 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.871352 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:23.871976 15545 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
W20260709 13:05:23.866636 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45738.7us
W20260709 13:05:23.870499 16863 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.215s	user 0.003s	sys 0.000s
I20260709 13:05:23.867274 16804 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:23.872198 16474 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:23.864507 16650 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:23.880635 16640 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:23.864187 16556 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.883312 15038 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:23.884584 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.888769 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:23.892019 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.892329 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.891759 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.898078 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.902714 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:23.893555 16869 raft_consensus.cc:993] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:23.885080 16723 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:23.898569 16671 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.903050 16715 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:23.928427 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:23.903648 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:23.900080 16492 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:05:23.953344 16711 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:23.935849 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:23.899550 16690 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 13:05:23.968063 15545 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:23.971189 16433 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.971307 16651 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.928823 16838 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:23.881137 16874 tablet_copy_client.cc:323] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:05:23.988240 14967 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:23.902899 16672 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:05:23.974073 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:23.934749 16556 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:23.998070 14967 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:24.001585 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 71618.9us
I20260709 13:05:24.003185 14967 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:24.005326 14967 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 13:05:24.005800 14967 pending_rounds.cc:85] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 2
I20260709 13:05:24.006155 14967 pending_rounds.cc:107] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 13:05:24.006506 14967 raft_consensus.cc:2889] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:23.955663 16794 raft_consensus.cc:1081] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:05:23.956290 16814 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:23.931061 16482 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:05:23.980093 16433 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.991818 16651 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.008642 16838 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:23.967847 16711 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:23.976303 16674 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:23.978024 16470 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:23.928867 16547 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 13:05:24.042881 14963 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:24.061892 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.929638 16723 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:23.939486 16751 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:05:24.057917 16869 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:24.058109 16888 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:05:24.059186 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 130810us
W20260709 13:05:24.060199 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46024.2us
I20260709 13:05:24.063660 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 337) took 1164 ms. Trace:
I20260709 13:05:24.072803 14968 rpcz_store.cc:276] 0709 13:05:22.899291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.899519 (+   228us) service_pool.cc:224] Handling call
0709 13:05:24.063503 (+1163984us) spinlock_profiling.cc:243] Waited 241 ms on lock 0x7b540016d354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:24.063606 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":555030272}
I20260709 13:05:24.017783 16492 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:23.941262 16671 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.061582 16674 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.019709 16715 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:05:24.021914 16524 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 13:05:24.070400 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.076669 16492 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.079391 16751 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:24.090457 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.117929 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.076761 16523 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:24.070403 16470 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.087750 16651 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.145463 15037 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 1.
I20260709 13:05:24.086585 16433 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.088884 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:24.086845 16858 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.431s	user 0.001s	sys 0.001s
I20260709 13:05:24.117508 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 37a7135d72784bd590fd05aeda0ea3b6 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:05:24.080727 16674 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.158826 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 37a7135d72784bd590fd05aeda0ea3b6 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-37a7135d72784bd590fd05aeda0ea3b6
I20260709 13:05:24.118284 16678 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:24.124305 16492 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:24.170661 16883 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:05:24.080360 16870 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260709 13:05:24.124130 16751 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:24.079623 16892 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:05:24.087834 14964 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:24.084224 15543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52838
I20260709 13:05:24.135447 16890 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.096s
I20260709 13:05:24.171717 16678 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:24.178743 16879 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:05:24.154796 16886 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.098s
I20260709 13:05:24.118796 16711 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:05:24.225117 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 204027us
I20260709 13:05:24.216876 15543 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:05:24.230023 16889 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:05:24.231980 16711 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.232542 16671 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.233151 16671 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.233686 16671 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.215996 16897 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.228989 15543 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.226362 16751 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.243745 16897 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.250095 16901 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.249951 16474 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.250571 16901 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.249217 16897 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.235466 16678 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.262496 16678 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:24.264055 16474 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.244019 16695 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.265658 16695 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.266880 15543 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.268647 16695 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.260283 16470 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.258261 16901 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.269768 16813 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.276741 16671 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.275933 16813 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.283106 16813 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.314465 14889 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:24.317011 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.320040 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 94099.7us
I20260709 13:05:24.320044 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:24.321596 14969 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.333214 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.334410 14887 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:24.334600 16908 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.335402 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.335716 16908 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.337282 15035 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:24.338480 14890 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:24.340178 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.341153 14893 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:24.341357 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:24.336629 14892 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:24.344650 16671 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:24.346108 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.347078 14890 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:24.274583 16492 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.348121 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.349166 14887 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:24.349965 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.350677 16492 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.350988 14891 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:24.351840 16474 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.352700 16474 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.353616 14893 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:24.354594 15543 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.356343 16523 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.356062 16674 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.356935 16523 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.358577 16674 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.360898 16754 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.361186 15545 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:24.363555 16690 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:24.364324 16851 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.365267 16851 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.361683 16754 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.371778 16690 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.372570 16690 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.372969 16754 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.375329 16690 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.376668 16851 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.378355 16474 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.379158 16523 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.379324 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.380667 14964 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:24.384769 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.385720 14891 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:24.385890 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 1972) took 1653 ms. Trace:
I20260709 13:05:24.386363 15039 rpcz_store.cc:276] 0709 13:05:22.732382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.732497 (+   115us) service_pool.cc:224] Handling call
0709 13:05:22.741189 (+  8692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:23.711244 (+970055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:24.385326 (+674082us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54001f31d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:24.385703 (+   377us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2210640256}
I20260709 13:05:24.388248 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.392040 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.395512 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.396461 15041 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:24.402578 16640 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:24.403039 16640 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:24.404740 16640 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.406925 14979 tablet_copy_source_session.cc:215] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:24.408782 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.409632 15545 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:24.412719 14969 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:24.416983 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:24.417755 15547 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.420358 16711 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.420460 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.421187 16711 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.423563 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.424613 15541 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:24.424867 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:24.426555 15543 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:24.427867 16851 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:24.428151 16711 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.428354 16851 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.428857 16851 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.428946 16711 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:24.429486 16711 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.429890 16711 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:24.438803 16908 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.444931 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.453999 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.454977 15040 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:24.458506 15545 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:24.458906 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:24.459658 15543 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 5
W20260709 13:05:24.464075 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.465366 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.476861 16751 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.477164 16891 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:24.477846 16891 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:24.470795 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:24.491619 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50261.1us
I20260709 13:05:24.496281 16544 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:24.496874 16544 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.497365 16544 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:24.486706 16908 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:24.502071 16908 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.502838 16723 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.504971 16908 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.512198 16697 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.513020 16697 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.515857 16678 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:24.516451 16678 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.519251 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:24.520836 16728 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:24.521459 16728 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.524097 16842 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:24.524592 16842 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:24.525645 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.532104 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.532912 14895 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:24.540627 14894 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:24.559365 15550 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:24.564047 16725 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.565011 16725 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.568027 16905 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.569005 16905 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.569927 16791 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.567970 16697 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.572891 16905 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.577584 15547 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:24.579191 16645 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.580067 16645 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.582521 16904 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.583276 16904 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.584152 16851 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.584717 16650 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.585444 16650 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.585799 15542 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:24.585824 16904 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.479252 16891 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.588012 16650 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.594936 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:24.595723 14890 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:24.597862 16905 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:24.598008 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.598428 16905 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.598556 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.598846 14892 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:24.599004 16905 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:24.652694 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.653684 14892 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:24.659088 14889 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:24.660455 16727 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:24.661311 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.662226 16645 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.661870 16727 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.666961 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.668004 14964 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:24.670544 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.667970 16725 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.671343 14964 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:24.672338 16727 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.673966 16728 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.675686 15543 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:24.676584 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.677188 15036 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:24.675794 14963 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:24.678284 16907 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.678830 16907 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.679781 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.680649 14963 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:24.681102 16907 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:24.681953 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:24.682657 15041 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:24.682878 16728 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.683012 15041 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:24.683262 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.684087 15041 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.685091 15041 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.685520 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.686312 14961 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:24.687808 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.689391 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:24.690133 14964 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.692019 14963 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:24.691944 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:24.693154 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.694342 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.695111 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.695588 16896 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:24.695739 14888 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:24.696336 16896 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:24.696643 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:24.697762 14963 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:24.698361 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163925us
I20260709 13:05:24.696710 16896 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:24.650913 16843 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.025s	sys 0.052s
I20260709 13:05:24.702939 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:24.709187 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.710371 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.712602 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:24.703315 16896 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:24.721253 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:24.716842 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:24.713732 16843 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.025s	sys 0.053s
W20260709 13:05:24.725477 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.725951 15040 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
W20260709 13:05:24.725520 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47744.9us
I20260709 13:05:24.727252 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.727973 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.729517 16725 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.730509 16697 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:24.730285 16725 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.730908 16697 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.731351 16697 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.732666 16725 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.735097 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:24.736325 16433 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:24.736490 16523 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:24.737536 14887 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:24.737417 16523 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.736680 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:24.739506 16690 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.740165 16690 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.738860 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.742506 16690 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.742987 14887 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:24.743484 16474 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.744091 16474 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.744596 16719 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:24.745174 16719 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.745559 16719 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.745494 16728 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:24.747769 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.748072 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:24.748764 14891 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:24.749832 16727 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:24.750258 16727 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.750625 16727 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:24.720784 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:24.751657 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 152005us
I20260709 13:05:24.752825 14893 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:05:24.753234 16897 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:24.753634 16897 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.754072 16897 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:24.754614 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.721688 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.756886 16838 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.708758 16754 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.713725 16645 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.771723 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:24.773548 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 54349us
I20260709 13:05:24.775897 14892 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
W20260709 13:05:24.807951 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:24.810956 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.817561 15040 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:24.821668 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.767699 16907 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:24.826038 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.826709 14962 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:24.822451 15035 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:24.819144 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:24.832715 16523 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.835506 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.836117 15545 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:24.838753 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.840047 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.840777 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.841638 15548 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:24.830355 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.858155 16474 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.858750 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.859493 15042 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:24.863505 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:24.864307 16907 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:24.865267 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.865453 16907 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.866783 16645 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.868067 15036 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:24.869212 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.870110 15547 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:24.859488 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:24.876224 14962 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:24.878856 16869 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.879434 16869 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.881857 16869 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:24.850304 16725 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:24.883566 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:24.883783 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.884230 15044 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:24.884729 15544 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:24.845743 16754 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.881886 15543 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:05:24.886910 16754 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.887648 16791 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.888325 16791 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:24.889484 16640 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:24.894135 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 62015.7us
I20260709 13:05:24.892585 15549 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:24.895973 15041 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:24.899026 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.825135 16908 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:24.900328 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:24.901235 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62477.8us
I20260709 13:05:24.891789 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:24.905412 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:24.903589 14890 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:24.912680 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.919842 16893 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.920415 16893 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.923243 16754 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:24.928855 16534 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:24.929399 15041 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:24.929567 16534 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.933548 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:24.926414 16474 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:24.943719 16474 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.944079 16474 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:24.943941 16544 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.946023 16544 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.950840 16727 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.953320 16874 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37a7135d72784bd590fd05aeda0ea3b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:24.934430 16690 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:05:24.917596 16908 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:24.959930 16882 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:05:24.976593 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 43610.6us
I20260709 13:05:24.942967 16711 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:24.988852 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 55387.9us
I20260709 13:05:24.931735 16791 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:24.991937 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:24.998917 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:24.989948 16882 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:24.996191 16754 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:24.992576 14964 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:25.008024 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:25.008618 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 191835us
I20260709 13:05:24.983860 16905 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:25.009725 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 107623us
I20260709 13:05:25.015152 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.015488 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.005245 16882 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.021593 16825 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:25.009894 16690 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:25.004825 16791 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:24.994095 16897 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.014671 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.000473 16719 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.027223 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:25.012298 16725 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:25.039526 14895 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:25.014740 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:25.044173 16754 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:25.053889 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.055316 16474 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.057180 16896 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.057966 16474 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.059533 16908 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.014839 16674 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 13:05:25.026000 16690 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:25.032344 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:25.071123 16896 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.072067 16897 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.071627 16754 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.073180 16671 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:25.073110 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:25.083752 15545 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.051887 16791 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.088611 16719 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.089069 16791 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:25.089744 16920 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:25.084904 16671 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:25.091607 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.091847 16671 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.092249 14964 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:25.092401 16928 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.093021 16888 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.092957 16928 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.093513 16888 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.093917 16888 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.095052 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.083365 16927 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:25.095655 14970 raft_consensus.cc:2376] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3. Re-sending same reply.
I20260709 13:05:25.095883 16927 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.096302 16927 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:25.096771 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69599.5us
I20260709 13:05:25.097823 16697 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.069998 16690 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.060036 16725 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.101555 15550 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:25.075387 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.075542 16755 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:25.039448 16869 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:25.028141 16544 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.102250 15039 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:25.117563 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 112440us
I20260709 13:05:25.095221 16928 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.115099 16711 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.110009 16755 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.083961 15541 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:25.107810 15545 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:25.108356 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 95718.6us
I20260709 13:05:25.120484 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.101107 15543 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 1.
I20260709 13:05:25.125697 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.125602 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:25.115157 16851 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.128116 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.111744 16719 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:05:25.124454 16755 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.141721 16934 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.142184 16934 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.142573 16934 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.145195 16906 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:25.145776 16906 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:25.147439 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.137535 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.137774 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.156633 15039 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:25.156792 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.157347 15041 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.161715 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:25.159062 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 90097.5us
I20260709 13:05:25.162348 14892 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:25.163059 16827 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:25.163555 16827 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:25.163643 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.163815 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.164345 16870 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:25.162950 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.164426 16897 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:25.165141 15039 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:25.165316 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:25.163980 16827 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.166000 15547 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.164829 16870 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.166491 16870 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:25.146772 16906 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.158686 16640 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:25.195291 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.195626 16640 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.196147 16640 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.196714 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.170945 16892 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:25.173434 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.172596 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:25.198128 14894 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:25.168242 16905 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.180514 16870 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.136313 16544 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.184056 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.184906 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.186105 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.186836 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.187762 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.190973 16893 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.140408 16869 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.192946 16534 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.211489 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.215651 14962 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.216559 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.209254 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.217780 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.200379 15041 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:25.218350 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 278) took 8731 ms. Trace:
I20260709 13:05:25.218901 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.194415 16927 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.167548 16937 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:05:25.203125 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.207640 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.207866 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.208496 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.209227 16544 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.209731 14961 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:25.209802 16755 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.210379 14970 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:25.199064 16892 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.210598 16869 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.254803 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.257606 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.222968 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:23.932152 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:25.267361 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.267731 16892 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.268440 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.273741 14963 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.275293 14965 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.276319 14968 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.239807 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:25.267575 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.255443 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.239465 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.224658 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:25.279093 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 56221.6us
I20260709 13:05:25.282995 15044 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:25.278091 16869 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:05:25.285295 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.280172 15545 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:25.240084 14967 raft_consensus.cc:2368] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:25.253866 16534 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.279863 16905 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:25.200660 16754 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:25.219605 14964 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:25.288255 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 116308us
I20260709 13:05:25.291114 14963 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:25.269122 16927 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.279979 16544 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:25.294135 16869 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:25.291103 15042 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.298138 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:25.298290 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95303.7us
I20260709 13:05:25.299295 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.300524 16933 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.300520 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.300985 16933 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.301158 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.301365 16933 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.302695 16935 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.300751 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.304220 14893 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.303543 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:25.305909 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:25.309180 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.290824 16754 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.306952 16697 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.311640 16674 raft_consensus.cc:2764] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:25.311761 16932 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.312305 16932 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.312803 15044 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:25.228833 16882 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.309576 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:25.320405 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.320884 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:25.321257 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.321162 15037 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:25.288520 16534 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.299265 16869 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:25.322485 14892 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:25.312862 16838 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:25.315366 16754 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.312644 16932 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.323617 16674 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:25.323172 16544 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:25.332592 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.327247 16697 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:25.334867 16697 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:25.335858 16697 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.339059 16925 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:25.339766 16925 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.340641 16723 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:25.341235 16671 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.341780 16925 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.332394 16934 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.343858 16869 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.344514 15544 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:25.345115 16869 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.346570 16934 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.348119 16892 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:25.359993 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 56493.7us
I20260709 13:05:25.361797 15042 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:25.364508 14893 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:25.365558 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.367970 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:25.307271 16935 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.333930 16674 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.333907 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.335876 16534 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.372941 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:25.380822 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:25.380936 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:25.333756 16838 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:25.369684 16896 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:05:25.375051 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54244.5us
I20260709 13:05:25.326611 16690 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.218719 14788 rpcz_store.cc:276] 0709 13:05:16.487265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.489604 (+  2339us) service_pool.cc:224] Handling call
0709 13:05:16.721224 (+231620us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:05:25.218130 (+8496906us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:22.886893 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:22.902124 (+ 15231us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:22.902157 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:05:22.902179 (+    22us) tablet.cc:662] Decoding operations
0709 13:05:22.966107 (+ 63928us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:22.968102 (+  1995us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:22.979889 (+ 11787us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:23.025453 (+ 45564us) tablet.cc:701] Row locks acquired
0709 13:05:23.025469 (+    16us) write_op.cc:260] PREPARE: finished
0709 13:05:23.025609 (+   140us) write_op.cc:270] Start()
0709 13:05:23.025732 (+   123us) write_op.cc:276] Timestamp: P: 1783602323025567 usec, L: 0
0709 13:05:23.025750 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:05:23.026397 (+   647us) log.cc:844] Serialized 1675 byte log entry
0709 13:05:23.482625 (+456228us) op_driver.cc:464] REPLICATION: finished
0709 13:05:23.734127 (+251502us) write_op.cc:301] APPLY: starting
0709 13:05:23.740775 (+  6648us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:23.745716 (+  4941us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:23.745889 (+   173us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:23.746800 (+   911us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:23.746969 (+   169us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:05:23.747011 (+    42us) write_op.cc:312] APPLY: finished
0709 13:05:23.761664 (+ 14653us) log.cc:844] Serialized 41 byte log entry
0709 13:05:23.761833 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:23.761937 (+   104us) write_op.cc:454] Released schema lock
0709 13:05:23.761978 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:23.762300 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:23.762330 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":806183,"reported_tablets":7,"spinlock_wait_cycles":279368960,"child_traces":[["op",{"apply.queue_time_us":222908,"apply.run_cpu_time_us":2815,"apply.run_wall_time_us":40040,"num_ops":4,"prepare.queue_time_us":89497,"prepare.run_cpu_time_us":16050,"prepare.run_wall_time_us":241212,"raft.queue_time_us":236184,"raft.run_cpu_time_us":60162,"raft.run_wall_time_us":231594,"replication_time_us":456704,"thread_start_us":351650,"threads_started":4,"wal-append.queue_time_us":122491,"wal-append.run_cpu_time_us":24226,"wal-append.run_wall_time_us":1677050}]]}
I20260709 13:05:25.371995 16925 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.378968 16674 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.384037 16711 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.390820 16828 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.391053 16711 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.391281 16828 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.381871 16671 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.393622 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:25.382656 16755 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.383734 16908 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:25.397676 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:25.398554 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.399497 14893 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.386782 16896 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:25.400573 16896 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:25.391515 16925 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:25.391746 16828 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.391532 16711 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.438431 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.399225 16927 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 13:05:25.439429 16935 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.409073 16534 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:25.389690 16474 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:05:25.441129 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 436) took 1024 ms. Trace:
I20260709 13:05:25.462054 15542 rpcz_store.cc:276] 0709 13:05:24.417258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.436046 (+ 18788us) service_pool.cc:224] Handling call
0709 13:05:24.471462 (+ 35416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:24.586439 (+114977us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:25.440737 (+854298us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b5400692654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:25.441043 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236242688}
I20260709 13:05:25.441007 16640 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:25.442512 16940 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:05:25.464193 16933 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.466413 16933 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.466456 16640 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.442324 16838 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.444418 16870 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.445007 16926 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:25.452169 16544 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.460904 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.461218 16474 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:25.472316 16474 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:25.472991 16932 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.473361 16474 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.473852 16690 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.474704 16474 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.439697 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:25.472352 14887 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.482168 14893 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:25.494150 16932 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.472697 14886 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:25.483532 16925 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:25.499984 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 102358us
I20260709 13:05:25.490149 16690 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.517297 16932 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.519112 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:25.492655 16882 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.522758 14887 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:25.524041 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.524730 14887 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.525529 16842 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.526964 16842 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.527487 16870 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.501729 16926 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.527534 16932 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.528725 16926 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.530397 16932 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.530861 16926 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.532750 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.537001 16892 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.537950 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.538475 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.539032 16678 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.539553 16690 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.541790 16645 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.538673 14968 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.541926 16690 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.545634 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:25.547843 14969 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:25.558580 14887 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:25.559952 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:25.560611 15543 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:25.521211 14964 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:25.575260 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.575986 14968 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:25.559012 16828 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.544441 16888 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.564208 16719 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.606921 16719 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.547924 16711 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.607350 16719 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.608939 16711 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.582789 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.609642 14964 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.613781 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.614375 14966 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.615937 15039 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:25.585255 16674 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.633512 16828 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.585831 16754 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.590967 16827 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.577476 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.636134 14888 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:25.636881 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.637045 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.637626 14892 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:25.637915 14888 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:25.638363 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.579188 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:25.589974 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:25.642668 14895 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:25.643538 14966 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:25.644886 16674 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.635634 16754 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.645978 16719 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.571719 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.648326 14961 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.626696 14791 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 3 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:25.650630 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:25.635673 16827 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.651422 15546 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:25.651451 16891 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.652869 16719 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.650530 14791 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.606467 16888 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:25.604771 16727 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.632833 14964 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:25.600524 16650 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:25.628957 16874 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52844 (request call id 523) took 2112 ms. Trace:
I20260709 13:05:25.663224 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.686790 16936 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:25.687461 16936 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:25.687762 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.688540 14967 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.688617 16936 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.626857 16896 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.698696 16896 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:25.697733 14967 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
W20260709 13:05:25.706025 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 126924us
I20260709 13:05:25.707473 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:25.708616 14859 leader_election.cc:400] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:25.709882 16842 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:25.710453 16842 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:25.710624 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2039) took 1118 ms. Trace:
I20260709 13:05:25.711313 16842 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.712893 16682 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.714752 16682 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.715242 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.710970 14894 rpcz_store.cc:276] 0709 13:05:24.591950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:24.651289 (+ 59339us) service_pool.cc:224] Handling call
0709 13:05:25.710451 (+1059162us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b54000cd854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:25.710551 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":896244608}
I20260709 13:05:25.716835 16682 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.717471 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.704934 16882 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.719533 16882 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.722011 16882 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.760211 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.761328 14966 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:25.764544 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:25.765604 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.769774 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.771986 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.772746 14965 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.774845 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.775583 14967 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:25.777164 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:25.780560 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:25.781456 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.782629 14791 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 2 to 3, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 3 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.788506 15546 raft_consensus.cc:2368] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:25.712479 16893 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:25.811055 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44413.6us
I20260709 13:05:25.768095 16896 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:05:25.812662 16896 consensus_queue.cc:1243] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:05:25.813498 16896 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:25.815013 16711 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.820502 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:25.820915 16711 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.815318 16827 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:25.823290 16896 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:25.822593 16725 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:25.823988 16725 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.824266 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.824430 16725 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:25.824442 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:25.827191 16665 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:25.828092 14933 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:25.830250 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:25.832304 16896 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.833915 16896 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.834326 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:25.835214 16791 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:25.835703 16791 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:25.836656 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.836582 16791 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.837739 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.838325 15040 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:25.839497 15042 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:25.840440 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.831301 16925 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:25.842500 16925 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.842893 16925 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.843766 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.843938 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:25.844545 15036 raft_consensus.cc:2368] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5.
I20260709 13:05:25.845508 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.845345 16725 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.846108 15044 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:25.848191 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.848177 15035 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:25.853206 14962 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:25.824935 15039 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:25.763083 16874 rpcz_store.cc:276] 0709 13:05:23.527643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.537624 (+  9981us) service_pool.cc:224] Handling call
0709 13:05:23.831799 (+294175us) ts_tablet_manager.cc:934] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
0709 13:05:24.951716 (+1119917us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:25.352566 (+400850us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:25.363000 (+ 10434us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:25.627993 (+264993us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:25.628354 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:25.628712 (+   358us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:25.628838 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":322,"tablet-copy.queue_time_us":272103,"thread_start_us":163134,"threads_started":2}
I20260709 13:05:25.868062 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.868942 15035 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:25.810289 14791 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 2 to 3, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 3 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:25.768286 16906 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:25.889997 15040 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:25.892577 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.958959 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.959648 15039 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.810849 16893 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:25.963742 16893 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.881251 14791 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 2, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 2 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:25.851931 16888 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:25.900538 14963 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:25.901089 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:25.902755 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:25.969194 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66503us
I20260709 13:05:25.768786 16650 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.865093 16727 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:25.865419 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.967892 16888 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:25.909409 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.910105 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.911939 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:25.880259 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:25.880589 16725 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:25.903267 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.915278 15042 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:25.916997 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:25.871554 16937 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:05:25.926416 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.984931 15041 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:25.899793 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:25.932332 14965 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:25.901408 14889 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:25.908124 16682 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.904002 16825 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.891784 16874 tablet_copy_client.cc:806] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
W20260709 13:05:26.022118 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:25.901539 16906 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:25.908843 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.974889 14861 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
W20260709 13:05:25.976538 15007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.075s	sys 0.117s
I20260709 13:05:26.024641 14861 leader_election.cc:403] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:26.024695 15044 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:26.024804 15007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.075s	sys 0.117s
W20260709 13:05:26.025532 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55321.6us
I20260709 13:05:26.025808 16905 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.023459 16931 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:26.027007 14861 leader_election.cc:400] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5.
I20260709 13:05:25.978097 15038 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:25.987250 15036 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:26.027560 14861 leader_election.cc:403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:05:26.023248 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:25.941591 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:25.994124 15039 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:26.029474 15035 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:25.986904 16728 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:26.030900 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 145762us
I20260709 13:05:26.002090 15043 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:25.991235 14966 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:25.975327 16645 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:25.975569 16534 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:25.987360 16814 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.004982 16932 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:26.008456 14961 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:25.978747 16953 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:25.983479 14964 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.030189 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:25.995164 15543 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:26.003075 16722 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:26.037979 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:26.042373 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:26.043823 14890 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:05:26.046483 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:26.017589 16678 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:26.038607 15544 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:26.051591 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:26.054863 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:26.027063 16931 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.056746 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.067180 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:26.057605 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:26.067762 14894 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.068181 15038 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:26.035549 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:26.060962 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:26.037984 16523 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:26.063473 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:26.051255 16957 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 13:05:26.063809 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:26.044242 16907 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.175s	user 0.006s	sys 0.018s
I20260709 13:05:26.022591 16682 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.067608 15546 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:26.073750 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:26.074445 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:26.071942 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:26.019691 16825 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.070763 16690 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.114122 15043 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.055990 16874 tablet_copy_client.cc:670] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:26.121917 15035 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:26.124948 14966 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:26.058785 16722 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:26.066975 16882 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:26.072105 16678 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.072553 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:26.116550 16951 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.029s	sys 0.173s
W20260709 13:05:26.148996 16951 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.029s	sys 0.174s
I20260709 13:05:26.136374 16825 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.150074 16825 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:26.150496 15038 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:26.050824 16534 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.140846 15035 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:26.134806 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:26.115617 16907 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.007s	sys 0.019s
I20260709 13:05:26.107815 16723 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.107985 16728 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:26.134443 16682 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.148959 15541 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.050617 16645 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.056056 16932 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.174248 16728 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.176512 16932 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.177089 16932 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:26.177549 16932 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:26.178457 16932 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.052851 16814 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.179145 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:26.179925 14887 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.181008 16814 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.150826 16825 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.183061 16825 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.144145 16882 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.169013 14894 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:26.128477 16888 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.170573 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.171523 15044 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:26.134045 16931 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.136214 16906 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.172005 15043 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:26.119032 16937 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:05:26.189571 14895 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:26.191274 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.108415 16953 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.198895 15541 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:26.188781 16882 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:26.184540 16723 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:26.195284 16827 raft_consensus.cc:2764] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:05:26.232286 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:26.270406 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 58213.3us
W20260709 13:05:26.276590 16967 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:05:26.266665 16965 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:05:26.242947 16645 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.284839 14965 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:26.280198 16896 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:26.310657 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 246507us
I20260709 13:05:26.312366 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:26.245203 16722 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.301910 16825 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:05:26.316954 16678 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.318981 16690 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:26.343984 16690 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.318729 16925 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.302893 16723 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.354494 16722 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.335114 16896 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.373112 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:26.374339 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:26.372965 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60664.1us
I20260709 13:05:26.360037 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:26.377427 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:26.380949 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:26.363751 14887 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
W20260709 13:05:26.369741 16969 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260709 13:05:26.383460 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:26.383679 16973 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:05:26.384166 14961 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:26.384471 16978 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.381827 16907 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.385449 16907 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:26.386373 16907 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.387089 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:26.387794 16678 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.388422 16678 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.388675 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:26.389953 16825 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:05:26.390195 14964 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:26.392632 16925 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.392903 15548 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:05:26.359362 16972 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:05:26.393092 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:26.396288 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.396390 16711 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.399205 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.400532 15548 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
W20260709 13:05:26.405699 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45732.6us
I20260709 13:05:26.360781 16932 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:26.408499 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:26.366489 16893 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.408483 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.408399 16979 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:26.409821 16972 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:26.424060 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:26.425275 14894 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:26.411535 16932 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.417016 16474 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:26.429571 16825 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:26.430013 16825 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.430464 16825 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.409240 16728 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:05:26.432456 16979 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:26.439113 16975 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:05:26.431445 16978 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.439556 16882 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.439761 16978 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.440816 16896 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.441769 16882 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.441931 16978 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.442670 16981 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:26.443161 16981 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:26.443922 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:26.444525 14965 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:26.444140 16981 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.445330 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.446414 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.448944 16893 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.431659 16932 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.430768 16972 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.451205 14886 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:26.451361 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:26.439258 16979 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.451960 14964 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.459122 14965 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:26.467555 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.468535 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.469276 16650 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.470057 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:26.450911 16972 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.467279 16986 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:26.485280 16986 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.487636 16986 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.488126 16986 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:26.488579 16986 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.500586 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:26.520812 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.521878 14888 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:26.524140 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.524658 14892 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:26.527942 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:26.547546 16905 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
I20260709 13:05:26.548044 16905 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:26.548607 14964 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:26.560442 16986 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.570677 16523 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5.
I20260709 13:05:26.571368 16988 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:26.519989 16825 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.635367 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:26.637115 14890 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:26.638470 14891 raft_consensus.cc:2368] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:26.631692 16988 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:26.632611 16932 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.641198 16988 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.677145 15547 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:05:26.672453 15516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.3:46271 timed out after 1.548s (SENT) [suppressed 7 similar messages]
I20260709 13:05:26.679489 16711 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:26.678977 16986 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.696182 16711 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.700484 16986 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.728063 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:26.733872 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:26.735008 15542 raft_consensus.cc:2368] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
W20260709 13:05:26.736346 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63931.7us
I20260709 13:05:26.740355 14895 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:26.740444 14861 leader_election.cc:400] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:26.741689 14861 leader_election.cc:403] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:26.743255 16640 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:26.746172 16825 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:26.747145 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:26.748122 16972 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.749385 15542 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:26.750605 16972 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.751295 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:26.757563 16986 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.761062 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.761559 14890 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:26.762372 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:26.764053 16970 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:26.764473 16970 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.764815 16970 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:26.773388 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:26.775965 16990 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 13:05:26.777318 16711 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.783577 16932 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.777716 16474 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:26.787127 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:26.794961 16474 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.795120 16907 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:26.795732 16994 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:05:26.795814 16907 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:26.796833 14970 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:26.796926 16907 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.804020 15007 leader_election.cc:400] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:26.804388 15007 leader_election.cc:403] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:26.805136 16492 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:26.805353 16722 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:05:26.805599 16492 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:26.806517 16492 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.809417 16953 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.809672 15010 leader_election.cc:400] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:26.810667 16640 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:26.802873 16988 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.819551 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:26.822309 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.822871 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:26.823359 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.824970 16722 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:26.825574 16988 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.826603 15541 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:26.825666 16650 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:26.828043 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:26.827600 15008 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:26.828329 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:26.830225 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.831223 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:26.829574 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:26.833630 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:26.834163 15042 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:26.823282 16492 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:26.836952 16645 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.843398 16665 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:26.844646 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:26.846998 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:26.827531 16953 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.851788 15040 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:26.832016 16951 raft_consensus.cc:2764] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:26.830277 16825 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:26.823053 16711 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:05:26.832180 16650 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:26.857488 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:26.878486 14893 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:26.882560 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:26.858631 16825 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.880861 16433 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:26.884773 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:26.890595 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:26.859223 16719 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:26.882699 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:26.849221 16474 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.885514 16931 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:26.883946 16925 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:26.887257 16937 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:26.885043 16953 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:26.891264 16433 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:26.885680 16681 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:05:26.901309 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:26.893051 16951 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:26.940228 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:26.947592 16676 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:26.943656 16951 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:26.949561 16951 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:26.949561 16650 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.933736 16937 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:26.942622 15541 raft_consensus.cc:2368] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:26.941733 16723 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:26.979801 16723 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.982267 16723 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:26.982806 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:26.985822 16970 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.976577 16937 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:26.973173 16665 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:26.933473 16931 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:26.978869 16474 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.949119 16825 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:26.972856 16676 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:27.001451 15010 leader_election.cc:400] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 2. Current term is 3.
I20260709 13:05:27.007151 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.008991 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:27.011780 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:27.012308 14894 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:27.012583 14890 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.012804 14894 pending_rounds.cc:85] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 1
I20260709 13:05:27.013211 14894 pending_rounds.cc:107] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:05:27.019670 14894 raft_consensus.cc:2889] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:27.010193 16665 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.027045 14890 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:27.027119 16665 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.019265 16681 raft_consensus.cc:2764] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:27.032366 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.032989 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:27.037168 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 145513us
I20260709 13:05:27.023463 16937 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.037895 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:27.013433 16988 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:05:27.044450 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:27.061758 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:27.040514 16719 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:27.070050 16722 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:27.070557 16534 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.071920 14886 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:27.074390 14887 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:27.074469 16827 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:27.068166 14889 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:27.075085 16827 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:27.016004 16676 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.043718 16953 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.076249 16953 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.076347 16827 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.078070 16986 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:27.078599 16986 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.080538 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:27.083724 16992 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:27.084237 16992 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:27.080686 16986 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.084070 16719 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.090344 16992 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.091297 17003 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:27.063829 16474 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:27.100556 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 62771.1us
I20260709 13:05:27.092549 16925 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.104250 15550 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:27.075273 16906 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.105939 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:27.069176 16650 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.110247 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:27.110936 16896 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:27.111466 16896 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:27.112705 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.113300 15040 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.102849 17003 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.112900 16640 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:27.118052 16804 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.118729 15544 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 13:05:27.119714 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.119257 16842 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:27.121137 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:27.138576 15037 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:27.126096 15040 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:27.127844 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.129688 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.124717 16650 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.141113 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.141474 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:27.130214 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:27.143458 15550 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:27.132009 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:27.112151 16951 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.132841 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:27.105564 16474 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:27.134855 17000 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.187s	user 0.005s	sys 0.003s
I20260709 13:05:27.132879 15044 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:27.142676 16650 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.103593 16925 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.126636 17003 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:27.148159 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 79520.4us
I20260709 13:05:27.131136 16640 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.135673 16953 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.127709 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:27.138082 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.154971 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.156644 16951 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.142899 15543 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.145557 16905 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:27.112361 16896 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.164155 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.165524 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.166695 14969 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:05:27.167207 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.196180 14966 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:27.168056 14962 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:27.158751 16640 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.152855 14889 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:27.151456 16825 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.172537 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:27.175730 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:27.176445 16931 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.222402 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.222756 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.223019 15044 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.176599 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:27.224879 14968 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.178208 16925 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.181749 14933 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:27.158349 16970 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:27.181974 17009 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.149652 16882 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:05:27.183848 16905 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:27.190745 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.202167 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:27.228359 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46676.8us
I20260709 13:05:27.233522 15040 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:27.236588 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.200358 14887 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:27.215579 16972 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:27.250382 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.250537 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.251010 15039 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:27.245656 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.248509 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.252408 14970 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:27.254921 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.227576 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.252157 15036 raft_consensus.cc:2376] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4. Re-sending same reply.
I20260709 13:05:27.231477 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:27.261648 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:27.262104 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.269199 14966 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:05:27.269985 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.271004 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.262384 15038 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:27.231606 16728 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:27.264279 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.261662 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.206848 17003 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.223961 16986 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:05:27.267520 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.234716 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:27.267705 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.274672 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:27.251853 16931 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:27.277055 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.251642 16492 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.277590 15044 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
W20260709 13:05:27.275270 16989 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.576s	user 0.027s	sys 0.024s
I20260709 13:05:27.276877 15039 raft_consensus.cc:606] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:27.227330 16825 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.280445 14966 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:27.279116 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.312099 15042 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:27.316558 14962 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:27.318439 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.322901 15036 raft_consensus.cc:2410] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:27.260159 16433 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:05:27.311622 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:27.312664 16931 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:27.328740 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.282662 16972 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:27.329061 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.334455 15035 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.261308 16665 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 13:05:27.326834 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.279337 16970 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:05:27.333212 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.340202 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.319834 16690 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:27.336406 16791 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:27.348201 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.343133 15038 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:27.350080 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.279711 17008 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 13:05:27.327601 16728 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:27.358865 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:27.333138 16937 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.360759 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:27.361487 14966 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:27.364439 15035 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:27.365854 14965 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:27.366489 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:27.367326 14969 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:27.368589 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:27.358278 16827 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.428721 16433 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.425239 17011 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:27.436178 17011 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:27.436059 16723 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:27.436851 17011 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:27.437264 16723 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:27.437747 16723 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:27.426954 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48516.3us
I20260709 13:05:27.439750 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:27.440308 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:27.441112 16645 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:27.442118 16645 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:27.442229 16676 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:27.442855 16676 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:27.444272 16825 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.443904 16676 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.350541 16791 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:27.446182 16791 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:27.458829 14968 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:27.435210 16433 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.461575 16433 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.438719 16723 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.463352 16723 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.473783 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.474910 15043 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:27.475922 17003 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.375933 16907 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.329716 16905 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:27.478080 17012 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.272s	user 0.001s	sys 0.001s
I20260709 13:05:27.368953 16931 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.486950 14888 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:27.490248 16804 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:27.490891 16804 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.499531 16804 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:27.499828 17017 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 13:05:27.369635 16937 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.501247 16728 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.349202 16972 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.429152 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.342708 17018 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.550567 15043 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:05:27.523114 15035 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:27.532796 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:27.539132 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.546648 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.487239 14887 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:27.548944 14966 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:27.555316 14893 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:27.555444 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:27.559089 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.357244 16690 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:27.566258 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46389.6us
I20260709 13:05:27.544425 16676 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.556129 16722 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.561405 17023 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:27.579989 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63957.5us
I20260709 13:05:27.585124 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:27.565482 17020 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:27.573304 15543 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:27.575044 16988 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:05:27.584491 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:27.559473 17018 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.588146 16970 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:27.587256 17009 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:05:27.586418 16722 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.614344 14886 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:05:27.633883 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 87327us
W20260709 13:05:27.626891 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54356.9us
I20260709 13:05:27.654878 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:27.662199 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 98450.2us
W20260709 13:05:27.658401 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73319.3us
I20260709 13:05:27.658720 17036 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:27.612335 16986 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:05:27.663060 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:27.664068 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.672115 16523 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.626063 16970 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.623631 15542 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:27.588327 17023 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.635190 16931 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:27.677317 16970 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.702440 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.704105 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.632802 16888 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 13:05:27.707304 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:27.710345 15041 raft_consensus.cc:606] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:27.710718 15041 raft_consensus.cc:614] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:27.707844 14967 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:05:27.711325 14967 pending_rounds.cc:85] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 1
I20260709 13:05:27.715598 16992 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:27.716809 14963 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:27.711745 14967 pending_rounds.cc:107] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 13:05:27.717317 14967 raft_consensus.cc:2917] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 13:05:27.717732 14967 raft_consensus.cc:2889] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:27.718317 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43894 (request call id 13) took 5606 ms. Trace:
I20260709 13:05:27.719195 16722 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.705778 16523 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.723474 16906 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.723966 16906 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.724304 16690 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.726666 17023 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.727290 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:27.728423 14886 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:05:27.728695 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:27.729300 15041 raft_consensus.cc:606] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:27.729619 15041 raft_consensus.cc:614] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:27.730257 14886 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:27.730698 16906 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.736781 16474 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:27.738133 16640 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.512s	user 0.007s	sys 0.004s
W20260709 13:05:27.740296 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 77305.2us
I20260709 13:05:27.742228 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:27.745801 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:27.748592 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44542.7us
I20260709 13:05:27.749526 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:27.738732 16640 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.666201 17036 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:27.707912 16825 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.701138 16931 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:27.762811 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50760.8us
I20260709 13:05:27.763065 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:27.708740 16681 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:27.718631 14967 rpcz_store.cc:276] 0709 13:05:22.111827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:22.111969 (+   142us) service_pool.cc:224] Handling call
0709 13:05:22.195085 (+ 83116us) log.cc:844] Serialized 499 byte log entry
0709 13:05:22.596810 (+401725us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b5400152d20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cebdbe 00007f5534cf6930 00007f5534cf68d8 00007f5534cf6858 00007f5534cf6813 00007f5534cf5a9c 00007f553abe1626 00007f553abdbdd8 00007f5534d327cb 00007f5534d352c0
0709 13:05:22.656841 (+ 60031us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b1800247540. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cf6b26 00007f5534cf049a 00007f5534cef714
0709 13:05:22.657797 (+   956us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5400152d20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cf6b26 00007f5534cf049a 00007f5534cef714 00007f5534ccfeaa 00007f5534cd6d53 00007f5534cd6cd9 00007f5534cd6c69 00007f5534cd6c31 00007f5534cd5dfd 000000000038f354
0709 13:05:22.712605 (+ 54808us) spinlock_profiling.cc:243] Waited 4.07 ms on lock 0x7b5400152d20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cef142 00007f5534ccfeaa 00007f5534cd6d53 00007f5534cd6cd9 00007f5534cd6c69 00007f5534cd6c31 00007f5534cd5dfd 000000000038f354 000000000038f199 00007f5531c89475
0709 13:05:22.770853 (+ 58248us) spinlock_profiling.cc:243] Waited 978 us on lock 0x7b5400152d20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cef142 00007f5534ccfeaa 00007f5534cd6d53 00007f5534cd6cd9 00007f5534cd6c69 00007f5534cd6c31 00007f5534cd5dfd 000000000038f354 000000000038f199 00007f5531c89475
0709 13:05:27.718185 (+4947332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13432,"raft.queue_time_us":1930,"raft.run_cpu_time_us":15891,"raft.run_wall_time_us":1351917,"spinlock_wait_cycles":165763584,"thread_start_us":38223,"threads_started":1,"wal-append.queue_time_us":62267,"wal-append.run_cpu_time_us":6424,"wal-append.run_wall_time_us":1315943}
I20260709 13:05:27.767333 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.766938 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:27.764293 17023 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.767171 16931 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.765261 16970 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:27.754257 17038 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:27.795289 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.771904 16474 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:27.772408 16972 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:27.797012 15037 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:27.770526 14886 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:27.845448 14963 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:27.753957 16906 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:05:27.832264 17018 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:27.832479 16722 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:27.832983 17035 raft_consensus.cc:993] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:27.833174 17036 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.769076 16986 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 13:05:27.772006 16962 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.062s
I20260709 13:05:27.791213 17033 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 13:05:27.836367 16640 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:27.784013 16681 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.837679 17038 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.838090 16791 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.912199 17011 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:27.848213 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:27.913951 15042 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:27.914232 17011 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:27.788962 16932 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:27.914750 16932 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:27.914927 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.915601 16932 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.916049 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.916575 16932 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.916767 14886 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:27.917618 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.840924 16474 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:27.918293 16474 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:27.921878 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:27.925964 17024 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.260s	user 0.006s	sys 0.009s
I20260709 13:05:27.934211 17005 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.934909 17005 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:27.936247 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:27.937469 17035 raft_consensus.cc:1081] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:27.907085 16992 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:27.939478 16992 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:27.946947 14895 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
W20260709 13:05:27.858369 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89648us
W20260709 13:05:27.860203 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 659934us
I20260709 13:05:27.792016 16905 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:27.907940 17036 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:27.911491 17037 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:27.951632 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:28.022107 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:28.022958 14967 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:27.952406 14886 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:27.950510 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:28.030120 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:27.792734 16523 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:05:27.835256 16970 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
W20260709 13:05:28.084030 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 310222us
I20260709 13:05:27.938604 16931 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:28.085601 16827 consensus_meta.cc:287] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.002s
I20260709 13:05:28.091017 16534 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:28.085493 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:28.220613 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 135200us
I20260709 13:05:28.088167 16970 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:28.091332 17003 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:28.244082 16723 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:28.278725 17037 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:28.281344 16474 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.291718 14894 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:28.311931 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.003s	sys 0.023s
I20260709 13:05:28.312163 17018 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:28.326000 17037 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.284940 16723 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:28.312476 16534 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:28.091243 16906 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.183s
W20260709 13:05:28.274255 17039 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.253s	user 0.001s	sys 0.000s
I20260709 13:05:28.313383 17003 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.334419 17035 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.343379 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.004s	sys 0.024s
I20260709 13:05:28.465914 14967 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:28.525394 16906 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.380656 16534 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.355762 17018 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.380342 16723 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:28.421906 14889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.021s	sys 0.005s
I20260709 13:05:28.581848 16719 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.582433 17009 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.401906 17003 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:28.556489 16827 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.400183 17035 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:28.643980 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 693436us
I20260709 13:05:28.649946 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:28.651517 16791 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:28.643996 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 692342us
I20260709 13:05:28.773592 15514 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:28.774121 17018 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.774374 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:28.770915 17009 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.744020 16906 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.775717 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:28.776592 17009 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.777299 16906 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:28.653638 16676 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.076s	user 0.012s	sys 0.000s
W20260709 13:05:28.421267 16728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.009s	sys 0.018s
W20260709 13:05:28.671165 16932 consensus_meta.cc:287] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.754s	user 0.011s	sys 0.000s
I20260709 13:05:28.693864 16474 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:28.681489 16681 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:28.769614 16992 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.721334 17053 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:28.769524 17037 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.718931 17046 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:28.728399 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 961406us
I20260709 13:05:28.716642 16825 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.734767 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1605) took 1018 ms. Trace:
I20260709 13:05:28.847676 14894 rpcz_store.cc:276] 0709 13:05:27.716489 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.383454 (+666965us) service_pool.cc:224] Handling call
0709 13:05:28.383841 (+   387us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:28.729130 (+345289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:28.734485 (+  5355us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:28.734522 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:28.734555 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.734599 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.734724 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:28.719484 17005 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.740412 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:28.756155 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:28.768970 14889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.022s	sys 0.007s
W20260709 13:05:28.782243 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:28.869364 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:28.782294 17045 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:28.790591 15041 raft_consensus.cc:606] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:28.871132 15041 raft_consensus.cc:614] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:28.692613 16931 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.777967 16874 tablet_copy_client.cc:538] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:28.871160 16825 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.889721 17045 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.891754 17045 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:28.778281 16827 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.845100 16681 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.895803 16681 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.896034 16825 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:28.771136 16719 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.896833 16827 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:28.796030 16534 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:28.779920 17018 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.897817 16681 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:28.897710 17018 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.778757 17036 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:28.781488 16728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.041s	user 0.009s	sys 0.018s
I20260709 13:05:28.875047 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:28.850268 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:28.779587 17048 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:28.779798 17003 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.091s
I20260709 13:05:28.911562 15549 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:05:28.939873 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 289986us
W20260709 13:05:28.942129 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 91951.1us
I20260709 13:05:28.942437 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:28.870379 17037 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.945407 17052 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:28.946699 14891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:28.946947 17052 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.945850 16931 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:28.945883 16723 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.948015 16931 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:28.948992 16931 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.951224 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50472 (request call id 14) took 1188 ms. Trace:
I20260709 13:05:28.936780 17049 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:28.947307 14891 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:28.898535 16719 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.953150 15549 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:28.953245 14891 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:28.951591 15041 rpcz_store.cc:276] 0709 13:05:27.762776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.762938 (+   162us) service_pool.cc:224] Handling call
0709 13:05:28.951057 (+1188119us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001f31d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d70853 00007f5539d3e60a 00007f55332c47d4 00007f55332c4762 00007f55332c4691 00007f55332c460c 00007f55332c38c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:28.951154 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361304832}
I20260709 13:05:28.903687 16791 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:28.958285 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 185496us
I20260709 13:05:28.975767 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:28.983624 16681 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:28.984229 16681 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.952191 17049 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.986532 17049 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:28.984541 17057 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:28.866284 17053 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.987543 16676 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.987239 17057 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.953630 17037 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.988018 16676 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.986649 16827 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.990173 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:28.995662 17053 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.995801 17037 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:28.996443 16676 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:28.996832 16719 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:28.987149 17054 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:28.956676 17036 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.997534 17054 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:28.998028 17036 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:28.999507 16827 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.000373 17052 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.000839 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 239) took 1463 ms. Trace:
I20260709 13:05:29.001477 16827 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.001238 14889 rpcz_store.cc:276] 0709 13:05:27.526017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.537750 (+ 11733us) service_pool.cc:224] Handling call
0709 13:05:27.573253 (+ 35503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.758822 (+185569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.764928 (+  6106us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.840242 (+ 75314us) log.cc:844] Serialized 26 byte log entry
0709 13:05:28.901069 (+1060827us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:28.938448 (+ 37379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:28.944121 (+  5673us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:28.945822 (+  1701us) raft_consensus.cc:1685] finished
0709 13:05:28.952733 (+  6911us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:28.968356 (+ 15623us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25938,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":10000,"thread_start_us":1169041,"threads_started":2,"wal-append.queue_time_us":851862}
I20260709 13:05:29.003599 17055 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:28.986550 16907 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.005993 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.007864 14891 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.047606 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:29.052230 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:29.003221 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.054626 14891 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.060319 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:29.069473 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.063169 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:28.968771 17035 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.063853 17061 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.071945 17057 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.057232 16534 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:29.062281 17054 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:28.869971 17046 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.072903 16534 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:29.009878 16681 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.063974 17053 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:29.071579 15549 raft_consensus.cc:2410] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:29.110669 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.149932 15041 raft_consensus.cc:2368] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5.
I20260709 13:05:29.120801 17060 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.064288 17005 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:29.111929 17058 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:29.114445 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:29.007583 17055 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.004287 16791 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.051510 17041 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.082280 15548 raft_consensus.cc:2410] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:29.063879 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.055377 16728 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:05:29.052677 16907 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.171716 17058 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.173976 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:29.053349 17062 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:29.137046 16676 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.071947 17061 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.177145 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1394) took 1900 ms. Trace:
I20260709 13:05:29.178572 15040 rpcz_store.cc:276] 0709 13:05:27.276850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.277026 (+   176us) service_pool.cc:224] Handling call
0709 13:05:27.277389 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.277856 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.277896 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:28.730337 (+1452441us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b18000216a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a
0709 13:05:29.003232 (+272895us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:05:29.003691 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.154908 (+151217us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:29.154946 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.155172 (+   226us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.176885 (+ 21713us) raft_consensus.cc:1685] finished
0709 13:05:29.176910 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.177075 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1316,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":16607,"spinlock_wait_cycles":39128320,"thread_start_us":150807,"threads_started":1,"wal-append.queue_time_us":167346}
I20260709 13:05:29.155057 17056 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:29.177871 15542 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:29.153563 17053 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:29.202595 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 260195us
I20260709 13:05:29.154870 17048 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:29.186165 17005 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:29.195354 17062 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:29.178843 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.206621 16825 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:29.209203 17053 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.193981 16676 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.210613 17037 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.215019 17005 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:29.214830 17048 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.215299 17018 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.210893 17058 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.205667 17066 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.208626 16907 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.268035 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:29.232795 17071 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.268747 14966 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:29.233348 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:29.268851 17071 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.269486 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:29.232848 16951 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.270192 14886 raft_consensus.cc:2368] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4.
I20260709 13:05:29.270336 16951 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:29.236919 16722 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.204401 16681 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:05:29.275458 16534 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.254297 17037 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.280402 16681 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:29.280849 16681 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:29.280504 16534 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.281901 17037 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.281654 16681 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.282420 17037 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:29.282773 16681 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.226195 16882 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:29.283541 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.283787 16882 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.283041 16534 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.240037 16711 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:29.285100 16711 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:29.285508 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.285743 16882 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.241199 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2103) took 1695 ms. Trace:
I20260709 13:05:29.241344 17046 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.244071 15041 raft_consensus.cc:606] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:29.244956 16676 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.289497 15041 raft_consensus.cc:614] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:29.159909 17060 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.290335 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:29.233166 16905 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:29.255919 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet 37a7135d72784bd590fd05aeda0ea3b6: Aborted: Op aborted by new leader
I20260709 13:05:29.257663 17048 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.258700 16874 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:29.260425 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.261720 17005 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.231490 17069 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.230695 17052 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.301317 17052 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.303369 17052 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.303889 17069 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.263747 16433 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:29.264127 17065 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:05:29.264308 17068 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.264699 16719 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.321308 16719 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.321977 17069 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.297333 16905 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.323342 16719 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.323912 16905 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.324754 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.265057 16728 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:29.266579 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:29.267751 17066 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.271641 17018 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:29.271732 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.271152 16951 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.273499 17055 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.217252 17061 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:29.230600 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 170360us
W20260709 13:05:29.336721 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 66813us
I20260709 13:05:29.337055 15514 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:29.337357 15514 leader_election.cc:403] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:29.338025 14861 leader_election.cc:400] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5.
I20260709 13:05:29.271047 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.338405 14861 leader_election.cc:403] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:29.338615 14886 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:29.282871 17037 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.340524 17080 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:29.341146 16825 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.341652 16825 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.341729 17037 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:29.239952 17064 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:05:29.342846 17053 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.345227 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:29.345816 14888 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.346853 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1532) took 2006 ms. Trace:
I20260709 13:05:29.276245 14962 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 13:05:29.349191 17042 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.237s	user 0.018s	sys 0.007s
W20260709 13:05:29.283115 14791 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 169) took 12340 ms (client timeout 15000 ms). Trace:
I20260709 13:05:29.286667 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.285923 16711 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.291234 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:29.275139 14966 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:29.185958 17041 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:29.294015 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 94715us
I20260709 13:05:29.333070 16905 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.271155 17071 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.288267 16722 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.236265 14889 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:29.301589 15544 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:29.287820 14887 rpcz_store.cc:276] 0709 13:05:27.545373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.586588 (+ 41215us) service_pool.cc:224] Handling call
0709 13:05:27.625802 (+ 39214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.663537 (+ 37735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.664280 (+   743us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.674915 (+ 10635us) log.cc:844] Serialized 26 byte log entry
0709 13:05:28.998038 (+1323123us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b18003702a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:05:29.193960 (+195922us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:29.195239 (+  1279us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.205666 (+ 10427us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.240876 (+ 35210us) raft_consensus.cc:1685] finished
0709 13:05:29.240900 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.241138 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6101,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4678,"spinlock_wait_cycles":48946432,"thread_start_us":177057,"threads_started":1,"wal-append.queue_time_us":1555403}
I20260709 13:05:29.263078 17062 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:29.367244 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.367190 16722 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.339190 16791 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.320393 17068 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.297269 16676 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.331934 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.351234 16951 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.355616 17055 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.378818 14893 raft_consensus.cc:2410] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:29.378998 17055 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.332337 14970 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:29.334718 14892 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:29.380527 17036 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:29.380589 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2097) took 1842 ms (client timeout 1786 ms). Trace:
I20260709 13:05:29.380975 17055 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:29.274804 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.381628 16676 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.383049 17032 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.383543 17032 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.383950 16676 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.384568 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:29.385532 17032 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.339928 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.386617 14886 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:29.386891 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:29.387475 14966 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:29.388288 17045 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:29.388728 17045 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.389127 17045 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.389817 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.390619 14887 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:29.391047 16937 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.292963 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:29.351962 14890 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:29.350829 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.351327 17060 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.391700 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.206909 17056 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.425112 14887 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 2: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:29.356360 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.361600 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:29.433279 15548 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.368769 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.319758 16433 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.351558 16986 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.358011 16534 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:05:29.448786 17010 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:29.450976 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:29.375020 17041 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.335908 16728 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.376055 17066 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.453732 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.347239 14964 rpcz_store.cc:276] 0709 13:05:27.340027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.356632 (+ 16605us) service_pool.cc:224] Handling call
0709 13:05:27.435699 (+ 79067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:27.555423 (+119724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:27.559020 (+  3597us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:27.601499 (+ 42479us) log.cc:844] Serialized 26 byte log entry
0709 13:05:27.768241 (+166742us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:27.786338 (+ 18097us) log.cc:844] Serialized 14 byte log entry
0709 13:05:27.799209 (+ 12871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.345095 (+1545886us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b18001d9f80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419
0709 13:05:29.346524 (+  1429us) spinlock_profiling.cc:243] Waited 76.8 ms on lock 0x7b5400420254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:29.346572 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:29.346611 (+    39us) raft_consensus.cc:1685] finished
0709 13:05:29.346625 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:29.346771 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2528,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":3569,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":40231,"spinlock_wait_cycles":197671552,"thread_start_us":85069,"threads_started":1,"wal-append.queue_time_us":175649,"wal-append.run_cpu_time_us":2156,"wal-append.run_wall_time_us":1066915}
W20260709 13:05:29.389204 17029 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 1.719s	user 0.017s	sys 0.036s
I20260709 13:05:29.345348 17053 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.425345 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.334451 17018 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.393111 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:29.350293 14791 rpcz_store.cc:269] 0709 13:05:16.942492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:16.950307 (+  7815us) service_pool.cc:224] Handling call
0709 13:05:29.283054 (+12332747us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:26.449596 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:26.517326 (+ 67730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:26.520742 (+  3416us) write_op.cc:435] Acquired schema lock
0709 13:05:26.522827 (+  2085us) tablet.cc:662] Decoding operations
0709 13:05:26.552655 (+ 29828us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:26.552762 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:26.552801 (+    39us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:05:26.553506 (+   705us) tablet.cc:701] Row locks acquired
0709 13:05:26.553541 (+    35us) write_op.cc:260] PREPARE: finished
0709 13:05:26.553734 (+   193us) write_op.cc:270] Start()
0709 13:05:26.553863 (+   129us) write_op.cc:276] Timestamp: P: 1783602326553666 usec, L: 0
0709 13:05:26.553899 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:05:26.554530 (+   631us) log.cc:844] Serialized 2112 byte log entry
0709 13:05:26.763207 (+208677us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b18003d9f60. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:26.895646 (+132439us) op_driver.cc:464] REPLICATION: finished
0709 13:05:27.142793 (+247147us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f5531c6c0ac 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f55387acef0
0709 13:05:27.567752 (+424959us) write_op.cc:301] APPLY: starting
0709 13:05:27.576975 (+  9223us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:27.592491 (+ 15516us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:27.592537 (+    46us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:27.593424 (+   887us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:27.593632 (+   208us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:05:27.593705 (+    73us) write_op.cc:312] APPLY: finished
0709 13:05:27.594013 (+   308us) log.cc:844] Serialized 47 byte log entry
0709 13:05:27.594196 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.594296 (+   100us) write_op.cc:454] Released schema lock
0709 13:05:27.594337 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:27.594706 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:27.594733 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":31156,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":467535,"apply.run_cpu_time_us":21969,"apply.run_wall_time_us":215933,"num_ops":5,"prepare.queue_time_us":104217,"prepare.run_cpu_time_us":29454,"prepare.run_wall_time_us":252084,"raft.queue_time_us":90193,"raft.run_cpu_time_us":24887,"raft.run_wall_time_us":459752,"replication_time_us":333753,"spinlock_wait_cycles":31357184,"thread_start_us":558810,"threads_started":4,"wal-append.queue_time_us":155135,"wal-append.run_cpu_time_us":16333,"wal-append.run_wall_time_us":1840637}]]}
W20260709 13:05:29.381247 14892 rpcz_store.cc:269] 0709 13:05:27.538464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.538585 (+   121us) service_pool.cc:224] Handling call
0709 13:05:29.271594 (+1733009us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:29.380506 (+108912us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8312576}
I20260709 13:05:29.426915 17056 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.446309 15542 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:29.456738 15548 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:29.457659 16433 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:29.458281 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 120127us
I20260709 13:05:29.453217 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:29.458609 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.466295 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.362432 16905 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:29.461791 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 68776.1us
I20260709 13:05:29.433135 17036 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:29.444183 16931 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.369364 17048 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:05:29.464596 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.467393 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:29.467597 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.478166 14891 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
I20260709 13:05:29.478227 15041 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.470674 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.471369 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:29.460616 17033 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:29.474318 15037 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:29.460867 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.462121 17018 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:29.459484 17045 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.479550 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.462584 17005 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:29.553480 14889 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:29.572041 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.572487 17047 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:29.572866 16723 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.572950 17047 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.573436 17047 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.476969 17036 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.576658 16905 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.578413 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.579018 17068 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.580309 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.580916 14890 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:29.487751 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.524145 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.582394 14891 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:29.479880 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:29.584800 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.566877 15041 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
W20260709 13:05:29.587890 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 108458us
I20260709 13:05:29.484898 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.590085 15044 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:29.525463 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.484565 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.592549 15038 raft_consensus.cc:2410] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:29.465407 17032 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:29.601285 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.582334 14892 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:29.612421 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.573288 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.623044 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.632225 15041 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:29.633378 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.634079 15041 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:29.637017 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.638773 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.641366 14895 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 1.
I20260709 13:05:29.642465 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.560149 17046 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.472478 17056 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:29.629940 14888 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:29.643107 15035 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:29.644558 14895 raft_consensus.cc:2410] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:29.480293 16931 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.644049 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.675498 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.635399 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:29.676684 15041 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.483385 17033 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:29.642524 15044 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:29.611302 17032 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.647100 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.537943 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.656701 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.663604 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.684717 14895 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:29.685853 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.600060 16905 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.688406 16905 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.689663 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.690442 16905 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:29.628607 17010 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:29.690963 17010 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.691354 17010 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.694579 14891 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:29.683516 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.683393 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.687081 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.687081 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:29.698609 14890 raft_consensus.cc:2410] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:29.629962 15541 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:29.702364 15041 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:29.709625 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.649596 16723 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:29.696686 16645 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:29.673861 17046 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:29.650595 17056 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.746048 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:29.685635 17033 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:29.962721 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 334587us
I20260709 13:05:29.775002 14895 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:29.806090 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58522.2us
W20260709 13:05:29.963878 14933 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.004s	sys 0.014s
I20260709 13:05:29.792698 17045 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:29.746218 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.674585 17061 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5.
I20260709 13:05:29.935685 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.696894 17032 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:29.831324 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 193695us
I20260709 13:05:29.720193 16906 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:29.774498 17083 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:05:29.959671 15041 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:29.964231 14933 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.005s	sys 0.014s
I20260709 13:05:29.972818 15041 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:29.972934 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 551797us
I20260709 13:05:29.973554 15041 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:29.798178 16681 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.002s
W20260709 13:05:29.880472 16825 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.538s	user 0.005s	sys 0.005s
W20260709 13:05:29.969945 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.732328 16723 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:29.981022 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:29.940006 16986 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:29.806510 17053 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:29.988320 17041 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.989143 16905 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.969009 17048 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.923138 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:29.990329 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.016251 15544 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.017305 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.018497 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.019541 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.999213 16723 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:29.991503 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.023541 14893 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:29.992949 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:29.994194 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.025782 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:29.986603 17010 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.805513 16931 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:29.786121 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:29.995843 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:29.996728 15041 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:29.963255 17056 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.830852 17062 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:29.999673 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:30.044480 15044 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:29.962234 16645 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.003394 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.047425 14968 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:30.047586 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:29.999166 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:30.048668 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49616.1us
I20260709 13:05:29.989569 16906 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:29.933517 17047 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:29.785472 16728 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.060454 16931 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:30.055768 17062 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.060943 16931 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:30.061348 16931 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.062620 17062 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.029071 17048 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.064956 17048 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:30.066850 17048 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:29.935845 17018 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.027336 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:30.005512 17020 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:30.050092 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:30.056756 15041 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:30.071671 15040 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:30.072414 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:29.999044 16825 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.067296 17048 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.007696 17053 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.013270 17041 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.028841 16905 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.074607 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.149281 16882 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:30.105558 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.149827 16882 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:30.150363 16882 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.035480 16951 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:30.151109 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 78794.7us
I20260709 13:05:30.087020 15549 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
W20260709 13:05:30.155833 15037 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.066s	sys 0.082s
W20260709 13:05:30.152890 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125607us
W20260709 13:05:30.156298 15037 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.066s	sys 0.082s
W20260709 13:05:30.145081 17093 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:05:30.155917 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.156183 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:30.153936 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 103907us
I20260709 13:05:30.156855 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.045248 15544 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:30.152868 15044 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:30.058934 16645 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.048331 15541 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.172075 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:30.188009 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.156862 16951 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.155786 17081 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:30.175091 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1408) took 1056 ms. Trace:
I20260709 13:05:30.175325 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.237613 15550 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:30.158020 17045 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:05:30.124689 16723 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.237250 15043 rpcz_store.cc:276] 0709 13:05:29.118798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.118915 (+   117us) service_pool.cc:224] Handling call
0709 13:05:29.119216 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.176442 (+ 57226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.176485 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:29.176542 (+    57us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:29.176587 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.174858 (+998271us) spinlock_profiling.cc:243] Waited 57 ms on lock 0x7b540014cdd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:30.174897 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.175039 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130998144}
I20260709 13:05:30.169314 17047 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:30.242481 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 82336.8us
I20260709 13:05:30.238691 16951 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:30.236312 17088 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 13:05:30.236902 17065 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:30.248438 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.239739 17081 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.157312 17020 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.239957 17045 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:30.160881 16988 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:05:30.256592 15035 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:30.250420 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.268172 15044 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
W20260709 13:05:30.247485 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 217367us
I20260709 13:05:30.154129 16906 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.170596 16640 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:05:30.250149 17047 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:30.247820 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 92653.7us
I20260709 13:05:30.259397 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1615) took 1279 ms. Trace:
I20260709 13:05:30.272331 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:30.257478 17010 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:30.263912 17081 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.274084 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.272791 14892 rpcz_store.cc:276] 0709 13:05:28.980327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.690453 (+710126us) service_pool.cc:224] Handling call
0709 13:05:29.690729 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.691078 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.691106 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.691575 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.937594 (+246019us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:29.937648 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.937736 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.259137 (+321401us) raft_consensus.cc:1685] finished
0709 13:05:30.259164 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.259326 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19774,"raft.queue_time_us":7519,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":111863,"thread_start_us":245627,"threads_started":1,"wal-append.queue_time_us":283530}
I20260709 13:05:30.288224 16953 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.290524 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.292863 14887 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:30.293972 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1613) took 1548 ms. Trace:
I20260709 13:05:30.303896 14894 rpcz_store.cc:276] 0709 13:05:28.759725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.910508 (+150783us) service_pool.cc:224] Handling call
0709 13:05:28.910936 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.058889 (+147953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.058921 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.059361 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.297358 (+237997us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:29.297407 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.293472 (+996065us) spinlock_profiling.cc:243] Waited 78 ms on lock 0x7b54002ec2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:30.293534 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.293597 (+    63us) raft_consensus.cc:1685] finished
0709 13:05:30.293617 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.293898 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":69563,"raft.queue_time_us":72018,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7548,"spinlock_wait_cycles":180601984,"thread_start_us":223086,"threads_started":1,"wal-append.queue_time_us":220346}
W20260709 13:05:30.250525 14961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1524) took 3083 ms (client timeout 1640 ms). Trace:
I20260709 13:05:30.296272 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.276551 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.268712 17045 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.306668 14963 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:30.308934 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.309666 14963 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:30.311985 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.314150 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.315631 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.316726 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.321620 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.325977 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.277174 17047 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.326530 16723 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:30.312016 16953 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.327786 17105 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:30.329443 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.313309 15544 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:30.334347 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.339306 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.341030 15044 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:30.343660 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.343779 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.344249 14965 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:30.307838 16523 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 13:05:30.346138 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:30.346376 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.339720 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67490.4us
I20260709 13:05:30.323154 17102 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:30.365299 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 469) took 1421 ms. Trace:
I20260709 13:05:30.365684 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.365748 15543 rpcz_store.cc:276] 0709 13:05:28.953422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:28.968212 (+ 14790us) service_pool.cc:224] Handling call
0709 13:05:28.977608 (+  9396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.203481 (+225873us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.207861 (+  4380us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:29.209646 (+  1785us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:29.209720 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.339173 (+1129453us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400512cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:30.342401 (+  3228us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.365206 (+ 22805us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500025728}
I20260709 13:05:30.366564 16723 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.366901 16953 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.324376 17101 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:05:30.372094 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55454.4us
W20260709 13:05:30.345081 17084 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:05:30.375998 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:30.379328 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:30.307791 14961 rpcz_store.cc:269] 0709 13:05:27.163971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.171524 (+  7553us) service_pool.cc:224] Handling call
0709 13:05:30.236812 (+3065288us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540010a4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:30.245052 (+  8240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3855849856}
I20260709 13:05:30.342408 16992 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:30.381590 14894 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:30.383455 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.347111 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.369290 16523 consensus_queue.cc:1243] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:05:30.386721 14893 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:30.370096 17053 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.371593 17082 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:30.374749 17048 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.378679 16711 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:30.381223 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.380290 16825 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.396705 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.394608 17082 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:30.399400 17082 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.402830 14964 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:30.404088 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.404277 16888 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.404691 14961 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:30.404811 16888 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.407361 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.408447 17046 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.408731 14964 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:30.417686 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.424804 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.397189 14965 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:30.427227 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.438196 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 379) took 1171 ms. Trace:
I20260709 13:05:30.438723 14967 rpcz_store.cc:276] 0709 13:05:29.266280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.267008 (+   728us) service_pool.cc:224] Handling call
0709 13:05:29.267279 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:29.466142 (+198863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.466161 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:29.466187 (+    26us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:29.466205 (+    18us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.437906 (+971701us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54003e6554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:30.437965 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.438122 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456883968}
I20260709 13:05:30.394098 17053 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:30.475148 14892 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:30.491526 17102 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:30.494864 14967 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:30.504791 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:30.509162 14892 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:30.510462 14892 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:30.503505 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.511984 14894 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:30.506911 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.512643 14963 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:30.415045 17033 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.516642 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.505805 16534 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.523270 16534 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.525686 16534 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.516422 16728 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.526456 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.526675 16728 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:30.505208 17084 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:05:30.474120 17085 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.528234 17085 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.459642 16888 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.389104 16992 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.422802 17047 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.422681 17048 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:05:30.528690 16728 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.704262 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.704780 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.705189 14894 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:30.705377 15035 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:30.612790 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.706570 14969 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:30.702404 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2053) took 1139 ms. Trace:
I20260709 13:05:30.703614 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.648193 15038 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:30.645061 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.701164 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.698886 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.679045 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2114) took 1222 ms. Trace:
W20260709 13:05:30.704950 17108 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:30.665386 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 562) took 1194 ms. Trace:
I20260709 13:05:30.710012 14891 rpcz_store.cc:276] 0709 13:05:29.456363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.935431 (+479068us) service_pool.cc:224] Handling call
0709 13:05:30.678432 (+743001us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:30.678588 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.678746 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.678780 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.678817 (+    37us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:30.678847 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.678896 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.678997 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32226688}
W20260709 13:05:30.712522 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 379166us
I20260709 13:05:30.677006 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2052) took 1141 ms. Trace:
I20260709 13:05:30.713550 15040 rpcz_store.cc:276] 0709 13:05:29.535399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.538380 (+  2981us) service_pool.cc:224] Handling call
0709 13:05:29.583006 (+ 44626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.151786 (+568780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.676791 (+525005us) spinlock_profiling.cc:243] Waited 488 ms on lock 0x7b54001cbbd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:30.676950 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1123159424}
I20260709 13:05:30.718766 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.712540 15549 rpcz_store.cc:276] 0709 13:05:29.471026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.471139 (+   113us) service_pool.cc:224] Handling call
0709 13:05:30.665126 (+1193987us) spinlock_profiling.cc:243] Waited 528 ms on lock 0x7b54003c91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:30.665274 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1213917568}
I20260709 13:05:30.711800 14965 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:30.714617 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.707567 15039 rpcz_store.cc:276] 0709 13:05:29.563033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.563150 (+   117us) service_pool.cc:224] Handling call
0709 13:05:30.701557 (+1138407us) spinlock_profiling.cc:243] Waited 1.07 ms on lock 0x7b5800144398. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:30.701779 (+   222us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.702006 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.702043 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.702096 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:30.702139 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.702205 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.702339 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2453376}
I20260709 13:05:30.715958 14890 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:30.662846 15547 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:30.530980 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.728407 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 563) took 1256 ms. Trace:
W20260709 13:05:30.570868 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 196436us
W20260709 13:05:30.731328 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.532037 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:30.732393 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:30.734162 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:30.734835 16711 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:30.707814 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:30.735653 14963 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.741601 17082 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.742295 17082 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.744737 14963 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:30.728892 15547 rpcz_store.cc:276] 0709 13:05:29.472049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.472165 (+   116us) service_pool.cc:224] Handling call
0709 13:05:30.662343 (+1190178us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:30.662524 (+   181us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.728093 (+ 65569us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.728334 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10223488}
I20260709 13:05:30.504769 17105 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:30.745874 16728 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:30.746826 16711 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:30.755107 16728 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:30.747073 16433 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:30.755290 17105 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.756336 16433 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:30.756709 16433 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:30.757458 16433 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.503883 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.759784 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.762045 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.749941 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 564) took 1276 ms. Trace:
I20260709 13:05:30.556726 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 386) took 1170 ms. Trace:
I20260709 13:05:30.762634 15546 rpcz_store.cc:276] 0709 13:05:29.473327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.473427 (+   100us) service_pool.cc:224] Handling call
0709 13:05:30.409714 (+936287us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:30.698701 (+288987us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51e9c 00007f5531c51a5b 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:30.749865 (+ 51164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":35314816}
W20260709 13:05:30.749595 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 384355us
I20260709 13:05:30.760907 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:30.755618 16728 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:30.754034 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.765877 14894 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:30.766119 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:30.767014 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:30.680823 17085 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:30.759891 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 376165us
I20260709 13:05:30.586326 17020 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.517421 17053 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:30.764917 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:30.760488 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.675140 17041 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.688939 16905 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:30.768452 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.767740 14894 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.748040 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:30.786613 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.787436 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:30.759457 17119 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.767083 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:30.554551 16988 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:30.773208 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.752831 17046 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:30.779892 14892 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.760195 16433 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.780115 14891 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:30.656474 16645 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.745307 17082 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.654832 17081 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.762689 14970 rpcz_store.cc:276] 0709 13:05:29.386253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.425797 (+ 39544us) service_pool.cc:224] Handling call
0709 13:05:29.426112 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:29.426332 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:29.426355 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:29.426785 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:05:29.697194 (+270409us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:29.958457 (+261263us) log.cc:844] Serialized 14 byte log entry
0709 13:05:29.958741 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:29.958834 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:30.404042 (+445208us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b18004661e0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:30.529472 (+125430us) raft_consensus.cc:1685] finished
0709 13:05:30.556483 (+ 27011us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.556652 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":258629,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":117,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"spinlock_wait_cycles":13290880,"thread_start_us":270063,"threads_started":1,"wal-append.queue_time_us":677333}
I20260709 13:05:30.771770 16722 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:30.772244 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.801087 14970 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:30.768767 17080 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:30.822134 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49934.7us
I20260709 13:05:30.829635 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.773977 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.830817 14961 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:30.834518 14894 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
W20260709 13:05:30.793727 16882 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.000s
I20260709 13:05:30.798388 17046 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.838795 14861 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:30.839303 14861 leader_election.cc:403] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:30.790627 17095 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:30.793526 16711 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:30.796301 17085 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:30.840430 14968 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:30.846844 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:30.828437 17032 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.830s	user 0.007s	sys 0.005s
I20260709 13:05:30.848556 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:30.824977 16905 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:30.833938 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:30.759284 17102 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.840731 17046 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.861253 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 482) took 1221 ms. Trace:
W20260709 13:05:30.857430 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 91355.1us
I20260709 13:05:30.863161 15550 rpcz_store.cc:276] 0709 13:05:29.639581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.244120 (+604539us) service_pool.cc:224] Handling call
0709 13:05:30.677959 (+433839us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:30.678141 (+   182us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:30.764991 (+ 86850us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.765035 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:30.765086 (+    51us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:30.765128 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.861043 (+ 95915us) spinlock_profiling.cc:243] Waited 86.6 ms on lock 0x7b540044ded4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:30.861091 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:30.861196 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":215245952}
I20260709 13:05:30.799537 17047 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 13:05:30.871726 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:30.871053 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.872696 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.877925 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.878321 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:30.854823 16931 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.793s	user 0.008s	sys 0.004s
I20260709 13:05:30.844498 17085 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.844913 16711 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:30.875022 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.879249 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:30.879767 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.873375 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:30.828912 16988 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.860394 17036 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:30.885295 15549 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:30.799000 17119 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.854336 17082 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:30.883975 14970 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
W20260709 13:05:30.889557 15541 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.655s	user 0.007s	sys 0.003s
I20260709 13:05:30.858083 16905 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:30.872193 16719 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:30.912760 17120 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260709 13:05:30.850746 16728 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.888090 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:30.888469 17033 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:30.885656 17085 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:30.885732 16711 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.841567 16882 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.854620 17128 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:30.867552 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:30.889146 16951 consensus_meta.cc:287] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.643s	user 0.003s	sys 0.006s
W20260709 13:05:30.911756 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147195us
I20260709 13:05:30.873692 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:30.854460 17032 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:30.918841 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46904.4us
I20260709 13:05:30.837611 17080 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:30.981992 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:30.889489 16986 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:30.887173 16888 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:30.937327 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.846107 17053 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.935423 16905 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:30.890157 16931 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:30.980719 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 107068us
W20260709 13:05:30.983871 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 338489us
I20260709 13:05:30.934705 17041 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:30.966039 17128 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.015882 17128 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.016355 16992 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.983016 16534 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:30.985286 17033 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 13:05:31.022393 17045 consensus_meta.cc:287] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.702s	user 0.005s	sys 0.001s
I20260709 13:05:31.025429 16882 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:30.989317 16986 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.028420 17032 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.005712 15548 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:31.029320 16986 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:30.983175 16951 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:31.030772 17056 consensus_meta.cc:287] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.963s	user 0.010s	sys 0.000s
I20260709 13:05:31.031162 17056 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.032217 16951 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.033138 17056 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:31.034145 15041 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:31.006482 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.036504 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:30.982981 17082 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:31.003969 16645 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:31.013754 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.046633 14893 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:30.938604 16719 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.017988 17095 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:30.985438 16728 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.020601 16534 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:30.924149 15541 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:31.022809 17045 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.043421 14966 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 13:05:31.059545 17116 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:05:31.048961 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.059952 16719 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.072263 17045 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.072379 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1629) took 1915 ms. Trace:
I20260709 13:05:31.008302 14892 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:31.072484 16645 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.045171 14962 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:31.073212 14889 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:31.073859 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.072786 14888 rpcz_store.cc:276] 0709 13:05:29.156644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.731627 (+574983us) service_pool.cc:224] Handling call
0709 13:05:30.420926 (+689299us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:30.421089 (+   163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.421437 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.421465 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.421882 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.517324 (+ 95442us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:05:30.517361 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.517424 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.072099 (+554675us) raft_consensus.cc:1685] finished
0709 13:05:31.072118 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.072324 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2381,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":52007,"spinlock_wait_cycles":32045440,"thread_start_us":95118,"threads_started":1,"wal-append.queue_time_us":452684}
I20260709 13:05:31.074389 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.074456 14962 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:31.038362 16888 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:31.034273 17041 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:31.068539 17128 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.075913 17041 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.076514 14887 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:31.059433 16988 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.077351 17128 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:31.059019 17123 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:05:31.123418 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 74560.1us
I20260709 13:05:31.006719 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.077926 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.120905 16534 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.121798 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.122077 15549 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:31.038056 17060 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:31.065303 17130 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:05:31.124609 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:31.064070 17126 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:05:31.075964 16888 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:31.129415 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 122709us
I20260709 13:05:31.047741 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.129935 17128 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.132218 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:31.064661 17122 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260709 13:05:31.070029 17100 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.705s	user 0.004s	sys 0.001s
I20260709 13:05:31.128741 14893 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:31.133327 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.162386 16523 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:31.162953 15542 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:31.131529 17045 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:31.134217 16874 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.059s	user 0.004s	sys 0.000s
I20260709 13:05:31.178771 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.179162 16874 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:05:31.179947 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.180343 16874 tablet_bootstrap.cc:492] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
W20260709 13:05:31.180526 17131 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:05:31.180872 14964 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:31.181115 16874 ts_tablet_manager.cc:1403] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 1.923s	user 0.037s	sys 0.041s
I20260709 13:05:31.124228 16988 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:31.183940 16988 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.186225 16988 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.144660 16931 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:31.019954 17119 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.020294 17081 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.125209 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.140568 14961 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:31.148468 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.195628 15546 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:31.196481 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.150067 15545 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:05:31.150044 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.197206 15545 pending_rounds.cc:85] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 5
I20260709 13:05:31.197397 15037 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:31.197539 15545 pending_rounds.cc:107] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:05:31.197839 15545 raft_consensus.cc:2889] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:31.198031 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.150734 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.078012 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 528) took 1424 ms. Trace:
I20260709 13:05:31.199390 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.199632 15541 rpcz_store.cc:276] 0709 13:05:29.653533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.785816 (+132283us) service_pool.cc:224] Handling call
0709 13:05:31.077950 (+1292134us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:31.200780 17137 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:05:31.201037 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2113) took 1745 ms. Trace:
I20260709 13:05:31.159193 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.201462 14889 rpcz_store.cc:276] 0709 13:05:29.456078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.793670 (+337592us) service_pool.cc:224] Handling call
0709 13:05:31.013194 (+1219524us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:31.073027 (+ 59833us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.073706 (+   679us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:31.200850 (+127144us) spinlock_profiling.cc:243] Waited 59.6 ms on lock 0x7b540024e0d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:31.200979 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141026432}
I20260709 13:05:31.159760 15035 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:31.202390 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:31.160981 15036 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:31.203223 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.203578 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.203729 14888 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:31.204149 15037 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:31.205526 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:31.205667 17018 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.130016 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.206113 14893 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:31.199342 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:31.209647 17104 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.844s	user 0.000s	sys 0.009s
I20260709 13:05:31.209689 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.209940 17041 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.167586 15043 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:31.167490 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.135039 17060 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.201792 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.177809 17045 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.212659 14968 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:31.159559 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.204149 15036 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:31.145301 17095 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:31.194327 16882 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:31.196681 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:31.219956 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.140061 17101 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:05:31.221154 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.198803 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:31.199256 17136 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:31.202023 15039 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
W20260709 13:05:31.207791 17135 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.002s
W20260709 13:05:31.207959 15038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2056) took 1577 ms (client timeout 1719 ms). Trace:
I20260709 13:05:31.076546 17080 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:31.182994 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.181854 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:31.215005 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89876.7us
I20260709 13:05:31.168396 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.215570 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.226881 14964 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:31.226888 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:31.227618 14967 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:05:31.228636 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.216555 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:31.217548 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50152.2us
I20260709 13:05:31.229645 14968 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.230306 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.229846 15008 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:31.233904 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.222620 17018 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.223874 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:31.224175 15038 rpcz_store.cc:269] 0709 13:05:29.630921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.681896 (+ 50975us) service_pool.cc:224] Handling call
0709 13:05:31.207740 (+1525844us) spinlock_profiling.cc:243] Waited 914 ms on lock 0x7b54001f45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:31.207887 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2102679424}
I20260709 13:05:31.223380 15550 raft_consensus.cc:2376] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5. Re-sending same reply.
I20260709 13:05:31.226109 14891 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:31.235726 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.236114 15037 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.234647 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.237646 15036 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:31.237826 16433 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:31.238196 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:31.238457 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.243355 14966 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:31.223114 16931 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:31.239530 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.238822 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.249805 14968 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:31.250557 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:31.251789 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.251883 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:31.252918 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.254005 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.255260 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.255718 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.219244 16676 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:31.257068 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.219108 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.255686 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.259941 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.262753 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:31.260704 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:31.263252 14966 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:31.261274 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.254525 15039 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:31.268769 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:31.269210 16433 consensus_queue.cc:1243] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:31.232348 17056 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:31.269711 16433 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:31.207293 16711 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.270586 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.247619 17107 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.276412 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.277491 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.279078 17146 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:31.247982 17119 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:31.288453 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.262046 16719 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:31.223616 16882 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.254909 17134 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.269613 16534 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:05:31.301570 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1411) took 1680 ms. Trace:
I20260709 13:05:31.262554 16676 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:31.292168 17133 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:31.297694 16951 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:31.298373 17085 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.298519 17009 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:31.273418 17114 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.289814 17033 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.291687 16719 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:31.300348 16905 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.267280 16931 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:31.304435 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.301914 15044 rpcz_store.cc:276] 0709 13:05:29.621053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.370950 (+749897us) service_pool.cc:224] Handling call
0709 13:05:30.371211 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:30.376443 (+  5232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:30.376471 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:30.380984 (+  4513us) log.cc:844] Serialized 26 byte log entry
0709 13:05:30.776292 (+395308us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:30.776330 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:30.776397 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:31.294947 (+518550us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b2400200798. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531b0f9c4 00007f5531b0dacb 00007f5531cc8dc9 00007f5531cc8a55 00007f5531cc7fb0 00007f553493e488 00007f553493ebe8 00007f5534916398 00007f553491176a 00007f5534910bb6
0709 13:05:31.301287 (+  6340us) raft_consensus.cc:1685] finished
0709 13:05:31.301311 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:31.301517 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10026,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":4585,"spinlock_wait_cycles":3640064,"thread_start_us":353818,"threads_started":1,"wal-append.queue_time_us":504044}
I20260709 13:05:31.326367 14970 raft_consensus.cc:2368] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:31.292012 17060 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.348071 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.274436 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:31.351804 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47425.5us
I20260709 13:05:31.354913 17060 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:31.355520 17099 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:31.340690 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 102543us
I20260709 13:05:31.356127 17099 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:31.356536 17099 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.341347 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:31.357349 14933 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:31.290063 17119 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:31.359601 17119 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.361057 17147 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:31.362362 17147 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:31.362694 17147 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:31.363030 17147 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.363554 16534 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:31.364629 17080 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:31.290803 17095 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.365021 17080 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:31.365187 16953 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:31.365600 16953 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:31.365868 17080 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.280272 17128 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:31.294651 17081 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.386933 15035 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:05:31.369629 14965 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:31.388576 14893 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:31.344229 17041 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.324720 17133 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.311887 16676 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.292531 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:31.355625 14969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 383) took 2065 ms (client timeout 1708 ms). Trace:
I20260709 13:05:31.363744 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.325516 16951 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.349395 15044 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.324226 16906 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:31.355449 17060 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:31.370070 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:31.416779 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46797.2us
I20260709 13:05:31.417547 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:31.339983 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61552.9us
I20260709 13:05:31.399832 17133 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:31.367942 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.421762 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.390512 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.351353 17046 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.366791 16953 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.397279 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:31.397984 15545 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 1. Current term is 2. Ops: []
I20260709 13:05:31.425859 15549 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:31.422711 14887 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:05:31.427438 16953 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.428193 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.402175 14891 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:31.348562 16719 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.396196 16988 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 13:05:31.432157 16711 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.432312 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:31.433399 17047 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:31.433311 17011 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:31.433852 17047 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:31.434281 17047 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.425316 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:31.434820 17011 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:05:31.435194 17011 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:31.435730 15044 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:31.436187 17011 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.367275 17080 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:31.400250 14969 rpcz_store.cc:269] 0709 13:05:29.290333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.290950 (+   617us) service_pool.cc:224] Handling call
0709 13:05:31.355431 (+2064481us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400217ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:31.355544 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3115788032}
I20260709 13:05:31.405411 16433 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:31.405725 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.367201 16882 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.419242 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.371234 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.406538 16951 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.387938 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.423879 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.305157 16874 raft_consensus.cc:359] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.436578 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.406574 16906 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:31.439477 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:31.365724 17085 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.416929 17060 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.445729 15040 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:31.446635 15035 raft_consensus.cc:2368] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4.
I20260709 13:05:31.452492 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.453428 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.462210 15039 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:31.463034 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.463577 15039 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:31.464298 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.464803 15039 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:31.465528 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.467334 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.419770 17128 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:31.467833 15043 raft_consensus.cc:2368] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:31.468653 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.469460 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.471768 14968 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.472105 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:31.474099 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.474172 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.474920 14891 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.404002 16931 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.487918 16433 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.452297 17103 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:31.424453 17036 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.483502 15035 raft_consensus.cc:2368] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4.
I20260709 13:05:31.491485 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.458328 16906 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.513509 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.514319 14969 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:31.496238 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.497505 17121 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:31.515687 17121 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:31.516206 17121 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.497555 17103 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:31.519933 17103 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:31.520506 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.521160 17103 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.523231 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:31.523711 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet b4b44d3457824f63aaf8c5cafbd75ea0: Illegal state: Replica eb4a5ac9f0c5425b92051187b939860f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:31.524904 14969 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:05:31.498808 16874 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:31.526192 16874 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:05:31.498052 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:31.456707 16992 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:05:31.514430 14891 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:31.523322 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.529496 14966 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.493819 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.466326 16882 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:31.531064 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.531486 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.551978 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.552794 15035 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:31.552981 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:31.553474 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:31.557247 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:31.556708 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.561254 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:31.563779 14968 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:31.554637 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.570715 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:31.573310 15036 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:31.531563 17011 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.547933 17146 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:31.600340 14968 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:31.559597 16882 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:31.612293 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 186998us
W20260709 13:05:31.617964 17149 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
I20260709 13:05:31.618465 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:31.618927 17153 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:05:31.619606 16722 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:05:31.620882 17152 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 13:05:31.622010 17154 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:05:31.622407 14966 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
W20260709 13:05:31.685199 15041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1417) took 2053 ms (client timeout 2027 ms). Trace:
W20260709 13:05:31.690377 15041 rpcz_store.cc:269] 0709 13:05:29.631746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.155892 (+524146us) service_pool.cc:224] Handling call
0709 13:05:31.685002 (+1529110us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54004051d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:31.685132 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010917632}
I20260709 13:05:31.691586 15041 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:31.691462 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 73091.4us
I20260709 13:05:31.692536 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:31.684526 15548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 560) took 2214 ms (client timeout 1794 ms). Trace:
I20260709 13:05:31.688660 15042 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:05:31.693192 15548 rpcz_store.cc:269] 0709 13:05:29.470234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:29.470467 (+   233us) service_pool.cc:224] Handling call
0709 13:05:31.684230 (+2213763us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54006509d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:31.684410 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3510900096}
W20260709 13:05:31.695159 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 171977us
W20260709 13:05:31.695328 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 82129us
W20260709 13:05:31.696026 15516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.3:46271 timed out after 1.518s (SENT) [suppressed 18 similar messages]
I20260709 13:05:31.696213 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.707602 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.707748 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.708531 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.660059 16905 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.719735 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:31.705390 16992 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:31.722980 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 854102us
I20260709 13:05:31.711784 17033 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:31.725421 16988 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.726066 17159 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:31.728075 17164 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.731773 17114 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.732318 17107 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.732851 17034 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:31.734081 17156 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:31.709918 16888 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:31.734879 17157 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:05:31.738102 17165 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:31.742868 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:31.749673 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:31.659574 17128 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.747381 17045 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.762759 17147 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.765693 17060 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.741485 17046 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:31.772958 17168 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:05:31.718773 16882 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.713730 17146 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.748672 17033 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:31.805369 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 56270.5us
W20260709 13:05:31.803988 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61230.3us
I20260709 13:05:31.818324 17169 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.821085 16825 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:31.821715 16523 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:31.801505 17165 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:31.807224 17134 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.836625 15035 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:31.808967 16723 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:31.803582 16722 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 13:05:31.841460 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 114446us
I20260709 13:05:31.843155 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:31.833596 16523 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.847090 16523 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.847605 16523 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:31.848675 16719 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.841581 16645 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:05:31.852239 16645 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:31.852571 16645 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:31.852747 17147 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:31.853385 16645 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.854528 16645 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:31.858866 17009 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:31.859457 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 440208us
W20260709 13:05:31.863351 15513 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.565s (SENT)
I20260709 13:05:31.803900 16888 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.859591 16953 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:31.865142 15516 leader_election.cc:400] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4.
I20260709 13:05:31.865767 15516 leader_election.cc:403] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:05:31.838711 16931 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:31.868327 17060 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:31.869498 17099 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.001s
I20260709 13:05:31.869865 17099 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.872069 16951 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.842129 14961 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:31.838490 17169 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:31.931527 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:31.937422 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73511.3us
W20260709 13:05:31.895000 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 362452us
W20260709 13:05:31.942530 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 215958us
W20260709 13:05:31.892781 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 70154.7us
I20260709 13:05:31.943382 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.943994 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.897102 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:31.944356 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:31.834529 16825 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.875860 16874 ts_tablet_manager.cc:1434] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.694s	user 0.013s	sys 0.012s
W20260709 13:05:31.865821 17119 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.002s
I20260709 13:05:31.947937 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.873965 17045 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:31.945472 17147 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:31.951373 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54385.9us
I20260709 13:05:31.952113 16905 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:31.954312 16888 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:31.954788 17151 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:05:31.951869 15516 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:31.865995 16719 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.948365 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:31.959825 14888 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:31.843544 17133 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.873853 16951 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.988912 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.980582 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.016000 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.016434 17133 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:31.964041 17045 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:31.937808 17175 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4.
W20260709 13:05:31.986275 16728 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.858s	user 0.009s	sys 0.002s
W20260709 13:05:31.962823 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.013587 17174 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:31.864358 16676 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.017323 15044 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:32.017915 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:32.002455 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50702.4us
I20260709 13:05:32.040587 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:31.965112 17009 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:32.018812 16905 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.023715 17167 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:31.963982 17033 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:31.988734 17119 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:31.866925 16931 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.002985 16988 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.032126 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:31.950095 16874 ts_tablet_manager.cc:1467] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Tablet startup took 768ms
W20260709 13:05:32.036077 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47226.7us
I20260709 13:05:32.036367 14966 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:32.037638 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:32.041250 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:32.047122 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.059175 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.028287 17045 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.059793 16905 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.061178 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.019542 17147 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:32.053489 14888 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:32.054822 17150 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:32.055928 16931 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:32.042035 17121 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.525s	user 0.012s	sys 0.000s
I20260709 13:05:32.056944 15037 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:32.063757 17036 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:32.063814 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.064219 17036 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:32.065114 17034 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:32.065689 17034 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:32.041878 16719 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.065052 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.081117 16905 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.081542 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.046393 16882 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:32.083186 16676 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:32.043110 17009 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:32.067371 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.087894 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.086457 14933 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:32.079041 14967 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:32.051134 17164 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.089884 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.091858 14888 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:32.093300 14893 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:32.094645 14888 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:32.094496 16433 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:32.095739 17148 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.096407 17148 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.097045 17148 consensus_queue.cc:1243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:31.996426 17165 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.077553 17119 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:32.104784 14893 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:32.098819 16951 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:32.065063 17036 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:32.107908 17132 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.027s	user 0.003s	sys 0.000s
I20260709 13:05:32.110003 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:32.110417 17169 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:32.077170 17121 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.091032 17009 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.045531 17061 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:05:32.115731 14964 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:32.113864 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.066493 17034 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.119474 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:32.098726 16728 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.083593 17150 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.114545 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.093457 17128 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:32.121641 17010 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.129570 17010 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.136345 17085 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.132504 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.133533 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 487) took 1055 ms. Trace:
I20260709 13:05:32.045922 17174 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:32.057691 16874 ts_tablet_manager.cc:1469] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Trace:
0709 13:05:23.527643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:23.537624 (+  9981us) service_pool.cc:224] Handling call
0709 13:05:23.831799 (+294175us) ts_tablet_manager.cc:934] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
0709 13:05:24.951716 (+1119917us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:25.352566 (+400850us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:25.363000 (+ 10434us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:25.627993 (+264993us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:25.628354 (+   361us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:25.628712 (+   358us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:25.628838 (+   126us) inbound_call.cc:177] Queueing success response
0709 13:05:29.258320 (+3629482us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:31.181489 (+1923169us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:31.184682 (+  3193us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:31.185424 (+   742us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":322,"mutex_wait_us":20010,"raft.queue_time_us":170868,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":4047,"tablet-copy.queue_time_us":272103,"tablet-download-pool.queue_time_us":13948,"tablet-download-pool.run_cpu_time_us":1396,"tablet-download-pool.run_wall_time_us":2639054,"thread_start_us":251803,"threads_started":3}
W20260709 13:05:32.134557 17018 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.004s	sys 0.003s
I20260709 13:05:32.138176 15550 rpcz_store.cc:276] 0709 13:05:31.078535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.078644 (+   109us) service_pool.cc:224] Handling call
0709 13:05:32.133325 (+1054681us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b5400692654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:32.133465 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205471488}
I20260709 13:05:32.133977 16719 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:32.115209 16951 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:32.156054 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.121937 17165 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.116976 17099 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:32.160617 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 120128us
I20260709 13:05:32.131649 16534 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:32.163265 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:32.164028 16433 raft_consensus.cc:2764] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:32.165876 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.166668 16433 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:32.168452 16433 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.131006 17128 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:32.170363 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.137818 17010 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:32.172746 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:32.154446 17018 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.004s	sys 0.004s
I20260709 13:05:32.173221 15043 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:32.174541 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.174965 15548 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:32.171978 17085 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:32.175856 17085 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:32.176084 17164 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.176668 17032 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.172489 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.176278 17085 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.181141 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:32.158500 17148 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:32.170454 17047 consensus_meta.cc:287] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.002s
I20260709 13:05:32.183620 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.157948 16719 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:32.180202 15542 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:32.169837 16534 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:32.172791 17128 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:32.174002 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.191692 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:32.192816 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:32.193281 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:32.158953 16728 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:05:32.178167 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:32.195772 15043 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:05:32.197996 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.212793 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.186635 16719 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.153959 17147 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.248641 14892 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:32.194008 17167 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:32.246129 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55831.3us
I20260709 13:05:32.259553 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:32.260106 14895 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:32.260470 14892 raft_consensus.cc:2410] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 6 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:32.187232 17047 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:32.248623 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 74507.9us
I20260709 13:05:32.261680 14887 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:32.245137 17121 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.274900 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:32.261230 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.295311 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.297086 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:32.279767 14861 leader_election.cc:400] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:32.298870 14861 leader_election.cc:403] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:32.281476 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.288698 14893 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.279857 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:32.302266 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.302495 14888 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:32.305250 14895 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:32.306702 14888 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:32.285321 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:32.308002 14859 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 2.032s (SENT)
I20260709 13:05:32.309074 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.309585 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.271924 17045 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.281683 16534 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.322510 16534 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.323342 17118 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:32.325805 15039 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:32.268780 16882 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:05:32.327713 17047 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:32.251581 17009 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.255689 16951 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.329895 17009 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.331128 17082 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:32.332171 16906 consensus_meta.cc:287] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.778s	user 0.005s	sys 0.005s
I20260709 13:05:32.313944 17011 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:05:32.332578 16906 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.333127 17011 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:32.334033 17011 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:32.334488 16906 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:32.335582 17148 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.261488 17110 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 13:05:32.311707 17080 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.867s	user 0.005s	sys 0.005s
I20260709 13:05:32.337919 15036 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:32.308818 16640 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:32.339905 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.314399 16728 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:32.340660 16728 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:32.341215 16728 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.341681 17099 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:32.343724 16719 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.343894 15542 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:32.342794 17033 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:05:32.347910 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 290598us
I20260709 13:05:32.344990 17010 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:32.352392 14895 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:32.348435 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.308517 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.349799 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.350764 14893 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:32.354768 14968 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:32.360324 15550 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:32.362453 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:32.363093 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.364238 15043 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:32.366143 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.373029 15040 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:32.374632 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.372921 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:32.380693 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.283463 17174 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:32.384749 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.383543 15040 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:32.386420 15040 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:32.388227 15038 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:32.322706 17045 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:32.376852 17095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.939s	user 0.003s	sys 0.006s
W20260709 13:05:32.393564 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 85577.6us
I20260709 13:05:32.388321 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.392959 16640 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.407908 14968 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:32.409233 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 60862.8us
I20260709 13:05:32.410298 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.414530 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.415899 17110 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.416571 17110 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.417152 17110 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:32.418758 16882 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.421947 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:32.423063 15543 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:32.425997 17045 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:32.335074 17011 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.428371 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:32.406628 17095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.003s	sys 0.007s
I20260709 13:05:32.463560 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.404116 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.408860 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:32.469441 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54989.3us
I20260709 13:05:32.470532 17011 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.471004 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.499202 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.501385 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.502678 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.504161 17095 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.504575 16723 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:32.465941 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52427.6us
I20260709 13:05:32.381667 17080 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 13:05:32.355567 17181 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 13:05:32.505877 16723 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:32.509167 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:32.509470 17159 consensus_meta.cc:287] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.004s
I20260709 13:05:32.498467 17110 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:32.507140 16728 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.527478 17159 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:32.528900 15542 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:32.529330 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:32.530048 15038 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:32.530208 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:32.532545 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:32.522728 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.465334 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:32.534998 15542 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.536211 15544 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:32.534651 17053 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.532694 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 542) took 1284 ms. Trace:
I20260709 13:05:32.543906 15038 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 3: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:32.543906 15546 rpcz_store.cc:276] 0709 13:05:31.248723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.251578 (+  2855us) service_pool.cc:224] Handling call
0709 13:05:32.532533 (+1280955us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b540068e554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:32.532645 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266884992}
I20260709 13:05:32.485203 17033 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 13:05:32.526790 17193 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:32.499169 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.521003 14968 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:32.557500 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:32.559305 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60224.3us
I20260709 13:05:32.557552 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.565120 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.553020 16676 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:05:32.526273 17060 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 13:05:32.573046 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:32.570583 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.577160 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.581012 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.559960 17169 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.584069 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.570765 16905 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:32.571271 16723 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.544983 17085 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.571004 17181 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:32.586515 17191 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:32.586282 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:32.600028 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:32.584995 17167 raft_consensus.cc:2764] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:32.588454 16905 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.586212 16719 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:32.607578 14886 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 257) took 2225 ms (client timeout 1565 ms). Trace:
I20260709 13:05:32.603734 17045 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:32.611753 16905 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:32.612006 17045 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.612584 17045 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:32.619042 16905 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.621424 16905 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.621322 17045 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.622958 16825 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.627133 15037 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:32.627231 17082 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:32.609668 14886 rpcz_store.cc:269] 0709 13:05:30.379000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.379160 (+   160us) service_pool.cc:224] Handling call
0709 13:05:32.601299 (+2222139us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000f7b54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:32.604260 (+  2961us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2363941120}
I20260709 13:05:32.642169 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:32.643918 17082 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.644687 16882 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:32.645058 16882 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:32.646006 17082 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.631357 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 293) took 1168 ms. Trace:
I20260709 13:05:32.648209 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:32.649179 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.628033 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1446) took 1189 ms. Trace:
I20260709 13:05:32.650666 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:32.651371 14966 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:32.653291 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.654059 16645 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.654137 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-37a7135d72784bd590fd05aeda0ea3b6 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:05:32.654562 16951 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.655233 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-37a7135d72784bd590fd05aeda0ea3b6 on tablet 37a7135d72784bd590fd05aeda0ea3b6 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:32.657037 14968 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:05:32.648082 15035 rpcz_store.cc:276] 0709 13:05:31.463070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.561039 (+ 97969us) service_pool.cc:224] Handling call
0709 13:05:32.631141 (+1070102us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540014bed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:32.631282 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":591573760}
I20260709 13:05:32.658797 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:32.660786 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.661580 15035 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.655534 16951 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.664656 16951 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:32.665366 17085 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:32.673988 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:32.677462 17128 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:32.677469 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.687469 14961 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:32.687770 17056 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:32.656538 17191 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:32.693722 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:32.761484 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67856us
I20260709 13:05:32.762738 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:32.693837 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 395) took 1823 ms. Trace:
I20260709 13:05:32.695241 16906 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:32.696425 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:32.649709 15036 rpcz_store.cc:276] 0709 13:05:31.438986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.584806 (+145820us) service_pool.cc:224] Handling call
0709 13:05:31.598798 (+ 13992us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.338453 (+739655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.627720 (+289267us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b540014cdd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:32.627923 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1699131648}
I20260709 13:05:32.645850 16882 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:32.747514 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 368733us
I20260709 13:05:32.767879 14893 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:32.783510 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:32.749912 17167 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.763672 14963 rpcz_store.cc:276] 0709 13:05:30.870444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.879120 (+  8676us) service_pool.cc:224] Handling call
0709 13:05:30.879368 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:31.019127 (+139759us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:31.134441 (+115314us) log.cc:844] Serialized 14 byte log entry
0709 13:05:31.231752 (+ 97311us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:31.231819 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:31.231880 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.693507 (+1461627us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b540031bd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:32.693572 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:32.693741 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16139,"prepare.queue_time_us":114846,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":40,"raft.queue_time_us":19768,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":5823,"spinlock_wait_cycles":305962240,"thread_start_us":195711,"threads_started":2,"wal-append.queue_time_us":133482,"wal-append.run_cpu_time_us":1093,"wal-append.run_wall_time_us":1019454}
I20260709 13:05:32.790766 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:32.760193 17056 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:32.774365 15035 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:32.784387 17174 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:32.767051 17168 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.781173 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:32.767570 16906 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:32.841624 17011 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:32.798931 17095 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:32.796252 17155 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:32.842614 17045 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.847921 17080 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:32.795083 17167 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.787663 17082 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:05:32.865576 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:32.850229 17174 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:32.801535 17121 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:32.875521 15547 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:32.856206 16882 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.844563 15542 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:32.781679 17191 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.867514 17011 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:32.868794 17080 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:32.908550 14888 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 4 index: 4. (term mismatch)
I20260709 13:05:32.910324 14888 pending_rounds.cc:85] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 3
I20260709 13:05:32.910570 14888 pending_rounds.cc:107] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:32.910795 14888 raft_consensus.cc:2889] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:32.876179 17174 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:32.915364 15043 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:32.869093 17155 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.916982 15043 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:32.921921 15043 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:32.912998 17080 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:32.911310 16640 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:32.921057 14961 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:32.938041 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 367515us
I20260709 13:05:32.940757 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:32.879498 17056 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.961805 14893 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:32.944571 16723 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:32.933856 16640 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:32.984936 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:32.985598 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 274620us
I20260709 13:05:32.986290 14893 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:32.946795 17128 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:32.989871 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:32.924484 16906 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.992147 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:33.000687 17205 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
W20260709 13:05:33.001281 17201 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:05:33.001391 17045 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:05:33.001928 17045 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:33.003091 17209 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:05:33.004885 17207 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:33.006213 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:33.006772 15041 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:33.002873 17045 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:32.944363 17011 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:32.999684 17047 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:05:33.018148 16681 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:33.022068 14891 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:33.022691 17181 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:33.025674 17095 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:33.028597 17155 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:32.982239 17056 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:33.056874 15041 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:33.062976 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.063210 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:33.029642 17200 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:05:33.065076 14968 raft_consensus.cc:2376] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4. Re-sending same reply.
I20260709 13:05:33.065999 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:33.067199 15041 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:33.067561 14968 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:33.063505 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.068682 14964 raft_consensus.cc:2410] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:05:33.070288 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 286868us
I20260709 13:05:33.031785 16906 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.072521 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:33.073479 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.073192 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.074227 14895 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:33.074589 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:33.065374 17212 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
W20260709 13:05:33.085834 14965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1314) took 2326 ms (client timeout 2041 ms). Trace:
W20260709 13:05:33.032193 17099 consensus_queue.cc:1175] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e4938453819c469599f515b22d92fe27" responder_term: 5 status { last_received { term: 4 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:05:33.150856 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61860.3us
W20260709 13:05:33.158308 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.095845 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:33.151191 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 59898us
W20260709 13:05:33.237124 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.185348 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.321568 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:33.308903 14965 rpcz_store.cc:269] 0709 13:05:30.759863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:30.760038 (+   175us) service_pool.cc:224] Handling call
0709 13:05:33.085633 (+2325595us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b540016d854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:33.085769 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323130752}
W20260709 13:05:33.169081 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.306120 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.086594 14962 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:05:33.319226 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:33.205859 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:33.290035 14968 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
W20260709 13:05:33.289701 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 85177.4us
I20260709 13:05:33.201120 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:33.324877 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 119110us
I20260709 13:05:33.325523 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:33.325810 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:33.325690 15546 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:33.327855 14964 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:33.329631 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:33.151777 17085 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.179s
W20260709 13:05:33.331061 17228 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 13:05:33.332351 16640 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:33.195370 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 547) took 1021 ms. Trace:
I20260709 13:05:33.336164 17155 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.335774 15543 rpcz_store.cc:276] 0709 13:05:32.173740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.176089 (+  2349us) service_pool.cc:224] Handling call
0709 13:05:33.195171 (+1019082us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54005f3cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:33.195291 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340178304}
I20260709 13:05:33.134785 17011 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:33.199030 17183 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.089s	user 0.006s	sys 0.000s
I20260709 13:05:33.070245 17167 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:33.341969 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:33.348814 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.350150 14966 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:33.199790 17214 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260709 13:05:33.345638 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.349134 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.134431 17081 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.134075 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.343041 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.364401 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.364912 14965 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:33.366686 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.368427 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:33.369870 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:33.372481 14889 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:33.372784 14890 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:33.373255 14890 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:33.373924 17085 consensus_queue.cc:1243] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:33.374125 14890 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.374923 17085 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:33.352201 17049 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:33.375327 17085 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:33.376269 17085 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.377393 17085 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:33.378661 16719 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.379340 16719 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:33.381009 16534 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:33.381465 16534 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:33.381822 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:33.382956 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:33.383527 15546 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:33.384176 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:33.347146 16905 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:05:33.382424 16534 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.387672 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.396754 17181 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:33.397392 17181 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:33.397528 17225 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:05:33.398270 17181 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.339253 17011 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.401533 17011 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:33.402721 17174 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.405511 17119 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:33.354632 17218 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 13:05:33.407428 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:33.408560 17119 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.409962 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.352305 17165 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:33.411293 17119 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:33.352548 17155 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.412971 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:33.413560 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84628.8us
I20260709 13:05:33.412799 14890 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.368688 14964 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:33.399510 15043 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:33.417601 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.365412 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.418490 17167 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:33.419798 14968 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:33.421247 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:33.511111 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 185627us
I20260709 13:05:33.464754 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:33.511901 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.511973 14964 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:33.512360 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:33.421391 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.482270 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:33.512737 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.516978 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.517941 14968 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:33.520967 15550 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:33.521032 15037 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:33.421864 17119 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:33.519951 16640 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 13:05:33.548535 14965 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:33.549867 14965 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:05:33.550104 16882 consensus_meta.cc:287] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.666s	user 0.010s	sys 0.004s
I20260709 13:05:33.551065 14965 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:05:33.391342 17183 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:05:33.553727 14890 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:33.392774 17047 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.557502 14965 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:33.422673 16722 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.391722 14961 raft_consensus.cc:2376] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3. Re-sending same reply.
I20260709 13:05:33.390750 17081 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.548418 17011 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:33.483443 17080 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
I20260709 13:05:33.413354 17049 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:33.557587 14964 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:33.567232 17119 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:33.553511 14895 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:33.578946 14965 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:33.580761 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.618393 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.511401 17167 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
W20260709 13:05:33.567766 16825 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:05:33.567529 16882 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:33.567945 17232 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:33.426944 17165 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:33.622651 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1580) took 2066 ms. Trace:
I20260709 13:05:33.626806 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.635193 14969 rpcz_store.cc:276] 0709 13:05:31.556529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.558896 (+  2367us) service_pool.cc:224] Handling call
0709 13:05:31.559153 (+   257us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:31.867061 (+307908us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:31.867102 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:31.884326 (+ 17224us) log.cc:844] Serialized 52 byte log entry
0709 13:05:32.000499 (+116173us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:32.028158 (+ 27659us) log.cc:844] Serialized 14 byte log entry
0709 13:05:32.043198 (+ 15040us) log.cc:844] Serialized 14 byte log entry
0709 13:05:32.043378 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:32.043459 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:33.198481 (+1155022us) spinlock_profiling.cc:243] Waited 4.96 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:33.622437 (+423956us) raft_consensus.cc:1685] finished
0709 13:05:33.622461 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.622600 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":319168,"prepare.queue_time_us":39002,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3057,"raft.queue_time_us":321329,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":257,"spinlock_wait_cycles":11401472,"thread_start_us":47857,"threads_started":1,"wal-append.queue_time_us":131654}
I20260709 13:05:33.647886 14966 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:33.622481 17046 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:33.650519 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.590982 16722 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.650725 16882 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:33.634038 16640 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:33.651165 17232 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:33.577859 17047 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.616817 17011 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.616549 17080 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.657505 15543 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:33.662660 16640 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.661661 17046 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.676666 17219 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:33.687386 16722 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:33.716030 17230 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:05:33.687696 16640 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:33.717760 17224 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:33.724180 17081 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:33.725615 17046 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:33.731572 16723 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.677090 17060 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:33.689654 17034 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.801312 17034 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.802510 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1588) took 1769 ms. Trace:
I20260709 13:05:33.676796 17155 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:05:33.804347 17155 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:33.804703 16951 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.804822 17155 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.805248 16951 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.806824 17155 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:33.807068 16951 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:33.677188 17049 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.776427 16640 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:33.814205 16640 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.816162 17060 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.817320 17080 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:33.756865 16882 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.818605 16723 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.820696 16723 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:33.802909 14970 rpcz_store.cc:276] 0709 13:05:32.033184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.082418 (+ 49234us) service_pool.cc:224] Handling call
0709 13:05:32.082677 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.094249 (+ 11572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.094277 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:32.094314 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:32.094345 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.802289 (+1707944us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54003e7954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:33.802327 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:33.802454 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26222336}
I20260709 13:05:33.734140 17174 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:33.832652 17150 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:33.834126 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1669) took 1560 ms. Trace:
I20260709 13:05:33.834596 14888 rpcz_store.cc:276] 0709 13:05:32.273244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.307476 (+ 34232us) service_pool.cc:224] Handling call
0709 13:05:32.307733 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.911189 (+603456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.833832 (+922643us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54000cd354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:33.834056 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380599680}
W20260709 13:05:33.828161 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 406769us
I20260709 13:05:33.844738 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:33.848172 17223 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.201s	user 0.003s	sys 0.001s
I20260709 13:05:33.685598 17165 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:33.855836 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:33.828510 17034 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:33.842049 17150 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:33.859539 17184 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.090480 17184 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:33.930156 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:33.856742 17167 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:34.089828 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 236552us
I20260709 13:05:34.121043 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:34.052066 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:33.881247 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.014487 15041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.833s	user 0.021s	sys 0.048s
W20260709 13:05:34.174005 15041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.992s	user 0.024s	sys 0.050s
W20260709 13:05:34.013571 16719 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.012s	sys 0.042s
W20260709 13:05:34.171383 17095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.018s	sys 0.024s
W20260709 13:05:33.977764 17241 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260709 13:05:34.212337 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91379.4us
I20260709 13:05:34.119839 17010 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.217164 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.215421 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 305) took 1628 ms. Trace:
I20260709 13:05:34.218354 15041 rpcz_store.cc:276] 0709 13:05:32.587438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.068922 (+481484us) service_pool.cc:224] Handling call
0709 13:05:33.069241 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.069911 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:33.181712 (+111801us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.214451 (+1032739us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:34.214513 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:34.215104 (+   591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.215188 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.215344 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20247,"prepare.queue_time_us":117198,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":37267,"thread_start_us":993824,"threads_started":1}
I20260709 13:05:33.977438 17061 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:34.185747 16640 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.120381 17060 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.225279 14890 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:33.978334 17182 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:34.180758 17046 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.120095 17150 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:33.892494 17034 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:34.238034 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.186228 17181 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:34.242012 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.008s	sys 0.023s
W20260709 13:05:34.216243 17095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.019s	sys 0.024s
W20260709 13:05:34.213852 16719 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.016s	sys 0.044s
I20260709 13:05:34.231089 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:34.249513 15035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.012s	sys 0.047s
I20260709 13:05:34.233446 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.234068 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.234463 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.227391 16640 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:34.242416 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.009s	sys 0.024s
I20260709 13:05:34.194110 17184 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:34.249830 15035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.012s	sys 0.047s
I20260709 13:05:34.251248 14894 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 1.
W20260709 13:05:34.262003 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 744986us
I20260709 13:05:34.241384 17046 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.225550 17010 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:34.275024 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.009s	sys 0.055s
I20260709 13:05:34.242894 17034 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:34.282954 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.009s	sys 0.055s
W20260709 13:05:34.275504 14964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.008s	sys 0.024s
W20260709 13:05:34.283610 14964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.009s	sys 0.024s
W20260709 13:05:34.275983 14965 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.010s	sys 0.023s
I20260709 13:05:34.238307 17182 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.264308 16640 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:34.284482 14965 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.010s	sys 0.023s
I20260709 13:05:34.276013 17127 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.288795 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.289734 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:34.314087 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.001s	sys 0.037s
W20260709 13:05:34.315950 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.001s	sys 0.037s
W20260709 13:05:34.304234 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.035s	sys 0.081s
W20260709 13:05:34.316561 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.005s	sys 0.038s
W20260709 13:05:34.316574 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.035s	sys 0.081s
W20260709 13:05:34.321226 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 764670us
W20260709 13:05:34.320570 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.005s	sys 0.038s
W20260709 13:05:34.322707 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 695886us
I20260709 13:05:34.317836 14890 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:05:34.332448 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:34.324698 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.339475 14969 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:34.320770 17127 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.344656 14887 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:05:34.346199 17150 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.346621 17127 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:34.347273 17127 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.347563 16719 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.348001 17127 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.348112 16719 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.348662 17081 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:05:34.349231 17243 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:05:34.350145 16719 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.350780 14965 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:34.351009 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 306) took 1591 ms. Trace:
I20260709 13:05:34.351343 17010 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.352466 17127 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.351397 15042 rpcz_store.cc:276] 0709 13:05:32.763174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.334620 (+571446us) service_pool.cc:224] Handling call
0709 13:05:33.334913 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.347396 (+ 12483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.347422 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.354507 (+  7085us) log.cc:844] Serialized 26 byte log entry
0709 13:05:33.776725 (+422218us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:33.830685 (+ 53960us) log.cc:844] Serialized 14 byte log entry
0709 13:05:33.830935 (+   250us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:33.831165 (+   230us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.350835 (+519670us) raft_consensus.cc:1685] finished
0709 13:05:34.350852 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.350959 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12060,"prepare.queue_time_us":35688,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":16852,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":11182,"thread_start_us":352214,"threads_started":1,"wal-append.queue_time_us":825246}
I20260709 13:05:34.355441 16728 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:34.356648 14967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1331) took 3223 ms (client timeout 2075 ms). Trace:
W20260709 13:05:34.357066 14967 rpcz_store.cc:269] 0709 13:05:31.133481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.228331 (+ 94850us) service_pool.cc:224] Handling call
0709 13:05:34.356469 (+3128138us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400099cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:34.356579 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1865271168}
W20260709 13:05:34.304147 17148 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.002s	sys 0.021s
W20260709 13:05:34.332087 17231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.029s	sys 0.016s
W20260709 13:05:34.361100 17148 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.704s	user 0.003s	sys 0.021s
I20260709 13:05:34.360280 17150 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.370677 16523 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
W20260709 13:05:34.377851 14968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.002s	sys 0.023s
W20260709 13:05:34.371395 17231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.030s	sys 0.016s
I20260709 13:05:34.379673 14890 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:05:34.370258 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.370162 16951 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:34.378221 14968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.002s	sys 0.023s
I20260709 13:05:34.378042 17061 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:34.404213 14934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.000s	sys 0.051s
W20260709 13:05:34.404702 14934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.000s	sys 0.051s
I20260709 13:05:34.386492 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.376538 17219 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:05:34.376368 17150 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.423017 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.424234 15041 raft_consensus.cc:2393] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 2: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:34.390727 14961 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:34.392658 17247 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.389161 16951 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.437166 17010 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.437896 17081 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:34.437856 17010 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.438450 17081 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:34.439194 17150 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.439313 17081 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.440323 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1604) took 1117 ms. Trace:
I20260709 13:05:34.432157 17246 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:34.442167 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 419) took 1355 ms. Trace:
I20260709 13:05:34.425983 14889 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:34.441793 17246 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.443657 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:34.444259 14889 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:34.445019 17246 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.445695 17249 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.446219 17249 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.437166 17261 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:05:34.449121 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.449704 14963 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
W20260709 13:05:34.450143 14963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1347) took 1376 ms (client timeout 1516 ms). Trace:
I20260709 13:05:34.450628 17254 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.426163 14887 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:34.452813 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.453183 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 583) took 1073 ms. Trace:
I20260709 13:05:34.454030 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.454324 17182 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.440675 14964 rpcz_store.cc:276] 0709 13:05:33.323289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.617023 (+293734us) service_pool.cc:224] Handling call
0709 13:05:33.622142 (+  5119us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:33.625212 (+  3070us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.625254 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:33.634884 (+  9630us) log.cc:844] Serialized 52 byte log entry
0709 13:05:34.284070 (+649186us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:34.327354 (+ 43284us) log.cc:844] Serialized 14 byte log entry
0709 13:05:34.338779 (+ 11425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.338870 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.440100 (+101230us) raft_consensus.cc:1685] finished
0709 13:05:34.440121 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.440267 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11024,"prepare.queue_time_us":43296,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":54361,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":3124,"spinlock_wait_cycles":65024,"thread_start_us":600599,"threads_started":1,"wal-append.queue_time_us":745756}
W20260709 13:05:34.437354 17255 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:05:34.448344 17249 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.442555 14968 rpcz_store.cc:276] 0709 13:05:33.086540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.528572 (+442032us) service_pool.cc:224] Handling call
0709 13:05:33.528966 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.533710 (+  4744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.533754 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.840410 (+306656us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b2c00010828. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:05:33.840806 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.394210 (+553404us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:34.394266 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.394354 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.441915 (+ 47561us) raft_consensus.cc:1685] finished
0709 13:05:34.441934 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.442114 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":52688768,"thread_start_us":553084,"threads_started":1,"wal-append.queue_time_us":599184}
I20260709 13:05:34.477680 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:34.450490 14963 rpcz_store.cc:269] 0709 13:05:33.074175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.076790 (+  2615us) service_pool.cc:224] Handling call
0709 13:05:34.448970 (+1372180us) spinlock_profiling.cc:243] Waited 57.1 ms on lock 0x7b5800003098. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:34.450096 (+  1126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":131349888}
I20260709 13:05:34.457669 14964 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:34.458356 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.464525 15040 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:34.481658 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.482678 14964 raft_consensus.cc:2410] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 13:05:34.410117 17049 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.014s	sys 0.014s
I20260709 13:05:34.455199 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:34.465080 17119 consensus_meta.cc:287] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.844s	user 0.001s	sys 0.012s
I20260709 13:05:34.455263 16640 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.487897 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.488485 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.456041 17046 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:34.493358 14963 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:34.485693 17049 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.015s	sys 0.014s
I20260709 13:05:34.453598 15543 rpcz_store.cc:276] 0709 13:05:33.380102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.415357 (+ 35255us) service_pool.cc:224] Handling call
0709 13:05:33.567139 (+151782us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.682353 (+115214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.452931 (+770578us) spinlock_profiling.cc:243] Waited 76.3 ms on lock 0x7b54005546d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:34.453121 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175469440}
I20260709 13:05:34.492287 15043 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:34.498477 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:34.451148 17254 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.489790 17249 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:34.499692 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:34.493201 15037 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:34.549697 15549 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:34.565676 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:34.565397 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:34.549746 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet 73ceb2cea7314e0cadb64aa9ccbad8de: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:34.566531 15037 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:34.567291 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:34.568609 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 397) took 3694 ms. Trace:
I20260709 13:05:34.568848 16523 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:34.569356 16523 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:34.569149 14962 rpcz_store.cc:276] 0709 13:05:30.874271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.075394 (+201123us) service_pool.cc:224] Handling call
0709 13:05:33.086367 (+2010973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.324236 (+237869us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.568362 (+1244126us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b540016d850. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:34.568519 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4623707520}
I20260709 13:05:34.492199 17250 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.569914 16523 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:34.571246 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:34.571481 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1461) took 1920 ms. Trace:
I20260709 13:05:34.586341 15035 rpcz_store.cc:276] 0709 13:05:32.651596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.326757 (+675161us) service_pool.cc:224] Handling call
0709 13:05:33.327038 (+   281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:33.353685 (+ 26647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:33.353769 (+    84us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:33.355818 (+  2049us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.263891 (+908073us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:34.263928 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.263990 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:34.571276 (+307286us) raft_consensus.cc:1685] finished
0709 13:05:34.571292 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:34.571427 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25657,"raft.queue_time_us":26151,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12193,"thread_start_us":775141,"threads_started":1,"wal-append.queue_time_us":828834}
I20260709 13:05:34.589246 15035 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:34.591048 15035 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:34.571282 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 238898us
I20260709 13:05:34.494890 17119 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:34.492600 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:34.580557 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:34.592381 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:34.492339 17099 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:34.486265 17150 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 13:05:34.549510 16640 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.600818 15043 raft_consensus.cc:606] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:34.495535 14887 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:34.499660 17061 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:34.563903 17249 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:34.599534 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.007s	sys 0.033s
I20260709 13:05:34.565115 17034 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:34.595830 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 588) took 1214 ms. Trace:
I20260709 13:05:34.627476 15546 rpcz_store.cc:276] 0709 13:05:33.381360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.384017 (+  2657us) service_pool.cc:224] Handling call
0709 13:05:34.571127 (+1187110us) spinlock_profiling.cc:243] Waited 5.26 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:34.595753 (+ 24626us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12098304}
I20260709 13:05:34.625594 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.634406 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.634990 17256 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.483150 17247 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.492444 17102 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:05:34.616140 17103 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.579977 17237 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.617069 14933 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:34.624809 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.595172 17046 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 13:05:34.605978 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.635774 17256 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.643736 17049 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:34.643951 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:34.629235 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:34.626250 17249 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:34.650578 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.651767 14963 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:34.684957 14963 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:34.613343 17010 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:34.689085 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.644290 17261 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.644778 17034 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:34.626619 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.007s	sys 0.033s
I20260709 13:05:34.660810 15546 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:34.616956 17119 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:34.624632 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:34.697538 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.612959 17099 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.595539 17250 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.709607 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:34.716619 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:34.660842 17150 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:34.617219 16640 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.626175 17061 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.646745 17246 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:05:34.653030 17045 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:05:34.718922 17119 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.649071 17258 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:05:34.681931 17231 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:05:34.654309 17103 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:34.752698 17259 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:05:34.752748 17103 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.746446 17099 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.692178 17049 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.748083 17250 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.756377 17250 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:34.711374 17261 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.717293 17034 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.749740 17095 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:34.719135 17150 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:34.659907 17237 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.766511 17246 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:34.767051 17246 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:34.767513 17247 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.768034 17246 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.769532 17246 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:34.770246 17261 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.754571 17254 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.764161 17150 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:34.800431 17249 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.803028 17249 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:34.877249 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.635051 14887 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:34.891005 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:34.893208 14889 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:34.893924 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:34.895376 14891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.062s	sys 0.046s
W20260709 13:05:34.901978 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.903441 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.613729 14961 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:34.686098 14963 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:34.917557 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 427836us
I20260709 13:05:34.918089 14963 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:34.703290 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:34.920264 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:34.920789 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:34.925351 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.926373 15043 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:34.930027 16523 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.920531 15035 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:34.933302 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.933729 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:34.754287 16951 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.934368 15035 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:34.940346 16951 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.941237 16951 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:34.944159 16951 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.944538 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:34.947475 17049 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:34.948777 17034 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:34.949033 17219 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:34.974843 17247 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:34.976114 17247 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.978593 17034 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.979565 17034 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.979950 17046 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:34.981308 17046 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.982227 17034 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.948486 17049 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.000056 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:34.974592 17061 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:34.981139 17237 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.017073 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.021129 17270 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.022022 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.020912 17049 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:34.974519 17256 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:35.035673 14966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1361) took 1944 ms (client timeout 2162 ms). Trace:
I20260709 13:05:35.037400 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:35.035706 17034 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:35.048244 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 95072.2us
W20260709 13:05:35.049752 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 397919us
I20260709 13:05:35.062924 17034 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.066524 17034 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.067464 17261 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:35.068343 17261 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.070806 17261 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.071892 15043 raft_consensus.cc:2410] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:35.073159 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.074150 15043 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:35.075970 15038 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:35.077304 17049 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.076002 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:35.078482 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2079) took 2707 ms. Trace:
W20260709 13:05:35.068558 15044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 280) took 3677 ms (client timeout 2289 ms). Trace:
I20260709 13:05:35.078953 15038 rpcz_store.cc:276] 0709 13:05:32.371385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.559677 (+188292us) service_pool.cc:224] Handling call
0709 13:05:35.075237 (+2515560us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.076526 (+  1289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.078215 (+  1689us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b540014b4d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.078396 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5783414528}
W20260709 13:05:35.084285 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 449254us
I20260709 13:05:35.084594 15041 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:35.084896 17278 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:35.090001 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 560) took 1877 ms. Trace:
I20260709 13:05:35.090411 15550 rpcz_store.cc:276] 0709 13:05:33.212521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.299542 (+ 87021us) service_pool.cc:224] Handling call
0709 13:05:33.299894 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:33.552544 (+252650us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.089481 (+1536937us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400501754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:35.089803 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":507945216}
I20260709 13:05:35.092178 17254 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.093156 17254 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.096588 17046 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.100224 17278 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.100513 17282 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.100718 17278 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:35.050627 16640 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.075066 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.022256 17270 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.106766 17249 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.062767 17267 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.105746 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:35.106312 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.107245 17249 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:35.080471 15044 rpcz_store.cc:269] 0709 13:05:31.391195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.436373 (+ 45178us) service_pool.cc:224] Handling call
0709 13:05:35.067988 (+3631615us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540014b4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.068318 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310621568}
I20260709 13:05:35.116823 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.108747 17258 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:35.111169 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:35.115777 17249 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.112787 17267 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.125959 17267 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.110150 17270 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:35.045665 14966 rpcz_store.cc:269] 0709 13:05:33.090707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.369607 (+278900us) service_pool.cc:224] Handling call
0709 13:05:35.035120 (+1665513us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400109ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.035456 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581149568}
I20260709 13:05:35.117628 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 483) took 4080 ms. Trace:
I20260709 13:05:35.123734 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.075052 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:35.132967 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.136061 16719 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.136752 16719 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.137313 14892 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:35.139951 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.130517 15547 rpcz_store.cc:276] 0709 13:05:31.006892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.007049 (+   157us) service_pool.cc:224] Handling call
0709 13:05:31.685359 (+678310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:32.878088 (+1192729us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.085446 (+2207358us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54006509d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:35.086626 (+  1180us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54006509d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.086873 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4259540992}
I20260709 13:05:35.145903 15043 raft_consensus.cc:606] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:35.126745 17258 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.152225 17159 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:35.152889 17258 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.153462 17258 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:35.153795 17258 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:35.154856 17258 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.163810 14891 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:35.164368 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.164815 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.165102 15043 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:35.165573 14891 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:35.166460 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.124850 17247 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.129335 17237 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.176178 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.177307 15042 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:35.178666 17011 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.180500 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.181697 15035 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:35.182703 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:35.183833 14887 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:35.101230 17282 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.150751 16719 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.193150 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:35.185861 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48723.9us
W20260709 13:05:35.205812 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.206398 17237 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.206878 17272 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:35.208557 17272 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:35.210054 17246 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.209929 17272 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.210726 17246 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:35.202896 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.004s	sys 0.006s
W20260709 13:05:35.200484 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 449252us
I20260709 13:05:35.227888 17250 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:35.203541 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59380.7us
I20260709 13:05:35.232861 17173 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:35.233385 14891 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:35.230237 17270 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:05:35.242543 17270 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:35.243007 17270 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:35.255908 17261 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.256831 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.256656 17261 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.258435 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.259783 17261 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.260615 17237 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.261425 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:35.204420 17254 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.251224 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:35.267519 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:35.247225 15043 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:35.282418 15040 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.246421 17047 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.244400 17270 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.285542 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.293139 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.279104 17237 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:35.276912 16719 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:35.297681 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 52030us
I20260709 13:05:35.288731 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.289676 17254 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.300379 17146 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:35.313978 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 564) took 1684 ms. Trace:
I20260709 13:05:35.304821 17282 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.322285 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:35.323686 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.328965 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59059.1us
I20260709 13:05:35.307988 17249 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.333775 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.334791 14970 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:35.335492 17289 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.332474 16719 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.317087 17146 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:35.335340 17291 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:05:35.352315 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.336364 17292 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:05:35.355916 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.355377 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 94212.5us
I20260709 13:05:35.352944 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:35.347728 17150 consensus_meta.cc:287] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.509s	user 0.003s	sys 0.018s
I20260709 13:05:35.344063 17246 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:35.356686 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 764260us
I20260709 13:05:35.363529 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.364202 17146 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.365351 17056 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.365630 17146 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:35.365931 17056 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:35.366557 17056 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.331535 17237 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.336326 17289 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.374055 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.376070 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:35.376885 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.377425 14892 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:35.377560 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:35.383922 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.385005 14889 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:35.385989 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.386792 14889 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
W20260709 13:05:35.387710 17203 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 2.504s	user 0.009s	sys 0.000s
I20260709 13:05:35.388579 17237 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.376595 17150 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:35.389024 17302 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.114s	user 0.002s	sys 0.000s
I20260709 13:05:35.384115 14968 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:35.370069 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:35.394061 15040 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:35.367045 17270 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.400157 15038 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
W20260709 13:05:35.403569 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49134.9us
I20260709 13:05:35.601851 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:35.532181 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46754.4us
W20260709 13:05:35.446923 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.414059 15042 raft_consensus.cc:606] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:35.318086 15548 rpcz_store.cc:276] 0709 13:05:33.546684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.363474 (+816790us) service_pool.cc:224] Handling call
0709 13:05:34.363773 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.363995 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:34.645162 (+281167us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.171243 (+526081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.175382 (+  4139us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:35.191928 (+ 16546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.201052 (+  9124us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.230526 (+ 29474us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31354,"prepare.queue_time_us":436979,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":37,"raft.queue_time_us":3104,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":181,"thread_start_us":706677,"threads_started":2,"wal-append.queue_time_us":460049}
W20260709 13:05:35.472087 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.598001 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 269053us
I20260709 13:05:35.555536 14963 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:35.470388 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2164) took 1067 ms. Trace:
I20260709 13:05:35.483839 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.450002 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:35.555337 15036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1459) took 2913 ms (client timeout 2329 ms). Trace:
W20260709 13:05:35.424834 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 87200.4us
I20260709 13:05:35.476629 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:35.422309 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54472.4us
I20260709 13:05:35.422812 14859 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:35.481242 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.610404 14968 raft_consensus.cc:2410] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:35.475984 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:35.607064 15036 rpcz_store.cc:269] 0709 13:05:32.641984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.863877 (+221893us) service_pool.cc:224] Handling call
0709 13:05:35.554870 (+2690993us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540014afd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.555115 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425982848}
W20260709 13:05:35.444294 17301 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 13:05:35.470383 17287 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 13:05:35.596087 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.421402 17237 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.475826 16719 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.567273 17265 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:35.369884 17254 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.611465 15547 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:35.595849 17150 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.470748 17249 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.629799 14970 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:35.594795 17036 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.555137 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.628968 14892 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 2.
I20260709 13:05:35.606871 14886 rpcz_store.cc:276] 0709 13:05:34.335791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.342836 (+  7045us) service_pool.cc:224] Handling call
0709 13:05:34.343187 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.571467 (+228280us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.571497 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.580584 (+  9087us) log.cc:844] Serialized 26 byte log entry
0709 13:05:35.131236 (+550652us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:35.149136 (+ 17900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.158976 (+  9840us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.383184 (+224208us) raft_consensus.cc:1685] finished
0709 13:05:35.383212 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.403206 (+ 19994us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":42978,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3347,"thread_start_us":677887,"threads_started":2,"wal-append.queue_time_us":539336}
I20260709 13:05:35.422541 17246 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.477406 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:35.632468 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.622284 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:35.592826 17289 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.635746 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:35.594305 17267 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.639890 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2174) took 1191 ms. Trace:
W20260709 13:05:35.641185 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 218585us
I20260709 13:05:35.632279 17306 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.632475 17305 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.624153 17250 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 13:05:35.633570 17278 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.532s	user 0.006s	sys 0.007s
W20260709 13:05:35.649636 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2162) took 2555 ms (client timeout 1935 ms). Trace:
I20260709 13:05:35.650410 17056 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.653795 17119 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.656075 15550 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:35.658265 17150 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.686543 15041 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:05:35.658694 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 495) took 4257 ms. Trace:
W20260709 13:05:35.661763 17229 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 2.114s	user 0.006s	sys 0.006s
W20260709 13:05:35.680563 14895 rpcz_store.cc:269] 0709 13:05:33.094658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.095520 (+   862us) service_pool.cc:224] Handling call
0709 13:05:35.649312 (+2553792us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540024f4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.649449 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534245248}
I20260709 13:05:35.639339 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2165) took 1303 ms. Trace:
I20260709 13:05:35.628984 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:35.625694 17053 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.669765 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.670210 14889 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:35.626571 17265 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:35.679538 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.623986 17237 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.682862 17047 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.684043 17060 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:35.678869 17305 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.689069 14893 rpcz_store.cc:276] 0709 13:05:34.336147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.336588 (+   441us) service_pool.cc:224] Handling call
0709 13:05:34.336921 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.341827 (+  4906us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.341869 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:34.341922 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:34.341974 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.638937 (+1296963us) spinlock_profiling.cc:243] Waited 4.68 ms on lock 0x7b54000f7154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:35.639000 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.639182 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10762112}
I20260709 13:05:35.691103 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:35.694913 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 66020.7us
W20260709 13:05:35.699425 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.699430 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 81259us
I20260709 13:05:35.693305 17237 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.693188 17047 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.696111 17305 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.706378 16932 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:35.676944 14887 rpcz_store.cc:276] 0709 13:05:34.448564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.893317 (+444753us) service_pool.cc:224] Handling call
0709 13:05:35.639705 (+746388us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540020d0d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.639813 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":663782656}
I20260709 13:05:35.712049 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.685225 17278 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.713469 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.714004 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.698474 16986 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.712138 17053 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.690441 17246 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.716859 17250 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:35.719676 17238 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:35.716531 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 282) took 1263 ms. Trace:
I20260709 13:05:35.716984 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:35.720937 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 578) took 3362 ms. Trace:
I20260709 13:05:35.716626 17134 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:05:35.711385 17047 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.737635 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:35.712221 16932 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:35.720963 15039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 295) took 4257 ms (client timeout 1521 ms). Trace:
I20260709 13:05:35.721873 15037 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:35.706017 17306 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.734952 15547 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:35.714768 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.739295 15044 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:35.740208 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:35.743988 16932 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.713131 16534 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.733158 15545 rpcz_store.cc:276] 0709 13:05:32.358891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.359013 (+   122us) service_pool.cc:224] Handling call
0709 13:05:32.359239 (+   226us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:32.359584 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.359612 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:32.359915 (+   303us) log.cc:844] Serialized 26 byte log entry
0709 13:05:35.112071 (+2752156us) spinlock_profiling.cc:243] Waited 17.4 ms on lock 0x7b18004068a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:05:35.151624 (+ 39553us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:35.151679 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.151780 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.713771 (+561991us) raft_consensus.cc:1685] finished
0709 13:05:35.713793 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.720767 (+  6974us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":7262,"spinlock_wait_cycles":40018304,"thread_start_us":39189,"threads_started":1,"wal-append.queue_time_us":2935772}
W20260709 13:05:35.739250 15039 rpcz_store.cc:269] 0709 13:05:31.463608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.465323 (+  1715us) service_pool.cc:224] Handling call
0709 13:05:35.720524 (+4255201us) spinlock_profiling.cc:243] Waited 845 ms on lock 0x7b54001f36d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.720762 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1943408384}
I20260709 13:05:35.733250 14894 rpcz_store.cc:276] 0709 13:05:34.452181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.897484 (+445303us) service_pool.cc:224] Handling call
0709 13:05:34.898188 (+   704us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.898928 (+   740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.898972 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.899900 (+   928us) log.cc:844] Serialized 26 byte log entry
0709 13:05:35.045011 (+145111us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:35.045052 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.045132 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.715765 (+670633us) raft_consensus.cc:1685] finished
0709 13:05:35.715783 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.715896 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20883,"raft.queue_time_us":160475,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":50975,"spinlock_wait_cycles":25472,"thread_start_us":132665,"threads_started":1,"wal-append.queue_time_us":396824}
I20260709 13:05:35.717428 17011 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:35.704805 17150 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:35.744910 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.753894 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:35.770516 15545 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:35.762883 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.765147 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 56980.2us
W20260709 13:05:35.773123 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59698.7us
I20260709 13:05:35.716275 16986 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:35.733150 17250 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.779605 17299 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:05:35.781165 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:35.781949 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:35.747757 17220 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.784314 17041 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:35.752348 17254 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.754747 17056 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.786128 14792 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 4, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:35.688601 15541 rpcz_store.cc:276] 0709 13:05:31.401099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:31.404247 (+  3148us) service_pool.cc:224] Handling call
0709 13:05:32.135808 (+731561us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:32.136274 (+   466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:32.136310 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:34.237113 (+2100803us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b1800377bc0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a
0709 13:05:35.095160 (+858047us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b2c00047618. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:05:35.135252 (+ 40092us) log.cc:844] Serialized 52 byte log entry
0709 13:05:35.156075 (+ 20823us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:35.156626 (+   551us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.202605 (+ 45979us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.232303 (+ 29698us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.390797 (+158494us) raft_consensus.cc:1685] finished
0709 13:05:35.397738 (+  6941us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.658349 (+260611us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b5400692650. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.658504 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14595,"prepare.queue_time_us":335,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":48784,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":10319,"spinlock_wait_cycles":1646545408,"thread_start_us":20167,"threads_started":1,"wal-append.queue_time_us":127162}
I20260709 13:05:35.762638 17103 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:35.824431 17103 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:35.824249 17220 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.748159 17168 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:35.788719 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.747819 17060 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:35.789124 16523 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.823827 14792 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:35.783661 17018 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:35.830474 16534 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.831043 16534 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.830855 17018 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.832120 14792 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:35.833243 16534 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.833683 14792 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:35.834677 17060 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:35.835788 17252 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:35.836403 17252 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:35.836302 17060 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.837881 17252 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.839972 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.775913 17238 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:35.841744 17238 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.757588 15542 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:05:35.843787 15542 pending_rounds.cc:85] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 4
I20260709 13:05:35.844141 15542 pending_rounds.cc:107] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:05:35.844527 15542 raft_consensus.cc:2889] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:35.765424 17128 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:05:35.753978 17306 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.795542 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.797178 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.761749 17150 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.798823 17081 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:35.853534 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 56499.7us
I20260709 13:05:35.804224 16932 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.794744 17047 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.813545 15548 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:35.745380 17053 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.816501 15547 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:35.817175 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:35.818010 15543 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.818137 16951 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.778604 16986 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.823835 16722 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:35.828892 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.885414 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:35.829360 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47497.6us
I20260709 13:05:35.829468 17061 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:35.829993 17110 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:35.755661 17011 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:35.816802 17250 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:35.850389 17253 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.850666 14890 raft_consensus.cc:2410] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:35.851330 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:35.849973 17018 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.839365 17252 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.883867 16951 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.804014 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 585) took 2423 ms. Trace:
I20260709 13:05:35.851284 17299 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:05:35.859351 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:35.900966 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2088) took 1400 ms. Trace:
W20260709 13:05:35.864194 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.892004 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.887040 14792 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:35.891906 17110 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:35.897943 15549 rpcz_store.cc:276] 0709 13:05:33.380699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.384180 (+  3481us) service_pool.cc:224] Handling call
0709 13:05:33.384419 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:34.571276 (+1186857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.803468 (+1232192us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003c91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:35.803816 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2679230848}
I20260709 13:05:35.885972 17247 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:35.901422 15037 rpcz_store.cc:276] 0709 13:05:34.495161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.572572 (+ 77411us) service_pool.cc:224] Handling call
0709 13:05:35.721527 (+1148955us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.747476 (+ 25949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.895711 (+148235us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001f36d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:35.895865 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2641371008}
W20260709 13:05:35.903715 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 125235us
I20260709 13:05:35.888139 17061 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:35.904268 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2170) took 1506 ms. Trace:
W20260709 13:05:35.905628 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46355.2us
I20260709 13:05:35.885637 16722 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:35.888166 17306 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.906016 14890 rpcz_store.cc:276] 0709 13:05:34.394755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.395584 (+   829us) service_pool.cc:224] Handling call
0709 13:05:35.795216 (+1399632us) spinlock_profiling.cc:243] Waited 8.32 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:35.900841 (+105625us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19144960}
I20260709 13:05:35.887535 17237 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.902437 17186 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:35.912350 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.907055 16722 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:35.909575 17253 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.908217 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.912055 17011 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.916002 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.913527 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.915781 14964 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:35.914336 17182 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:35.925576 17182 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.930555 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.931636 14970 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:35.918545 14792 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 4, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 4 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:35.932443 16676 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:35.932549 17266 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:35.914031 17095 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.933382 17061 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.914213 17010 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:35.863143 17265 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.909894 17306 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:35.937579 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 86367.1us
I20260709 13:05:35.940217 17182 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.943987 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.945920 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:35.964713 14894 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.946391 17148 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.922881 17036 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:35.930485 17018 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:35.966141 17311 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.312s	user 0.003s	sys 0.000s
I20260709 13:05:35.950239 17266 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:35.983747 17095 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.912976 17247 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.939532 16676 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.997504 17095 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.998013 16676 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:35.999024 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:35.932078 17053 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:35.923080 17168 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:35.961539 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.914317 17110 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.962729 14792 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 3 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:35.966970 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.939129 15545 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:35.968350 17134 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:05:35.970402 16951 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.967939 16905 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.005738 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.005901 16905 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.972030 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.007051 16523 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:36.007495 16523 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:36.008064 16905 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.008944 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.009653 15541 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:35.973747 17119 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:36.010021 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.010246 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.011198 14961 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:36.002789 17049 raft_consensus.cc:2764] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:05:36.011474 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:35.964399 17299 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.012039 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.012765 14961 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.973512 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.974016 17018 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.013610 14887 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:36.014473 16882 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.014858 17018 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:35.973767 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57864.7us
I20260709 13:05:36.015898 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.016324 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.016970 15550 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:36.018522 17103 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:35.971657 16722 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.019860 17103 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.020990 16722 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:35.975756 17011 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:35.976198 17220 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:35.976989 17047 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.977249 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:35.977671 17061 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.978406 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.024955 14969 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:35.978667 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:35.979171 17263 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.352s	user 0.005s	sys 0.000s
I20260709 13:05:35.976293 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:35.979825 14966 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:35.980155 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 557) took 3437 ms. Trace:
I20260709 13:05:35.974047 17148 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.981891 16932 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:35.967887 17147 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:35.984932 17237 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.027726 14967 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:35.994014 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.996061 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:36.002132 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.040426 17147 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:35.972848 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:35.976305 15543 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:36.016902 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:35.974287 14970 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:36.022398 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.048075 15547 raft_consensus.cc:2368] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:35.975389 17306 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.012074 14968 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.023123 14894 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:35.999086 17266 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.049817 14890 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.050175 17266 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.051187 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:36.055770 17018 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.056167 17018 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.056528 17018 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.059932 17267 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:36.060307 17119 raft_consensus.cc:2764] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:05:36.060909 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.061899 14886 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:36.062932 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.040519 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1686) took 1821 ms. Trace:
I20260709 13:05:36.038791 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:35.977591 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 562) took 2488 ms. Trace:
I20260709 13:05:35.915495 17186 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.043289 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.081136 14887 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.044386 15546 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:36.025669 17246 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:36.042593 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48651.8us
I20260709 13:05:36.033383 14792 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.063428 17272 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.065366 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.065552 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.049870 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.066679 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.070978 14892 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:36.031792 15542 rpcz_store.cc:276] 0709 13:05:32.542418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:32.915016 (+372598us) service_pool.cc:224] Handling call
0709 13:05:32.932491 (+ 17475us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.845255 (+2912764us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.979856 (+134601us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b54004efcd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:35.980074 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6491712384}
I20260709 13:05:36.088533 14964 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:36.072916 15545 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:36.073362 17148 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.073751 17299 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:36.104411 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:36.104970 15040 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:35.999711 17053 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.027251 17181 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.111215 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.111581 17181 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:36.112092 17181 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.112491 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.114048 14964 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:36.073539 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.115368 14964 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:36.117525 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1612) took 1660 ms. Trace:
W20260709 13:05:36.023648 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 114496us
I20260709 13:05:36.087939 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:36.089638 15547 raft_consensus.cc:2410] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:36.092926 17147 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:36.093278 17317 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:05:36.093658 17267 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.094182 17107 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.028502 17305 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.095806 17041 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:36.097390 17186 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.097990 16523 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.098941 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.028789 16986 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.100297 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.100569 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.102156 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.102910 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.102995 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.103711 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.104993 14962 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:36.076232 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:36.106541 14890 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
W20260709 13:05:36.045457 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44463us
I20260709 13:05:36.137501 15038 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:36.107892 14968 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:36.043449 17220 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.085716 14889 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 6. Ops: []
I20260709 13:05:36.071241 16882 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.110688 15545 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:36.121644 17056 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:36.119429 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 114957us
I20260709 13:05:36.122902 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:36.122596 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 74070.8us
I20260709 13:05:36.154134 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.121129 14963 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:36.126397 14967 rpcz_store.cc:276] 0709 13:05:34.457034 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.458094 (+  1060us) service_pool.cc:224] Handling call
0709 13:05:36.117359 (+1659265us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54001973d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:36.117471 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3555948288}
I20260709 13:05:36.115624 14886 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:36.130789 14887 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:36.132256 15040 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:36.131727 14933 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.079906 14888 rpcz_store.cc:276] 0709 13:05:34.218609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:34.218789 (+   180us) service_pool.cc:224] Handling call
0709 13:05:34.219201 (+   412us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:34.219635 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:34.219673 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:34.220242 (+   569us) log.cc:844] Serialized 26 byte log entry
0709 13:05:34.430425 (+210183us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:34.430482 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:34.430594 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:35.978448 (+1547854us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:36.032326 (+ 53878us) raft_consensus.cc:1685] finished
0709 13:05:36.032346 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:36.040334 (+  7988us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17050,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":17757440,"thread_start_us":209810,"threads_started":1,"wal-append.queue_time_us":374287}
W20260709 13:05:36.143203 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55343.3us
I20260709 13:05:36.142633 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.148273 16523 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.148372 16986 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.148901 17305 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.118677 17278 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.150491 15546 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:36.154636 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:36.132221 17041 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:36.139830 17107 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.167999 14968 pending_rounds.cc:85] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 6
I20260709 13:05:36.173713 14968 pending_rounds.cc:107] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:05:36.174162 14968 raft_consensus.cc:2889] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.173697 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:36.167779 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91640.7us
I20260709 13:05:36.172956 14893 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:36.176479 14894 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:36.150846 17056 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.178814 14887 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:36.177217 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:36.136075 17018 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.122706 17181 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.193632 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:36.169670 16932 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:36.178175 14792 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.175906 17186 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.198438 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.201779 14963 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:36.196930 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.177852 17110 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.213106 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.142778 17299 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.207572 17114 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.208153 16986 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.216046 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.216429 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.217094 14861 leader_election.cc:400] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:36.216958 15547 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:36.217383 14861 leader_election.cc:403] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:36.204025 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:36.202723 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.174708 17061 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.192860 17056 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.199021 17244 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.226120 17244 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.164213 17267 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.218238 17110 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.229044 17267 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:36.229288 17110 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.231098 16723 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:05:36.217918 16932 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:36.232885 16932 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.195771 17278 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:36.235688 17278 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:36.235864 14967 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:36.236640 17278 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.237829 17250 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.222111 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.222874 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 320) took 1097 ms. Trace:
I20260709 13:05:36.239686 15044 rpcz_store.cc:276] 0709 13:05:35.125471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.125607 (+   136us) service_pool.cc:224] Handling call
0709 13:05:35.126325 (+   718us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:35.747911 (+621586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.222637 (+474726us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54003331d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:36.222818 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1409064192}
I20260709 13:05:36.240867 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.241809 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.241897 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:36.243254 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46367.6us
I20260709 13:05:36.243635 17306 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:36.223141 17127 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.244993 17127 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.245496 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:36.246394 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:36.205281 16882 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:05:36.204924 17095 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:05:36.214419 17186 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.247853 17146 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.248050 17186 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.247525 17110 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.248299 17146 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.248725 17146 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:36.223719 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.219080 17119 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.247586 17081 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:36.169965 17011 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 13:05:36.251451 17081 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:36.250984 17119 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.253552 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.219300 17041 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.247145 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:36.252470 17081 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.247117 17127 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.260535 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:36.260897 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 82024.9us
I20260709 13:05:36.245536 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.261636 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.204815 17238 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.262938 17270 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.216619 16986 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.263450 17018 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.263551 17128 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:36.276854 16723 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.277359 16723 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.277777 16723 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.277807 17253 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.264999 17107 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.265892 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:36.279852 15036 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.279800 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.281621 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.283049 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.266719 17168 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:36.267903 14890 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:36.268481 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.286118 14892 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:36.285037 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.268638 17181 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.268996 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.269495 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.270202 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.271682 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:36.272230 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51639.6us
I20260709 13:05:36.274292 16986 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.270321 16905 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.294490 16905 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.274268 17147 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:36.295576 17114 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:36.295795 17147 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:36.296322 17306 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:36.291256 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:36.287433 14792 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.288829 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.298534 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:36.304042 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 107573us
I20260709 13:05:36.283594 17168 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.283737 14887 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:36.307191 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:36.308102 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62628.5us
I20260709 13:05:36.271059 17238 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.311503 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.311503 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:36.312026 17127 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:36.314630 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:36.324561 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.320545 14962 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:36.327580 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.327724 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.296720 17306 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.330032 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.285395 17119 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.327298 17047 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:36.334658 17114 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:36.335085 17320 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.224s	user 0.004s	sys 0.000s
I20260709 13:05:36.339524 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.339851 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:36.339635 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.272522 17061 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:36.341888 17321 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:05:36.325062 17238 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.343976 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:36.327064 17252 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:36.344063 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.086411 15544 rpcz_store.cc:276] 0709 13:05:33.443886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:33.479375 (+ 35489us) service_pool.cc:224] Handling call
0709 13:05:35.723141 (+2243766us) spinlock_profiling.cc:243] Waited 8.52 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:35.723460 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:35.723879 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:35.724217 (+   338us) log.cc:844] Serialized 14 byte log entry
0709 13:05:35.909220 (+185003us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:35.910748 (+  1528us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:35.918564 (+  7816us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:35.921539 (+  2975us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:35.931818 (+ 10279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8738,"prepare.queue_time_us":1510,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":10126,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5211,"spinlock_wait_cycles":19591424,"thread_start_us":171206,"threads_started":1,"wal-append.queue_time_us":214234}
I20260709 13:05:36.384538 14792 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:36.377317 17114 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.345475 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.391906 17114 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.392058 14792 catalog_manager.cc:5697] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.392760 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.393586 15037 raft_consensus.cc:2410] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:36.346020 17306 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.346297 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.348359 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:36.395555 14892 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:36.350245 17053 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.296718 17147 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.352479 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.355702 17110 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:36.356298 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.359979 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.361253 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.362521 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.362917 17270 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.363241 15542 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:36.363615 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.417755 14887 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:36.408951 14891 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:36.364745 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.365857 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:36.368247 15036 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
W20260709 13:05:36.374320 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44588.7us
I20260709 13:05:36.321616 17041 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:36.382637 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58171.3us
I20260709 13:05:36.382581 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.384352 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:36.389330 15041 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.397091 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:36.426885 15547 raft_consensus.cc:2410] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:05:36.426977 15042 raft_consensus.cc:606] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:36.427614 15042 raft_consensus.cc:614] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:05:36.396013 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47711.3us
I20260709 13:05:36.350477 14961 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:36.339210 16986 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.393659 14792 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.386379 17061 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.422925 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.424183 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.408689 15039 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:36.433415 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.435546 17103 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:36.435927 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:36.401371 16676 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:36.443579 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.377077 17056 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:36.484326 17326 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 13:05:36.377429 17146 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.449978 15040 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:36.450968 17167 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:36.451957 15039 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:36.445426 14792 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.459529 17174 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:05:36.460319 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:36.489274 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53402.8us
I20260709 13:05:36.489681 14887 raft_consensus.cc:2410] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:05:36.460675 16723 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.460903 16986 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.447974 17246 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:05:36.461627 15038 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:36.462703 15037 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:36.455219 15035 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:36.475438 16676 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.476770 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.467056 17186 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.478806 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.404472 17252 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:36.479954 17287 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:05:36.480899 14895 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:36.482115 17220 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.481894 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.446422 17253 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.442745 14888 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:36.491609 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.489122 17167 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:36.497879 14892 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:36.477751 15041 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
W20260709 13:05:36.498932 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49687.5us
I20260709 13:05:36.511065 15043 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:05:36.499788 14893 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.500195 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:36.498023 16676 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.496747 16722 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:36.501178 17246 consensus_queue.cc:1243] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:36.527464 15545 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:36.523151 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:36.527722 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45946.5us
I20260709 13:05:36.525689 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.526549 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.534548 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:36.496927 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 169341us
I20260709 13:05:36.534044 15035 raft_consensus.cc:606] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:36.535394 14892 raft_consensus.cc:2410] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:05:36.536176 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.537299 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.538049 14888 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:36.539726 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:36.541029 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.540815 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.542052 15035 raft_consensus.cc:614] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:36.540853 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.543495 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.549319 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 3, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:36.519644 16722 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.551749 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.524192 16723 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:36.556766 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.560081 14966 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:36.515390 17252 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.526189 17056 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:36.534808 17305 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.575091 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.581997 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.584203 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:36.554680 17237 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:36.548420 17148 raft_consensus.cc:2764] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:36.592739 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.593706 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:36.559509 16722 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:36.584968 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.578574 17081 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:36.582571 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:36.516505 17114 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.517827 17238 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.601723 17146 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:36.603045 17238 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.584203 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:36.607620 14893 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:36.576810 17060 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:36.590866 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.595222 16888 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:36.591569 17252 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:36.599736 14792 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.527127 17167 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.608336 14886 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:36.619585 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.589509 17237 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.623718 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.624619 14968 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:36.607712 17056 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:36.629448 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:36.637059 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:36.612946 17252 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.638437 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.643728 14968 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:36.618207 17107 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.640637 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.627067 17237 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.635205 14792 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 6, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.651062 17344 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:36.651636 17344 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.652082 17344 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:36.652230 14967 pending_rounds.cc:85] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 5
I20260709 13:05:36.652766 14967 pending_rounds.cc:107] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:05:36.653069 14967 raft_consensus.cc:2889] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:36.619132 17238 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:05:36.632858 17056 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:36.614006 17081 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:36.655728 14792 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:36.658242 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.663141 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.639593 17148 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:36.666013 14889 raft_consensus.cc:2410] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:36.666446 14966 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:36.667357 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:36.633594 17146 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:05:36.727857 14792 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:36.727948 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.646500 17252 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.665256 17056 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:36.636313 17168 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:36.725805 14970 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:36.728183 14886 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:36.668427 17167 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.743148 14968 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:36.736361 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:36.768049 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 119940us
I20260709 13:05:36.760660 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.770630 14886 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.772912 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:36.744063 14792 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:05:36.756155 17341 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:05:36.740026 17342 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:05:36.787218 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.797472 14968 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:36.761600 17330 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 13:05:36.796087 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.799022 14887 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.795953 16676 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.800206 17250 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.801487 16676 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:36.731799 17186 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.804240 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:36.763712 17253 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:36.762040 17114 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.752552 17168 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.816841 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:36.821229 14792 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:36.823427 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:36.824077 14965 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:36.825690 17060 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:36.828408 17107 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:36.852501 14887 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:36.860417 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.377094 14970 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:36.779155 17306 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.374572 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1651) took 1068 ms. Trace:
I20260709 13:05:36.863745 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.380049 14963 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.377405 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:36.896817 14968 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:37.380972 14887 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:37.381434 14969 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:36.928709 14886 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:36.816779 16676 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:36.985618 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.048621 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.188613 14888 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.631s	user 0.009s	sys 0.000s
I20260709 13:05:37.387065 14888 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:37.375254 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 324) took 1067 ms. Trace:
I20260709 13:05:36.863591 14966 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:36.948988 14965 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:37.373884 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:37.297307 17344 consensus_meta.cc:287] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.645s	user 0.009s	sys 0.003s
I20260709 13:05:37.394371 17344 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:37.395288 17167 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.633s	user 0.002s	sys 0.008s
I20260709 13:05:37.397012 17306 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:37.397076 17344 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.397717 17348 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:37.403705 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:37.404711 14886 raft_consensus.cc:2410] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:37.405586 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:37.408839 17056 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.658s	user 0.010s	sys 0.000s
I20260709 13:05:37.409273 17056 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.391965 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:37.413657 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:37.398267 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.406239 14886 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:37.411134 14970 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
W20260709 13:05:37.029848 17337 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:05:37.413833 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1711) took 1137 ms. Trace:
I20260709 13:05:37.436890 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:37.438221 14888 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:37.033769 17250 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.378690 14962 rpcz_store.cc:276] 0709 13:05:36.306654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.372343 (+ 65689us) service_pool.cc:224] Handling call
0709 13:05:36.375401 (+  3058us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.375757 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.375783 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.382168 (+  6385us) log.cc:844] Serialized 499 byte log entry
0709 13:05:36.529820 (+147652us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:36.529856 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.529917 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.828937 (+299020us) raft_consensus.cc:1685] finished
0709 13:05:36.828959 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.374509 (+545550us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11136,"thread_start_us":145737,"threads_started":1,"wal-append.queue_time_us":271010}
I20260709 13:05:37.293519 17114 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.484408 14963 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:37.375808 17107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.010s
I20260709 13:05:36.863400 17148 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:37.436785 14892 rpcz_store.cc:276] 0709 13:05:36.276446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.536295 (+259849us) service_pool.cc:224] Handling call
0709 13:05:36.552561 (+ 16266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.590244 (+ 37683us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.590309 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.611891 (+ 21582us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.783096 (+171205us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:36.815683 (+ 32587us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.816221 (+   538us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.816341 (+   120us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.413634 (+597293us) raft_consensus.cc:1685] finished
0709 13:05:37.413655 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.413782 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15023,"prepare.queue_time_us":32024,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":19501,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":15327,"thread_start_us":140446,"threads_started":1,"wal-append.queue_time_us":642667}
I20260709 13:05:36.876230 17168 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.168686 17186 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:36.900480 17247 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:37.526531 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:37.527302 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:37.392915 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.088945 17041 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:37.387316 16676 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:37.028430 17146 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.415s
I20260709 13:05:37.545781 14888 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.546411 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2206) took 1090 ms. Trace:
I20260709 13:05:37.529652 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.388327 15037 rpcz_store.cc:276] 0709 13:05:36.307995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.502836 (+194841us) service_pool.cc:224] Handling call
0709 13:05:36.520143 (+ 17307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.520413 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.520438 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.520938 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.575330 (+ 54392us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:36.575387 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.575465 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:36.904912 (+329447us) raft_consensus.cc:1685] finished
0709 13:05:36.904941 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.375184 (+470243us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":54042,"threads_started":1,"wal-append.queue_time_us":86777}
I20260709 13:05:37.546726 14888 rpcz_store.cc:276] 0709 13:05:36.456385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.524682 (+1068297us) service_pool.cc:224] Handling call
0709 13:05:37.545614 (+ 20932us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.546176 (+   562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.546360 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:37.411216 17056 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:37.531450 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:37.532948 17041 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:36.927512 16722 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.028617 17238 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.493s
I20260709 13:05:37.540625 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.562073 14887 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:37.527251 17167 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:37.218503 17252 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.566056 16905 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:36.974279 17237 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.529865 17114 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.558380 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2211) took 1100 ms. Trace:
I20260709 13:05:37.544862 16676 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.559866 14886 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:37.513967 17265 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:37.530936 17107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.010s
W20260709 13:05:37.573014 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 173666us
I20260709 13:05:37.562229 14970 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:37.543931 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:37.532382 16723 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.021s	sys 0.018s
I20260709 13:05:37.563228 14887 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:37.576828 17358 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:37.569044 14892 rpcz_store.cc:276] 0709 13:05:36.458166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.542652 (+1084486us) service_pool.cc:224] Handling call
0709 13:05:37.557894 (+ 15242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.558056 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.558084 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.558124 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:37.558153 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.558214 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.558331 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:37.558265 17186 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.615687 14887 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.615877 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:37.618273 17041 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.618677 15548 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:37.619014 17186 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:37.532305 17060 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.011s	sys 0.001s
W20260709 13:05:37.590086 14792 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.061s	sys 0.097s
I20260709 13:05:37.571859 16905 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:36.921001 17081 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.528738 17250 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.572454 15040 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:37.550426 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.532075 17168 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.572305 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 509) took 1377 ms. Trace:
I20260709 13:05:37.524653 17348 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:37.590528 17148 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.568909 17167 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.619634 17186 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:37.633337 17114 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.633249 17186 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.624650 16905 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.612047 17107 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:37.621464 17060 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.011s	sys 0.001s
I20260709 13:05:37.628324 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:37.628253 17146 raft_consensus.cc:2764] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:37.631348 14965 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:37.631644 15545 rpcz_store.cc:276] 0709 13:05:36.191206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.195875 (+  4669us) service_pool.cc:224] Handling call
0709 13:05:37.568518 (+1372643us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54007baf54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:37.568618 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":721363712}
W20260709 13:05:37.633575 15548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 574) took 1320 ms (client timeout 1733 ms). Trace:
W20260709 13:05:37.644382 15548 rpcz_store.cc:269] 0709 13:05:36.313367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.397963 (+1084596us) service_pool.cc:224] Handling call
0709 13:05:37.633428 (+235465us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400692654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:37.633527 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467908864}
I20260709 13:05:37.633966 16722 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:37.620858 14792 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.063s	sys 0.117s
W20260709 13:05:37.614670 16723 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.021s	sys 0.018s
I20260709 13:05:37.637080 17186 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.623867 17358 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.671224 17167 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:37.673781 16905 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:37.673887 16676 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.679261 16676 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:37.682986 17358 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.665854 17348 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:37.683255 17173 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:05:37.689385 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.675207 17237 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.692250 14965 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:37.699911 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:37.700666 14892 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:37.716084 17356 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.716737 17356 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.718071 15044 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:37.691515 17252 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.720072 14892 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:37.691150 17173 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:37.723292 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:37.724007 14892 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.703971 17146 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:37.728230 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:37.692747 17353 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:37.735049 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:37.740810 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:37.742985 14892 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
W20260709 13:05:37.747133 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.747777 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.748574 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:37.751332 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:37.751992 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.752955 15541 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:37.753911 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:37.720993 17107 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.754909 17252 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.756511 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:37.757745 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:37.760028 15042 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:37.727262 16905 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:37.765555 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.767160 17173 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.768661 17173 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.768985 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:37.769752 14894 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:37.770277 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:37.772321 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:37.775096 14890 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:37.780486 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2190) took 1815 ms (client timeout 2201 ms). Trace:
W20260709 13:05:37.803212 14895 rpcz_store.cc:269] 0709 13:05:35.965122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.965256 (+   134us) service_pool.cc:224] Handling call
0709 13:05:37.780272 (+1815016us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540015a9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:37.780400 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1029923200}
I20260709 13:05:37.804955 14965 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:37.749128 17167 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:05:37.787786 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.788475 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:37.729602 17299 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:37.789100 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:37.790678 15037 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:37.790910 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.792264 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:37.794023 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.794654 14964 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:37.796186 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 70833.4us
I20260709 13:05:37.779009 14890 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:37.807164 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:37.830412 14963 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:37.808409 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:37.831744 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:37.813462 17168 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:37.813922 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:37.814437 17165 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:37.814886 17366 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.815662 16905 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:05:37.815754 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 55905.5us
I20260709 13:05:37.816344 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:37.853250 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:37.853817 14968 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.854420 15550 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:37.758984 17252 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:37.739792 17146 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.824198 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1723) took 1191 ms. Trace:
I20260709 13:05:37.825155 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:37.828955 16986 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.874666 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:37.875340 14894 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:37.838948 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:37.875998 14886 rpcz_store.cc:276] 0709 13:05:36.633274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.570851 (+937577us) service_pool.cc:224] Handling call
0709 13:05:37.588477 (+ 17626us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.588867 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.588902 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.604427 (+ 15525us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.647569 (+ 43142us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.807644 (+160075us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.818075 (+ 10431us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.823920 (+  5845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.823983 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:37.824020 (+    37us) raft_consensus.cc:1685] finished
0709 13:05:37.824031 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.824139 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15595,"raft.queue_time_us":52262,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":12464,"spinlock_wait_cycles":10572160,"thread_start_us":174896,"threads_started":2,"wal-append.queue_time_us":38046}
I20260709 13:05:37.836826 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:37.840080 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 47894.4us
I20260709 13:05:37.878800 14961 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:37.824869 14859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.556s (SENT) [suppressed 18 similar messages]
W20260709 13:05:37.879699 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48038.4us
I20260709 13:05:37.853291 15035 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:37.817456 17167 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:37.880725 16676 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:37.880750 17167 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:37.881209 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:37.881456 16676 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:37.882339 16676 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:37.878046 15545 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:37.878822 17148 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:37.882730 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:37.885293 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:37.886873 17148 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:37.887765 17148 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:37.877044 14963 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:37.888254 17148 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:37.839915 14933 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:37.891525 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54791.7us
W20260709 13:05:37.891676 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66615us
I20260709 13:05:37.875551 17134 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:05:37.894747 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54926.2us
I20260709 13:05:37.894969 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:37.820557 17265 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:05:37.845412 17250 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:37.900576 14968 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:37.897534 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:37.837944 17246 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:05:37.889756 17148 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:37.956615 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 58339.8us
I20260709 13:05:37.852723 16905 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:37.938884 14965 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:37.928879 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1721) took 1313 ms. Trace:
W20260709 13:05:37.967345 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:37.973183 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 94466.4us
W20260709 13:05:37.889052 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80422.9us
I20260709 13:05:37.890874 17371 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:37.968636 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 143771us
I20260709 13:05:37.897311 15542 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:37.894205 16986 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.852839 17165 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.880170 17252 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.974761 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.115079 17107 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.117340 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:38.089308 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1653) took 1286 ms. Trace:
I20260709 13:05:37.915477 15544 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:38.121033 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:38.117425 17107 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.122145 17278 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.981405 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:38.123901 17374 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:05:38.112612 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2201) took 1858 ms. Trace:
I20260709 13:05:38.124308 17107 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:38.126353 17355 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.714s	user 0.002s	sys 0.000s
I20260709 13:05:38.129472 15037 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:37.896510 16932 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:37.896600 17134 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:37.895823 17366 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.072626 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1655) took 1269 ms. Trace:
W20260709 13:05:37.974931 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77494.2us
I20260709 13:05:38.140184 14961 rpcz_store.cc:276] 0709 13:05:36.803308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.803579 (+   271us) service_pool.cc:224] Handling call
0709 13:05:36.830669 (+ 27090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.879225 (+1048556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.072290 (+193065us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54003093d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:38.072514 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2409906560}
W20260709 13:05:38.140622 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 245728us
I20260709 13:05:38.124526 17305 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:37.941663 15543 raft_consensus.cc:2410] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:05:38.038892 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 200620us
W20260709 13:05:38.095400 15044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1487) took 1944 ms (client timeout 2329 ms). Trace:
I20260709 13:05:37.956453 17041 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.185s
I20260709 13:05:37.899976 17114 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.247s
I20260709 13:05:37.991118 17250 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 13:05:38.212363 15548 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:38.212178 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.089592 15042 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
W20260709 13:05:38.044750 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 159526us
I20260709 13:05:38.216534 14970 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
W20260709 13:05:38.195448 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54130.2us
I20260709 13:05:37.899824 17168 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:38.041015 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1484) took 1916 ms. Trace:
I20260709 13:05:38.220633 15043 rpcz_store.cc:276] 0709 13:05:36.124828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.400497 (+275669us) service_pool.cc:224] Handling call
0709 13:05:36.510789 (+110292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.511522 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.040815 (+1529293us) spinlock_profiling.cc:243] Waited 82.2 ms on lock 0x7b540014b9d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:38.040957 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188957952}
I20260709 13:05:38.135731 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.124526 14889 rpcz_store.cc:276] 0709 13:05:36.254105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.258951 (+  4846us) service_pool.cc:224] Handling call
0709 13:05:38.112360 (+1853409us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54000da554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:38.112532 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":847575936}
I20260709 13:05:38.120889 14969 rpcz_store.cc:276] 0709 13:05:36.802723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.805213 (+  2490us) service_pool.cc:224] Handling call
0709 13:05:37.381224 (+576011us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.381947 (+   723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.074603 (+692656us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b540016dd50. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:38.089250 (+ 14647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1295331200}
I20260709 13:05:38.221819 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1486) took 2085 ms. Trace:
I20260709 13:05:38.138619 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 447) took 1495 ms. Trace:
I20260709 13:05:38.119534 17371 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:37.972637 14888 rpcz_store.cc:276] 0709 13:05:36.615196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.563264 (+948068us) service_pool.cc:224] Handling call
0709 13:05:37.571595 (+  8331us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.603565 (+ 31970us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:37.709808 (+106243us) log.cc:844] Serialized 14 byte log entry
0709 13:05:37.927087 (+217279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:37.927165 (+    78us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:37.927224 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.927312 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:37.928801 (+  1489us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":237059,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":58028,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":10592,"thread_start_us":260806,"threads_started":2,"wal-append.queue_time_us":296387}
I20260709 13:05:38.143630 14963 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:38.227389 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:38.144691 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 179206us
I20260709 13:05:37.908609 17358 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:37.957032 17081 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:37.964895 17299 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.216563 15042 pending_rounds.cc:85] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 3
W20260709 13:05:38.026257 17361 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:38.188444 15549 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.243641 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.195905 17265 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.244899 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:38.225679 17220 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.324s	user 0.024s	sys 0.026s
I20260709 13:05:38.223894 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 323) took 1916 ms. Trace:
I20260709 13:05:38.219612 17366 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.249578 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:38.219650 15044 rpcz_store.cc:269] 0709 13:05:36.144526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.290987 (+146461us) service_pool.cc:224] Handling call
0709 13:05:38.073961 (+1782974us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540014afd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:38.089115 (+ 15154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3264727424}
I20260709 13:05:37.991868 17244 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.059100 17146 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:38.230741 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 256035us
I20260709 13:05:37.991539 17238 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:38.232203 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.228085 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.233739 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.274744 17265 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.276780 17265 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:38.277590 15007 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.279062 17265 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:38.236066 15042 pending_rounds.cc:107] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:05:38.149647 17047 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:38.212914 17347 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.801s	user 0.001s	sys 0.004s
I20260709 13:05:38.279626 15042 raft_consensus.cc:2889] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:38.193128 16888 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:38.280397 17047 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.281570 17047 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.141816 17134 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.239674 17358 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.240860 16905 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.288015 17363 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:38.288441 16905 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.241626 17371 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.187737 17056 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.093s
I20260709 13:05:38.242745 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2216) took 1472 ms. Trace:
I20260709 13:05:38.222304 14967 rpcz_store.cc:276] 0709 13:05:36.643146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.643259 (+   113us) service_pool.cc:224] Handling call
0709 13:05:36.651925 (+  8666us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:36.801458 (+149533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.801518 (+    60us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:36.802605 (+  1087us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.135304 (+332699us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:37.135357 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:37.135488 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.125812 (+990324us) spinlock_profiling.cc:243] Waited 24.3 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:38.128043 (+  2231us) raft_consensus.cc:1685] finished
0709 13:05:38.128072 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.138560 (+ 10488us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93691,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"spinlock_wait_cycles":55891840,"thread_start_us":479266,"threads_started":2,"wal-append.queue_time_us":609000}
I20260709 13:05:38.195106 17384 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.145352 17278 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:37.973481 17365 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:38.145605 17305 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:38.304800 17246 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:38.304477 17305 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.305251 17246 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:38.306116 17305 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.306401 17246 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.222178 15036 rpcz_store.cc:276] 0709 13:05:36.136883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.419232 (+282349us) service_pool.cc:224] Handling call
0709 13:05:36.441764 (+ 22532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:36.446595 (+  4831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:36.446637 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:36.450491 (+  3854us) log.cc:844] Serialized 26 byte log entry
0709 13:05:36.642358 (+191867us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:36.724828 (+ 82470us) log.cc:844] Serialized 14 byte log entry
0709 13:05:36.778053 (+ 53225us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:36.778131 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.062421 (+1284290us) spinlock_profiling.cc:243] Waited 2.91 ms on lock 0x7b1800299f80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:38.091369 (+ 28948us) raft_consensus.cc:1685] finished
0709 13:05:38.095464 (+  4095us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.114960 (+ 19496us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b1800299f80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:38.221659 (+106699us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b5400187250. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:38.221769 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89693,"prepare.queue_time_us":83684,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":57728,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":15252,"spinlock_wait_cycles":73354240,"thread_start_us":178506,"threads_started":1,"wal-append.queue_time_us":339402}
I20260709 13:05:38.246672 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:38.319826 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 73228.5us
I20260709 13:05:38.319952 17244 raft_consensus.cc:2764] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:38.322629 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.247748 17364 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.247792 17081 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:38.323541 14886 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:38.324021 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.324708 14892 raft_consensus.cc:2368] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:38.324460 17081 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.324810 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.254014 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.325591 14886 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
W20260709 13:05:38.326196 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 72220.5us
I20260709 13:05:38.327440 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.146481 17147 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 13:05:38.230458 17356 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:38.255549 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.139350 16932 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:38.328476 17382 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.328677 16932 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.329202 17364 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.329751 17364 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.212191 16986 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:38.213691 17357 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:05:38.331946 17147 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:38.332331 17147 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:38.332428 17357 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:38.332835 17357 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.333153 17147 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.333626 17357 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.334329 17147 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.334770 17357 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.332414 17364 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.325553 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.273940 14891 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:38.254146 17385 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:38.336877 17385 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:38.337281 17385 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.329232 17382 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.340718 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.341938 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.341835 16932 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.294839 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:38.272691 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:38.250156 17220 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.358s	user 0.024s	sys 0.026s
I20260709 13:05:38.296484 14887 rpcz_store.cc:276] 0709 13:05:36.769943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.619458 (+849515us) service_pool.cc:224] Handling call
0709 13:05:37.619957 (+   499us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:37.666381 (+ 46424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:37.666426 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:37.669578 (+  3152us) log.cc:844] Serialized 52 byte log entry
0709 13:05:37.727377 (+ 57799us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:37.727441 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.224724 (+497283us) spinlock_profiling.cc:243] Waited 40.6 ms on lock 0x7b54000cd854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:38.224802 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:38.224865 (+    63us) raft_consensus.cc:1685] finished
0709 13:05:38.224885 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.242671 (+ 17786us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1624,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":12771,"spinlock_wait_cycles":93328128,"thread_start_us":33725,"threads_started":1,"wal-append.queue_time_us":129185}
W20260709 13:05:38.188194 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44937.3us
I20260709 13:05:38.307958 17278 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:38.290213 17250 consensus_queue.cc:1175] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "58ee9fe38eb8453098f6d964e7675e79" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
W20260709 13:05:38.311100 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.365952 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 71185.1us
I20260709 13:05:38.311621 17365 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:38.315102 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 166456us
I20260709 13:05:38.249380 15040 rpcz_store.cc:276] 0709 13:05:36.307742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.498255 (+190513us) service_pool.cc:224] Handling call
0709 13:05:36.512582 (+ 14327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:37.630252 (+1117670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.223665 (+593413us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540014bed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:38.223842 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2436903808}
I20260709 13:05:38.323585 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.342912 17382 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.255752 17344 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.263578 17041 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.293081 17265 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.384735 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.384994 17357 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:38.385351 14967 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:38.385416 17357 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.386329 17357 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.387456 17357 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.391477 17356 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:38.392207 17356 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.393424 17356 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.315613 17384 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.397924 17384 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.387344 17134 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.401592 17134 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.290537 17378 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:38.348768 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.244432 17299 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.321915 17246 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.307996 16723 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:38.408874 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:38.300037 17238 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:38.349587 15549 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:38.353567 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2202) took 2055 ms. Trace:
I20260709 13:05:38.302186 17363 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:05:38.346606 17103 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.317291 17352 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:38.308516 17360 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:38.366586 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:38.347535 17168 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:38.375289 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.414647 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.380017 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:38.415649 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.416046 14968 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
W20260709 13:05:38.381305 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 108703us
I20260709 13:05:38.371661 17220 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:38.383643 17107 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.417299 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.383858 17047 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.384076 17041 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:38.409966 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61331us
I20260709 13:05:38.409984 14893 rpcz_store.cc:276] 0709 13:05:36.297738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:36.608847 (+311109us) service_pool.cc:224] Handling call
0709 13:05:36.609175 (+   328us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:36.609402 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:36.625889 (+ 16487us) log.cc:844] Serialized 14 byte log entry
0709 13:05:38.242807 (+1616918us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b1800371140. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f553491623a 00007f5534d80a2a
0709 13:05:38.353224 (+110417us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:38.353274 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:38.353325 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:38.353391 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:38.353495 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16148,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":3155,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":6993,"spinlock_wait_cycles":16156032,"thread_start_us":107388,"threads_started":1,"wal-append.queue_time_us":1754115}
I20260709 13:05:38.375113 17253 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:38.403554 16932 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.413902 14933 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.405547 14894 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
W20260709 13:05:38.423578 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57060.5us
I20260709 13:05:38.423574 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.425730 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:38.432220 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.413167 17103 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.431710 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:38.408675 16723 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.414086 17391 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.413807 17252 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.413695 17360 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:38.422523 16905 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.439646 15547 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:38.440889 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.441620 15548 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:38.437426 17306 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:38.443091 15545 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:38.441269 15010 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eec3351a3e94e158c79a8784e2c6574. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:05:38.443956 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.383075 17365 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.447974 17238 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.449851 17173 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:38.450280 17173 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.450641 17173 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.432775 17186 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:38.434144 17056 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:38.433380 17134 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:38.430470 17392 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:38.433669 17081 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:38.439025 14936 connection.cc:256] RPC call timeout handler was delayed by -1.1700803869999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
I20260709 13:05:38.434170 17107 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.425625 17220 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.462147 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.463117 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.495260 14968 raft_consensus.cc:2368] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:38.461958 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.464535 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.432919 17352 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.466790 17348 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:38.511566 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:38.512909 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:38.513516 14970 raft_consensus.cc:2376] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4. Re-sending same reply.
I20260709 13:05:38.514472 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:38.467345 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.515547 14964 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:38.467523 17244 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.467941 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.464869 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.460457 17392 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.468379 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.457902 17396 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:38.460754 17363 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:38.470743 17103 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:38.475764 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.476498 17168 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.532968 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.533278 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.533847 14962 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:38.534027 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.534732 14969 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:38.534634 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.448024 16723 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.452939 16888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44380 (request call id 13) took 3511 ms. Trace:
I20260709 13:05:38.454743 16676 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:05:38.535898 16723 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.429162 17146 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:05:38.452661 16905 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.537634 17352 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.538012 15544 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:38.539024 16905 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.539146 17220 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.486037 17167 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.522876 17348 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.540413 17167 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.541600 17348 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.523085 17353 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:05:38.542520 17165 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.480103 17041 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.488281 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.456398 17306 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:38.543466 17382 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:38.543838 17265 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:38.544256 17265 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.545187 17306 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.489655 15543 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:05:38.545035 17265 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.546197 17265 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.546406 14967 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:38.547482 16986 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.547698 17396 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.548002 16986 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.456651 17134 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.549757 17396 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.549606 17134 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.441529 17391 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.550964 17134 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:38.490343 17360 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.454269 17186 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.551977 17391 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:38.552189 17186 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.493085 17358 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.496747 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:38.556759 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 60086.5us
I20260709 13:05:38.509451 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:38.432832 17253 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.510895 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.520464 14970 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:38.510087 17107 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.439354 17148 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.528294 14961 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:38.439544 17357 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:05:38.530911 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.522221 17392 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.484368 17299 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.552989 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.553316 15546 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.564282 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.574352 15548 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.565965 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.576145 15042 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
W20260709 13:05:38.576782 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 153244us
I20260709 13:05:38.569401 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.578377 15036 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:38.552018 17360 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.571079 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.584353 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.585004 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.570888 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:38.589495 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 216889us
I20260709 13:05:38.597188 14968 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:38.599125 14892 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:05:38.599260 14889 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:05:38.584136 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.603264 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.605266 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.605839 15040 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.606091 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.558902 17060 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.610778 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.611368 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.614847 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.620815 15548 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:38.568343 17358 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.526973 17385 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:38.607525 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 169878us
I20260709 13:05:38.627053 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.627640 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.632068 14895 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.629093 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.630316 15036 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:38.632746 14888 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:38.583783 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.634752 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.559680 17382 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:05:38.637457 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.638269 15549 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:38.640846 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.561784 17306 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:05:38.641633 15550 raft_consensus.cc:2376] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4. Re-sending same reply.
I20260709 13:05:38.644274 15044 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:38.648648 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.626505 17396 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.650612 15042 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:38.535768 16888 rpcz_store.cc:276] 0709 13:05:34.929773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:35.165700 (+235927us) service_pool.cc:224] Handling call
0709 13:05:35.347512 (+181812us) log.cc:844] Serialized 499 byte log entry
0709 13:05:35.800991 (+453479us) spinlock_profiling.cc:243] Waited 27.6 ms on lock 0x7b18003a41a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:38.440415 (+2639424us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12271,"raft.queue_time_us":37518,"raft.run_cpu_time_us":2275,"raft.run_wall_time_us":77675,"spinlock_wait_cycles":63393664,"thread_start_us":229519,"threads_started":1,"wal-append.queue_time_us":320019,"wal-append.run_cpu_time_us":2128,"wal-append.run_wall_time_us":1076124}
W20260709 13:05:38.660889 17398 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:05:38.630836 17352 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.610306 17299 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:05:38.636097 17041 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:38.633944 17358 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.668286 15545 raft_consensus.cc:2410] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:05:38.668956 17385 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.670352 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.670660 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.671540 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:38.671746 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.672900 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.675595 17384 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:38.676047 17371 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:38.676184 17250 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.623075 16986 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:38.676570 15040 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:38.666491 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:38.684151 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49480.5us
I20260709 13:05:38.624116 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.657280 14970 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:38.687479 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.689267 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:38.694599 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.696331 15035 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:38.697536 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:38.666486 17401 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
I20260709 13:05:38.631050 17278 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:05:38.760061 15550 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:38.760546 14963 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:38.761096 15036 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:38.760138 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 88677.8us
I20260709 13:05:38.761478 15039 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:38.762496 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.763651 15042 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:38.761583 14962 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:38.764231 14859 leader_election.cc:400] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:38.764526 14859 leader_election.cc:403] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:38.760617 15549 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:38.755980 14961 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:38.767040 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.767467 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.768050 15036 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 5: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:05:38.769338 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79744.3us
I20260709 13:05:38.770627 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.774333 15036 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:38.775110 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.776804 15542 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:38.777419 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.759317 17371 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.778198 15040 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 4: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:38.651088 17060 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.107s
I20260709 13:05:38.778970 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.779066 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:38.779709 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:38.783468 15040 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:38.776826 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:38.787140 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:38.782063 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.788832 14893 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.789515 17168 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.793033 15035 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:38.794487 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:38.700054 17056 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.797188 14893 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:38.796949 17056 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.799057 17348 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:38.803845 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.770615 17353 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:38.780243 17246 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:38.787360 17402 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.778481 17371 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.799485 17348 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:38.704031 17352 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.853732 17352 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.808343 17403 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:38.855051 17403 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:38.855538 17403 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.858851 15043 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:05:38.860327 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:38.862226 17404 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:05:38.864432 17186 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:38.866418 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.809130 17041 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.867975 17306 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:38.869831 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.806581 17385 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:38.871816 17385 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:38.873310 17306 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:38.873021 17385 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:38.873775 17306 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:38.874215 17306 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:38.876955 15550 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
W20260709 13:05:38.878530 17305 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260709 13:05:38.878782 15546 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:38.879050 14966 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:38.881067 17306 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.883553 17306 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.808921 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.885660 15541 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:38.886219 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 520) took 1101 ms. Trace:
I20260709 13:05:38.836359 17253 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:38.809823 17246 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:38.886795 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.887382 14889 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:38.887670 17246 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.888365 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.889011 17246 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:38.889600 14890 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:38.890558 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.839648 17148 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.814038 17173 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.839907 17371 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.894447 17173 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:38.886554 15541 rpcz_store.cc:276] 0709 13:05:37.784922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:37.812796 (+ 27874us) service_pool.cc:224] Handling call
0709 13:05:38.439700 (+626904us) spinlock_profiling.cc:243] Waited 5.85 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51eee 0000000000375939 00007f5539cc51e0 00007f5539d8e0c4 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:38.807354 (+367654us) spinlock_profiling.cc:243] Waited 916 us on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51f8c 00007f5531c51ef6 0000000000375939 00007f5539cc51e0 00007f5539d8e0c4 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:38.886155 (+ 78801us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15569152}
I20260709 13:05:38.769305 17406 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:05:38.809934 17353 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:38.896600 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.897014 17353 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.897297 14887 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:38.841800 14895 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:38.884372 17358 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:38.896008 14886 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:38.884914 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.903271 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:38.832603 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:38.912189 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 79644.8us
I20260709 13:05:38.913348 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:38.933701 14891 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 10 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:05:38.935604 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.936913 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.938171 15044 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:05:38.938539 15044 pending_rounds.cc:85] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 3
I20260709 13:05:38.938755 15044 pending_rounds.cc:107] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:05:38.938971 15044 raft_consensus.cc:2889] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:38.942504 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.944240 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.944962 15548 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:38.947213 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.901484 17348 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:38.947809 14968 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:38.948185 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:38.949153 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:38.943151 14964 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:38.952610 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.933071 17357 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:38.956176 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:38.932585 17344 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:38.932819 17173 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.967351 14895 raft_consensus.cc:2376] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5. Re-sending same reply.
I20260709 13:05:38.969621 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.978788 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:38.980715 17360 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:38.981422 17360 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.981972 17360 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:38.984553 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 83185.3us
I20260709 13:05:38.985242 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:38.970383 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.940934 17246 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:38.940238 17358 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.991761 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:38.937060 17041 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:38.967648 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.993898 14962 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 4: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:38.937494 17278 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:38.987789 14970 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:38.990113 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:38.995121 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:38.943771 17299 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 13:05:38.997535 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:38.998607 17278 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.002231 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:39.002606 17360 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.003567 17356 raft_consensus.cc:2764] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:05:39.004231 17356 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.004722 17356 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:39.005630 17356 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.000272 17167 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.008073 17167 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.008239 15544 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:05:39.008484 17167 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.991508 17250 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:39.009614 17250 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:39.010437 17250 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.000129 17396 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.011785 17396 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.012116 17396 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:38.967020 17357 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:38.996532 17246 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.003291 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:39.023917 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:38.905905 17392 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:38.983727 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:39.020505 14887 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:38.988909 17344 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:39.021035 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:39.024501 14961 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:39.024475 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:39.028463 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 247566us
I20260709 13:05:39.023268 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:39.029564 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:39.029913 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:39.027988 14891 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 3.
I20260709 13:05:39.031236 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:39.034724 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.035490 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:39.036669 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.037832 14888 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:39.038208 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:39.038690 15035 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.033892 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:39.015038 17407 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:05:39.038826 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:39.041206 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:39.049141 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.003304 17278 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:39.052353 14894 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:39.052659 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:39.020077 17186 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:39.025776 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.055068 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:39.056734 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:39.057451 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.045720 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.059314 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.061738 15038 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:39.063273 15035 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:38.991151 17173 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.052759 16932 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.066655 15541 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:05:39.066803 17411 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 13:05:39.069713 17186 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:39.069953 17278 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:39.039336 17147 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:05:39.040855 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:39.071310 17382 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:39.045168 17107 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:39.073645 16932 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.078429 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:39.118696 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.042305 17360 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:39.119647 17360 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.090268 15550 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:39.071633 17352 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.074132 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.070887 17265 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:39.055665 17146 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:05:39.046667 17060 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:39.121644 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:39.108079 17278 consensus_queue.cc:1243] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:39.103611 17299 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:39.127034 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52970us
I20260709 13:05:39.131729 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.120045 17360 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.133749 15036 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:39.121832 16932 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.133703 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:39.136737 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 87665.5us
I20260709 13:05:39.140790 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:39.125784 17060 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.127791 17148 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.144079 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:39.128695 17358 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:39.086740 17357 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.130695 17382 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:39.131806 17107 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:39.146970 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.140718 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:39.150909 15038 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:05:39.151012 17410 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:05:39.151391 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.219094 15036 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:39.164769 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:39.219936 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.220525 15040 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:39.177102 17134 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:39.177945 17402 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4.
I20260709 13:05:39.148067 17238 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:39.181330 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.134066 17265 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:39.139413 17250 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:39.220456 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:39.144447 17148 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:39.221969 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 75090.5us
I20260709 13:05:39.224753 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.240792 17134 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:39.269974 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:39.270071 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.266399 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.134541 17299 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.229677 16932 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.230069 17167 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.231272 17246 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:39.231659 17353 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.235735 17392 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:39.219439 17382 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:39.236538 17357 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.236873 17403 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.132174 17344 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.203217 17107 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:39.144253 17060 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:39.179201 17173 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.261765 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:39.319712 14895 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:39.165732 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:39.264699 15545 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:39.273213 17114 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:39.240470 17146 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:39.310111 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.240598 15542 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:39.271530 17148 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.317200 17396 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.308763 17305 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:39.263125 14963 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:39.272012 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.274160 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.324101 15549 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:39.302910 17238 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:39.343653 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.343710 15038 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:39.336658 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 204970us
I20260709 13:05:39.345333 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:39.270709 16986 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:05:39.335865 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 170194us
I20260709 13:05:39.318773 17107 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:05:39.352871 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 81268.1us
I20260709 13:05:39.357861 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:39.357375 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.354175 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:39.365581 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.273716 17134 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.364771 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.370651 14893 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:39.370996 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:39.335722 17366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.002s	sys 0.018s
I20260709 13:05:39.355944 17168 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:39.358561 17250 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:39.380752 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:39.362552 17358 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.384096 14886 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.364748 17278 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.367221 17173 raft_consensus.cc:2764] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 13:05:39.383155 17366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.002s	sys 0.018s
I20260709 13:05:39.375837 17146 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:39.397753 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:39.392357 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 118296us
I20260709 13:05:39.376924 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:39.405555 14889 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:39.381726 17250 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:39.415014 17425 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 13:05:39.395473 17358 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.365729 17265 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.368678 17392 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 13:05:39.417371 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 295749us
I20260709 13:05:39.427388 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.355715 17382 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.373109 17385 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.395345 17056 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.418503 15547 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.386796 16986 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:39.396764 17429 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:39.428563 15040 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:39.429767 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:39.430995 17449 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:05:39.431279 17081 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:39.432070 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet da044c14437c4be087d871f129926239: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:39.432376 17396 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.432400 17305 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:39.433679 17167 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.424659 17173 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.397787 17278 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.435186 14966 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:05:39.436389 14963 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:39.408567 17238 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.416208 17443 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:05:39.448482 17439 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:39.448918 17358 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:39.450387 17436 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:39.630769 17358 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.631341 17358 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.632671 15545 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:39.633490 17358 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.633924 15545 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:05:39.457738 17299 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.468482 14891 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:39.470928 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.635079 15544 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:39.423110 17250 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.636994 17114 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:39.637362 17114 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:39.637775 17278 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:39.523135 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 93433.2us
W20260709 13:05:39.533278 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 162324us
I20260709 13:05:39.515790 17366 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.514927 17146 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.514143 17056 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:39.545346 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125328us
I20260709 13:05:39.526167 16932 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.545338 17173 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:39.521673 17353 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.498961 17385 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:39.496635 17360 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:39.620638 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 240863us
I20260709 13:05:39.523324 17081 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:39.552124 17437 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:39.451826 17433 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:39.640265 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:39.640400 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:39.723301 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 82966.7us
I20260709 13:05:39.723340 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:39.641731 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:39.642158 14970 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:39.725159 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:39.725857 14970 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:39.726106 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:39.726675 14965 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:39.642812 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:39.655611 15547 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:39.710115 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:39.709103 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.724139 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.659765 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:39.729300 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 336329us
I20260709 13:05:39.729950 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:39.718824 15035 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:39.657706 17348 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.681s	user 0.012s	sys 0.001s
I20260709 13:05:39.727133 14970 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:39.660148 17056 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.707424 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 616) took 1152 ms. Trace:
I20260709 13:05:39.717125 17385 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.707185 17403 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.658546 17107 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:39.736625 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:39.715294 17173 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.740270 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.749912 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:39.723666 17081 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.733170 16932 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:39.707329 17449 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 13:05:39.739504 17352 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260709 13:05:39.789252 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:39.638146 17114 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.735592 16986 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:39.653389 17278 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 13:05:39.659315 17060 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.793256 14961 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:39.785686 17344 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:39.804852 17360 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.806165 17460 ts_tablet_manager.cc:933] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:39.807011 17442 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:05:39.807648 17457 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 13:05:39.660897 17146 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.738932 17407 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:39.657091 17366 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.850749 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:39.810694 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 70446.5us
I20260709 13:05:39.818295 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:39.853971 14889 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:39.855962 17107 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.837277 17148 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.861871 17148 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.861917 17081 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:39.862835 14968 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:39.865398 17432 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.641s	user 0.004s	sys 0.000s
I20260709 13:05:39.869319 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:39.869942 14888 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:39.820746 14967 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:39.873224 15039 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:39.873870 17060 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:39.735931 17265 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 13:05:39.878405 14891 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:39.741163 17348 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:39.880098 14969 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:39.881135 17348 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:39.748198 17363 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:05:39.883384 17366 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.791929 17452 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:39.883978 17452 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:39.821696 17352 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:39.887571 14886 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:05:39.890727 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 149892us
I20260709 13:05:39.900622 14969 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:39.891479 14968 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:39.898025 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:39.884361 17452 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:39.905171 14967 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:39.899255 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:39.912413 14891 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:39.859103 17146 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:39.924396 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.928551 15040 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:39.925120 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:39.935423 14961 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.995687 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:39.996727 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:39.995994 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:39.997676 15037 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:39.998639 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 173011us
I20260709 13:05:40.000304 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:40.003942 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:39.844386 17344 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.005252 14961 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:39.938894 17348 raft_consensus.cc:2764] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:05:39.862248 17250 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:39.938489 17464 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:40.018966 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:40.015669 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.007059 17186 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:39.939597 17363 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 13:05:40.024950 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:40.024972 14961 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:40.026563 14964 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 13:05:40.027859 15043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2126) took 1457 ms (client timeout 1590 ms). Trace:
I20260709 13:05:40.029068 14893 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:40.029786 15043 rpcz_store.cc:269] 0709 13:05:38.570784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.586607 (+ 15823us) service_pool.cc:224] Handling call
0709 13:05:40.027688 (+1441081us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54001f45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:40.027803 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493527808}
I20260709 13:05:40.013701 17451 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:40.016995 17464 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.007377 17366 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:05:40.027868 17186 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.034276 17466 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.036765 14961 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:40.037621 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:40.039706 17458 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 13:05:40.039969 17443 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.030768 17459 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:05:40.042152 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 612) took 1612 ms. Trace:
I20260709 13:05:40.044804 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:39.738857 15543 rpcz_store.cc:276] 0709 13:05:38.554757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.561109 (+  6352us) service_pool.cc:224] Handling call
0709 13:05:39.007622 (+446513us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:39.007871 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.008376 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:39.008419 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:39.008972 (+   553us) log.cc:844] Serialized 26 byte log entry
0709 13:05:39.043950 (+ 34978us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:39.043988 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:39.044062 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:39.545463 (+501401us) raft_consensus.cc:1685] finished
0709 13:05:39.548552 (+  3089us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:39.707329 (+158777us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2421,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":10343168,"thread_start_us":34551,"threads_started":1,"wal-append.queue_time_us":134869}
I20260709 13:05:40.070758 15546 rpcz_store.cc:276] 0709 13:05:38.429642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:38.433877 (+  4235us) service_pool.cc:224] Handling call
0709 13:05:38.488130 (+ 54253us) spinlock_profiling.cc:243] Waited 2.56 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:40.041935 (+1553805us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b540071e654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:40.042076 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28027520}
I20260709 13:05:40.049897 17466 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.050360 17443 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.051604 16986 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:40.056334 17250 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.060073 17173 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.083707 17173 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.065543 17081 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:40.066386 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.066989 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1745) took 1027 ms. Trace:
I20260709 13:05:40.068301 15037 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:40.068684 17451 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:40.084821 14895 rpcz_store.cc:276] 0709 13:05:39.040076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.067259 (+ 27183us) service_pool.cc:224] Handling call
0709 13:05:39.067599 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:39.320115 (+252516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.066785 (+746670us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54003d4fd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:40.066934 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":579377920}
I20260709 13:05:40.025589 16932 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:40.086334 17452 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.056324 14963 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:40.063618 17344 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.086585 16932 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.091027 17443 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:40.031359 17460 tablet_copy_client.cc:323] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:05:40.038784 17464 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.048849 17186 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:40.081300 16986 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.100950 16986 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:40.102442 17456 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:05:40.105361 17467 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:05:40.121276 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96383.8us
I20260709 13:05:40.130893 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:40.132074 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:40.127811 14887 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Committing config change with OpId 3.3: config changed from index -1 to 3, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:40.099311 17469 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:40.152462 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.154488 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:40.129385 17443 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:40.153193 14970 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:40.143327 17469 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:40.200026 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.142515 17363 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:40.263273 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.147374 17385 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.156742 17475 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:40.158708 17463 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.272862 17475 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:40.273008 17385 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.273664 15543 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:40.273836 17475 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.272249 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 6eec3351a3e94e158c79a8784e2c6574 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
W20260709 13:05:40.270756 17434 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 13:05:40.421368 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 122603us
W20260709 13:05:40.300557 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.639s (SENT)
I20260709 13:05:40.507205 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:40.361737 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.509496 14970 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:40.360631 17466 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:40.441040 16676 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:05:40.492152 16986 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.416277 16723 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.518512 16723 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.520617 16723 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:40.263571 17406 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:40.521219 17470 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
I20260709 13:05:40.521353 17406 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:40.424896 17476 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:05:40.523631 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:40.526599 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 226064us
I20260709 13:05:40.263222 17473 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:40.266206 17469 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.187732 17443 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.437489 16888 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.511763 17047 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:40.535567 17047 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:40.540323 17047 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.541356 17047 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:40.524569 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 6eec3351a3e94e158c79a8784e2c6574 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-6eec3351a3e94e158c79a8784e2c6574
I20260709 13:05:40.545323 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:40.547374 15035 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.528859 17452 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:40.272964 17463 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.551519 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:40.530139 17477 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:40.554126 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:40.535748 17056 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.770s	user 0.007s	sys 0.002s
I20260709 13:05:40.559643 15035 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:40.561353 14965 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.562136 15037 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:40.567662 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:40.544864 16986 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.275285 17363 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.570959 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 589) took 1502 ms. Trace:
I20260709 13:05:40.571079 15548 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:40.573156 15547 rpcz_store.cc:276] 0709 13:05:39.068142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.331675 (+263533us) service_pool.cc:224] Handling call
0709 13:05:40.570770 (+1239095us) spinlock_profiling.cc:243] Waited 49.2 ms on lock 0x7b5400692654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:40.570906 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":113211776}
I20260709 13:05:40.533249 17473 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.544757 16888 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.582211 14969 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:40.571344 16932 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:40.596901 14965 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:40.567965 17056 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.621937 17186 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.597460 16932 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:40.573661 17477 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:05:40.652895 17406 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:40.665122 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 133678us
I20260709 13:05:40.658387 17344 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:40.658625 17419 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.678118 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.677258 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.665002 17477 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.628535 16932 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.690449 17173 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:40.690613 17186 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:40.690923 17173 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:40.691497 17429 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:40.693786 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:40.694430 14961 raft_consensus.cc:2376] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5. Re-sending same reply.
I20260709 13:05:40.694681 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.691818 17173 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.682073 17168 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.695463 17173 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.695806 17168 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.698192 17168 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:40.699776 17464 consensus_meta.cc:287] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.003s
I20260709 13:05:40.700232 17464 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.701366 14968 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:40.702394 17464 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.703236 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:40.704455 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:40.704589 15038 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:40.705011 14961 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:40.705835 15054 tablet_copy_source_session.cc:215] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:05:40.706393 17468 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:40.706789 17468 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:40.712585 14961 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:40.726634 17047 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:40.727378 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.727285 17047 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.729995 17047 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:40.708727 17429 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:40.733625 14964 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:40.676153 17419 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.672955 17344 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.692947 17477 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.756609 15038 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:05:40.759740 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.707635 17468 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.802460 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.798913 17047 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:40.805984 17047 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.760049 17450 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.811216 17468 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:40.792106 17363 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:40.818212 17134 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:40.820308 17299 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:40.823884 17427 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:40.824222 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet be840274e2c843b9b2b9f24277dca78d: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:40.824437 17427 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:40.826552 17427 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:40.827278 17428 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.827778 17428 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.828738 17477 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.830297 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:40.830220 17406 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:40.831297 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 978151us
I20260709 13:05:40.831811 17406 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:40.830667 17419 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:40.833876 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:40.832226 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:40.834455 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:40.836275 15550 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:40.835579 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:40.837217 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:40.837839 15038 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
W20260709 13:05:40.838052 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.860620 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:40.864282 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:40.864830 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.864919 15043 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:40.865543 14970 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:40.864035 17419 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:40.871742 17419 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.871840 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:40.872144 17419 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:40.872953 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:40.873790 14895 raft_consensus.cc:2410] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:40.874068 17457 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:40.873009 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:40.876778 14886 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
W20260709 13:05:40.888082 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:40.832974 17428 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:40.832785 17356 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 13:05:40.874547 17457 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.913718 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:40.963616 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1742) took 1927 ms. Trace:
I20260709 13:05:40.930101 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:40.992969 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 157459us
I20260709 13:05:40.832587 17426 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:40.815873 17450 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:40.860600 17477 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:41.005033 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:40.995123 14887 rpcz_store.cc:276] 0709 13:05:39.035849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.036243 (+   394us) service_pool.cc:224] Handling call
0709 13:05:39.036877 (+   634us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:39.037240 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:39.037276 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.060269 (+1022993us) spinlock_profiling.cc:243] Waited 33.1 ms on lock 0x7b4c002d8700. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5533042a20 00007f5533053a29 00007f5533019644 00007f5533040f2d 00007f5533040b93 00007f5534d7118b 00007f5534d71cb5 00007f5534d73004 00007f5534d72729 00007f5534d77d96 00007f5534d6cadb
0709 13:05:40.061031 (+   762us) log.cc:844] Serialized 499 byte log entry
0709 13:05:40.127697 (+ 66666us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:40.158088 (+ 30391us) log.cc:844] Serialized 14 byte log entry
0709 13:05:40.930490 (+772402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.930592 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:40.930651 (+    59us) raft_consensus.cc:1685] finished
0709 13:05:40.963377 (+ 32726us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:40.963547 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772170,"raft.queue_time_us":838074,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":7246,"spinlock_wait_cycles":76078848,"thread_start_us":66327,"threads_started":1,"wal-append.queue_time_us":203471}
I20260709 13:05:41.017908 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:40.951763 17430 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.006630 14962 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:41.009485 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:41.022226 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:41.011612 16888 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:41.024020 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:41.024561 17459 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.025022 14970 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:41.025215 17459 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.000662 17427 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 13:05:41.028321 17459 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:41.029963 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:41.031523 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:41.028559 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:41.036226 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:41.036662 14963 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:41.032323 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:41.035631 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:41.038802 14966 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:41.037413 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:41.042050 14964 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:40.952608 17041 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.034205 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:40.963428 17466 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:41.001662 17461 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.044713 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:40.997249 15035 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
I20260709 13:05:41.031790 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:40.929181 17168 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.056015 17168 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.012441 17426 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:40.952468 17385 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:41.030258 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 168150us
I20260709 13:05:40.927805 17358 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:40.997536 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:41.051065 15039 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 13:05:41.143741 15039 pending_rounds.cc:85] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 6
I20260709 13:05:41.144057 15039 pending_rounds.cc:107] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:05:41.144345 15039 raft_consensus.cc:2889] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:41.011704 16676 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 13:05:41.039729 17430 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:41.046590 17466 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:41.046690 17173 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:41.163019 17445 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:05:41.163285 17173 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.164220 17457 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:40.914769 17250 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.164861 17445 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:41.165218 17250 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.165748 17445 consensus_queue.cc:1243] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:05:40.914592 17462 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.072208 17426 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:41.135469 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:41.135671 17134 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:40.876159 17429 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.216259 17253 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:41.211615 17469 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.003s
I20260709 13:05:41.148383 17406 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.137157 17385 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:41.037115 17441 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:41.147675 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.072280 17461 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:41.200371 17457 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:41.207818 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:41.036988 17392 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 13:05:41.216552 17462 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.266243 17360 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:41.154891 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:41.072160 15549 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:41.211838 17358 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:41.551393 14890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.066s	sys 0.102s
W20260709 13:05:41.623983 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 627709us
W20260709 13:05:41.624550 14890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.068s	sys 0.105s
W20260709 13:05:41.511569 14891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.003s
W20260709 13:05:41.625525 14891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.008s	sys 0.005s
W20260709 13:05:41.415787 14892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.050s	sys 0.036s
W20260709 13:05:41.626623 14892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.053s	sys 0.042s
I20260709 13:05:41.626902 14886 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:41.624958 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:41.457791 14895 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 2.
W20260709 13:05:41.346657 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:41.440240 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:41.645172 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.783614 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:41.788727 15549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 542) took 1769 ms (client timeout 1640 ms). Trace:
W20260709 13:05:41.789287 15549 rpcz_store.cc:269] 0709 13:05:39.857253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:40.929848 (+1072595us) service_pool.cc:224] Handling call
0709 13:05:41.626722 (+696874us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:41.820569 14935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.003s	sys 0.007s
W20260709 13:05:41.821076 14935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.003s	sys 0.007s
W20260709 13:05:41.721331 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 281126us
I20260709 13:05:41.824568 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:41.826874 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:41.705332 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 550458us
I20260709 13:05:41.829312 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:41.821838 14967 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.004s	sys 0.008s
I20260709 13:05:41.830071 14886 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:41.830349 14967 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.004s	sys 0.008s
I20260709 13:05:41.831074 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:41.598011 17419 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.002s
I20260709 13:05:41.590565 17460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eec3351a3e94e158c79a8784e2c6574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:05:41.859236 14886 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:41.859903 14894 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:41.258076 17441 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:41.291159 17429 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:41.642174 17428 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.003s	sys 0.001s
W20260709 13:05:41.765898 17490 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.742s	user 0.000s	sys 0.001s
W20260709 13:05:41.867049 14858 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.009s	sys 0.004s
W20260709 13:05:41.932672 14858 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.009s	sys 0.005s
I20260709 13:05:41.663348 17459 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:41.368285 17493 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.417686 17167 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.823501 17452 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:41.782591 17356 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:41.832147 16932 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:41.880496 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:41.881390 17358 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:41.882579 17173 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:41.979313 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.023s	sys 0.036s
I20260709 13:05:41.884351 17056 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:41.810267 17360 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:41.886865 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:41.980481 14887 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:41.981093 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1775) took 1119 ms. Trace:
I20260709 13:05:41.981487 14887 rpcz_store.cc:276] 0709 13:05:40.861494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.886636 (+1025142us) service_pool.cc:224] Handling call
0709 13:05:41.981014 (+ 94378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:41.887149 17462 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:41.892642 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 348) took 1969 ms. Trace:
I20260709 13:05:41.985718 15039 rpcz_store.cc:276] 0709 13:05:39.922956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.923458 (+   502us) service_pool.cc:224] Handling call
0709 13:05:39.998682 (+ 75224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.144874 (+1146192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.892412 (+747538us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001f36d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:41.892579 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2419317120}
W20260709 13:05:41.892910 17426 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.675s	user 0.009s	sys 0.000s
I20260709 13:05:41.895275 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2241) took 1993 ms. Trace:
I20260709 13:05:42.008601 14891 rpcz_store.cc:276] 0709 13:05:39.901699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.994431 (+ 92732us) service_pool.cc:224] Handling call
0709 13:05:39.998878 (+  4447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.860346 (+861468us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.860378 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.867935 (+  7557us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.625936 (+758001us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:41.625988 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.626073 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.895086 (+269013us) raft_consensus.cc:1685] finished
0709 13:05:41.895104 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.895220 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":898941,"raft.queue_time_us":997034,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"thread_start_us":649803,"threads_started":1,"wal-append.queue_time_us":962423}
I20260709 13:05:42.011447 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.012203 14891 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:41.591958 17461 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:41.896178 17505 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:41.266314 17250 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:41.471163 17402 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.418387 17403 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.471815 17253 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.801614 17344 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:41.912806 17041 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.251331 17469 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:41.916280 17385 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:41.917232 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 539) took 2568 ms. Trace:
I20260709 13:05:41.924701 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:41.925992 17468 consensus_meta.cc:287] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.000s
I20260709 13:05:41.928229 17168 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:41.928392 15044 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:41.928970 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:42.055951 15038 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:41.930469 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2234) took 2113 ms. Trace:
I20260709 13:05:41.909045 17466 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:41.932011 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2233) took 2116 ms. Trace:
I20260709 13:05:41.934605 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:41.752213 17464 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.009s	sys 0.002s
I20260709 13:05:41.936771 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:41.944108 17493 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:41.937896 14933 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.13.120.62:42905, user_credentials={real_user=slave}} blocked reactor thread for 63378.3us
I20260709 13:05:41.938556 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:41.940429 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 315666us
I20260709 13:05:41.267304 17406 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:41.906203 17428 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.003s	sys 0.005s
I20260709 13:05:41.948379 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:41.948674 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.067919 15547 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.067960 15043 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:41.873982 17443 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:42.039196 17344 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:41.906931 17441 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:41.970304 16932 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:41.390283 17439 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:41.341445 17238 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.600s
I20260709 13:05:41.835812 17299 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.107s
I20260709 13:05:41.982730 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.089691 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1778) took 1058 ms. Trace:
I20260709 13:05:42.090091 14887 rpcz_store.cc:276] 0709 13:05:41.031245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.982437 (+951192us) service_pool.cc:224] Handling call
0709 13:05:42.089613 (+107176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:41.938082 17366 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:41.985409 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.023s	sys 0.036s
W20260709 13:05:42.097321 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 1.05061e+06us
I20260709 13:05:41.935251 17396 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:41.979081 17348 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.029s
I20260709 13:05:41.874337 17419 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:41.948284 17167 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.117580 15043 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:42.016992 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:42.119849 14891 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:42.120957 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.121958 14891 raft_consensus.cc:2410] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:05:42.024646 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 544) took 2138 ms. Trace:
I20260709 13:05:41.983131 17358 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:42.036877 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.036s	sys 0.051s
W20260709 13:05:42.126470 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.037s	sys 0.051s
I20260709 13:05:41.987082 17452 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:41.985729 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:42.041296 14893 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:42.132958 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1774) took 1271 ms. Trace:
I20260709 13:05:42.133271 14893 rpcz_store.cc:276] 0709 13:05:40.861242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.924426 (+1063184us) service_pool.cc:224] Handling call
0709 13:05:42.132893 (+208467us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.134449 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:42.135013 14893 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.135774 17502 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.138854 14995 heartbeater.cc:646] Failed to heartbeat to 127.13.120.62:42905 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.120.62:42905 timed out after 15.000s (SENT)
I20260709 13:05:42.130970 17168 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:42.118026 17396 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:42.141769 14893 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:42.141861 17168 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.142861 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:42.144145 17168 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:42.144563 17167 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.041075 15548 rpcz_store.cc:276] 0709 13:05:39.348974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.633353 (+284379us) service_pool.cc:224] Handling call
0709 13:05:40.570914 (+937561us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:40.573203 (+  2289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.917057 (+1343854us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b5400692650. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:41.917177 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155476352}
I20260709 13:05:42.008222 17462 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:42.058799 15549 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:42.059583 15037 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.145598 17462 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.146427 17473 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:42.147536 17462 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:41.936736 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:42.151726 15040 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.058385 14892 rpcz_store.cc:276] 0709 13:05:39.815869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.816020 (+   151us) service_pool.cc:224] Handling call
0709 13:05:39.816413 (+   393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.823058 (+1006645us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.823092 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.823622 (+   530us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.627077 (+803455us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:05:41.627130 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.627208 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.931828 (+304620us) raft_consensus.cc:1685] finished
0709 13:05:41.931847 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.931962 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1006213,"raft.queue_time_us":1009238,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":803069,"threads_started":1,"wal-append.queue_time_us":1082167}
I20260709 13:05:42.083020 17344 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.155956 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.156533 14892 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:42.157299 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.157657 17344 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.056393 14890 rpcz_store.cc:276] 0709 13:05:39.816673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.816806 (+   133us) service_pool.cc:224] Handling call
0709 13:05:39.817096 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.825083 (+1007987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.825113 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.825530 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.625041 (+799511us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:41.625086 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.625156 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:41.930226 (+305070us) raft_consensus.cc:1685] finished
0709 13:05:41.930246 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:41.930379 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1007600,"raft.queue_time_us":1008798,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":799145,"threads_started":1,"wal-append.queue_time_us":1103096}
I20260709 13:05:42.158181 17344 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.064492 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:42.073026 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 134547us
I20260709 13:05:42.073654 14968 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:41.325953 17457 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.073432 17385 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.159174 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:42.159631 17385 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.161660 17385 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.161795 17168 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:41.943862 17459 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.039606 17403 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.039453 17253 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:42.091398 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 261620us
I20260709 13:05:42.098584 15547 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:42.081233 17468 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:42.196295 15043 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:42.038070 17402 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.102748 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.200760 17253 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:42.201100 14887 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
W20260709 13:05:42.103952 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 284251us
I20260709 13:05:42.201606 17516 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:42.203205 15513 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.864s (SENT)
I20260709 13:05:42.084977 16932 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.203661 17403 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.086966 17466 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.095908 17056 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.207804 17056 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:42.104349 17348 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.009s	sys 0.029s
I20260709 13:05:42.128532 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.129151 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.250253 15037 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:42.144742 17452 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.141319 17360 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:42.014485 17426 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.158671 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.257576 14890 raft_consensus.cc:2410] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:42.172077 15038 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:42.182965 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:42.184346 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:42.086956 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 260128us
W20260709 13:05:42.259084 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.158197 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:42.260273 14892 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.192308 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:42.262269 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 70034.9us
I20260709 13:05:42.262302 15040 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:42.256009 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:42.264159 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:42.214591 14886 raft_consensus.cc:2368] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6.
I20260709 13:05:42.126787 17238 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.201642 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1776) took 1337 ms. Trace:
I20260709 13:05:42.267256 14893 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.267072 14887 rpcz_store.cc:276] 0709 13:05:40.866549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.102506 (+1235957us) service_pool.cc:224] Handling call
0709 13:05:42.201585 (+ 99079us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.267721 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:42.268864 14887 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:42.269408 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1762) took 1430 ms. Trace:
I20260709 13:05:42.269690 14887 rpcz_store.cc:276] 0709 13:05:40.839139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.268241 (+1429102us) service_pool.cc:224] Handling call
0709 13:05:42.268583 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.269198 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.269360 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.270661 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:42.271446 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1763) took 1432 ms. Trace:
I20260709 13:05:42.142985 17464 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:05:42.254344 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 125254us
I20260709 13:05:42.203680 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:42.272782 14887 rpcz_store.cc:276] 0709 13:05:40.839496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.270672 (+1431176us) service_pool.cc:224] Handling call
0709 13:05:42.270932 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.271148 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.271173 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.271211 (+    38us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:42.271241 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.271289 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.271378 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.277120 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:42.115475 17366 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.279106 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.282554 14893 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:42.031586 17505 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.087841 17439 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.158661 17344 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.200773 17402 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.137470 17501 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:05:42.114735 17454 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.159s
I20260709 13:05:42.292956 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:42.288148 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 185742us
I20260709 13:05:42.305771 15041 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:42.275779 14887 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:42.136333 17502 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.307967 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.306788 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1764) took 1467 ms. Trace:
I20260709 13:05:42.255213 17457 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:42.254133 17468 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:42.321796 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.309576 14887 rpcz_store.cc:276] 0709 13:05:40.839769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.275170 (+1435401us) service_pool.cc:224] Handling call
0709 13:05:42.275541 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.306535 (+ 30994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.306730 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.311239 14892 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:42.264005 17253 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:05:42.317549 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 114324us
I20260709 13:05:42.278360 17464 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:42.286403 17173 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:42.340569 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.334337 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 323) took 1067 ms. Trace:
I20260709 13:05:42.336057 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.341274 14892 rpcz_store.cc:276] 0709 13:05:41.266860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.158014 (+891154us) service_pool.cc:224] Handling call
0709 13:05:42.334280 (+176266us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.322926 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.202155 17516 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.288407 17473 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:42.307812 17503 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.342715 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.346810 14892 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:42.355280 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1767) took 1514 ms. Trace:
I20260709 13:05:42.355350 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.355772 14892 rpcz_store.cc:276] 0709 13:05:40.840606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.346254 (+1505648us) service_pool.cc:224] Handling call
0709 13:05:42.346606 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.355068 (+  8462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.355232 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.285652 17360 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:42.357203 14892 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:42.360594 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 327) took 1092 ms. Trace:
I20260709 13:05:42.360795 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.313153 17510 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:42.361021 14892 rpcz_store.cc:276] 0709 13:05:41.268016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.356714 (+1088698us) service_pool.cc:224] Handling call
0709 13:05:42.357007 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.360288 (+  3281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.360534 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.341295 17462 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:42.354777 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61937.4us
I20260709 13:05:42.353106 17437 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.283561 17403 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 13:05:42.314143 17509 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:42.340014 17385 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:42.323945 17402 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 13:05:42.369634 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.359642 16676 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:42.371104 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.339988 17253 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.287567 17238 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.372602 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:42.373462 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.373883 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 328) took 1105 ms. Trace:
I20260709 13:05:42.371171 17041 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:42.381950 17494 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.246s	user 0.005s	sys 0.018s
I20260709 13:05:42.362779 17167 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:42.354223 17173 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:42.389430 17419 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:42.390844 17459 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:42.341349 17457 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:05:42.391760 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.397357 17348 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:42.393218 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 322) took 1126 ms. Trace:
W20260709 13:05:42.356115 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 173200us
I20260709 13:05:42.393792 17056 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:42.125034 15544 rpcz_store.cc:276] 0709 13:05:39.886510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.900474 (+ 13964us) service_pool.cc:224] Handling call
0709 13:05:40.638128 (+737654us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51eee 0000000000375939 00007f5539cc51e0 00007f5539d8e0c4 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:40.638338 (+   210us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.675287 (+ 36949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.678413 (+  3126us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.799771 (+121358us) log.cc:844] Serialized 26 byte log entry
0709 13:05:40.929250 (+129479us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:40.952033 (+ 22783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:40.968770 (+ 16737us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:42.024213 (+1055443us) raft_consensus.cc:1685] finished
0709 13:05:42.024246 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.024578 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26349,"raft.queue_time_us":34037,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":3053,"spinlock_wait_cycles":10011008,"thread_start_us":46376,"threads_started":1,"wal-append.queue_time_us":213885}
W20260709 13:05:42.373893 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.395646 15042 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:42.323649 17474 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:05:42.359139 17454 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:42.436399 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.359823 17360 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:42.358989 17353 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:42.371838 17462 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:42.359705 17356 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:42.413874 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 157925us
I20260709 13:05:42.414268 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.377370 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.413614 14892 rpcz_store.cc:276] 0709 13:05:41.268339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.370237 (+1101898us) service_pool.cc:224] Handling call
0709 13:05:42.370507 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.372957 (+  2450us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.373093 (+   136us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.373248 (+   155us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:42.373514 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.373745 (+   231us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.373837 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.377655 17461 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.415262 15036 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:42.416675 15043 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:42.364960 17299 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:42.419872 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 47332.1us
I20260709 13:05:42.355274 17168 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:05:42.392513 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.418135 17253 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:42.424750 14886 rpcz_store.cc:276] 0709 13:05:41.266563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.880185 (+613622us) service_pool.cc:224] Handling call
0709 13:05:42.392997 (+512812us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540024ead4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:42.393154 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559962368}
I20260709 13:05:42.435987 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.483539 15037 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 2.
I20260709 13:05:42.431027 17527 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:42.419284 17114 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:42.426949 17348 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:42.442190 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.443001 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.418907 17385 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:42.426172 17493 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:42.470731 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:42.362977 17503 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.474334 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.407344 17464 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.555519 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.395097 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.483927 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:42.557612 14886 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:42.478068 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:42.558787 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 80786.1us
I20260709 13:05:42.487629 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.438792 17402 consensus_queue.cc:1243] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:42.482903 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.436789 17454 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:42.503393 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:42.444916 17360 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.471495 17462 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:42.435083 17459 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 13:05:42.546753 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:42.574839 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1761) took 1736 ms. Trace:
I20260709 13:05:42.578950 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:42.547535 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2237) took 2724 ms. Trace:
I20260709 13:05:42.398525 17437 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.549172 14964 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:42.548251 17426 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:42.552979 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 157722us
I20260709 13:05:42.554596 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.423565 17468 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.485321 17509 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:42.567687 14968 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:42.488116 17530 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.503489 17299 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:42.548393 17385 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:42.470639 17353 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.580116 14889 rpcz_store.cc:276] 0709 13:05:39.823304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.854724 (+ 31420us) service_pool.cc:224] Handling call
0709 13:05:39.855006 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.862752 (+1007746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:40.862793 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:40.874528 (+ 11735us) log.cc:844] Serialized 26 byte log entry
0709 13:05:41.015527 (+140999us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:41.015583 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:41.015647 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:42.362159 (+1346512us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:42.504634 (+142475us) raft_consensus.cc:1685] finished
0709 13:05:42.504663 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.547468 (+ 42805us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":978669,"raft.queue_time_us":1112559,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":17114,"spinlock_wait_cycles":13934848,"thread_start_us":140599,"threads_started":1,"wal-append.queue_time_us":260814}
I20260709 13:05:42.503319 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:42.582569 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 101943us
W20260709 13:05:42.587064 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 279842us
I20260709 13:05:42.487717 17461 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:42.552665 17173 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:42.831916 14861 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.4:39473 timed out after 1.717s (SENT) [suppressed 34 similar messages]
W20260709 13:05:43.524310 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 692330us
I20260709 13:05:43.524466 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1705) took 1083 ms. Trace:
W20260709 13:05:43.034643 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 86266.7us
W20260709 13:05:43.410841 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:42.569402 17056 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:43.526330 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:43.533550 15038 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
W20260709 13:05:43.276574 14894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1770) took 2435 ms (client timeout 2079 ms). Trace:
W20260709 13:05:43.388321 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1772) took 2546 ms (client timeout 2016 ms). Trace:
W20260709 13:05:42.778784 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100869us
W20260709 13:05:43.124662 14962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.009s	sys 0.009s
W20260709 13:05:43.040407 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 461479us
I20260709 13:05:42.587882 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:42.842101 14964 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:43.529536 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:43.517779 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1711) took 1062 ms. Trace:
I20260709 13:05:42.572077 17428 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.569814 17439 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:43.593437 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:43.590687 14962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.019s	user 0.016s	sys 0.021s
W20260709 13:05:43.591230 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.196s	user 0.003s	sys 0.009s
I20260709 13:05:42.575265 17443 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:42.826706 17466 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.619s	user 0.004s	sys 0.004s
I20260709 13:05:43.594215 15036 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:43.594662 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1701) took 1158 ms. Trace:
W20260709 13:05:43.595664 14961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.043s	user 0.006s	sys 0.012s
I20260709 13:05:43.525019 14970 rpcz_store.cc:276] 0709 13:05:42.441544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.441679 (+   135us) service_pool.cc:224] Handling call
0709 13:05:42.477414 (+ 35735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.490764 (+ 13350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.490816 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:42.491441 (+   625us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.524055 (+1032614us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:43.524109 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.524192 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:43.524245 (+    53us) raft_consensus.cc:1685] finished
0709 13:05:43.524261 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.524403 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16327,"raft.queue_time_us":99215,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19492,"thread_start_us":304294,"threads_started":2,"wal-append.queue_time_us":890699}
W20260709 13:05:43.596720 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.004s	sys 0.009s
W20260709 13:05:43.631819 14961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.006s	sys 0.012s
W20260709 13:05:43.631943 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 1.23662e+06us
I20260709 13:05:43.592125 14963 rpcz_store.cc:276] 0709 13:05:42.455355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.569150 (+113795us) service_pool.cc:224] Handling call
0709 13:05:43.517245 (+948095us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:43.517426 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:43.517450 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:43.517512 (+    62us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:43.517545 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.517593 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.517717 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:42.830358 17531 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 13:05:43.648576 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 366) took 1472 ms. Trace:
I20260709 13:05:43.649009 15039 rpcz_store.cc:276] 0709 13:05:42.176151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.176419 (+   268us) service_pool.cc:224] Handling call
0709 13:05:42.195230 (+ 18811us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:42.249168 (+ 53938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.249213 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:42.249793 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:05:42.417809 (+168016us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:42.417849 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.417911 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:43.648371 (+1230460us) raft_consensus.cc:1685] finished
0709 13:05:43.648392 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.648520 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56639,"raft.queue_time_us":59425,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":27855,"thread_start_us":94223,"threads_started":1,"wal-append.queue_time_us":139799}
I20260709 13:05:43.516855 17344 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:43.324751 17537 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 13:05:43.508780 17441 consensus_meta.cc:287] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.422s	user 0.010s	sys 0.000s
I20260709 13:05:43.636186 14968 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:42.587009 17512 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:43.630784 14964 rpcz_store.cc:276] 0709 13:05:42.436234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.436414 (+   180us) service_pool.cc:224] Handling call
0709 13:05:43.594592 (+1158178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.637707 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1537) took 1243 ms. Trace:
I20260709 13:05:43.534075 17056 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.637843 17299 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.571628 17419 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.020s
I20260709 13:05:43.322906 17503 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.587150 17527 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.056s
W20260709 13:05:43.685083 14859 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.579s (SENT)
W20260709 13:05:43.643080 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 119785us
I20260709 13:05:43.688090 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:43.688848 15550 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
W20260709 13:05:43.589857 14895 rpcz_store.cc:269] 0709 13:05:40.842006 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.035326 (+193320us) service_pool.cc:224] Handling call
0709 13:05:43.388071 (+2352745us) spinlock_profiling.cc:243] Waited 419 ms on lock 0x7b54002eb3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:43.388229 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":963663104}
I20260709 13:05:42.586529 17510 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:43.327649 17520 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:42.674243 17528 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 1.088s
I20260709 13:05:42.579380 14891 rpcz_store.cc:276] 0709 13:05:40.838857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.257168 (+1418311us) service_pool.cc:224] Handling call
0709 13:05:42.257493 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.257704 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:42.412483 (+154779us) log.cc:844] Serialized 14 byte log entry
0709 13:05:42.574538 (+162055us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:42.574591 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:42.574632 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:42.574692 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:42.574791 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":286938,"prepare.run_cpu_time_us":190,"prepare.run_wall_time_us":9553,"thread_start_us":283129,"threads_started":2}
I20260709 13:05:43.674165 17466 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.704303 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:43.664539 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 135041us
I20260709 13:05:43.665583 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1709) took 1210 ms. Trace:
W20260709 13:05:43.325064 17546 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:05:42.586935 17041 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:42.876950 17238 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.830466 17538 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:43.516680 17502 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.411793 17473 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:42.847306 17454 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:43.326699 17403 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:43.213945 17540 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.532809 17530 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:42.668920 17426 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:42.681035 17516 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.033901 17474 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:42.832433 17505 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:42.582885 17469 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:43.670019 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.240s	user 0.010s	sys 0.005s
W20260709 13:05:43.754369 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.324s	user 0.010s	sys 0.006s
W20260709 13:05:43.754730 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 1.32451e+06us
I20260709 13:05:43.148535 17463 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:43.671603 15036 rpcz_store.cc:276] 0709 13:05:42.394161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.563324 (+169163us) service_pool.cc:224] Handling call
0709 13:05:43.637643 (+1074319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.677171 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:43.730975 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:43.756335 14889 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:43.756992 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 332) took 1381 ms. Trace:
I20260709 13:05:43.757531 14889 rpcz_store.cc:276] 0709 13:05:42.376039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.628603 (+1252564us) service_pool.cc:224] Handling call
0709 13:05:43.756926 (+128323us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.669816 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1712) took 1214 ms. Trace:
W20260709 13:05:43.679618 15007 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.003s	sys 0.012s
W20260709 13:05:43.759436 15007 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.003s	sys 0.012s
W20260709 13:05:43.759783 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 877453us
W20260709 13:05:43.747004 16932 consensus_meta.cc:287] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.543s	user 0.010s	sys 0.001s
I20260709 13:05:43.169267 17529 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:43.638512 17047 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:43.684760 15547 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:42.587234 17517 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 1.067s
I20260709 13:05:43.665148 17439 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:42.787833 17348 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:43.590305 14894 rpcz_store.cc:269] 0709 13:05:40.841436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.135146 (+293710us) service_pool.cc:224] Handling call
0709 13:05:43.276311 (+2141165us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b540024f9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:43.276481 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515802880}
I20260709 13:05:43.693526 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:43.670089 17477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.012s
W20260709 13:05:43.673871 17451 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.007s	sys 0.008s
I20260709 13:05:43.678321 17186 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:43.134687 17518 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.506s	user 0.001s	sys 0.001s
I20260709 13:05:43.679515 17056 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:43.668442 17547 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:43.745446 17473 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.713053 14962 rpcz_store.cc:276] 0709 13:05:42.454889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.562871 (+107982us) service_pool.cc:224] Handling call
0709 13:05:42.563174 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.563365 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:42.571670 (+  8305us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.665169 (+1093499us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:43.665239 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:43.665300 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.665381 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.665516 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86131,"prepare.queue_time_us":8341,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":7961,"raft.queue_time_us":72887,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5014,"thread_start_us":1023728,"threads_started":1}
W20260709 13:05:43.717757 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:43.629738 17428 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:43.675434 17457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.248s	user 0.013s	sys 0.002s
W20260709 13:05:43.798691 17451 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.454s	user 0.007s	sys 0.008s
I20260709 13:05:43.668782 17532 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:43.730376 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:43.790781 17047 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.664106 17443 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.694893 17520 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:43.676640 17441 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.761277 17426 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.279978 17450 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.763814 17463 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:43.837786 17186 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.764676 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:43.896402 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:43.896790 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 336) took 1507 ms. Trace:
I20260709 13:05:43.767570 17474 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.720639 17305 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 13:05:43.679100 17512 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:43.948804 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69708us
I20260709 13:05:43.949960 17512 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:43.781694 17558 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:43.951778 17558 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:43.731578 17515 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:43.703332 17544 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 13:05:43.782439 14859 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.629s (SENT)
I20260709 13:05:43.953779 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:43.784554 15010 connection.cc:256] RPC call timeout handler was delayed by -1.7982178790000489s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.164s for a response
W20260709 13:05:43.788364 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 262070us
I20260709 13:05:43.753345 17454 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:43.733353 17466 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:43.963533 17463 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:43.964032 17463 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.964730 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1522) took 2046 ms. Trace:
I20260709 13:05:43.964905 17466 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:43.965114 15041 rpcz_store.cc:276] 0709 13:05:41.917940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.935736 (+ 17796us) service_pool.cc:224] Handling call
0709 13:05:41.949427 (+ 13691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:42.306242 (+356815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.964525 (+1658283us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b5400404cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:43.964674 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818966400}
I20260709 13:05:43.965871 17463 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:43.966786 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 369) took 1626 ms. Trace:
I20260709 13:05:43.967167 15042 rpcz_store.cc:276] 0709 13:05:42.340203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.340331 (+   128us) service_pool.cc:224] Handling call
0709 13:05:43.966635 (+1626304us) spinlock_profiling.cc:243] Waited 54.3 ms on lock 0x7b5400187c54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:43.966735 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124867968}
I20260709 13:05:43.744134 17403 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:43.785007 17167 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.325s	user 0.012s	sys 0.033s
W20260709 13:05:43.832455 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 242400us
I20260709 13:05:43.888866 17461 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.835477 17499 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:43.838246 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 144822us
I20260709 13:05:43.788384 17529 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.671442 17536 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:05:43.799121 17477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.000s	sys 0.013s
I20260709 13:05:43.998333 17396 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.843642 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:43.998603 17536 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:43.999302 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1789) took 1431 ms. Trace:
I20260709 13:05:43.999688 14894 rpcz_store.cc:276] 0709 13:05:42.568257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.793650 (+1225393us) service_pool.cc:224] Handling call
0709 13:05:43.999244 (+205594us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:42.911036 17360 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:43.875609 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 282200us
I20260709 13:05:43.884250 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:43.886849 14860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.022s	sys 0.038s
W20260709 13:05:43.875101 17457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.015s	sys 0.002s
I20260709 13:05:43.787253 16932 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.891521 15039 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:43.758450 14968 rpcz_store.cc:276] 0709 13:05:42.455670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.503188 (+ 47518us) service_pool.cc:224] Handling call
0709 13:05:43.669738 (+1166550us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.007333 16932 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.007583 17529 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.008921 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:44.007269 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.013171 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:43.880311 17041 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:43.897219 14889 rpcz_store.cc:276] 0709 13:05:42.389368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.758274 (+1368906us) service_pool.cc:224] Handling call
0709 13:05:43.896716 (+138442us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:43.741727 17538 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.753151 17540 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:43.879956 17545 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.954864 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:44.031061 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 76271.7us
I20260709 13:05:44.031148 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:43.954948 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 172532us
I20260709 13:05:43.955641 17500 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.234s
I20260709 13:05:43.956251 17473 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:43.905344 17426 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:43.885337 17047 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.957003 15544 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:43.957074 17562 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:43.960170 17186 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.960763 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2238) took 4134 ms. Trace:
I20260709 13:05:44.043885 14888 rpcz_store.cc:276] 0709 13:05:39.826477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.870603 (+ 44126us) service_pool.cc:224] Handling call
0709 13:05:39.870960 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:40.992100 (+1121140us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:05:40.998293 (+  6193us) log.cc:844] Serialized 14 byte log entry
0709 13:05:41.048587 (+ 50294us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b1800370fc0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:43.282696 (+2234109us) spinlock_profiling.cc:243] Waited 9.29 ms on lock 0x7b1800370fc0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f553491623a
0709 13:05:43.389300 (+106604us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:43.429393 (+ 40093us) log.cc:844] Serialized 26 byte log entry
0709 13:05:43.706303 (+276910us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:43.706356 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.707022 (+   666us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:43.960575 (+253553us) raft_consensus.cc:1685] finished
0709 13:05:43.960594 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.960710 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1399382,"prepare.queue_time_us":6021,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1580391,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":22542,"spinlock_wait_cycles":33571456,"thread_start_us":312165,"threads_started":2,"wal-append.queue_time_us":503789,"wal-append.run_cpu_time_us":1169,"wal-append.run_wall_time_us":1001211}
I20260709 13:05:44.046108 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.046646 14888 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:43.888134 17353 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:43.958653 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:43.798532 17439 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.049160 17439 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.049636 17439 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:43.976814 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:44.050998 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 74270.1us
I20260709 13:05:44.051651 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:42.654780 17402 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:43.971937 17550 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:43.979856 17499 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:43.981153 17553 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:05:43.981472 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1414) took 2979 ms. Trace:
I20260709 13:05:44.061312 14967 rpcz_store.cc:276] 0709 13:05:41.002233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:41.006796 (+  4563us) service_pool.cc:224] Handling call
0709 13:05:41.021744 (+ 14948us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:41.830889 (+809145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:41.830922 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:41.830966 (+    44us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:41.830999 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.981254 (+2150255us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003eba54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:43.981296 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:43.981398 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":328570,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":31926,"spinlock_wait_cycles":335638272,"thread_start_us":662729,"threads_started":1}
I20260709 13:05:43.983875 17147 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.984097 17544 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:43.984643 17450 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:43.985219 17521 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:43.987222 17344 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:43.988410 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:43.988782 17509 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:43.989387 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:43.975162 17167 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.533s	user 0.012s	sys 0.033s
I20260709 13:05:43.991777 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:43.992468 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:43.884876 17532 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:44.002430 14860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.142s	user 0.023s	sys 0.038s
I20260709 13:05:44.002493 14886 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:43.873428 17547 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.005431 17430 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.015419 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:43.897475 17510 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:43.999627 17536 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:44.059834 17360 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.019301 17529 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:44.011098 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:44.024966 14890 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:44.020505 17558 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.025421 17474 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.068248 17473 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:44.035034 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.043264 17358 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:44.054960 14891 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:44.056631 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.058216 14895 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:44.058521 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 99906.4us
I20260709 13:05:44.014425 17403 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.054787 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:44.002075 17557 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 13:05:44.039321 17253 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.494s	user 0.009s	sys 0.003s
I20260709 13:05:44.037305 17457 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:44.063843 17527 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:44.075690 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:44.124533 14966 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.075832 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.127204 17515 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:44.127640 17515 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.128377 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.129101 14962 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:44.077838 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.071954 17509 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.072134 17167 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:44.085379 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.086107 17560 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:44.086402 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:44.134130 14968 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:44.016985 17563 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:44.031858 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:44.071816 17426 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:44.110208 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 99202.6us
I20260709 13:05:44.136585 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.137552 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.138069 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:44.114114 17512 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:44.143746 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:44.144152 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:44.115749 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61072.5us
I20260709 13:05:44.116873 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.145424 14894 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:44.070187 17147 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.118206 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:44.083274 17114 consensus_meta.cc:287] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.529s	user 0.008s	sys 0.004s
I20260709 13:05:44.122419 17403 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.087350 17538 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.123322 17540 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.123378 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1708) took 1668 ms. Trace:
I20260709 13:05:44.119318 17530 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.132453 14886 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:44.164345 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.164933 15044 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:44.165066 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.165679 14886 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:44.166200 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.166422 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.166792 15040 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:44.063835 17402 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.134418 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.190654 14967 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:44.144407 14968 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:44.147208 16723 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.148434 17557 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.135809 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.203466 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.082410 17396 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:44.145807 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:44.147779 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 115977us
I20260709 13:05:44.001616 17520 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.207803 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.121531 17552 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.072880 17450 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.129405 17457 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:44.134843 17551 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.126s	user 0.008s	sys 0.000s
I20260709 13:05:44.118628 17503 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:44.082149 17344 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.151780 17299 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:05:44.160221 14961 rpcz_store.cc:276] 0709 13:05:42.454601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.454741 (+   140us) service_pool.cc:224] Handling call
0709 13:05:42.455174 (+   433us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:42.455645 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.455693 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:42.472248 (+ 16555us) log.cc:844] Serialized 52 byte log entry
0709 13:05:43.632405 (+1160157us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:43.877935 (+245530us) log.cc:844] Serialized 14 byte log entry
0709 13:05:43.878145 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:43.878213 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.123161 (+244948us) raft_consensus.cc:1685] finished
0709 13:05:44.123183 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.123323 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19156,"prepare.queue_time_us":364963,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":101184,"raft.run_cpu_time_us":279,"raft.run_wall_time_us":18779,"thread_start_us":1319593,"threads_started":2,"wal-append.queue_time_us":1239530}
I20260709 13:05:44.066969 17550 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.163481 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.168149 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.169627 14966 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:44.039299 17545 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.216261 17552 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:44.117094 17529 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.066244 17469 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:44.194824 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.087852 17521 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.200973 17564 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.201256 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:44.295241 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 94062us
I20260709 13:05:44.201967 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.148537 17560 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:42.930799 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:44.129808 17253 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.160223 17426 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.070564 17544 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.167639 17246 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:44.193207 17460 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.344s	user 0.018s	sys 0.000s
W20260709 13:05:44.223168 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 79788.4us
W20260709 13:05:44.318005 14859 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.717s (SENT)
I20260709 13:05:44.227229 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.229490 17568 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:44.202696 17557 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:44.233026 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.119360 17353 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:44.227059 17167 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.330255 17353 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:44.330642 17353 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.313549 16932 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:44.332966 16932 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.333330 16932 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.225652 17473 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:44.336156 17473 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.256335 15042 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:44.339808 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.340438 15042 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:44.341002 17493 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:44.341305 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.341822 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:44.342512 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.170840 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.343796 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.222863 17457 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.221470 17441 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.275856 15043 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:44.115051 17047 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.254580 17358 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:44.285820 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:44.286430 17519 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.895s	user 0.010s	sys 0.005s
W20260709 13:05:44.289323 14890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2253) took 2034 ms (client timeout 1562 ms). Trace:
W20260709 13:05:44.385368 14890 rpcz_store.cc:269] 0709 13:05:42.254675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.278785 (+ 24110us) service_pool.cc:224] Handling call
0709 13:05:44.289129 (+2010344us) spinlock_profiling.cc:243] Waited 1.73 s on lock 0x7b54000cc454. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:44.289254 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3983145728}
I20260709 13:05:44.291788 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:44.293048 17450 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.294684 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:44.298074 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 179917us
I20260709 13:05:44.234299 17299 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:44.216053 17396 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.207868 16723 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:44.313825 14887 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:44.395866 14887 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:44.270200 17552 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.319708 14893 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
W20260709 13:05:44.400174 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.320919 14968 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:44.315375 17246 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.321702 17566 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.322273 17474 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:44.322490 17571 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:44.322772 17460 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52838 (request call id 537) took 5272 ms. Trace:
W20260709 13:05:44.323331 17573 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:05:44.323866 17147 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.423349 17353 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.233718 17538 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.079s
I20260709 13:05:44.275377 17469 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:44.319110 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.238027 17540 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260709 13:05:44.327802 14970 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:44.297413 17357 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:44.329870 17557 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.235119 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.452179 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.341378 17493 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:44.491209 17406 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.491878 17493 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.493490 17493 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.434317 17469 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.496606 17353 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.325178 17344 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.256590 17503 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.268092 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:44.316768 17385 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.723s	user 0.011s	sys 0.000s
I20260709 13:05:44.499897 14966 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:44.499776 17385 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:44.350317 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.501065 14966 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 13:05:44.372262 14895 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:44.408013 17474 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:44.380142 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.356638 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:44.157985 17499 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.387030 15550 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:44.388720 17535 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.392504 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.508095 14890 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 3.
W20260709 13:05:44.508154 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 151581us
I20260709 13:05:44.508948 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:44.411816 17566 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:44.516162 14890 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:44.396919 15040 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:44.316458 17564 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.318061 17426 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.407356 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.523398 14968 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:44.405150 14887 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.411733 17460 rpcz_store.cc:276] 0709 13:05:39.050305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.414294 (+363989us) service_pool.cc:224] Handling call
0709 13:05:39.845519 (+431225us) ts_tablet_manager.cc:934] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
0709 13:05:41.020475 (+1174956us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:42.826147 (+1805672us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:42.826259 (+   112us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:44.321960 (+1495701us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:44.322324 (+   364us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:44.322628 (+   304us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:44.322690 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":19009,"tablet-copy.queue_time_us":343462,"thread_start_us":286675,"threads_started":2}
I20260709 13:05:44.397641 17299 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:44.430800 15042 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:44.391613 17512 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:44.433337 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.399312 16723 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.430681 17047 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.536209 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.490238 17581 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:05:44.439608 17357 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:44.504040 15043 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.489609 14961 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
W20260709 13:05:44.393801 17462 consensus_meta.cc:287] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.805s	user 0.011s	sys 0.000s
I20260709 13:05:44.509545 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:44.513581 17578 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.524838 17468 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:44.514460 17577 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:05:44.514537 17535 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:44.520547 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 201470us
I20260709 13:05:44.524394 14887 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.397997 17560 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.524863 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:44.570518 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:44.570927 14890 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.540015 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:44.515524 17538 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:44.540711 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.537431 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:44.573227 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:44.513505 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:44.543174 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:44.574718 15549 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:44.524838 17358 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:44.522372 17566 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.548167 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.583238 15036 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:44.524564 17167 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:44.544261 15035 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:44.537279 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:44.577235 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63827.6us
W20260709 13:05:44.578004 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73800.4us
I20260709 13:05:44.544004 17468 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.536968 17544 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.541954 17047 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.588186 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.642535 15044 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
W20260709 13:05:44.705811 15038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1535) took 2312 ms (client timeout 2083 ms). Trace:
I20260709 13:05:44.648387 17550 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:44.707264 15038 rpcz_store.cc:269] 0709 13:05:42.393675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.554335 (+160660us) service_pool.cc:224] Handling call
0709 13:05:44.705623 (+2151288us) spinlock_profiling.cc:243] Waited 943 ms on lock 0x7b540008acd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:44.705741 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2169741056}
W20260709 13:05:44.707939 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 133721us
I20260709 13:05:44.576383 17460 tablet_copy_client.cc:806] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:05:44.708940 17460 tablet_copy_client.cc:670] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:05:44.708875 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.709352 17047 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.648355 17437 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.710048 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.686730 17512 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.583287 17562 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:44.707587 17550 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.678879 17357 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.711135 17550 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.543601 17462 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.711905 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.712385 17357 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.713063 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.713228 17550 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.713718 15044 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:44.656236 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.626323 17564 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.707794 15043 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:44.713750 17462 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:44.716949 14859 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38806 dropped due to backpressure: service queue is full with 50 items
I20260709 13:05:44.717229 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.717056 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.720677 17167 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.721063 15042 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:44.717048 14861 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:51176 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 329)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 330)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2252)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1782)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1785)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1786)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2254)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2262)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1791)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1799)
I20260709 13:05:44.722697 17167 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.710988 17562 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:44.723276 17562 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.595499 17578 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.576958 17538 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:44.715453 17550 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.726063 17538 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.726181 17550 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:44.727208 17538 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:44.725180 15044 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:44.685732 17253 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:44.720129 14890 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:44.729236 17550 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.729650 17578 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.730692 15044 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:44.727969 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1707) took 2285 ms. Trace:
I20260709 13:05:44.732730 14887 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:44.729241 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:44.733426 17504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:05:44.733644 14890 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:44.735661 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.547570 17535 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:44.738116 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1766) took 3897 ms. Trace:
I20260709 13:05:44.738288 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.740165 17358 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:44.732582 14965 rpcz_store.cc:276] 0709 13:05:42.442378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.442794 (+   416us) service_pool.cc:224] Handling call
0709 13:05:42.443092 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:42.445069 (+  1977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:42.445114 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:42.445841 (+   727us) log.cc:844] Serialized 52 byte log entry
0709 13:05:44.379595 (+1933754us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b1800496660. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:05:44.440509 (+ 60914us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:44.440571 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.440662 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:44.727648 (+286986us) raft_consensus.cc:1685] finished
0709 13:05:44.727672 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:44.727906 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1545,"raft.queue_time_us":108698,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":13638,"spinlock_wait_cycles":4891392,"thread_start_us":59567,"threads_started":1,"wal-append.queue_time_us":2039106}
W20260709 13:05:44.780470 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.782487 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:44.782357 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45389.8us
I20260709 13:05:44.744257 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.783666 15044 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:44.783754 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:44.784027 14887 rpcz_store.cc:276] 0709 13:05:40.840322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.346557 (+1506235us) service_pool.cc:224] Handling call
0709 13:05:42.346813 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:44.313740 (+1966927us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400038520. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d781c0 00007f5534d79231 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c
0709 13:05:44.733263 (+419523us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:44.738049 (+  4786us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499022080}
I20260709 13:05:44.785218 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.785734 14887 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:44.655967 17540 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.786880 17540 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.783865 14890 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:44.788177 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.785636 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.793428 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.794415 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.795598 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:44.626271 17041 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:44.798486 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.589419 17527 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:44.829052 14887 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:44.737627 17468 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:44.743319 17545 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.792240 17521 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:44.837590 17056 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.962s	user 0.010s	sys 0.002s
I20260709 13:05:44.836895 17041 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.832835 17527 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:44.796607 17114 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:44.868305 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:44.871732 14887 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:44.873705 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 88164us
I20260709 13:05:44.874486 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.876431 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:44.871219 17527 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:44.659638 17474 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.870931 17540 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:44.887935 15038 raft_consensus.cc:2410] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:44.880081 17186 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:44.871331 17056 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:44.894410 17576 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:44.908960 14887 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:44.910444 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.911194 14887 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:44.911778 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2260) took 1168 ms. Trace:
I20260709 13:05:44.912176 14887 rpcz_store.cc:276] 0709 13:05:43.743903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.910125 (+1166222us) service_pool.cc:224] Handling call
0709 13:05:44.911718 (+  1593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:44.895274 17474 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:44.945456 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.921295 17186 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:44.951962 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.923311 17426 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.955063 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.959462 14887 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:44.969072 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.972409 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:44.972731 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:44.920257 17469 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:44.973809 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:44.957139 17186 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:44.974547 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.957446 17357 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:44.979135 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:44.977587 17522 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:44.977710 17107 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:44.989953 14887 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:44.991526 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.980094 17186 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:44.995424 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:44.997697 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:44.993752 17522 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:44.974951 17521 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.009857 17536 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:45.010291 17536 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:45.010654 17536 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:45.012493 16932 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.000s
I20260709 13:05:45.012897 16932 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.013983 15550 raft_consensus.cc:2368] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6.
W20260709 13:05:45.017320 17509 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.871s	user 0.004s	sys 0.005s
I20260709 13:05:45.017729 17509 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.020126 17056 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.024195 17527 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.028893 17527 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.032416 17469 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.991595 17357 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:45.037024 17515 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.909s	user 0.001s	sys 0.008s
I20260709 13:05:45.037398 17357 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:44.999544 17499 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:45.043998 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:45.004624 17253 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:45.044019 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.049104 14887 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
W20260709 13:05:45.052983 17552 consensus_meta.cc:287] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.001s
I20260709 13:05:45.065492 17509 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:45.048563 17521 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:45.037480 17515 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.048563 17522 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
W20260709 13:05:45.065927 17299 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:05:45.050326 17253 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:45.072875 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 529740us
I20260709 13:05:45.084563 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.085372 17253 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:45.085837 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:45.076145 17403 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.913s	user 0.009s	sys 0.001s
I20260709 13:05:45.086280 17511 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:45.075992 17299 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.086685 17511 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.087528 17511 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.088204 17299 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.088426 17511 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:45.078928 17457 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.000s
I20260709 13:05:45.079457 17529 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:45.081329 17493 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
W20260709 13:05:45.076189 17557 consensus_meta.cc:287] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.560s	user 0.007s	sys 0.001s
I20260709 13:05:45.071550 17464 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.068866 17552 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.089030 17595 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:45.089310 17535 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.090440 17527 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.068094 16932 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.064759 17562 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:45.102068 17566 consensus_meta.cc:287] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.514s	user 0.009s	sys 0.000s
I20260709 13:05:45.108706 17515 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.108727 17253 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.169837 17527 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.112205 17532 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.108973 17396 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.073472 17521 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.115113 17536 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.115934 17468 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.159019 17595 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.180706 17595 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.181008 17521 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.172030 17566 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.184265 17562 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.168673 17469 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.177567 17552 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.159436 17557 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:45.178292 17523 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 2.791s	user 0.006s	sys 0.010s
I20260709 13:05:45.219250 14890 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:45.218886 14888 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:45.220818 14886 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:45.221031 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 171538us
I20260709 13:05:45.222779 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.227584 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.228987 14961 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.229290 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.090564 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1427) took 1101 ms. Trace:
I20260709 13:05:45.095440 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.116178 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.230921 14970 rpcz_store.cc:276] 0709 13:05:43.989053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.989163 (+   110us) service_pool.cc:224] Handling call
0709 13:05:45.090411 (+1101248us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540025b554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.090509 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590259968}
I20260709 13:05:45.232510 15040 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
W20260709 13:05:45.232594 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 137083us
I20260709 13:05:45.234887 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.097056 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.238397 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.239117 15037 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:45.092739 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.069515 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.240880 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.241671 14887 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:45.110539 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.129492 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.130841 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:45.243606 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.136171 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.244560 15043 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.245541 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.246229 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.131239 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.103986 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 550) took 1426 ms. Trace:
I20260709 13:05:45.247248 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.248699 15543 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.248126 15544 rpcz_store.cc:276] 0709 13:05:43.677562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.685533 (+  7971us) service_pool.cc:224] Handling call
0709 13:05:45.103811 (+1418278us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000ec754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.103921 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452138880}
I20260709 13:05:45.249136 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.249704 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.249925 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.250444 15549 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:45.250514 17047 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:45.250756 15544 raft_consensus.cc:2376] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4. Re-sending same reply.
I20260709 13:05:45.132656 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.251127 17047 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:45.251843 17047 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.252640 15547 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:05:45.128827 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.253885 15550 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:45.082369 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.131491 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.255544 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:45.094998 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.251194 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.261000 15546 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.261765 15037 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:45.241811 15041 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.128129 17168 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.236706 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.109930 17452 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.277734 17168 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.278496 17522 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.280128 17047 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.280644 17522 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:45.156265 17457 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.281805 17469 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.283771 17543 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.284053 17457 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.284652 17469 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.284559 17543 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.286037 17603 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:45.286846 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.286978 17595 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.287643 15541 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.287724 15040 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.267954 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.158910 17186 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.270476 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.280745 17168 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:45.185228 17468 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.289099 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.268206 17500 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:45.299242 17532 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:45.303164 15549 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 5 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:05:45.300817 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.187628 17527 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.309376 17460 tablet_copy_client.cc:538] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:05:45.310285 15010 leader_election.cc:400] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6.
I20260709 13:05:45.310669 15010 leader_election.cc:403] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:45.293889 17543 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.316468 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.319197 17566 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.289602 17522 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.283317 17047 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.334839 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.286998 17603 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.276479 17114 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.311918 17500 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.190587 17557 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.337297 17522 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.346916 15040 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
W20260709 13:05:45.348362 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.351191 15041 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:45.337954 17253 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.344635 17500 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:45.354564 15545 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.355392 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:45.356524 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.358855 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.358949 17581 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6.
I20260709 13:05:45.359526 17535 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.359684 14970 raft_consensus.cc:2376] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6. Re-sending same reply.
I20260709 13:05:45.363574 14962 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:45.358949 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.365311 15544 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.366068 17544 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.366772 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:45.368367 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.368623 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.369414 15041 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:45.370041 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.371033 14889 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 13:05:45.372041 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 60640.7us
I20260709 13:05:45.373036 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1796) took 1252 ms. Trace:
I20260709 13:05:45.373440 14890 rpcz_store.cc:276] 0709 13:05:44.120181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.787940 (+667759us) service_pool.cc:224] Handling call
0709 13:05:45.372782 (+584842us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b540024f9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.372950 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986165632}
I20260709 13:05:45.374673 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:45.376552 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 333) took 2993 ms (client timeout 1738 ms). Trace:
I20260709 13:05:45.377068 15041 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:45.366626 17544 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.366647 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.378207 15549 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.378751 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.379117 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.379467 15544 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:45.379709 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.380043 15549 raft_consensus.cc:2410] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:05:45.376961 14892 rpcz_store.cc:269] 0709 13:05:42.383213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:42.473806 (+ 90593us) service_pool.cc:224] Handling call
0709 13:05:45.376150 (+2902344us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b540020f3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.376371 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416953216}
I20260709 13:05:45.381386 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.382236 14893 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:45.382354 17536 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.382433 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.358310 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.390017 14961 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:45.383355 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.393316 14890 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:45.381009 15544 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 6. Ops: []
I20260709 13:05:45.385241 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.395923 14894 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:45.397171 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.398099 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 339) took 1176 ms. Trace:
I20260709 13:05:45.398511 14894 rpcz_store.cc:276] 0709 13:05:44.221852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.396776 (+1174924us) service_pool.cc:224] Handling call
0709 13:05:45.398019 (+  1243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.381417 15549 raft_consensus.cc:1217] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[4.5-4.5]   Dedup: 4.5->[]
I20260709 13:05:45.399744 15549 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 13:05:45.399537 17114 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.402377 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:45.402968 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1795) took 1287 ms. Trace:
I20260709 13:05:45.403659 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.404417 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1544) took 1123 ms. Trace:
I20260709 13:05:45.412012 15035 rpcz_store.cc:276] 0709 13:05:44.280967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.285600 (+  4633us) service_pool.cc:224] Handling call
0709 13:05:45.403966 (+1118366us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540014c3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.404197 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373093760}
I20260709 13:05:45.413844 15035 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:45.413955 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 92161.9us
I20260709 13:05:45.404621 15039 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:05:45.414507 17522 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.405823 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.417613 15036 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:45.420126 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 343) took 1197 ms. Trace:
I20260709 13:05:45.408041 15042 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.411450 14893 raft_consensus.cc:2376] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5. Re-sending same reply.
I20260709 13:05:45.416427 17536 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:45.407384 14889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2255) took 1655 ms (client timeout 1828 ms). Trace:
I20260709 13:05:45.421254 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 347) took 1165 ms. Trace:
I20260709 13:05:45.421357 15542 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:45.421726 14893 rpcz_store.cc:276] 0709 13:05:44.255808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.401889 (+1146081us) service_pool.cc:224] Handling call
0709 13:05:45.421204 (+ 19315us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:45.421315 14889 rpcz_store.cc:269] 0709 13:05:43.716261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.027589 (+311328us) service_pool.cc:224] Handling call
0709 13:05:45.369683 (+1342094us) spinlock_profiling.cc:243] Waited 890 us on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:05:45.371379 (+  1696us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2046848}
I20260709 13:05:45.423012 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.423182 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:45.424268 14889 raft_consensus.cc:2410] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:05:45.424779 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2267) took 1130 ms. Trace:
I20260709 13:05:45.421290 17536 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.425407 17536 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.425619 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.425182 14894 rpcz_store.cc:276] 0709 13:05:44.222754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.399257 (+1176503us) service_pool.cc:224] Handling call
0709 13:05:45.420062 (+ 20805us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.383399 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:05:45.403314 14886 rpcz_store.cc:276] 0709 13:05:44.116070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.166224 (+ 50154us) service_pool.cc:224] Handling call
0709 13:05:45.402759 (+1236535us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54002eb3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.402901 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2421639424}
I20260709 13:05:45.430028 14889 rpcz_store.cc:276] 0709 13:05:44.294437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.422798 (+1128361us) service_pool.cc:224] Handling call
0709 13:05:45.424717 (+  1919us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.436486 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 346) took 1173 ms. Trace:
I20260709 13:05:45.436959 14892 rpcz_store.cc:276] 0709 13:05:44.255473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.382019 (+1126546us) service_pool.cc:224] Handling call
0709 13:05:45.428837 (+ 46818us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.407603 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:45.454438 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 329) took 4168 ms. Trace:
I20260709 13:05:45.416368 17500 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.458143 14965 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:45.458652 15549 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.457159 14893 rpcz_store.cc:276] 0709 13:05:41.268631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.424037 (+4155406us) service_pool.cc:224] Handling call
0709 13:05:45.424566 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.424849 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.424872 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.424930 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:45.427773 (+  2843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.436377 (+  8604us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.436558 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.462497 15037 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:45.462754 14887 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:45.463577 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 338) took 1242 ms. Trace:
I20260709 13:05:45.463994 14887 rpcz_store.cc:276] 0709 13:05:44.221630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.317700 (+1096070us) service_pool.cc:224] Handling call
0709 13:05:45.463506 (+145806us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.465602 14887 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:45.466323 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2252) took 3300 ms. Trace:
I20260709 13:05:45.466730 14887 rpcz_store.cc:276] 0709 13:05:42.165567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.464801 (+3299234us) service_pool.cc:224] Handling call
0709 13:05:45.465291 (+   490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.466040 (+   749us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.466242 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.470628 14886 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:45.471422 15544 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.474524 14890 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:05:45.475380 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2247) took 3372 ms. Trace:
I20260709 13:05:45.475859 14890 rpcz_store.cc:276] 0709 13:05:42.103151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.452539 (+3349388us) service_pool.cc:224] Handling call
0709 13:05:45.474278 (+ 21739us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.475096 (+   818us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.475304 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.477802 14890 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:45.462903 15037 pending_rounds.cc:85] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 2
I20260709 13:05:45.471218 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2244) took 3368 ms. Trace:
I20260709 13:05:45.484771 14886 rpcz_store.cc:276] 0709 13:05:42.102406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.452354 (+3349948us) service_pool.cc:224] Handling call
0709 13:05:45.470464 (+ 18110us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.470993 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.471149 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.483045 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.490504 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1779) took 2918 ms. Trace:
I20260709 13:05:45.490916 14890 rpcz_store.cc:276] 0709 13:05:42.565627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.476879 (+2911252us) service_pool.cc:224] Handling call
0709 13:05:45.477329 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.483954 (+  6625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.484077 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.492317 14894 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:05:45.484388 15037 pending_rounds.cc:107] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:45.493005 15037 raft_consensus.cc:2889] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:45.495705 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2245) took 3393 ms. Trace:
I20260709 13:05:45.496129 14892 rpcz_store.cc:276] 0709 13:05:42.102661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.451982 (+3349321us) service_pool.cc:224] Handling call
0709 13:05:45.453789 (+  1807us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.495337 (+ 41548us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.495360 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.495433 (+    73us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:45.495461 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.495532 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.495636 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.453789 17521 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:45.518888 17521 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:45.519176 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.520844 17500 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.521307 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:45.524056 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.524497 14889 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.517457 17443 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.521662 14968 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:45.531651 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.533213 17529 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:45.533712 17529 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.492697 14894 pending_rounds.cc:85] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 5
I20260709 13:05:45.536060 14894 pending_rounds.cc:107] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:05:45.539064 14894 raft_consensus.cc:2889] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:45.520251 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.517134 17522 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.510751 17430 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:45.524403 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.526769 15542 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:45.526901 14969 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:45.539947 14961 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:45.548650 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2251) took 3399 ms. Trace:
I20260709 13:05:45.507835 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:45.551317 14889 rpcz_store.cc:276] 0709 13:05:42.126068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.455528 (+3329460us) service_pool.cc:224] Handling call
0709 13:05:45.520435 (+ 64907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.524970 (+  4535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.525130 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.589186 17595 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.534945 17529 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.565860 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 330) took 4219 ms. Trace:
I20260709 13:05:45.569689 17460 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:05:45.601519 14894 rpcz_store.cc:276] 0709 13:05:41.341016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.427437 (+4086421us) service_pool.cc:224] Handling call
0709 13:05:45.455507 (+ 28070us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.559506 (+103999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.559744 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:45.560336 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.578244 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.604326 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:45.604539 15514 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.727s (SENT)
I20260709 13:05:45.604987 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:45.605000 15043 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.568881 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.580495 14969 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:05:45.519322 17521 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:45.567176 17582 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.058s	user 0.000s	sys 0.003s
I20260709 13:05:45.603569 14894 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:05:45.564353 14967 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.616771 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1784) took 3049 ms. Trace:
I20260709 13:05:45.618443 14894 rpcz_store.cc:276] 0709 13:05:42.566982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.602762 (+3035780us) service_pool.cc:224] Handling call
0709 13:05:45.603196 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.616449 (+ 13253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.616705 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.629464 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.630430 15038 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:45.631745 17459 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.633486 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.634400 15548 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:45.636556 17521 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.637594 14961 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:45.639111 17544 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.644510 17366 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.649365 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1783) took 3082 ms. Trace:
I20260709 13:05:45.649466 17246 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:45.649763 14887 rpcz_store.cc:276] 0709 13:05:42.566736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.550079 (+2983343us) service_pool.cc:224] Handling call
0709 13:05:45.648308 (+ 98229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.648624 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.648650 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.648703 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:45.648734 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.648784 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.648877 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.650777 17521 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:45.652859 17402 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.659994 14886 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:45.663981 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2254) took 1948 ms. Trace:
I20260709 13:05:45.664377 14886 rpcz_store.cc:276] 0709 13:05:43.715923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.659182 (+1943259us) service_pool.cc:224] Handling call
0709 13:05:45.659616 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.663350 (+  3734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.663926 (+   576us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.665757 15043 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:45.655386 17428 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.657837 17041 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.679178 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.679252 15548 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:45.680282 14961 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:45.688191 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.692023 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1780) took 3126 ms. Trace:
I20260709 13:05:45.692417 14893 rpcz_store.cc:276] 0709 13:05:42.565947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.493349 (+2927402us) service_pool.cc:224] Handling call
0709 13:05:45.497440 (+  4091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.530030 (+ 32590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.530061 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.530608 (+   547us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.558001 (+ 27393us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:45.558060 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.558152 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.691809 (+133657us) raft_consensus.cc:1685] finished
0709 13:05:45.691829 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.691972 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32101,"raft.queue_time_us":34946,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":245,"thread_start_us":26923,"threads_started":1,"wal-append.queue_time_us":159374}
I20260709 13:05:45.695794 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.697108 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.697674 14966 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:45.699652 17520 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:45.701006 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.662505 17536 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.681273 17544 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:45.706099 15548 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:45.708935 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:45.711843 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.716629 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.720461 14889 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:45.721112 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1786) took 3153 ms. Trace:
I20260709 13:05:45.721414 14889 rpcz_store.cc:276] 0709 13:05:42.567507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.623029 (+3055522us) service_pool.cc:224] Handling call
0709 13:05:45.708828 (+ 85799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.720873 (+ 12045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.721037 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.722704 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:45.723505 15548 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:05:45.726543 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.727540 14968 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:45.729607 14962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 1722) took 1564 ms (client timeout 1605 ms). Trace:
I20260709 13:05:45.729964 14964 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:45.730345 14964 pending_rounds.cc:85] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 6
W20260709 13:05:45.730037 14962 rpcz_store.cc:269] 0709 13:05:44.165237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.203237 (+ 38000us) service_pool.cc:224] Handling call
0709 13:05:45.729355 (+1526118us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003e5654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.729526 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2665264000}
I20260709 13:05:45.730671 14964 pending_rounds.cc:107] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:45.730921 14964 raft_consensus.cc:2889] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:45.736897 17617 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
I20260709 13:05:45.741714 14967 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:45.743255 14966 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:45.748349 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:45.749981 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 242257us
I20260709 13:05:45.756187 15548 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:45.760983 14889 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:45.755276 17544 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.764027 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2262) took 1979 ms. Trace:
I20260709 13:05:45.765450 14889 rpcz_store.cc:276] 0709 13:05:43.784559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.724628 (+1940069us) service_pool.cc:224] Handling call
0709 13:05:45.754875 (+ 30247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.763837 (+  8962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.763987 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:05:45.768240 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.768797 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.764494 15548 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:45.758522 17529 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.774480 15514 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.773958 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2261) took 2020 ms. Trace:
I20260709 13:05:45.758601 17041 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.765092 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.778610 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.781147 14966 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:45.784718 17041 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.786839 17041 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.787380 17344 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:45.790843 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.779356 14886 rpcz_store.cc:276] 0709 13:05:43.753739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.665090 (+1911351us) service_pool.cc:224] Handling call
0709 13:05:45.669020 (+  3930us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.671035 (+  2015us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:05:45.716669 (+ 45634us) log.cc:844] Serialized 14 byte log entry
0709 13:05:45.773635 (+ 56966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.773686 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:05:45.773748 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.773804 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.773905 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87519,"raft.queue_time_us":99,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":71928,"threads_started":2}
I20260709 13:05:45.798758 15544 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:45.801152 17543 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:45.801604 17543 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.802156 15544 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:45.803149 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 119738us
I20260709 13:05:45.803771 17536 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.804001 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.805712 17528 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:45.806260 17528 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.807307 17528 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:45.808135 14891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1788) took 3240 ms (client timeout 2037 ms). Trace:
I20260709 13:05:45.808528 17463 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:45.808602 14891 rpcz_store.cc:269] 0709 13:05:42.568022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.704039 (+1136017us) service_pool.cc:224] Handling call
0709 13:05:45.807815 (+2103776us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54002ec2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.807965 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772352896}
I20260709 13:05:45.809336 17463 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.810868 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1793) took 1748 ms. Trace:
I20260709 13:05:45.811218 17451 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:45.811789 17451 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.803056 17186 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:45.813836 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.802708 17543 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.815747 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.816792 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.811251 14891 rpcz_store.cc:276] 0709 13:05:44.062080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.809808 (+1747728us) service_pool.cc:224] Handling call
0709 13:05:45.810144 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.810401 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.810435 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.810491 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:45.810529 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.810704 (+   175us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.810819 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.820647 17459 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:45.821256 17459 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.823594 17526 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:45.823695 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.824268 17526 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.825294 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.825356 17526 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.826526 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.827271 17581 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:45.827790 15010 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:05:45.827811 17581 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:45.822496 17459 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.829245 17581 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.829952 17503 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.832019 17463 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:45.833155 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.834327 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.834805 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:45.838233 17366 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:45.839859 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.840173 17603 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.840569 15036 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:45.812850 17451 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.842316 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1782) took 3275 ms. Trace:
W20260709 13:05:45.842768 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1787) took 3274 ms (client timeout 1900 ms). Trace:
I20260709 13:05:45.842692 14890 rpcz_store.cc:276] 0709 13:05:42.566486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.494775 (+2928289us) service_pool.cc:224] Handling call
0709 13:05:45.661916 (+167141us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.716515 (+ 54599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.716607 (+    92us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.750202 (+ 33595us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.781962 (+ 31760us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:45.781996 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.782059 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.842119 (+ 60060us) raft_consensus.cc:1685] finished
0709 13:05:45.842136 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.842248 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14333,"raft.queue_time_us":21492,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":8449,"thread_start_us":21189,"threads_started":1,"wal-append.queue_time_us":59321}
W20260709 13:05:45.844805 14888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1781) took 3278 ms (client timeout 3164 ms). Trace:
I20260709 13:05:45.845075 14890 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:05:45.845198 14888 rpcz_store.cc:269] 0709 13:05:42.566233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.047269 (+1481036us) service_pool.cc:224] Handling call
0709 13:05:45.844623 (+1797354us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54000f7b54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.844725 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2540244224}
I20260709 13:05:45.845678 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 350) took 1517 ms. Trace:
I20260709 13:05:45.846151 14890 rpcz_store.cc:276] 0709 13:05:44.327960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.844452 (+1516492us) service_pool.cc:224] Handling call
0709 13:05:45.844831 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.845460 (+   629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.845635 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.846618 14888 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:45.847043 17385 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.847447 14890 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:45.848009 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2269) took 1408 ms. Trace:
W20260709 13:05:45.848913 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.848331 14890 rpcz_store.cc:276] 0709 13:05:44.440015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.846869 (+1406854us) service_pool.cc:224] Handling call
0709 13:05:45.847146 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.847810 (+   664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.847971 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.851015 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1799) took 1141 ms. Trace:
I20260709 13:05:45.851296 14887 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:45.851444 14890 rpcz_store.cc:276] 0709 13:05:44.709903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.849964 (+1140061us) service_pool.cc:224] Handling call
0709 13:05:45.850335 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.850671 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.850698 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.850756 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:45.850807 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.850861 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.850964 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.847174 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2268) took 1414 ms. Trace:
W20260709 13:05:45.852420 15547 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 556) took 1321 ms (client timeout 1685 ms). Trace:
I20260709 13:05:45.853188 14890 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:05:45.854470 14890 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.852521 14888 rpcz_store.cc:276] 0709 13:05:44.432806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.846104 (+1413298us) service_pool.cc:224] Handling call
0709 13:05:45.846413 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.846969 (+   556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.847133 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.855665 14890 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:05:45.857324 17618 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 13:05:45.857503 14886 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:45.858119 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 348) took 1587 ms. Trace:
I20260709 13:05:45.783856 17544 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.828125 15010 leader_election.cc:403] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:45.861431 17544 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:45.861474 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.861851 17463 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:45.862504 15041 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:45.852041 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2257) took 2135 ms. Trace:
I20260709 13:05:45.858381 14886 rpcz_store.cc:276] 0709 13:05:44.270898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.857120 (+1586222us) service_pool.cc:224] Handling call
0709 13:05:45.857354 (+   234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.857948 (+   594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.858077 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:45.863281 14887 rpcz_store.cc:276] 0709 13:05:43.716824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.663064 (+1946240us) service_pool.cc:224] Handling call
0709 13:05:45.850852 (+187788us) spinlock_profiling.cc:243] Waited 14.2 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:45.851098 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.851840 (+   742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.851994 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32699136}
I20260709 13:05:45.862406 17428 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:05:45.868979 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.869505 17443 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
W20260709 13:05:45.843214 14895 rpcz_store.cc:269] 0709 13:05:42.567764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:43.691058 (+1123294us) service_pool.cc:224] Handling call
0709 13:05:45.842477 (+2151419us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b54002ebdd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.842613 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419444096}
I20260709 13:05:45.869906 17443 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:45.869753 17114 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:45.848398 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:45.852972 15547 rpcz_store.cc:269] 0709 13:05:44.531121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.531253 (+   132us) service_pool.cc:224] Handling call
0709 13:05:45.852226 (+1320973us) spinlock_profiling.cc:243] Waited 679 ms on lock 0x7b54003c91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:45.852355 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1562603904}
I20260709 13:05:45.861366 17563 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:05:45.874754 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.870959 17443 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.885593 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:45.887382 17443 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.887262 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:45.890796 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1790) took 2128 ms. Trace:
I20260709 13:05:45.876477 17521 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:45.894172 14893 rpcz_store.cc:276] 0709 13:05:43.762838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.694023 (+1931185us) service_pool.cc:224] Handling call
0709 13:05:45.880126 (+186103us) spinlock_profiling.cc:243] Waited 9.75 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:45.880280 (+   154us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.890492 (+ 10212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.890519 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:45.890559 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:45.890587 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.890650 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.890747 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22419840}
W20260709 13:05:45.895371 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 104643us
I20260709 13:05:45.899418 17056 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:45.899854 17056 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:45.900930 17056 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.902410 17056 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:45.911860 17246 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:45.912397 17246 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:45.912869 17246 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:45.913473 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.913650 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:45.914125 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.871487 17441 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:05:45.924734 15036 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:45.925379 15010 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:05:45.925697 15010 leader_election.cc:403] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:45.926678 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:45.930017 17595 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:45.930799 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.931684 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:44.717418 14859 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:38806 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1797)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 344)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1796)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2270)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2271)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2260)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1798)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2273)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1800)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 338)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1802)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2272)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 339)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 1801)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 329)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 330)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2244)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2245)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2247)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2251)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2252)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1779)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1780)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1782)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1783)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1784)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1785)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1786)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2254)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2257)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2261)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1790)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2262)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1791)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1793)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 348)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 350)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2268)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2269)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1799)
I20260709 13:05:45.934365 15548 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:05:45.935683 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 138125us
I20260709 13:05:45.891888 17563 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.894210 17503 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:45.944458 17536 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:45.945009 17544 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:45.945482 17536 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:45.946007 17544 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:45.946434 17536 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:45.947029 17536 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.947225 17430 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:45.947642 17430 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.948511 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1785) took 3381 ms. Trace:
I20260709 13:05:45.948859 17186 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:45.949482 17186 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:45.949059 14894 rpcz_store.cc:276] 0709 13:05:42.567228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.620605 (+3053377us) service_pool.cc:224] Handling call
0709 13:05:45.687853 (+ 67248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.718260 (+ 30407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.718289 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.741603 (+ 23314us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.795269 (+ 53666us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:45.795307 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.795384 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:45.948224 (+152840us) raft_consensus.cc:1685] finished
0709 13:05:45.948251 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:45.948441 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6216,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":18743,"thread_start_us":39247,"threads_started":1,"wal-append.queue_time_us":148256}
I20260709 13:05:45.945114 17547 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:45.948532 17430 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:45.953336 17430 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.955601 17603 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:45.946470 17544 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:45.957451 17544 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.959466 17544 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.943161 17503 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:45.960275 17503 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.961994 15041 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:45.964563 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.964247 17536 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:45.964279 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:45.967590 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.950707 17186 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:45.969208 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 73896.5us
I20260709 13:05:45.974519 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:45.977437 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.978914 14970 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:45.978788 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:45.975841 17463 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
W20260709 13:05:45.986009 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59384.1us
I20260709 13:05:45.989259 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:45.990106 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:45.965796 17543 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:45.965266 17522 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:45.993795 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:45.999732 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.002741 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.004909 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.005668 14966 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:46.008247 14970 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:46.010947 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:45.959299 17563 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.017851 14963 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:46.022689 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:46.004510 17441 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:46.017841 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:46.029703 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.010571 17536 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:46.032060 15007 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 2.016s (SENT)
I20260709 13:05:46.036955 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.031059 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.030133 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.033778 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.037827 14970 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:46.034160 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:45.997856 17522 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.039049 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.039122 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.042369 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:46.039746 14969 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:05:46.043216 14966 raft_consensus.cc:2410] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:46.043200 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.045042 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.046000 15546 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.025542 17463 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:46.049584 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.051496 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:46.051674 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.052179 15040 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:46.052852 17516 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.053297 17516 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:46.053696 17516 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.056941 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.042191 17441 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:46.057468 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:46.051064 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.054852 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.064709 14969 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:46.056291 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.058540 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.072068 15549 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.059089 17428 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:46.073385 17428 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.073786 17428 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.060341 14964 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:46.047540 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.075665 14961 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:46.065632 17505 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.076375 17505 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:46.076855 17505 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:46.076987 17622 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.352s	user 0.001s	sys 0.003s
I20260709 13:05:46.066087 17529 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:46.079823 17529 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.080415 15044 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:46.066246 15550 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.066107 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.071367 17463 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:46.085235 14967 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:46.094184 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.097323 14970 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.098204 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.095824 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.027053 17520 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 13:05:46.105314 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:46.108414 15038 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.106376 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:46.111280 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:46.081661 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:46.109311 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:46.118306 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.109941 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:46.124046 15044 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.080767 17529 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.116842 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:46.099880 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.129477 17441 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:46.131114 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 164111us
I20260709 13:05:46.132988 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:46.133754 14968 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:46.133984 17503 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.160943 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.162353 17503 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:46.162665 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:46.136018 17522 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.137959 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.141810 17560 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.143255 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.126911 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2266) took 1834 ms. Trace:
I20260709 13:05:46.156821 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.173247 14963 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.159433 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.159631 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.160180 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.166522 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.167851 15036 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
W20260709 13:05:46.168444 17583 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.652s	user 0.004s	sys 0.000s
I20260709 13:05:46.175158 15040 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:46.175312 17430 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.175491 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:46.175868 17463 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.175846 17451 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:46.176810 17443 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:46.181681 14967 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:46.181620 17528 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:05:46.182907 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.191180 15544 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.185973 17563 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:46.189117 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:46.166311 15542 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:46.187347 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.193926 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:46.196197 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 139742us
I20260709 13:05:46.199481 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.209167 14967 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:46.207685 14969 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:46.183808 17542 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.201287 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.203747 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.192291 17430 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:46.188167 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:46.210922 15549 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:46.196029 17451 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:46.215900 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 183869us
I20260709 13:05:46.218604 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.219596 14961 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:05:46.223989 14963 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:05:46.224284 17630 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260709 13:05:46.221493 17542 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.224864 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.174361 14891 rpcz_store.cc:276] 0709 13:05:44.292459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.867151 (+1574692us) service_pool.cc:224] Handling call
0709 13:05:45.898337 (+ 31186us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:45.971244 (+ 72907us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:45.984354 (+ 13110us) log.cc:844] Serialized 14 byte log entry
0709 13:05:46.126347 (+141993us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:46.126401 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:46.126452 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:46.126514 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.126861 (+   347us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8311,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":15439,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":2648,"thread_start_us":126259,"threads_started":1}
I20260709 13:05:46.209457 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:46.230967 15007 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 2.079s (SENT)
I20260709 13:05:46.231454 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.229045 14966 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:46.215041 17430 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.246163 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:46.243480 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49669.2us
I20260709 13:05:46.240032 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1791) took 2182 ms. Trace:
I20260709 13:05:46.251387 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.218892 17451 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:46.258548 15043 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:05:46.238884 17631 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 13:05:46.231350 17366 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:46.260152 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.221307 17521 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.262148 17563 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:05:46.263064 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.264632 17542 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.252514 14889 rpcz_store.cc:276] 0709 13:05:44.057268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:45.766288 (+1709020us) service_pool.cc:224] Handling call
0709 13:05:45.766696 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:45.767220 (+   524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:45.767250 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:45.767707 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 13:05:45.795613 (+ 27906us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:45.795646 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:45.795705 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:46.239837 (+444132us) raft_consensus.cc:1685] finished
0709 13:05:46.239855 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:46.239981 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":905,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":27611,"threads_started":1,"wal-append.queue_time_us":117135}
W20260709 13:05:46.280174 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.261687 17639 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:46.304232 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 154278us
W20260709 13:05:46.310288 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.314692 14970 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:46.268195 17459 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.307106 17521 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:46.324054 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.324777 14966 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:05:46.306098 17366 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:46.235360 17428 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.327951 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.330245 17366 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.331202 17428 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:46.247331 17516 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.332360 17505 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.333386 17516 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.334856 17505 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:46.335901 14962 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:46.339824 15037 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:46.340548 17540 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.341179 17540 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.341403 17459 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.328811 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.347904 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.349218 17639 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.350386 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.351501 17639 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.322160 17542 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.325747 17521 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.356122 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.364025 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.364615 17459 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:46.370818 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.373040 17544 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.375514 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.387969 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.372237 17540 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.393126 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.400455 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.398854 17505 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:46.415490 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.417928 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.418699 14968 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:05:46.419050 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 63273.3us
W20260709 13:05:46.422705 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.425961 14966 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:05:46.389133 17246 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.429322 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.391570 17056 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:05:46.394112 17542 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.458280 17505 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:46.459813 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.460666 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.461218 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.461493 14893 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:46.461997 14891 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:46.462242 17603 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:46.462863 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.463586 14894 raft_consensus.cc:2376] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8. Re-sending same reply.
I20260709 13:05:46.458830 14970 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:46.464669 17503 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.465613 17505 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:46.465734 17520 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:46.466566 17516 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:05:46.462764 17522 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:46.467054 17516 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.460763 17542 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:46.466050 17505 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.464003 17603 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:05:46.466070 17632 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.326s	user 0.002s	sys 0.000s
I20260709 13:05:46.481676 17543 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:46.482306 17543 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.482030 17516 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.483387 17516 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:46.484419 17522 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:46.467916 17540 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.502638 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:46.503995 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 78697.4us
I20260709 13:05:46.439023 17451 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.513314 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:46.517894 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49011.8us
W20260709 13:05:46.518018 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.521896 17566 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.522060 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "156c010162bf4cb99b535677eccb2740"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:46.522717 14891 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:46.522862 15042 raft_consensus.cc:606] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:46.523027 17566 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:46.523511 17566 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:46.524861 17505 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.525784 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.526309 17505 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.523208 15042 raft_consensus.cc:614] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:46.527153 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.527740 14894 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.514773 17056 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:05:46.528959 17056 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:46.519203 14963 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:05:46.536451 17594 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:46.539201 17520 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:46.483435 17543 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.507658 17503 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:46.540936 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:46.543653 15548 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:46.546921 17560 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.548614 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.548987 17543 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.541296 17520 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.550202 17520 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.550638 17536 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:46.548947 17560 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.529289 17056 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:46.547441 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.547669 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.539903 17540 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.548641 17637 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.556118 17056 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.556303 17540 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.556825 17637 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.557240 17637 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.557380 17056 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.558768 17246 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.554620 15546 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:46.560088 14889 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:46.560796 14893 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:05:46.560396 17566 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.560173 17540 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.561594 17566 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.561983 15008 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:05:46.543010 17503 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.564450 17451 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:46.567147 17443 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:46.568397 17430 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.568882 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.563551 17503 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:46.569857 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.570050 17503 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:46.570475 17430 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.570637 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.554804 14891 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:46.560025 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:46.572283 15042 raft_consensus.cc:606] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:46.569748 14790 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 4, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.574630 17540 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.575614 14894 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:46.576889 15042 raft_consensus.cc:614] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:46.577744 17581 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:46.578325 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.577698 17428 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:46.578960 14970 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:46.576557 17520 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.586463 17460 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:05:46.576777 17443 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.588508 17650 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:46.588932 17650 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.589721 17650 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.590864 17650 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.591682 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:46.593636 17647 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:05:46.594117 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.595194 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.595743 17535 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.596130 17535 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.596498 17535 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.596549 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:46.597489 17633 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.387s	user 0.002s	sys 0.001s
I20260709 13:05:46.598472 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.598839 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.599588 17547 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.593415 17637 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.605239 14965 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:46.612716 17535 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.587419 17460 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:05:46.621580 17560 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.621910 17637 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:46.627772 17460 ts_tablet_manager.cc:1403] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 1.058s	user 0.032s	sys 0.026s
I20260709 13:05:46.628988 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:46.616050 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62742.8us
I20260709 13:05:46.613025 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:46.616393 17366 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:46.629899 14965 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:46.631171 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:46.633968 14962 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:46.639604 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.640025 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.641767 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.577456 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:46.648991 15007 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.900s (SENT)
I20260709 13:05:46.650964 14894 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:46.652228 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.653610 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.654255 14889 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.640219 14962 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:46.655889 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.657325 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.660475 14961 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
W20260709 13:05:46.660653 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 66646.7us
W20260709 13:05:46.660960 14792 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 279) took 19045 ms (client timeout 15000 ms). Trace:
I20260709 13:05:46.661505 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.662055 14961 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:46.661716 14790 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.662935 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.664139 14969 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:05:46.669799 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.674626 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.658128 14891 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:46.671628 14890 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:46.668272 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:46.670465 14888 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.668586 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:46.673902 14967 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:46.702950 15042 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:46.703754 15042 raft_consensus.cc:614] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:46.703974 14894 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:46.677093 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.664474 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.701548 14969 pending_rounds.cc:85] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 6
I20260709 13:05:46.706156 14969 pending_rounds.cc:107] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:05:46.706630 14969 raft_consensus.cc:2889] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:46.707332 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:46.707648 14886 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:46.675184 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.663345 14961 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:05:46.709970 14887 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.675521 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.674422 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.708504 14893 raft_consensus.cc:2410] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:05:46.711283 14892 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:46.713985 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.714164 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.714795 14891 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.715515 17566 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.715924 17566 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:46.716265 17566 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.667671 17560 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.667476 17595 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:46.610934 17521 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.675073 17639 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.722935 14967 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:46.722692 17246 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:05:46.674899 17056 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:46.674866 17638 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:46.673674 17542 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.725631 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.709532 17451 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:46.729374 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54818.2us
I20260709 13:05:46.736284 15008 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
W20260709 13:05:46.732342 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.667981 17594 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:46.732597 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.664345 14790 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:46.739068 14967 raft_consensus.cc:2368] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:46.668619 17474 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:05:46.726583 17595 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.719595 17540 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:46.751940 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:46.733121 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.754110 14961 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:46.736490 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:46.661309 14792 rpcz_store.cc:269] 0709 13:05:27.615677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.621557 (+  5880us) service_pool.cc:224] Handling call
0709 13:05:46.660715 (+19039158us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:37.667699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:37.716463 (+ 48764us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:37.716515 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:05:37.716547 (+    32us) tablet.cc:662] Decoding operations
0709 13:05:37.718437 (+  1890us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:37.718514 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:37.718539 (+    25us) tablet.cc:685] Acquiring locks for 24 operations
0709 13:05:38.027348 (+308809us) tablet.cc:701] Row locks acquired
0709 13:05:38.038185 (+ 10837us) write_op.cc:260] PREPARE: finished
0709 13:05:38.101103 (+ 62918us) write_op.cc:270] Start()
0709 13:05:38.101316 (+   213us) write_op.cc:276] Timestamp: P: 1783602338064953 usec, L: 0
0709 13:05:38.101348 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:05:38.312011 (+210663us) log.cc:844] Serialized 9345 byte log entry
0709 13:05:38.871135 (+559124us) op_driver.cc:464] REPLICATION: finished
0709 13:05:39.053739 (+182604us) write_op.cc:301] APPLY: starting
0709 13:05:39.070594 (+ 16855us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:39.140934 (+ 70340us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:39.151361 (+ 10427us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:39.153959 (+  2598us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:39.154490 (+   531us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 13:05:39.154555 (+    65us) write_op.cc:312] APPLY: finished
0709 13:05:39.155230 (+   675us) log.cc:844] Serialized 164 byte log entry
0709 13:05:39.218686 (+ 63456us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:39.221900 (+  3214us) write_op.cc:454] Released schema lock
0709 13:05:39.224013 (+  2113us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:39.224406 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:39.224432 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":11590,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":149090,"apply.run_cpu_time_us":6275,"apply.run_wall_time_us":191582,"num_ops":24,"prepare.queue_time_us":608597,"prepare.run_cpu_time_us":64051,"prepare.run_wall_time_us":773250,"raft.queue_time_us":93290,"raft.run_cpu_time_us":8009,"raft.run_wall_time_us":106648,"replication_time_us":769620,"thread_start_us":868394,"threads_started":4,"wal-append.queue_time_us":148911,"wal-append.run_cpu_time_us":27281,"wal-append.run_wall_time_us":1660924}]]}
I20260709 13:05:46.744942 14963 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:46.745419 14968 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:46.746300 14895 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.746603 14966 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:05:46.757722 14888 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 13:05:46.747622 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 73283.7us
I20260709 13:05:46.747138 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.743712 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:46.759478 14965 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:46.733860 14890 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:46.731187 17056 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.735790 17451 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.767022 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:46.769805 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.770457 14893 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:46.751488 17595 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.769901 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.775609 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.746173 17441 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:05:46.747771 17503 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 13:05:46.765888 17056 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:46.770277 17451 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:46.788471 14790 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 3, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:46.791697 14790 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 3, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 3 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:46.793601 17460 raft_consensus.cc:359] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:46.794621 17460 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:05:46.758505 17639 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.778520 17459 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:46.778362 17535 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:46.784667 17246 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:05:46.778824 17652 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:46.788746 17638 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.797276 15008 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
W20260709 13:05:46.795717 15007 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 2.037s (SENT)
I20260709 13:05:46.829289 14961 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:46.837718 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.828941 14891 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:05:46.825218 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49658.8us
I20260709 13:05:46.840579 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.840842 14892 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:46.803339 14889 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:46.842502 14887 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:46.808847 14790 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 2, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:46.815882 17543 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:05:46.848343 17655 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:46.848930 17543 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:46.787194 17526 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:05:46.849352 17543 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:46.850771 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53627.9us
I20260709 13:05:46.846894 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:46.855937 17428 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.859019 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.859792 14895 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:46.863232 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:46.864343 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:46.853399 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.860662 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:46.815941 17652 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:46.809597 17639 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:46.870155 14888 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:46.820166 17528 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:46.809835 17459 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:46.823846 17463 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:46.876737 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:46.877352 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:46.847589 17529 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:46.881076 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.816053 17544 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:05:46.856724 17542 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:46.886977 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:46.816869 17503 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 13:05:46.872689 17603 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:46.807672 17530 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260709 13:05:46.875135 17520 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:46.873095 17652 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:46.823042 17566 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.872864 17522 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:46.896440 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100761us
I20260709 13:05:46.875746 17528 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:46.887461 17463 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:46.816668 17638 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.907166 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:46.923565 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.795372 17460 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:46.891317 17651 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:46.850188 17543 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:46.937024 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:46.938436 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 51519.1us
I20260709 13:05:46.926926 17529 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:46.922246 17603 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.926069 17536 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:46.928869 17520 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:46.932770 17521 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:46.933847 17522 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:46.948340 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91243.7us
I20260709 13:05:46.957379 15543 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEARNER]: Advancing to term 4
I20260709 13:05:46.957087 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:46.958979 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:46.929190 17637 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:46.961330 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:46.958413 15542 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:46.942296 17655 raft_consensus.cc:2764] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:05:46.973567 15040 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.968917 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:46.977149 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.948658 17529 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:46.970804 14964 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:46.978624 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:46.981954 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:46.969565 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:46.984982 15036 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:46.985356 15043 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:46.988596 15040 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:46.987262 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:46.981503 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:46.993345 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.029444 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.030864 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52306.5us
I20260709 13:05:47.034528 17563 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:46.946908 17459 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.036374 17459 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.036676 17662 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:05:47.039769 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 63117.4us
I20260709 13:05:46.964543 17536 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:46.987083 17529 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.046377 15543 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 13:05:47.078086 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96670.9us
W20260709 13:05:47.030076 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.078819 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.079988 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:46.974843 17637 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:47.056993 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.083669 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:47.083997 17658 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:05:47.085219 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:47.031330 17655 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:47.086855 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 53455.8us
I20260709 13:05:47.086266 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:47.086548 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 109297us
I20260709 13:05:47.039145 17503 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:47.093138 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:47.086418 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 116906us
I20260709 13:05:47.097025 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.098906 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:47.101051 17547 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260709 13:05:47.101481 17547 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.092507 17520 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.102989 14964 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:47.076552 17528 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.099653 17663 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:47.110550 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.087736 17544 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:47.087144 17521 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:47.084406 17530 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.121086 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 43489.7us
W20260709 13:05:47.126729 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.110109 17651 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.119136 17663 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.136610 17663 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:47.139642 17656 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:05:47.140069 17637 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:47.143074 17661 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 13:05:47.145264 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:47.083711 17671 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.105822 17430 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.096058 17503 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:47.172286 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 51378.5us
I20260709 13:05:47.172643 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:47.173046 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.146425 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.150470 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.106627 17560 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.027556 17463 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.113821 17505 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:05:47.176594 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 82690.5us
W20260709 13:05:47.184784 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.149587 17443 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.561s	user 0.006s	sys 0.003s
I20260709 13:05:47.189066 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:47.190546 14968 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:47.136629 17543 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:47.195580 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 87152.4us
W20260709 13:05:47.200016 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76802.2us
I20260709 13:05:47.198961 17542 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.091041 17603 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.175813 17503 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.145790 17056 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.210882 17463 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.151340 17530 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.220892 17528 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.221330 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:47.201745 17443 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:47.094440 17522 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:47.224023 17660 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:05:47.175369 17566 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.211377 17520 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.151866 17521 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:05:47.241791 15040 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:47.276059 15039 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:47.242048 15043 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:47.203372 17544 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:05:47.244724 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:47.248416 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.286077 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:47.254051 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.286648 14965 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.286669 14964 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.236749 17460 ts_tablet_manager.cc:1434] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.608s	user 0.002s	sys 0.008s
I20260709 13:05:47.250515 17663 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:47.309799 14967 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.261909 15042 raft_consensus.cc:606] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:47.310398 15042 raft_consensus.cc:614] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:47.311120 15550 raft_consensus.cc:2410] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:47.266239 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.266928 17673 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:47.269609 17659 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
W20260709 13:05:47.270533 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 69824us
I20260709 13:05:47.316035 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:47.151575 17651 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 13:05:47.121668 17547 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:05:47.272303 14889 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:47.247174 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58222us
W20260709 13:05:47.287357 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.323107 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:47.276796 17671 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.326187 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 175799us
I20260709 13:05:47.288995 14965 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:47.260284 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:47.330574 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 64399.3us
W20260709 13:05:47.298030 17674 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:05:47.285624 17560 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:05:47.302361 15039 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:47.294974 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:47.336105 14888 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
W20260709 13:05:47.331627 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.258533 17638 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.308810 17056 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:47.343317 14965 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.344863 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:47.314482 17673 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:05:47.309695 17460 ts_tablet_manager.cc:1467] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Tablet startup took 664ms
I20260709 13:05:47.356446 15043 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:05:47.356904 15043 pending_rounds.cc:85] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 5
I20260709 13:05:47.357061 15043 pending_rounds.cc:107] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:05:47.357204 15043 raft_consensus.cc:2889] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:47.359529 17595 consensus_meta.cc:287] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.576s	user 0.010s	sys 0.001s
I20260709 13:05:47.360055 17595 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.362170 17595 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:47.363937 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.366269 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:47.332571 17663 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:47.368312 17540 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.001s
I20260709 13:05:47.368794 17540 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.368498 17663 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.369606 17540 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:47.370061 17540 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:47.370503 17540 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.372939 17560 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:47.380291 15041 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:47.335743 17542 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:47.388669 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.392076 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.393321 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.393841 14967 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:47.394568 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.398180 14967 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:47.367173 17683 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.331840 17682 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.329532 17459 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260709 13:05:47.401315 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 47008.5us
I20260709 13:05:47.356410 17536 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:47.407665 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.410151 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:47.356664 17566 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:47.399940 17653 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.003s
I20260709 13:05:47.344898 17526 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 13:05:47.450222 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.450717 17530 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:47.451576 17530 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:47.354601 17430 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:05:47.336028 17671 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.356032 17673 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.432503 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:47.433207 15044 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:47.454622 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:47.455204 17595 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:47.455974 15044 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:47.456765 17526 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:47.458437 17526 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:05:47.460099 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:47.430981 17688 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:05:47.430740 17505 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:05:47.435463 17566 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.440689 17563 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:47.435338 17521 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:05:47.441756 17535 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:47.442700 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:47.467312 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:47.443333 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:47.403174 17529 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.447983 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.395519 17651 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.434255 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:47.473536 14967 raft_consensus.cc:2410] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:05:47.461575 14962 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:47.461460 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 129826us
W20260709 13:05:47.473819 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 133134us
I20260709 13:05:47.460775 14964 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:47.475612 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:47.476574 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:47.481251 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:47.484606 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.486577 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.489595 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:47.491479 14962 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:47.491998 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.468212 17566 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.495579 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:47.497149 14964 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.494604 15042 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:47.540659 15043 raft_consensus.cc:606] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:47.541174 15043 raft_consensus.cc:614] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:47.541730 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.542284 14894 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:47.460930 17463 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:05:47.539541 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50298.9us
W20260709 13:05:47.545225 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49721.4us
I20260709 13:05:47.489835 17543 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:47.469643 17535 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:47.543090 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:47.543466 15513 leader_election.cc:336] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 2.373s (SENT)
I20260709 13:05:47.410620 17683 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.541985 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:47.495909 17451 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.664s	user 0.007s	sys 0.003s
I20260709 13:05:47.547236 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:47.487727 17672 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:47.549055 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 97085.5us
I20260709 13:05:47.551622 14892 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:47.578943 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:47.603641 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 56439.4us
I20260709 13:05:47.609369 14891 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:47.488456 17669 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.614199 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.499985 17679 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:47.498845 17560 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:47.611572 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:47.540838 17563 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.617285 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.632290 14891 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:47.548609 17581 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:05:47.615232 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 71803.7us
I20260709 13:05:47.488139 17520 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:05:47.485520 17682 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.124s
I20260709 13:05:47.632807 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:47.641113 14892 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:47.643143 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:47.645516 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:47.614427 17663 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:47.555370 17638 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:05:47.669690 14893 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:47.668846 14895 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:47.670226 14891 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:47.678974 14964 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:47.601694 17639 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:05:47.628034 17679 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:47.631655 17521 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.556236 17428 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.114s
I20260709 13:05:47.639832 17560 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:47.609822 17451 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.606630 17056 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.070s
W20260709 13:05:47.686519 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 72563.3us
I20260709 13:05:47.700935 14891 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:05:47.688958 17650 consensus_meta.cc:287] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.098s	user 0.015s	sys 0.007s
I20260709 13:05:47.712735 15035 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:47.687629 17637 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:47.689198 17679 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.727597 14891 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.730433 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:47.741119 14895 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:47.744295 14894 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:47.620126 17693 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:05:47.666409 17563 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:47.749975 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:47.750701 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 139197us
I20260709 13:05:47.694859 17443 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.758651 17692 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 13:05:47.667302 17535 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.788574 17704 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:47.789110 17704 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:47.789599 17694 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 13:05:47.790903 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.790055 17704 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.701903 17521 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.824038 17683 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.824991 17521 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.825546 17168 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:47.826360 17695 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 13:05:47.826077 17168 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.828308 17168 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:47.800588 17366 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.823155 14891 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:47.769690 17663 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:47.838413 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.839193 14891 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.848531 14891 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:47.764998 17443 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:47.861313 14966 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:05:47.832541 17451 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:47.833110 17535 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:47.836421 17704 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.874061 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.861671 17529 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.830542 17366 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:47.882872 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 516601us
W20260709 13:05:47.884955 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 127060us
I20260709 13:05:47.888242 14891 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:47.896271 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:47.892387 15513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 2.231s (SENT) [suppressed 53 similar messages]
W20260709 13:05:47.889890 17652 consensus_meta.cc:287] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.955s	user 0.012s	sys 0.000s
I20260709 13:05:47.866611 17540 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.902042 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.889150 17581 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:47.356084 17460 ts_tablet_manager.cc:1469] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Trace:
0709 13:05:39.050305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:39.414294 (+363989us) service_pool.cc:224] Handling call
0709 13:05:39.845519 (+431225us) ts_tablet_manager.cc:934] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
0709 13:05:41.020475 (+1174956us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:05:42.826147 (+1805672us) tablet_metadata.cc:665] Metadata flushed
0709 13:05:42.826259 (+   112us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:05:44.321960 (+1495701us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:05:44.322324 (+   364us) tablet_replica.cc:206] Creating consensus instance
0709 13:05:44.322628 (+   304us) ts_tablet_manager.cc:989] Replica registered.
0709 13:05:44.322690 (+    62us) inbound_call.cc:177] Queueing success response
0709 13:05:45.569037 (+1246347us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:05:46.628329 (+1059292us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:05:46.790689 (+162360us) tablet_replica.cc:261] Starting instrumentation
0709 13:05:46.791472 (+   783us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":19009,"raft.queue_time_us":5450,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6460,"tablet-copy.queue_time_us":343462,"tablet-download-pool.queue_time_us":114,"tablet-download-pool.run_cpu_time_us":1306,"tablet-download-pool.run_wall_time_us":592336,"thread_start_us":286675,"threads_started":2}
I20260709 13:05:47.865854 17560 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.935524 17566 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.952734 15039 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:05:47.952903 17563 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.954613 17566 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:47.916301 17687 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.420s	user 0.004s	sys 0.000s
I20260709 13:05:47.904067 17652 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:47.917021 17699 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:05:47.958539 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:47.959504 15550 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:47.959700 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2190) took 1009 ms. Trace:
I20260709 13:05:47.959817 17652 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:47.960427 15037 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:47.915764 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.918520 17663 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:47.919909 17705 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:05:47.921571 17540 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:47.915138 17683 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:05:47.923977 17702 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:47.924397 17682 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:47.924700 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.978322 14895 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:47.925392 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:47.924082 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:47.926419 17528 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.669s	user 0.008s	sys 0.000s
W20260709 13:05:47.929286 17503 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.000s
I20260709 13:05:47.929795 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.930543 17637 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:47.933967 14970 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:47.982589 14887 raft_consensus.cc:2376] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4. Re-sending same reply.
I20260709 13:05:47.982677 14891 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:05:47.933931 17679 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:47.934401 17186 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:47.935500 17428 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:47.936903 14888 raft_consensus.cc:2410] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:05:47.938246 17529 raft_consensus.cc:1064] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:47.939873 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:47.940868 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:47.941267 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:47.997211 14892 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:47.944295 15548 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:47.944638 17366 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:47.947029 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:48.001132 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:47.947300 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:48.002203 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:48.004437 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.004482 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:48.005725 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:47.997294 17683 consensus_queue.cc:1243] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:47.948259 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 533) took 1121 ms. Trace:
I20260709 13:05:48.007551 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:48.008316 15040 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:48.009213 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:47.984848 17637 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:47.949386 17443 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:47.956226 14890 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
W20260709 13:05:47.957605 17703 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:05:47.918010 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:47.960088 15038 rpcz_store.cc:276] 0709 13:05:46.950290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.950440 (+   150us) service_pool.cc:224] Handling call
0709 13:05:46.970095 (+ 19655us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:47.150835 (+180740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:47.150864 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:47.175620 (+ 24756us) log.cc:844] Serialized 26 byte log entry
0709 13:05:47.320015 (+144395us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:47.320051 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.320112 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.827079 (+506967us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:47.959431 (+132352us) raft_consensus.cc:1685] finished
0709 13:05:47.959453 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.959644 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8461,"raft.queue_time_us":64810,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":30050560,"thread_start_us":257498,"threads_started":2,"wal-append.queue_time_us":232866}
W20260709 13:05:47.986343 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 93993.1us
I20260709 13:05:47.996234 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.007717 14963 rpcz_store.cc:276] 0709 13:05:46.826922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.827640 (+   718us) service_pool.cc:224] Handling call
0709 13:05:46.827939 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:46.828285 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:46.828314 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:46.828674 (+   360us) log.cc:844] Serialized 26 byte log entry
0709 13:05:47.202532 (+373858us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:47.202604 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:47.202679 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:47.891665 (+688986us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b24002a6338. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531b0f9c4 00007f5531b0dacb 00007f5531cc8dc9 00007f5531cc8a55 00007f5531cc7fb0 00007f553493e488 00007f553493ebe8 00007f5534916398 00007f553491176a 00007f5534910bb6
0709 13:05:47.947685 (+ 56020us) raft_consensus.cc:1685] finished
0709 13:05:47.947706 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:47.948178 (+   472us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9324,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":10974,"spinlock_wait_cycles":8229120,"thread_start_us":372200,"threads_started":1,"wal-append.queue_time_us":369026}
I20260709 13:05:47.941560 17673 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:48.027463 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:47.998713 15542 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.002420 15545 raft_consensus.cc:2368] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6.
I20260709 13:05:48.010130 15040 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:47.956904 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.012667 14964 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:48.015745 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.016444 14895 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:48.030819 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:48.031677 15041 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:47.997751 17428 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:48.023741 14893 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:48.023229 17520 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:47.987130 17186 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:48.025719 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.034740 14936 leader_election.cc:400] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6.
I20260709 13:05:48.050944 14936 leader_election.cc:403] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:05:48.035669 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:48.019784 17529 raft_consensus.cc:1068] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Unable to promote non-voter 58ee9fe38eb8453098f6d964e7675e79: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:05:48.009532 17679 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.039566 17522 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:48.040400 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:47.987295 17503 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.021612 14892 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:48.053910 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:48.054821 15038 raft_consensus.cc:2368] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:48.049737 14964 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
W20260709 13:05:48.052457 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.057116 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.057789 15041 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:05:48.058881 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:48.065063 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147094us
I20260709 13:05:48.065042 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.065969 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.065637 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:48.061529 17719 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 13:05:48.052837 17682 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:48.078991 15040 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.074115 14965 raft_consensus.cc:2410] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:05:48.041821 17716 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:48.077226 14861 leader_election.cc:400] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:48.079923 14861 leader_election.cc:403] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:48.053018 17521 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6.
I20260709 13:05:48.085711 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.087689 17186 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.088757 17186 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.096378 17673 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.053470 17520 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.097724 17503 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.080829 17704 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:48.041561 17428 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.098498 17704 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:48.078343 17560 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:48.078450 17682 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:48.099710 17682 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.101409 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:48.103637 17716 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:48.099396 17704 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.123291 17655 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:48.120461 17529 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:48.124626 14963 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.126853 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.121943 17540 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.124553 17655 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.125108 17560 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 13:05:48.122292 17428 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.146349 14968 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:48.147379 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:48.147061 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:48.149749 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.133522 17540 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.134467 17655 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:48.154552 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:48.151211 17560 consensus_queue.cc:1243] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:05:48.158792 17530 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:48.158960 15542 raft_consensus.cc:2410] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:05:48.159575 17718 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 13:05:48.162914 17528 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.163105 17706 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.163745 17706 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.164951 17535 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:48.165313 17535 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:48.165978 17706 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.165771 17655 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.166591 17706 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.167321 17655 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.171556 17520 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.172181 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:48.166278 17535 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.181635 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:48.186987 14968 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:05:48.188326 14893 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:05:48.188469 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47545.9us
I20260709 13:05:48.189425 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.182163 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.182390 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:48.182921 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:48.190629 14890 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:48.190945 14963 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.183784 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.190502 14961 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:48.134207 17529 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.197320 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.203758 14890 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.197885 14886 raft_consensus.cc:2368] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6.
W20260709 13:05:48.204366 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48042.9us
I20260709 13:05:48.205350 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.175560 17663 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:48.167155 17706 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.206137 14893 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:48.210072 17700 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:48.225754 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 536) took 1362 ms. Trace:
I20260709 13:05:48.206909 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:48.216542 17691 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:05:48.225078 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:48.225749 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.224661 17451 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:05:48.231462 14892 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:48.232607 14892 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:48.227885 14966 rpcz_store.cc:276] 0709 13:05:46.862880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.863001 (+   121us) service_pool.cc:224] Handling call
0709 13:05:46.869583 (+  6582us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:47.864759 (+995176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.225506 (+360747us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540016ce54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:48.225700 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2280023424}
I20260709 13:05:48.230530 17663 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:48.240439 17663 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.241026 17706 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.241842 17539 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:48.231933 17522 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:05:48.213970 17637 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:48.206501 17542 raft_consensus.cc:2764] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:05:48.180686 17366 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:05:48.258208 14890 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:48.260788 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:48.262753 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.271001 14893 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:48.234001 17535 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.235237 17683 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:48.282614 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 77048.4us
I20260709 13:05:48.291780 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.292734 15038 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:48.266862 17718 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.277410 17430 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.294976 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.269897 17708 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:48.302852 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:48.303768 15036 raft_consensus.cc:2368] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:05:48.316745 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:48.321270 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:48.322220 14936 leader_election.cc:400] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:05:48.322597 14936 leader_election.cc:403] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 13:05:48.323902 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63226.7us
I20260709 13:05:48.316286 17528 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:48.328245 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.327849 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:48.300632 17430 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.327083 17521 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:48.318403 17708 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:48.294044 17683 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.325480 17595 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:48.331733 15038 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:05:48.339564 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.300798 17682 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.329843 17528 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.331281 17679 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.331755 17521 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.302074 17718 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.329807 17539 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:48.351887 17451 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.359671 17683 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.364120 17539 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.357601 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:48.349498 17528 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:48.366387 17741 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:05:48.380468 14963 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:48.367790 14933 leader_election.cc:400] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6.
W20260709 13:05:48.383083 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55321.5us
I20260709 13:05:48.385911 15038 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:48.350641 17521 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.382704 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:48.332108 17530 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:05:48.393913 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:48.397048 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.404222 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.407258 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.407972 14893 raft_consensus.cc:2376] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6. Re-sending same reply.
I20260709 13:05:48.404889 14886 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:48.367131 17637 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:48.367641 17740 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:48.380669 17529 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:48.427810 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 106617us
I20260709 13:05:48.428498 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.422089 17520 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:48.430219 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.433394 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.431061 14889 raft_consensus.cc:2376] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8. Re-sending same reply.
W20260709 13:05:48.423759 17743 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:05:48.420303 17741 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:48.445001 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62370.8us
I20260709 13:05:48.429508 17520 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.447934 14859 leader_election.cc:400] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:48.446297 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:48.432610 17650 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.450875 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.441128 17708 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.464504 17503 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:48.465893 17503 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:48.466305 17739 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:05:48.466387 17503 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:48.468349 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.458169 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:48.452502 17520 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.452612 17740 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:48.488323 17430 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:48.514307 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60292us
I20260709 13:05:48.515244 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.488715 17718 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.489228 17682 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.453876 17529 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:48.456228 17650 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.497887 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:48.519328 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50472 (request call id 25) took 1082 ms. Trace:
I20260709 13:05:48.519855 15043 rpcz_store.cc:276] 0709 13:05:47.432061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.432223 (+   162us) service_pool.cc:224] Handling call
0709 13:05:48.513876 (+1081653us) spinlock_profiling.cc:243] Waited 72.7 ms on lock 0x7b540014afd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d70853 00007f5539d3e60a 00007f55332c47d4 00007f55332c4762 00007f55332c4691 00007f55332c460c 00007f55332c38c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:48.514032 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":167159680}
W20260709 13:05:48.525811 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73100.6us
I20260709 13:05:48.521479 17672 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.519830 17529 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:48.522878 17738 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:05:48.522608 17754 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.539520 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.467841 17741 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.525269 17740 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:48.468290 17503 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.533068 17529 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.562583 14967 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:05:48.564435 17683 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:48.533123 17672 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.533123 17682 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:48.551894 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:05:48.557668 17759 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.559033 17650 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.522068 17430 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:05:48.581117 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:48.577193 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:48.587874 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:48.619153 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.626449 15041 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:05:48.574219 17679 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:05:48.586725 17682 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:48.635047 17754 raft_consensus.cc:2764] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:48.635387 17740 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:48.636096 17698 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.774s	user 0.004s	sys 0.000s
I20260709 13:05:48.621515 17693 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.587019 17691 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:48.648029 17535 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.632388 17528 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:48.654280 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 127506us
I20260709 13:05:48.588294 17759 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:48.660750 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 72978us
I20260709 13:05:48.663774 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.664662 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:48.665664 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.668967 14967 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:48.668642 17754 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:48.676052 17754 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:48.676437 17754 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:48.676568 17528 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.677321 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:48.677526 17540 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260709 13:05:48.678136 17540 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.678769 17682 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.676057 17718 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:05:48.653493 17693 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.671595 17560 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:48.682269 17693 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:48.683111 17672 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:48.683657 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.683265 17529 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.685402 17529 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.677404 17759 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:48.671255 14859 connection.cc:256] RPC call timeout handler was delayed by -1.0192278769999348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 13:05:48.692283 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:48.693131 14963 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:05:48.668794 17691 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:48.696142 17760 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:48.696679 17760 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.697762 15043 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:48.698665 17760 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.805830 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2200) took 1377 ms. Trace:
I20260709 13:05:48.806726 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.807713 15042 rpcz_store.cc:276] 0709 13:05:47.428267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.428556 (+   289us) service_pool.cc:224] Handling call
0709 13:05:48.805652 (+1377096us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b540014afd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:48.805773 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":60385152}
W20260709 13:05:48.799849 17703 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:05:48.798273 17718 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:48.824939 17718 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:48.827342 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.828193 17544 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:48.828612 17544 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:48.829522 17544 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.830315 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.830667 17544 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:48.831472 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.832562 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.833484 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.833984 14895 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:48.834669 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.836084 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.840952 14892 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
W20260709 13:05:48.836608 17770 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 13:05:48.841285 17547 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:48.844719 17547 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.847271 17547 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.847755 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:48.848145 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:48.848325 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.848462 15546 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:48.842964 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.849407 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.849885 14892 raft_consensus.cc:2410] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:48.849960 14889 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.850562 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:48.850829 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.851315 15543 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:48.851346 14892 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.849426 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:48.827203 17718 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:48.856859 15042 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:48.857700 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:48.850095 15548 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:48.858291 14895 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:48.871018 14889 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:48.888962 14892 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:48.890918 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:48.893092 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:48.856451 17754 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.868088 17520 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.898355 17679 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:48.903298 17723 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:48.918237 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-6eec3351a3e94e158c79a8784e2c6574 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:05:48.918965 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-6eec3351a3e94e158c79a8784e2c6574 on tablet 6eec3351a3e94e158c79a8784e2c6574 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:48.894156 17459 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 13:05:48.925644 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.006s	sys 0.007s
W20260709 13:05:48.925946 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.006s	sys 0.007s
W20260709 13:05:48.926187 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 719266us
W20260709 13:05:48.931268 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.933245 17520 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:48.898849 17693 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:05:48.935516 17679 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:48.936890 14970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1463) took 2342 ms (client timeout 1906 ms). Trace:
W20260709 13:05:48.937290 14970 rpcz_store.cc:269] 0709 13:05:46.594824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.594942 (+   118us) service_pool.cc:224] Handling call
0709 13:05:48.936714 (+2341772us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54003093d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:48.936808 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2653083520}
I20260709 13:05:48.938243 17521 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:48.940483 17723 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:48.940676 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2201) took 1509 ms. Trace:
I20260709 13:05:48.940975 17723 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:48.941004 15039 rpcz_store.cc:276] 0709 13:05:47.430997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.431161 (+   164us) service_pool.cc:224] Handling call
0709 13:05:47.440608 (+  9447us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:47.953171 (+512563us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.940422 (+987251us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b54001f45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:48.940595 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177144704}
I20260709 13:05:48.942322 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:48.942827 15039 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:48.942936 14887 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:48.943661 17749 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.944310 14891 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:48.959844 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.960382 14891 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:48.945258 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 359) took 1367 ms. Trace:
I20260709 13:05:48.961230 14888 rpcz_store.cc:276] 0709 13:05:47.577942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.578138 (+   196us) service_pool.cc:224] Handling call
0709 13:05:48.945030 (+1366892us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003877d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:48.945191 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":740089088}
I20260709 13:05:48.946264 14894 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:05:48.948097 17718 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:48.948796 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.949303 17763 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.940971 17521 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:48.955464 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:48.956156 17505 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.957521 14892 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:48.936461 17679 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:48.960279 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:48.996279 14887 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:48.959414 17529 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.945161 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.964540 14970 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:48.966156 14961 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:49.005661 14961 pending_rounds.cc:85] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 2
I20260709 13:05:49.005923 14961 pending_rounds.cc:107] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:49.006196 14961 raft_consensus.cc:2889] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.966117 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:48.968286 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:49.007493 14968 raft_consensus.cc:2368] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:48.976508 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:48.979964 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:49.008591 14969 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:48.980400 17670 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:48.984247 17671 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:48.973609 17718 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:48.994827 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 174112us
I20260709 13:05:48.962338 14894 pending_rounds.cc:85] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 7
I20260709 13:05:49.017225 14966 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:49.026124 14894 pending_rounds.cc:107] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:05:49.026436 14894 raft_consensus.cc:2889] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:48.967844 17430 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:49.031845 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:49.039997 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63581.7us
I20260709 13:05:49.041451 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.042440 14887 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:49.044389 14891 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:49.043432 17756 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:48.995656 17526 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:05:49.046975 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.048266 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.962855 17749 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.059664 17526 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:49.060557 17526 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.061192 17749 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:49.052616 17682 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:49.062916 17682 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:49.063253 17682 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:49.063470 17693 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:49.063877 17693 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.064247 17693 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:49.064028 17682 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.065233 17682 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.052719 17655 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.066398 17655 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.022512 17529 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.070345 17459 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:49.052644 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:48.998076 17505 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.071020 17459 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:49.071206 14970 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:49.071931 17459 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.072520 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.073395 14888 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:49.073784 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:49.046556 17430 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.054327 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:49.076865 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2205) took 1317 ms. Trace:
I20260709 13:05:49.077170 17655 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.077227 15041 rpcz_store.cc:276] 0709 13:05:47.759960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.076214 (+316254us) service_pool.cc:224] Handling call
0709 13:05:48.080831 (+  4617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:48.626922 (+546091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.076661 (+449739us) spinlock_profiling.cc:243] Waited 545 ms on lock 0x7b54001f4ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:49.076811 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1253685120}
I20260709 13:05:49.078577 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:48.977134 17763 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.081691 17763 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:49.052906 17528 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.052064 17754 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:49.032955 17723 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.070408 17529 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:49.085803 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.087358 15041 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:49.089048 14859 leader_election.cc:400] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:49.089385 14859 leader_election.cc:403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:05:49.017633 17503 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:49.093430 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.094444 14969 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:05:49.097744 15036 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:49.098608 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:49.100555 15035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 404) took 1856 ms (client timeout 2161 ms). Trace:
W20260709 13:05:49.101080 15035 rpcz_store.cc:269] 0709 13:05:47.244390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.244497 (+   107us) service_pool.cc:224] Handling call
0709 13:05:49.100366 (+1855869us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54003327d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:49.100488 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367553920}
I20260709 13:05:49.104106 14970 raft_consensus.cc:2376] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7. Re-sending same reply.
I20260709 13:05:49.049911 17186 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:49.045962 17759 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:49.085027 17718 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:49.092512 17772 raft_consensus.cc:1064] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:05:49.089905 17768 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:49.100412 17655 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:05:49.072517 17505 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:49.103235 17536 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:49.117599 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.083375 17528 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.034302 17670 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.128752 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:49.129123 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.128470 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.167526 14891 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:49.167651 14889 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:49.102567 17503 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:49.126933 17744 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.023s	sys 0.034s
I20260709 13:05:49.130663 17756 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:49.119186 17759 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.117550 17186 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.127562 17723 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:49.204337 17784 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:05:49.208005 17503 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:49.208814 17785 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:05:49.204507 17528 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:49.176090 17744 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.024s	sys 0.034s
I20260709 13:05:49.173537 17563 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.211227 17563 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.213186 17430 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.213470 17563 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.189416 17547 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:49.214902 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.214836 17547 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.215564 15550 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:49.201704 17790 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:49.216635 17790 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:49.217106 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:49.217629 15550 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.217571 17790 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.218995 17547 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:49.177033 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 109039us
W20260709 13:05:49.176585 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 88692.8us
I20260709 13:05:49.126142 17536 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.221051 17670 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.221796 17536 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.123749 17768 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.223713 17768 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.210631 17756 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.225325 15550 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:49.225407 17639 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.225932 17639 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:49.226823 17639 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.228070 17759 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.228730 17759 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.227887 15039 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:05:49.230351 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.230983 15543 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:05:49.176956 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48304.7us
I20260709 13:05:49.232514 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.233184 14964 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 3: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:49.233857 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.235251 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.235313 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.148028 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.237656 14887 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:49.239642 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.241629 15550 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 13:05:49.241827 14970 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:49.243113 15550 pending_rounds.cc:85] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 5
I20260709 13:05:49.243475 15550 pending_rounds.cc:107] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 13:05:49.243788 15550 raft_consensus.cc:2889] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:49.242241 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:49.242904 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.245893 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.229259 17759 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.250567 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:49.228006 17639 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.247598 14890 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:49.252727 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.256960 15543 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:49.258152 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.259397 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.259678 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.229897 17756 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.263844 17503 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:49.272848 17503 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.273219 17503 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.274727 17186 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:49.247615 17768 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:49.275884 17768 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:49.276840 17768 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:49.312250 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55755.4us
I20260709 13:05:49.283635 17682 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:05:49.316584 17716 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:49.317070 17716 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:49.249891 17536 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:05:49.328634 14965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1475) took 1986 ms (client timeout 1520 ms). Trace:
W20260709 13:05:49.346477 15037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2191) took 2395 ms (client timeout 1680 ms). Trace:
I20260709 13:05:49.263548 17430 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:49.330220 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:49.263842 17459 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:05:49.350315 14965 rpcz_store.cc:269] 0709 13:05:47.342275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.389166 (+ 46891us) service_pool.cc:224] Handling call
0709 13:05:49.321169 (+1932003us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b540025ba54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:49.328548 (+  7379us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1484074240}
W20260709 13:05:49.351046 15037 rpcz_store.cc:269] 0709 13:05:46.950616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:46.950744 (+   128us) service_pool.cc:224] Handling call
0709 13:05:49.346204 (+2395460us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400089dd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:49.346367 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2263809792}
I20260709 13:05:49.384824 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:49.391712 17755 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.864s	user 0.004s	sys 0.000s
W20260709 13:05:49.393533 15007 connection.cc:256] RPC call timeout handler was delayed by -1.2632424610000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
W20260709 13:05:49.393987 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.394253 15007 connection.cc:256] RPC call timeout handler was delayed by -1.2247807210000019s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1743s for a response
W20260709 13:05:49.394876 17798 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260709 13:05:49.396150 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 371) took 1576 ms. Trace:
I20260709 13:05:49.396541 14894 rpcz_store.cc:276] 0709 13:05:47.820176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.820332 (+   156us) service_pool.cc:224] Handling call
0709 13:05:48.945882 (+1125550us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.043180 (+ 97298us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.395947 (+352767us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003877d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:49.396074 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2571264896}
I20260709 13:05:49.358886 17430 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.401312 14890 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 13:05:49.401791 14890 pending_rounds.cc:85] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 4
I20260709 13:05:49.402063 14890 pending_rounds.cc:107] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:05:49.402354 14890 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:49.403597 15007 connection.cc:256] RPC call timeout handler was delayed by -1.0148928849999947s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1902s for a response
W20260709 13:05:49.404487 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.409889 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.412868 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:49.413206 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 83074.4us
I20260709 13:05:49.410643 14886 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:49.418447 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.362249 17536 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:49.431978 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.427892 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:49.428308 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.434429 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:49.387461 17547 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:49.437467 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.427239 17797 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:49.438761 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:49.441363 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:49.444866 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 327015us
I20260709 13:05:49.400277 17459 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:49.409960 17430 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.442472 14963 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:49.445856 15037 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:49.458189 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.459499 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:49.430910 17581 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.430727 17672 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:49.465171 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.466133 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:49.467662 15035 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 2.
I20260709 13:05:49.445271 17670 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:49.468918 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:49.461059 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.417701 17763 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:05:49.458163 17505 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:49.478214 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 384799us
I20260709 13:05:49.493480 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:49.504592 14969 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.517771 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:49.518604 15037 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:49.457360 17797 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:49.545917 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 90328.8us
W20260709 13:05:49.547029 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 47816.5us
I20260709 13:05:49.547830 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:49.555999 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:49.558732 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 92557.2us
I20260709 13:05:49.559528 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:49.470613 17672 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.565058 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:49.568226 15035 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:49.470011 17581 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.536571 17706 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:05:49.575402 17814 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.575974 17814 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.578250 17814 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:49.579058 17814 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:49.579496 17814 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.579957 17814 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:49.580801 17797 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:49.574683 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 115312us
W20260709 13:05:49.593021 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:49.500488 17505 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:49.636448 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76997.9us
W20260709 13:05:49.656880 17783 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.675s	user 0.000s	sys 0.001s
I20260709 13:05:49.680744 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:49.685228 17544 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:49.685755 17786 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.326s	user 0.000s	sys 0.000s
I20260709 13:05:49.686090 17544 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.685187 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:49.687661 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:49.687755 15044 raft_consensus.cc:2376] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5. Re-sending same reply.
I20260709 13:05:49.688977 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:49.541695 17767 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 13:05:49.877637 17802 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.377s	user 0.000s	sys 0.000s
I20260709 13:05:49.860589 17759 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:49.859794 17788 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 13:05:49.879352 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1839) took 1187 ms. Trace:
I20260709 13:05:49.512357 17536 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.879812 14893 rpcz_store.cc:276] 0709 13:05:48.692389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.921331 (+228942us) service_pool.cc:224] Handling call
0709 13:05:48.921655 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.922100 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:49.129285 (+207185us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.387765 (+258480us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:49.430439 (+ 42674us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.430583 (+   144us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:49.430622 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.430683 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.879135 (+448452us) raft_consensus.cc:1685] finished
0709 13:05:49.879152 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.879291 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":25674,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1370,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":164,"thread_start_us":440920,"threads_started":2,"wal-append.queue_time_us":306883}
W20260709 13:05:49.880851 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 193240us
I20260709 13:05:49.885228 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 413) took 1918 ms. Trace:
I20260709 13:05:49.683983 15036 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
W20260709 13:05:49.887183 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 305344us
I20260709 13:05:49.887981 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:49.893543 15043 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:05:49.898706 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2320) took 1214 ms. Trace:
I20260709 13:05:49.899133 14895 rpcz_store.cc:276] 0709 13:05:48.684643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.866608 (+181965us) service_pool.cc:224] Handling call
0709 13:05:48.870557 (+  3949us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.870860 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.870895 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:48.893948 (+ 23053us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.148762 (+254814us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:49.148817 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.148904 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.685192 (+536288us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:49.886652 (+201460us) raft_consensus.cc:1685] finished
0709 13:05:49.886687 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.898583 (+ 11896us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":149,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":15676,"spinlock_wait_cycles":38742912,"thread_start_us":237643,"threads_started":1,"wal-append.queue_time_us":273515}
W20260709 13:05:49.879799 17800 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.335s	user 0.000s	sys 0.000s
I20260709 13:05:49.891427 15040 rpcz_store.cc:276] 0709 13:05:47.966840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.454113 (+487273us) service_pool.cc:224] Handling call
0709 13:05:48.517565 (+ 63452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.520859 (+  3294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.520901 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:48.837666 (+316765us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:05:48.838021 (+   355us) log.cc:844] Serialized 26 byte log entry
0709 13:05:48.913388 (+ 75367us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:48.913439 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:48.913529 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.656120 (+742591us) spinlock_profiling.cc:243] Waited 9.78 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:49.884987 (+228867us) raft_consensus.cc:1685] finished
0709 13:05:49.885016 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.885166 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2889,"raft.queue_time_us":3402,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2695,"spinlock_wait_cycles":28625024,"thread_start_us":74983,"threads_started":1,"wal-append.queue_time_us":143800}
W20260709 13:05:49.912247 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:49.706264 17796 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.426s	user 0.003s	sys 0.000s
I20260709 13:05:49.566152 17683 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:49.728711 15041 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:49.919546 17807 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.920192 17807 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.922358 17807 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:49.924145 15035 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:49.908099 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 419) took 1047 ms. Trace:
W20260709 13:05:49.707530 17795 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.434s	user 0.002s	sys 0.000s
I20260709 13:05:49.828819 17545 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.555637 17459 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:49.833520 17790 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.964286 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.912536 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:49.692106 17544 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:49.902496 17186 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:49.953500 15039 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:05:49.867759 17535 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:49.963308 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.981361 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.902468 17759 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:49.925009 15042 rpcz_store.cc:276] 0709 13:05:48.861001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.879503 (+ 18502us) service_pool.cc:224] Handling call
0709 13:05:48.900173 (+ 20670us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:48.900618 (+   445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:48.900656 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:48.906700 (+  6044us) log.cc:844] Serialized 26 byte log entry
0709 13:05:49.135769 (+229069us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:49.413947 (+278178us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b180041b780. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f553876e3c7 00007f5534d809a7 00007f5534d900bf 00007f5534d90038
0709 13:05:49.557799 (+143852us) log.cc:844] Serialized 14 byte log entry
0709 13:05:49.850511 (+292712us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:49.850612 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:49.850670 (+    58us) raft_consensus.cc:1685] finished
0709 13:05:49.907847 (+ 57177us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:49.908028 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4122,"prepare.queue_time_us":302490,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":111017,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":3694,"spinlock_wait_cycles":33134976,"thread_start_us":624918,"threads_started":3,"wal-append.queue_time_us":214587}
I20260709 13:05:49.829205 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:05:49.975742 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63747.4us
I20260709 13:05:49.976781 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:49.983520 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:49.985944 15547 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:49.986948 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:49.988528 15041 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:05:49.961413 17639 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.034s
I20260709 13:05:49.994756 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.005230 15550 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:50.008368 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:49.996009 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 440137us
I20260709 13:05:50.001933 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.002020 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:50.011441 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:50.009588 15043 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
W20260709 13:05:50.012766 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 102739us
I20260709 13:05:50.013566 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:50.014353 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:50.021122 15039 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:05:49.977599 17186 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:49.966712 17521 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.037580 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:50.016204 17563 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.040s	sys 0.095s
I20260709 13:05:50.059298 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.060113 14961 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:49.701117 17716 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.069123 15038 raft_consensus.cc:1217] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Deduplicated request from leader. Original: 4.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:05:50.071370 15038 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:05:50.035676 17744 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.076326 17744 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.078480 17744 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.034441 17669 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.043344 17186 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:50.055611 17563 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.040s	sys 0.096s
I20260709 13:05:49.985509 17790 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:49.961686 17545 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:50.070206 17785 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:50.003209 17759 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:50.131597 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.021s
W20260709 13:05:50.132025 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.021s
W20260709 13:05:50.132360 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 619963us
I20260709 13:05:50.053194 17521 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:50.168476 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 277584us
W20260709 13:05:50.226439 15037 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.000s
I20260709 13:05:50.226866 15037 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:50.235050 17818 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:50.240742 17745 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.822s	user 0.003s	sys 0.000s
W20260709 13:05:50.182459 17801 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:05:50.235513 15513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.012s	sys 0.033s
W20260709 13:05:50.291468 15513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.012s	sys 0.033s
W20260709 13:05:50.291935 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 808406us
W20260709 13:05:50.278057 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 144578us
I20260709 13:05:50.086800 17547 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:50.130199 17744 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:50.227327 17581 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:50.325587 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:50.362399 14936 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:50.320259 17693 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.256s	user 0.011s	sys 0.003s
I20260709 13:05:50.360668 17526 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:05:50.380945 17819 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.381825 17522 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:50.382308 17522 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.382747 17522 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:50.364266 17744 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.364035 17539 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
W20260709 13:05:50.398989 17826 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 13:05:50.399151 17820 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:05:50.335718 17650 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:05:50.381481 17819 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.396157 17535 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.360620 17529 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:05:50.398324 17744 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.404697 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:50.376087 17679 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.388631 17797 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:50.400415 17650 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:50.360406 17686 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.090s
I20260709 13:05:50.360814 17547 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:50.485316 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.010s	sys 0.014s
W20260709 13:05:50.489398 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.010s	sys 0.014s
W20260709 13:05:50.487643 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 442359us
W20260709 13:05:50.465234 17503 consensus_meta.cc:287] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.192s	user 0.023s	sys 0.004s
I20260709 13:05:50.401759 17693 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.448789 17650 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:50.425661 17797 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.412812 17535 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.515727 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:50.446802 17740 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:50.492873 17744 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.466512 17679 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.532620 17679 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.521791 17797 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:50.533470 17526 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.533993 17526 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.535512 17819 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:50.535840 17526 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:50.537993 17805 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.498s	user 0.000s	sys 0.001s
W20260709 13:05:50.538552 17804 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.472s	user 0.000s	sys 0.001s
I20260709 13:05:50.539666 17744 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.540622 17797 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.541667 14961 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:50.543318 17797 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:50.546258 17822 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:05:50.514233 17503 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.553746 17503 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.556809 17526 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.556939 17744 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.561614 17790 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:50.582927 17828 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.293s	user 0.000s	sys 0.001s
I20260709 13:05:50.565487 17545 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.528602 17740 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:50.584254 17536 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.020s
I20260709 13:05:50.583285 17759 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.604106 17693 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:50.582538 17526 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.587846 17521 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:50.608698 17536 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.009s	sys 0.020s
W20260709 13:05:50.616273 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.608570 17744 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:50.617056 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 88030.7us
W20260709 13:05:50.612783 17814 consensus_meta.cc:287] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.032s	user 0.009s	sys 0.002s
I20260709 13:05:50.620759 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.598694 17832 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:50.584882 17650 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.621054 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.621358 14962 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:05:50.600380 17790 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:05:50.624681 14969 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:50.623951 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.627007 14966 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:50.629318 14965 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:05:50.620075 17670 consensus_meta.cc:287] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.147s	user 0.012s	sys 0.000s
I20260709 13:05:50.636749 14968 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:50.636889 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:50.638324 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.641114 14962 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:50.641254 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 145420us
I20260709 13:05:50.641844 17522 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.644111 17526 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:50.644896 17650 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:50.645114 17522 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.647581 17547 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.621891 17744 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.647672 17843 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:05:50.649277 17535 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.641695 17847 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:05:50.652154 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:50.652676 14962 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:50.640486 17838 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.670912 17838 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.673343 17838 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.676689 14962 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:50.652814 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:50.636811 17670 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:50.641652 17842 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 13:05:50.658001 17830 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 13:05:50.659628 17832 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:50.660981 14968 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:50.662889 17535 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.663064 17790 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.663731 17547 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:50.664191 17756 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.342s	user 0.008s	sys 0.017s
W20260709 13:05:50.667897 17430 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.206s	user 0.008s	sys 0.004s
I20260709 13:05:50.624465 17814 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.686278 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:50.682636 17682 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:50.700865 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.701115 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.707356 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.711279 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:50.711911 15548 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:50.713780 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.708251 15543 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:05:50.687348 17838 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:50.715799 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.716827 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.717056 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.717630 15549 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:50.717005 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.718202 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.719223 15550 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:50.720597 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:50.733897 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:50.734702 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.744860 17505 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.748235 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.762171 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:50.762828 14889 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:50.750049 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.763648 14890 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:50.764546 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.765579 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.766098 14890 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:50.750402 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.767130 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.767858 15550 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:50.767735 14792 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 5, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:50.769850 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 4, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 4 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:50.750735 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:50.751698 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:50.771767 14887 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:50.772254 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:50.772683 17831 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.773329 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.773195 17831 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.774363 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.774907 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:05:50.753777 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.758991 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:50.760627 17716 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:50.778612 17811 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.412s	user 0.000s	sys 0.001s
I20260709 13:05:50.779047 14887 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:50.784027 17671 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:05:50.784307 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 746719us
I20260709 13:05:50.784749 17671 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:50.785115 17671 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:50.785473 17671 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:50.787585 17710 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:50.788338 17710 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:50.788782 14890 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:05:50.789615 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.791692 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.793313 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.793572 17566 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:50.794540 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.795104 15041 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:50.795702 17544 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.809868 17544 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.810178 14889 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:50.811758 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.795830 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.812500 14889 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:50.814024 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.815673 15036 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:50.816402 15041 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:05:50.695035 17430 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.797885 17815 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:50.798961 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.800408 17816 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:50.800846 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:50.801285 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 396607us
W20260709 13:05:50.827232 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 141020us
I20260709 13:05:50.827920 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:50.828300 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:50.801373 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:50.801947 17824 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:50.795883 15043 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:05:50.803336 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.803946 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:50.770943 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 9, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:50.807041 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:50.807875 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91466.7us
I20260709 13:05:50.796396 17505 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.775343 17831 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.820699 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.849220 15549 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:50.708554 17740 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.689204 17535 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.691764 17790 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.836575 15548 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:50.840201 14961 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:50.692934 17547 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.832413 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:50.821389 14895 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:50.708262 17835 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:50.694016 17756 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:50.856931 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:50.857672 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:50.857985 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:50.817211 17832 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:50.699162 17682 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.812537 17544 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.839229 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:50.860977 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:50.849613 17829 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:50.868893 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:50.852604 17669 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:50.849447 17520 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:50.842443 17744 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:50.905206 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66014.8us
I20260709 13:05:50.859081 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.861020 17818 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:50.899262 17740 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:50.902362 14893 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:50.881151 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:50.907845 17520 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.904532 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:50.855124 17815 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.860150 17847 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:50.921015 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:50.867779 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:50.922849 17520 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:50.923985 17814 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.924414 17535 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.924935 17815 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.914057 17740 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:50.925586 17547 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.927342 17756 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:50.928031 17693 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:50.919741 17669 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:50.867192 17850 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 13:05:50.848905 17816 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.931702 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:50.865280 17459 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
W20260709 13:05:50.932686 17849 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
W20260709 13:05:50.933588 17853 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:05:50.937489 17851 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:50.921335 17846 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:05:50.938516 17772 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.905635 17848 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.100s
I20260709 13:05:51.020306 17682 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:50.909611 17829 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:50.852358 17505 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:50.912106 17818 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:50.942483 17843 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:50.854856 17581 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:05:50.863265 17831 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:50.942708 17790 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.863142 17521 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:50.952404 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:50.868988 17670 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 13:05:50.903856 17832 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:50.909387 17824 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:51.022776 17851 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:51.027844 17818 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:50.865523 17835 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.001673 14893 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:51.096832 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:51.097558 14893 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:50.932466 14887 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:50.871640 17845 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.132s
W20260709 13:05:50.939924 17186 consensus_meta.cc:287] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.713s	user 0.009s	sys 0.001s
I20260709 13:05:50.996511 17740 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:51.009209 17816 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:51.015846 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:51.017058 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:51.019591 17430 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:50.940678 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1575) took 2998 ms. Trace:
I20260709 13:05:51.116751 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.117036 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.117300 15038 rpcz_store.cc:276] 0709 13:05:47.942423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:48.389003 (+446580us) service_pool.cc:224] Handling call
0709 13:05:49.346820 (+957817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:50.071754 (+724934us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:50.824801 (+753047us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400089dd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:50.940467 (+115666us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400089dd0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:50.940595 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3862620800}
W20260709 13:05:51.045574 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.057195 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:51.062709 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 433) took 1113 ms. Trace:
I20260709 13:05:51.084615 17639 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:05:51.064376 17838 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:51.131017 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 73881.2us
I20260709 13:05:51.133517 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:51.134271 14887 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.065985 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.095762 17718 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:51.082453 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 130155us
I20260709 13:05:50.956360 14792 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:05:51.091249 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 232756us
I20260709 13:05:51.063503 17710 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:51.091029 17824 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.034348 17843 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:51.101460 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.063391 17544 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.118431 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.106150 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.106931 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:51.192662 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 85812.2us
W20260709 13:05:51.106879 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 321101us
I20260709 13:05:51.193761 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.108942 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:51.081660 17521 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:51.042472 17807 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.016s	sys 0.001s
I20260709 13:05:51.124060 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.138289 17842 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:51.022104 17817 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:05:51.139349 15007 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.139467 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:51.108461 17825 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.140887 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 75003.6us
I20260709 13:05:51.119031 15040 rpcz_store.cc:276] 0709 13:05:49.949142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.973600 (+ 24458us) service_pool.cc:224] Handling call
0709 13:05:49.973943 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.974199 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:50.022661 (+ 48462us) log.cc:844] Serialized 14 byte log entry
0709 13:05:50.782709 (+760048us) spinlock_profiling.cc:243] Waited 5.9 ms on lock 0x7b180008a940. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f5534d6e060 00007f5534d80716 00007f5534d91287 00007f5534d91208
0709 13:05:51.062212 (+279503us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.062306 (+    94us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:51.062377 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.062477 (+   100us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.062635 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47773,"prepare.queue_time_us":62477,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":2083,"raft.queue_time_us":766060,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":13580032,"thread_start_us":279220,"threads_started":1}
I20260709 13:05:51.243841 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.104331 17831 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:51.245290 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:51.246361 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:51.246186 17831 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.248169 17846 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:51.125485 17669 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.249186 17528 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:51.249735 17528 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.250180 17528 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:51.147717 17671 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.104246 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2215) took 1781 ms. Trace:
I20260709 13:05:51.251597 17723 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:51.252055 17723 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:51.252592 17723 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.251474 15044 rpcz_store.cc:276] 0709 13:05:49.323010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.878420 (+555410us) service_pool.cc:224] Handling call
0709 13:05:49.878745 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:49.879042 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:05:49.879660 (+   618us) log.cc:844] Serialized 14 byte log entry
0709 13:05:51.103803 (+1224143us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:51.103872 (+    69us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:51.103940 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.104029 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:51.104165 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":742505,"prepare.queue_time_us":171,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":748203,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"thread_start_us":481174,"threads_started":2,"wal-append.queue_time_us":270752}
I20260709 13:05:51.252861 17671 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:51.142179 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 293575us
I20260709 13:05:51.159384 14887 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:51.126081 17823 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:51.084256 17672 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:51.202806 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.134936 17790 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:51.242699 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 103313us
I20260709 13:05:51.270095 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:51.239755 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100492us
I20260709 13:05:51.254015 15041 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:51.195853 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:51.143795 17824 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:51.239863 17807 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.112s	user 0.016s	sys 0.002s
I20260709 13:05:51.118898 17186 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.152361 17843 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.256712 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:51.238077 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44404.7us
I20260709 13:05:51.239742 17521 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.318468 14893 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:51.321229 17526 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:05:51.321352 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64732.4us
I20260709 13:05:51.321833 17526 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:51.322412 17756 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:51.322695 17526 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.324489 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:51.325186 17756 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:51.326771 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.236304 17430 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:51.141263 17850 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.127s
I20260709 13:05:51.241662 17842 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.311298 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:51.286963 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 91204.6us
I20260709 13:05:51.341703 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:51.235678 17821 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:05:51.313498 17686 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:51.269742 17793 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:05:51.314493 17870 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:51.242177 17817 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:51.303966 17671 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:05:51.137140 17838 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.266299 17682 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.266641 17847 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:51.344344 15545 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:51.310760 17535 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 13:05:51.307548 17744 raft_consensus.cc:2764] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:51.310331 17790 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.345244 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:51.376997 17672 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:51.377420 17672 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.377744 17672 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:51.196089 17544 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.379305 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:51.333209 17430 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.388548 14893 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:51.342177 17756 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:51.366925 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:51.367672 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:51.396430 14968 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:51.355386 17686 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:51.368266 17671 consensus_queue.cc:1243] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:51.407393 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:51.356007 17870 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.313707 17716 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:05:51.369992 17682 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.344063 17842 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:51.417755 17864 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:05:51.408444 17686 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:51.419829 17863 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:51.419914 17428 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:51.420588 17428 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.311008 17851 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.422796 17428 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:51.271651 17825 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.425027 17825 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:51.424896 17842 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.398222 17744 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:51.426662 17520 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.427120 17744 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.429808 17744 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:51.398587 17544 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:51.431967 17756 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.411638 17671 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.433007 17650 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:51.433233 17671 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.433629 17650 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.439572 14970 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:05:51.403012 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.354969 17522 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:51.412674 14965 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:51.397945 17430 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:51.456209 17528 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.457412 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.457996 14893 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:51.458811 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.386253 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:51.470393 14893 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:51.439709 17829 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:51.452756 17544 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:51.474721 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 598) took 1503 ms. Trace:
I20260709 13:05:51.454108 17870 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:51.287765 17832 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.466144 17522 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:51.487751 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:51.454514 17740 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.451838 17671 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:51.489503 17686 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.490028 17740 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:51.465528 17186 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:51.490774 14963 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:05:51.491552 17869 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:51.491950 17869 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:51.464613 17835 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:51.458763 17521 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.458693 17528 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:51.492777 17869 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.493854 14961 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:51.494222 17869 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:51.495043 17521 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:51.439042 17723 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:51.462815 14790 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 280) took 24187 ms (client timeout 15000 ms). Trace:
I20260709 13:05:51.463732 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 5, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 5 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.475116 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.427214 17842 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:51.511886 17521 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:51.494412 14966 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:51.514067 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 6 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.475193 15545 rpcz_store.cc:276] 0709 13:05:49.963240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.977502 (+ 14262us) service_pool.cc:224] Handling call
0709 13:05:49.977843 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.371631 (+1393788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.466375 (+ 94744us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54002e6dd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:51.466551 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3142038912}
I20260709 13:05:51.516520 14792 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:51.446825 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:51.519956 14792 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 4, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:51.499830 14893 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:51.523038 14792 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 4, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 4 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.525604 14792 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 3, term changed from 3 to 4, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to <none>, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:05:51.539032 14792 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 4, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 4 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:05:51.487082 17522 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.545883 15542 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:51.463864 17749 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:05:51.550412 14792 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 4, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 4 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:05:51.528784 17650 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:51.553261 14891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.011s	sys 0.023s
I20260709 13:05:51.530598 17581 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:51.498538 14790 rpcz_store.cc:269] 0709 13:05:27.275119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.324959 (+ 49840us) service_pool.cc:224] Handling call
0709 13:05:51.462742 (+24137783us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:47.253330 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:47.253947 (+   617us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:47.253994 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:05:47.254016 (+    22us) tablet.cc:662] Decoding operations
0709 13:05:47.295220 (+ 41204us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:47.295311 (+    91us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:47.295341 (+    30us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:05:47.295952 (+   611us) tablet.cc:701] Row locks acquired
0709 13:05:47.295985 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:05:47.296130 (+   145us) write_op.cc:270] Start()
0709 13:05:47.296267 (+   137us) write_op.cc:276] Timestamp: P: 1783602347296068 usec, L: 0
0709 13:05:47.296288 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:05:47.459597 (+163309us) log.cc:844] Serialized 2434 byte log entry
0709 13:05:47.953954 (+494357us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d71e28 00007f55387ac581 00007f55387abd58 00007f55387b09f1 00007f55387b09a9 00007f55387b0939 00007f55387b0901 00007f55387afb2d 000000000038f354 000000000038f199
0709 13:05:48.130210 (+176256us) op_driver.cc:464] REPLICATION: finished
0709 13:05:48.316998 (+186788us) write_op.cc:301] APPLY: starting
0709 13:05:48.319172 (+  2174us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:48.334376 (+ 15204us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:48.340100 (+  5724us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:48.530034 (+189934us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:48.551135 (+ 21101us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:05:48.551194 (+    59us) write_op.cc:312] APPLY: finished
0709 13:05:48.551572 (+   378us) log.cc:844] Serialized 53 byte log entry
0709 13:05:48.551762 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:48.586397 (+ 34635us) write_op.cc:454] Released schema lock
0709 13:05:48.625958 (+ 39561us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:48.651830 (+ 25872us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:48.652677 (+   847us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":887225,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":153243,"apply.run_cpu_time_us":4604,"apply.run_wall_time_us":344429,"num_ops":6,"prepare.queue_time_us":392751,"prepare.run_cpu_time_us":33639,"prepare.run_wall_time_us":701131,"raft.queue_time_us":127722,"raft.run_cpu_time_us":27499,"raft.run_wall_time_us":77529,"replication_time_us":833745,"spinlock_wait_cycles":65466240,"thread_start_us":811569,"threads_started":4,"wal-append.queue_time_us":535977,"wal-append.run_cpu_time_us":50539,"wal-append.run_wall_time_us":1568758}]]}
I20260709 13:05:51.498099 17544 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:51.555110 14792 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 5, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 5 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:05:51.517675 17672 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.577261 14892 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:51.577107 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:05:51.652458 14892 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:51.531117 17430 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.570029 17686 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:51.681005 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:51.688550 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.670970 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.792649 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.794284 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.830780 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.831696 14894 raft_consensus.cc:2393] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:51.833423 14969 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:05:51.681058 17772 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.007s	sys 0.025s
I20260709 13:05:51.638906 17818 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.891871 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.879642 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:51.879842 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:51.641418 17824 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:51.901647 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:51.915015 14894 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:51.916221 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.003s	sys 0.044s
W20260709 13:05:51.916718 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.003s	sys 0.044s
W20260709 13:05:51.921036 15549 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.049s
W20260709 13:05:51.921536 15549 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.003s	sys 0.050s
W20260709 13:05:51.961745 14889 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.019s	sys 0.016s
W20260709 13:05:51.962549 14889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.019s	sys 0.016s
I20260709 13:05:51.831310 17563 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:51.891772 15541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.015s	sys 0.011s
I20260709 13:05:51.847951 17815 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:51.983441 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:51.918040 17706 raft_consensus.cc:1027] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: attempt to promote peer 58ee9fe38eb8453098f6d964e7675e79: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
W20260709 13:05:51.970574 17839 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:05:51.992311 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:51.995203 15008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.006s	sys 0.026s
W20260709 13:05:52.005487 15008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.007s	sys 0.026s
I20260709 13:05:52.010407 15043 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:05:51.985383 15541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.016s	sys 0.012s
I20260709 13:05:51.980108 17520 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:51.995581 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.003s	sys 0.029s
I20260709 13:05:51.996706 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:52.029161 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:52.030092 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.003s	sys 0.029s
I20260709 13:05:52.016436 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:52.022473 15040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.018s	sys 0.016s
W20260709 13:05:52.032650 15040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.018s	sys 0.016s
W20260709 13:05:52.002086 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.008s	sys 0.023s
I20260709 13:05:52.018759 15037 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:05:52.021823 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.004034 17529 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:05:52.030555 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 567926us
W20260709 13:05:52.036218 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.009s	sys 0.023s
W20260709 13:05:52.015213 17756 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.011s	sys 0.024s
W20260709 13:05:52.029016 17526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.014s	sys 0.020s
W20260709 13:05:52.096496 14886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.029s	sys 0.054s
I20260709 13:05:52.004601 17814 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:51.995088 17851 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.019s	sys 0.013s
W20260709 13:05:52.093314 17839 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:05:52.021767 17761 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.006s	sys 0.029s
W20260709 13:05:52.095759 17669 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.020s	sys 0.060s
W20260709 13:05:52.186296 14886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.030s	sys 0.055s
W20260709 13:05:52.192117 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.025s	sys 0.078s
W20260709 13:05:52.210544 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.026s	sys 0.078s
W20260709 13:05:52.210807 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 743257us
I20260709 13:05:52.211370 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:52.144534 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:52.212369 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:52.209591 15009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.076s	sys 0.125s
I20260709 13:05:52.212687 14894 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:05:52.190763 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46577.8us
W20260709 13:05:52.214345 15009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.076s	sys 0.126s
I20260709 13:05:52.215180 14892 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:52.050940 17529 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:52.091490 17807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.000s	sys 0.035s
I20260709 13:05:52.219791 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:52.211098 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 404) took 1454 ms. Trace:
W20260709 13:05:52.138013 17756 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.011s	sys 0.024s
I20260709 13:05:52.098908 17723 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:52.191490 17851 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.020s	sys 0.013s
W20260709 13:05:52.149739 17832 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.036s	sys 0.058s
W20260709 13:05:52.259889 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.186506 17526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.015s	sys 0.020s
I20260709 13:05:52.233484 14892 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:52.233170 14886 rpcz_store.cc:276] 0709 13:05:50.756171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.081766 (+325595us) service_pool.cc:224] Handling call
0709 13:05:51.082128 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.082390 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:51.310494 (+228104us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.210624 (+900130us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.210702 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:52.210772 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.210876 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.211028 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":257703,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":1090245,"threads_started":2}
I20260709 13:05:52.191277 17650 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:52.302908 17650 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:52.305433 17682 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:52.305763 17650 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:52.259023 17520 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.306818 17520 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:52.307297 17520 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:05:52.219050 17761 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.007s	sys 0.030s
W20260709 13:05:52.210166 17669 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.020s	sys 0.068s
W20260709 13:05:52.222074 17843 consensus_meta.cc:287] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.902s	user 0.010s	sys 0.000s
I20260709 13:05:52.279078 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:52.337867 14968 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:52.339958 14893 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.017s	sys 0.030s
I20260709 13:05:52.264122 17672 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:52.231573 17807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.000s	sys 0.036s
W20260709 13:05:52.257766 17880 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.297s	user 0.000s	sys 0.000s
W20260709 13:05:52.258378 17879 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 13:05:52.283054 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:52.349802 14886 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:52.270762 14894 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:52.285118 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.351006 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:52.285841 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:52.351665 14892 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.287606 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.291697 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:52.291567 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:52.355535 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:52.356343 14887 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:52.357654 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:52.292163 17884 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:05:52.222707 17710 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.294099 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.361953 15041 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:52.296120 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.299451 17505 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:52.222867 17683 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:52.231743 17825 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.334824 17430 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:52.340344 14893 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.017s	sys 0.030s
I20260709 13:05:52.345016 17563 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.273552 17763 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.313596 17885 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:52.277418 17544 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:52.279493 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.351452 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:52.374913 14894 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:52.292850 17878 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.256s	user 0.000s	sys 0.000s
I20260709 13:05:52.377841 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 409) took 1244 ms. Trace:
I20260709 13:05:52.272590 17772 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:05:52.378320 14893 rpcz_store.cc:276] 0709 13:05:51.133334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.532320 (+398986us) service_pool.cc:224] Handling call
0709 13:05:51.544563 (+ 12243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.544801 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:05:51.555651 (+ 10850us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.377451 (+821800us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:52.377506 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:05:52.377553 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.377652 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:52.377770 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15661,"prepare.queue_time_us":12114,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":36,"thread_start_us":811504,"threads_started":1}
I20260709 13:05:52.385902 14894 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:52.364471 17710 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.365185 17670 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:52.365882 17683 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:52.284452 17832 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.036s	sys 0.058s
W20260709 13:05:52.371471 15010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.006s	sys 0.048s
I20260709 13:05:52.372277 14887 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 13:05:52.483748 14887 pending_rounds.cc:85] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 2
I20260709 13:05:52.484112 14887 pending_rounds.cc:107] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 13:05:52.484422 14887 raft_consensus.cc:2889] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:52.366711 17825 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:52.345588 17790 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:52.386997 14893 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:52.387933 15037 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:52.376336 17818 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:52.408264 17520 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.414422 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:52.417742 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:52.379575 17563 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.377734 17824 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:52.381310 17842 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:52.343369 17843 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:52.375773 17885 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:52.453323 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.471997 14892 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
W20260709 13:05:52.479547 17831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.089s	user 0.020s	sys 0.063s
I20260709 13:05:52.477852 14968 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:52.504551 14969 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:52.489264 17825 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:52.380493 17529 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:52.402534 17670 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:52.492933 15010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.089s	user 0.008s	sys 0.056s
I20260709 13:05:52.378659 17763 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.363018 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:52.496012 14891 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.016s	sys 0.028s
W20260709 13:05:52.546392 14891 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.016s	sys 0.028s
I20260709 13:05:52.445737 17718 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.501765 14893 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
W20260709 13:05:52.491542 17881 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 13:05:52.496160 17878 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.095s	user 0.007s	sys 0.000s
W20260709 13:05:52.522403 14792 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.027s	sys 0.069s
I20260709 13:05:52.531886 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:52.613791 14792 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.027s	sys 0.069s
I20260709 13:05:52.614615 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.541326 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:52.615924 15044 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:52.542014 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.616643 15041 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:52.617758 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.543215 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.544873 15038 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.545116 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:52.547286 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 184367us
I20260709 13:05:52.620858 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:52.508764 17831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.125s	user 0.021s	sys 0.064s
I20260709 13:05:52.405788 17817 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:52.627737 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:52.796167 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.812376 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 184686us
I20260709 13:05:52.834427 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.812647 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:52.838605 17898 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:05:52.860394 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.866901 15044 raft_consensus.cc:2368] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:05:52.842298 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.868124 15037 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:52.868577 15041 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:52.869138 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.871824 14962 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:52.873651 14892 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:05:52.629032 15036 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:52.634873 14895 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:52.656960 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.682415 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:52.882385 14968 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.504741 17885 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:52.888671 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.808080 17901 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 13:05:52.893785 15036 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:52.555440 17772 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:52.896849 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:52.841135 17892 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 13:05:52.897585 15042 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:52.827987 17529 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.811915 17888 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:52.683934 17832 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:52.898500 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:52.737018 17891 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:05:52.896423 17886 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.494s	user 0.000s	sys 0.001s
I20260709 13:05:52.890756 17817 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:52.554440 17718 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.927990 17888 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.896513 17772 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:52.895797 17670 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:52.925542 15044 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:52.897485 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:53.061018 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163656us
I20260709 13:05:53.061976 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:52.905167 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.017s	sys 0.036s
W20260709 13:05:53.063611 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.017s	sys 0.036s
W20260709 13:05:52.956889 17887 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
W20260709 13:05:52.920019 17899 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 13:05:52.872413 17898 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:52.965204 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:52.986950 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.010s	sys 0.046s
I20260709 13:05:52.990203 15041 raft_consensus.cc:2410] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:05:53.026225 14933 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.930s (SENT) [suppressed 8 similar messages]
I20260709 13:05:52.904529 17895 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:52.923833 17832 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.100425 17888 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.109448 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 401) took 2354 ms. Trace:
I20260709 13:05:53.138357 14895 rpcz_store.cc:276] 0709 13:05:50.755477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.932513 (+177036us) service_pool.cc:224] Handling call
0709 13:05:50.932805 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.880294 (+1947489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.109197 (+228903us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b5400148554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:53.109374 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3913677184}
W20260709 13:05:53.101495 17814 consensus_meta.cc:287] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.893s	user 0.007s	sys 0.003s
I20260709 13:05:53.102046 17848 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:53.105198 17843 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.106257 17563 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:52.961439 14968 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:53.029313 17772 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:52.964792 17902 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:53.141994 14886 consensus_meta.cc:287] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.004s
I20260709 13:05:53.164546 14886 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
W20260709 13:05:53.129784 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.011s	sys 0.046s
W20260709 13:05:53.165571 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 1.13034e+06us
I20260709 13:05:53.130510 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.168510 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:53.130870 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 104696us
W20260709 13:05:53.129671 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61871.8us
I20260709 13:05:53.172591 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:53.144613 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:52.957542 17891 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:53.153949 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 604) took 1775 ms. Trace:
I20260709 13:05:53.155700 15038 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:53.183173 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.175200 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:53.132757 17832 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:53.159621 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.057s	sys 0.142s
I20260709 13:05:53.107452 17763 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:53.130126 17889 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.587s	user 0.000s	sys 0.001s
I20260709 13:05:53.129462 17905 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
W20260709 13:05:53.116998 17903 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260709 13:05:53.107357 17718 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:53.119210 17876 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.227s	user 0.004s	sys 0.000s
I20260709 13:05:53.152820 17861 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.129683 17870 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:53.200616 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 411) took 1874 ms. Trace:
I20260709 13:05:53.107514 17894 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:53.209275 14936 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.060s	user 0.039s	sys 0.044s
I20260709 13:05:53.107776 17710 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:53.188935 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.057s	sys 0.142s
I20260709 13:05:53.179539 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:53.131264 17896 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.215003 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:53.115948 17535 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:53.182219 15549 rpcz_store.cc:276] 0709 13:05:51.378674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.380453 (+  1779us) service_pool.cc:224] Handling call
0709 13:05:51.380740 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.381218 (+   478us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.381288 (+    70us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.382136 (+   848us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.921993 (+539857us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:51.922045 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:51.922131 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.153669 (+1231538us) raft_consensus.cc:1685] finished
0709 13:05:53.153697 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.153881 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1339,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":125,"thread_start_us":539281,"threads_started":1,"wal-append.queue_time_us":979804}
I20260709 13:05:53.135812 15042 raft_consensus.cc:2410] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:05:53.204278 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:53.191218 17904 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 13:05:53.231597 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:53.203981 14891 rpcz_store.cc:276] 0709 13:05:51.326335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.570205 (+243870us) service_pool.cc:224] Handling call
0709 13:05:51.570591 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.595702 (+ 25111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.595745 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.649973 (+ 54228us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.546859 (+896886us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.546913 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.546997 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.192075 (+645078us) raft_consensus.cc:1685] finished
0709 13:05:53.192094 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.200541 (+  8447us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":95,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":78871,"thread_start_us":751086,"threads_started":1,"wal-append.queue_time_us":1464330}
I20260709 13:05:53.187765 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:53.232916 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.233162 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:53.233810 14886 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:53.233704 14891 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:53.209501 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:53.235170 14965 raft_consensus.cc:2410] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:05:53.209776 14936 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.061s	user 0.039s	sys 0.044s
I20260709 13:05:53.158535 17814 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.020228 17831 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.241441 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:53.190006 17902 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.242093 15549 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:53.243229 15043 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:05:53.212589 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:53.244074 17902 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.244858 17902 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:53.245460 17902 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:53.162644 15035 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.713s	user 0.084s	sys 0.127s
W20260709 13:05:53.246719 15035 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.830s	user 0.085s	sys 0.127s
I20260709 13:05:53.247319 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 442) took 2439 ms. Trace:
I20260709 13:05:53.223783 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 603) took 1845 ms. Trace:
I20260709 13:05:53.251780 15035 rpcz_store.cc:276] 0709 13:05:50.807966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.868084 (+ 60118us) service_pool.cc:224] Handling call
0709 13:05:50.912680 (+ 44596us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:50.912934 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:05:51.119836 (+206902us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.247047 (+2127211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.247089 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:53.247127 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.247185 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.247273 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7014,"prepare.queue_time_us":464283,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":11872,"raft.run_cpu_time_us":47,"raft.run_wall_time_us":48,"thread_start_us":2326116,"threads_started":3,"wal-append.queue_time_us":541853}
I20260709 13:05:53.212733 17870 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.227087 17838 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.224474 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:53.227634 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:53.224825 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:53.131139 17895 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:53.222901 15513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.016s	sys 0.039s
I20260709 13:05:53.225363 17535 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.181857 17888 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.225544 17861 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:53.228943 17891 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.180640 17670 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:53.204875 15541 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.054s	sys 0.127s
I20260709 13:05:53.236632 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:53.213768 17886 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:05:53.129230 17898 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:53.240525 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 1.10382e+06us
I20260709 13:05:53.241258 17831 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.212318 14968 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:53.248517 17639 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:53.248771 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 448) took 2099 ms. Trace:
I20260709 13:05:53.249735 17528 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:53.253064 17749 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:05:53.223886 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:53.254662 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:53.224436 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:53.246518 17902 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.261308 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:53.336866 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 75621us
I20260709 13:05:53.214205 17718 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:05:53.267134 15513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.016s	sys 0.040s
W20260709 13:05:53.342238 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 1.00871e+06us
I20260709 13:05:53.342808 14969 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:53.266927 14886 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
W20260709 13:05:53.267856 14894 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.002s	sys 0.020s
W20260709 13:05:53.346328 14894 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.002s	sys 0.020s
I20260709 13:05:53.230376 17815 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:53.271219 17547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.006s	sys 0.017s
I20260709 13:05:53.276788 17912 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:53.282037 14887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.012s	sys 0.002s
W20260709 13:05:53.359161 14887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.013s	sys 0.002s
I20260709 13:05:53.160641 17848 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.233500 17905 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:53.214545 17686 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:05:53.327337 15040 rpcz_store.cc:276] 0709 13:05:51.149021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.244610 (+ 95589us) service_pool.cc:224] Handling call
0709 13:05:51.244918 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.245262 (+   344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.245294 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.265029 (+ 19735us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.033612 (+768583us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:52.033663 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.033746 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.248613 (+1214867us) raft_consensus.cc:1685] finished
0709 13:05:53.248629 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.248726 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3775,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":80,"thread_start_us":703678,"threads_started":1,"wal-append.queue_time_us":1103140}
I20260709 13:05:53.199743 17520 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.330052 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:53.324733 15541 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.084s	user 0.055s	sys 0.127s
I20260709 13:05:53.335126 15548 raft_consensus.cc:2368] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:05:53.272284 17861 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:53.223945 17818 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:53.231508 17896 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:53.404450 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 74482.6us
W20260709 13:05:53.352079 14888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2352) took 2603 ms (client timeout 1930 ms). Trace:
I20260709 13:05:53.345639 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 400) took 2590 ms. Trace:
W20260709 13:05:53.405102 14888 rpcz_store.cc:269] 0709 13:05:50.749142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.750185 (+  1043us) service_pool.cc:224] Handling call
0709 13:05:53.351853 (+2601668us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54000ce754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:53.352005 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3964967168}
I20260709 13:05:53.405294 14889 rpcz_store.cc:276] 0709 13:05:50.755232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.843227 (+ 87995us) service_pool.cc:224] Handling call
0709 13:05:50.843686 (+   459us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.242960 (+399274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.242999 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.264989 (+ 21990us) log.cc:844] Serialized 26 byte log entry
0709 13:05:51.963180 (+698191us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:52.022349 (+ 59169us) log.cc:844] Serialized 14 byte log entry
0709 13:05:52.047840 (+ 25491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:52.047931 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.129319 (+1081388us) spinlock_profiling.cc:243] Waited 47.1 ms on lock 0x7b1800395b00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:53.345301 (+215982us) raft_consensus.cc:1685] finished
0709 13:05:53.345408 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.345569 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18816,"prepare.queue_time_us":59648,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":37,"raft.queue_time_us":130314,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":49736,"spinlock_wait_cycles":108259200,"thread_start_us":1028996,"threads_started":2,"wal-append.queue_time_us":1079912}
W20260709 13:05:53.357007 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.331159 17843 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:53.365564 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 129011us
I20260709 13:05:53.368422 17823 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:53.412673 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:53.375219 17718 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:53.370326 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:53.318274 17888 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:53.343966 17869 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.848s	user 0.015s	sys 0.000s
I20260709 13:05:53.370900 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:53.425347 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54550.2us
I20260709 13:05:53.377707 17914 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.341243 17528 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:53.345784 17763 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:53.262832 15542 rpcz_store.cc:276] 0709 13:05:51.378346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.379946 (+  1600us) service_pool.cc:224] Handling call
0709 13:05:51.380229 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.558254 (+178025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.223492 (+1665238us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54004efcd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:53.223708 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":375091456}
I20260709 13:05:53.404531 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1863) took 1666 ms. Trace:
I20260709 13:05:53.407258 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 585) took 1969 ms. Trace:
W20260709 13:05:53.407756 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.330364 17885 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.365067 17838 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.357511 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:53.424157 17544 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:05:53.366161 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.004s	sys 0.017s
W20260709 13:05:53.446070 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.005s	sys 0.018s
I20260709 13:05:53.368526 17832 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.415516 17823 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.416544 17848 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.417439 17861 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.417932 17843 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:53.420121 17683 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:53.420728 15544 raft_consensus.cc:2410] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:05:53.463845 17843 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:53.375592 17814 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.465617 17823 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:53.422600 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 52342.9us
I20260709 13:05:53.439064 17869 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:05:53.358808 17547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.006s	sys 0.017s
I20260709 13:05:53.410413 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:53.395577 17909 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.434296 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1810) took 2481 ms. Trace:
I20260709 13:05:53.471382 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:53.473202 14961 rpcz_store.cc:276] 0709 13:05:50.944577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.944740 (+   163us) service_pool.cc:224] Handling call
0709 13:05:50.945010 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:51.494259 (+549249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.425340 (+1931081us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54003ebf54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:53.425496 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1261725056}
I20260709 13:05:53.366364 17815 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.438321 14887 rpcz_store.cc:276] 0709 13:05:51.738452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.489534 (+751082us) service_pool.cc:224] Handling call
0709 13:05:52.489948 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:52.490242 (+   294us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:05:52.490578 (+   336us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.404188 (+913610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:53.404238 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:53.404289 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.404358 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.404474 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45124,"prepare.queue_time_us":3296,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":51828,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":12852,"thread_start_us":868796,"threads_started":1,"wal-append.queue_time_us":785957}
I20260709 13:05:53.439790 14963 rpcz_store.cc:276] 0709 13:05:51.438308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.438425 (+   117us) service_pool.cc:224] Handling call
0709 13:05:51.438737 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.491186 (+ 52449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.406965 (+1915779us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b54002175d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:53.407195 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":119135104}
I20260709 13:05:53.401526 17723 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:05:53.406507 17923 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.408921 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 578) took 2043 ms. Trace:
I20260709 13:05:53.479774 14966 rpcz_store.cc:276] 0709 13:05:51.365318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:51.366715 (+  1397us) service_pool.cc:224] Handling call
0709 13:05:53.408676 (+2041961us) spinlock_profiling.cc:243] Waited 89.4 ms on lock 0x7b5400109ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:53.408850 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205692288}
I20260709 13:05:53.410981 17916 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.465693 17814 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.466533 17832 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:53.445129 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.904s	user 0.005s	sys 0.028s
W20260709 13:05:53.487576 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.006s	sys 0.029s
W20260709 13:05:53.445621 15039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.025s	sys 0.028s
W20260709 13:05:53.487931 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 947138us
W20260709 13:05:53.488175 15039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.025s	sys 0.028s
I20260709 13:05:53.434033 17817 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:53.434125 17790 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.376418 17912 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.489025 17790 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.468358 17869 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:53.490176 17869 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:53.447942 17838 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.432046 17928 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:53.455942 17718 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.456882 17885 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.458462 17535 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.443784 17671 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:05:53.459996 17895 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.436403 17763 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:53.377496 17905 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.466913 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:53.425989 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:53.514757 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 88829.1us
I20260709 13:05:53.411660 17818 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:53.468729 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 58425.7us
I20260709 13:05:53.474814 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:53.483773 17683 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:53.488546 17832 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.490433 17912 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.490608 17817 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:53.482276 17544 raft_consensus.cc:2764] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 13:05:53.505962 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.520462 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:53.513528 17763 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:53.523756 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 56936.7us
I20260709 13:05:53.527240 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:53.437333 17914 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.512333 17870 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:53.528414 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53704.8us
W20260709 13:05:53.528604 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 190390us
W20260709 13:05:53.516335 17529 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.001s
I20260709 13:05:53.553445 17905 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:53.553978 17905 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:53.513875 17790 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.555395 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:53.558696 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1606) took 1270 ms. Trace:
I20260709 13:05:53.525944 17817 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:53.563642 15039 rpcz_store.cc:276] 0709 13:05:52.288327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.289431 (+  1104us) service_pool.cc:224] Handling call
0709 13:05:52.289759 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.341576 (+ 51817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.341620 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.526106 (+184486us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:05:52.547702 (+ 21596us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.488558 (+940856us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:53.488606 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.488670 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.558367 (+ 69697us) raft_consensus.cc:1685] finished
0709 13:05:53.558393 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.558630 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51409,"raft.queue_time_us":54489,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"spinlock_wait_cycles":7785344,"thread_start_us":676424,"threads_started":1,"wal-append.queue_time_us":897532}
I20260709 13:05:53.559449 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.565913 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.563068 15040 raft_consensus.cc:2376] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7. Re-sending same reply.
W20260709 13:05:53.575158 14936 connection.cc:256] RPC call timeout handler was delayed by -1.8019579489999842s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260709 13:05:53.568854 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:53.577294 14888 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:53.569293 15042 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:05:53.569327 14887 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:53.578472 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:53.578893 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.540705 17581 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:53.570621 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:53.567672 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.575706 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.528164 17522 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.527379 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:53.540921 17928 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:53.539541 17683 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:53.596916 17928 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:53.494086 17916 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.597401 17683 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.597863 17928 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.520298 17528 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.576866 17686 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:53.574397 17831 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.576155 17920 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:05:53.579866 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:53.580090 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.570307 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.580547 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.580854 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.581151 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.582391 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.583163 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.541468 17832 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.586131 15040 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:53.545449 17925 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:53.541869 17710 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.485055 17909 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.592007 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.562282 17563 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:05:53.613857 14893 raft_consensus.cc:2410] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:05:53.651093 14936 connection.cc:256] RPC call timeout handler was delayed by -1.7569579489999114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1577s for a response
I20260709 13:05:53.651666 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:53.652503 15035 raft_consensus.cc:2376] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8. Re-sending same reply.
I20260709 13:05:53.555311 17905 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
W20260709 13:05:53.651583 14936 connection.cc:256] RPC call timeout handler was delayed by -1.6642579489999889s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.168s for a response
W20260709 13:05:53.654987 14936 connection.cc:256] RPC call timeout handler was delayed by -1.4302579489999516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
W20260709 13:05:53.655541 14936 connection.cc:256] RPC call timeout handler was delayed by -1.3838420350000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15300000000000002s for a response
W20260709 13:05:53.656034 14936 connection.cc:256] RPC call timeout handler was delayed by -1.3348924059999945s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260709 13:05:53.656709 14936 connection.cc:256] RPC call timeout handler was delayed by -1.3069579489999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2077s for a response
W20260709 13:05:53.657130 14936 connection.cc:256] RPC call timeout handler was delayed by -1.2664579489999142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
W20260709 13:05:53.657596 14936 connection.cc:256] RPC call timeout handler was delayed by -1.1980924060000007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
W20260709 13:05:53.658115 14936 connection.cc:256] RPC call timeout handler was delayed by -1.1386924060000183s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.193s for a response
I20260709 13:05:53.591961 17939 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:53.621161 17814 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:53.658713 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 107185us
I20260709 13:05:53.591298 17888 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.613497 17815 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:53.618654 17909 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.608281 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:53.599370 17916 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.616813 17710 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.607761 17686 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.643616 17843 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.615546 17832 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.666638 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:53.845125 14936 connection.cc:256] RPC call timeout handler was delayed by -1.1332579489999262s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.227s for a response
W20260709 13:05:53.763263 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 247802us
W20260709 13:05:53.711140 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 121958us
W20260709 13:05:53.846055 14936 connection.cc:256] RPC call timeout handler was delayed by -1.1148191419999876s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
W20260709 13:05:53.668460 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:53.703558 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 212215us
I20260709 13:05:53.851445 17909 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.851958 17909 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.736696 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:53.856842 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:53.694789 17825 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.122s	user 0.008s	sys 0.004s
W20260709 13:05:53.849800 17935 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
W20260709 13:05:53.878113 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 297271us
I20260709 13:05:53.669333 17931 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:53.879280 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:53.882356 15040 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
W20260709 13:05:53.845036 17940 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:05:53.693827 17939 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:53.877171 17772 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.004s
W20260709 13:05:53.876917 17670 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.552s	user 0.011s	sys 0.000s
I20260709 13:05:53.719623 17671 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.827308 17905 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:53.738721 17894 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.006s
I20260709 13:05:53.883811 17459 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:53.887777 17522 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:53.892771 17909 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.888036 17851 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.884131 17895 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:05:53.717994 17818 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:53.894352 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 672) took 3192 ms. Trace:
I20260709 13:05:53.737254 17563 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.953357 17563 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.954067 17581 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:05:53.955755 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:53.889190 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:53.668138 17869 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.883944 17520 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:53.884008 17920 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:53.891542 17639 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:53.999617 17639 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.002018 17639 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.887091 17931 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:53.902796 17772 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.004061 17931 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.005074 17931 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.005470 17772 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.884600 17825 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.909624 17710 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.910637 17686 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.911649 17843 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:53.912106 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:53.913460 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1862) took 2175 ms. Trace:
I20260709 13:05:53.885418 17814 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:53.913290 17671 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.883339 17948 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:54.154448 14891 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:53.923326 14888 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:53.929196 17851 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:53.930837 17832 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:53.923161 17939 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:53.879942 17943 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:05:53.934895 17763 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:53.940018 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48843.7us
W20260709 13:05:53.975268 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 86167.4us
I20260709 13:05:53.923900 17894 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:53.996379 17951 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.006247 17817 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:53.917943 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 64285.9us
I20260709 13:05:54.185004 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.007081 14964 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.139199 17825 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.007463 14893 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:53.918286 17905 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.144315 14894 rpcz_store.cc:276] 0709 13:05:51.738161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.391083 (+652922us) service_pool.cc:224] Handling call
0709 13:05:52.402034 (+ 10951us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:53.346773 (+944739us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.346815 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:53.347358 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.587428 (+240070us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:53.629584 (+ 42156us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.629848 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.629954 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.913213 (+283259us) raft_consensus.cc:1685] finished
0709 13:05:53.913241 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.913391 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42206,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":102568,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":11755,"thread_start_us":1132639,"threads_started":2,"wal-append.queue_time_us":301572}
W20260709 13:05:54.189903 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 133265us
I20260709 13:05:54.190276 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.191331 17905 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.149189 17915 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:54.149463 17671 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.152190 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2235) took 1597 ms. Trace:
W20260709 13:05:54.153470 17930 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.780s	user 0.008s	sys 0.006s
I20260709 13:05:54.155880 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:54.156885 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:54.007381 17920 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.177237 17683 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.171753 14936 leader_election.cc:400] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:05:54.173177 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.186606 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.158821 17814 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.200356 15036 rpcz_store.cc:276] 0709 13:05:52.554408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.901858 (+347450us) service_pool.cc:224] Handling call
0709 13:05:52.902153 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.922549 (+ 20396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.922577 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.956727 (+ 34150us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.496370 (+539643us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:53.643960 (+147590us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.644257 (+   297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.644348 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.150190 (+505842us) spinlock_profiling.cc:243] Waited 983 us on lock 0x7b18004767a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:54.151906 (+  1716us) raft_consensus.cc:1685] finished
0709 13:05:54.152010 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.152137 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2898,"prepare.queue_time_us":381863,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":11806,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":8286,"spinlock_wait_cycles":2260864,"thread_start_us":464008,"threads_started":2,"wal-append.queue_time_us":592253}
I20260709 13:05:54.204218 14888 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:54.211555 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:53.958678 17563 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.204658 14893 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.205307 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:54.206733 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:54.165910 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 279301us
I20260709 13:05:54.168020 17891 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:05:54.211901 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.220244 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.221477 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.221601 15041 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:54.197772 17915 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:54.213101 17671 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.226303 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.227115 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.227990 14963 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.161160 17948 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.268303 17869 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.257942 17958 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.273700 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.224340 17943 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.257642 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.271037 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.274765 14963 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:54.223913 17815 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:54.226071 17520 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:54.276211 14967 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
W20260709 13:05:54.272550 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45506.5us
W20260709 13:05:54.276677 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51539.8us
I20260709 13:05:54.232587 17772 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.280427 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.284567 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.281296 15548 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:54.284621 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.290853 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.292225 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.293002 15044 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:54.293375 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.289425 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.275543 17522 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.303510 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.265677 17968 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:54.301615 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:54.306988 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.259536 17528 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:05:54.310309 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:54.293862 17520 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.230881 17671 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.351248 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.225833 17683 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:54.294544 17430 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:54.308970 17956 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:05:54.361039 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.308794 17936 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.363898 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2384) took 1530 ms. Trace:
I20260709 13:05:54.283160 17710 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:05:54.309154 17968 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.368330 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.312880 17894 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:54.294054 17815 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:54.380251 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89391.1us
W20260709 13:05:54.380487 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.371740 14895 rpcz_store.cc:276] 0709 13:05:52.833520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.139138 (+305618us) service_pool.cc:224] Handling call
0709 13:05:53.139467 (+   329us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:53.139808 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:53.139850 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:53.159160 (+ 19310us) log.cc:844] Serialized 52 byte log entry
0709 13:05:53.373481 (+214321us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:53.373535 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.373624 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.152899 (+779275us) spinlock_profiling.cc:243] Waited 83.6 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:54.359273 (+206374us) raft_consensus.cc:1685] finished
0709 13:05:54.359296 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.363837 (+  4541us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":966,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5504,"spinlock_wait_cycles":192310016,"thread_start_us":153262,"threads_started":1,"wal-append.queue_time_us":188643}
I20260709 13:05:54.386039 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:54.349871 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:54.411998 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43787.4us
I20260709 13:05:54.412904 14936 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:54.384969 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 74762.1us
W20260709 13:05:54.358125 17875 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 2.368s	user 0.004s	sys 0.007s
I20260709 13:05:54.299635 17706 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:05:54.351361 17772 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.386793 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.357939 17520 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.308563 17544 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 13:05:54.362066 17851 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.421325 15548 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:05:54.369531 17528 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:54.405961 17968 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.304800 17915 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.411562 17430 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.435369 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.418792 17891 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:54.421674 15544 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.388568 17825 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:05:54.448453 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.450708 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.451121 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.451304 14969 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:54.448653 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.452549 14961 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:05:54.422086 17763 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.451992 14968 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:54.453799 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.454085 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.454471 14968 raft_consensus.cc:2368] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:05:54.454732 14965 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:54.455650 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.447376 17772 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.426757 17710 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.459692 17814 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.462117 17815 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.422762 17972 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:54.427206 17824 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:05:54.449476 17639 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:53.948491 15541 rpcz_store.cc:276] 0709 13:05:50.701595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:50.707466 (+  5871us) service_pool.cc:224] Handling call
0709 13:05:51.068892 (+361426us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:05:51.069171 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:51.095581 (+ 26410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:51.102148 (+  6567us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:51.235153 (+133005us) log.cc:844] Serialized 26 byte log entry
0709 13:05:52.074137 (+838984us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:05:53.406280 (+1332143us) log.cc:844] Serialized 14 byte log entry
0709 13:05:53.878247 (+471967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.883708 (+  5461us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:53.886068 (+  2360us) raft_consensus.cc:1685] finished
0709 13:05:53.894120 (+  8052us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:53.894271 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5720,"prepare.queue_time_us":1181914,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":27917,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":171,"spinlock_wait_cycles":3747072,"thread_start_us":2253614,"threads_started":4,"wal-append.queue_time_us":1230260,"wal-append.run_cpu_time_us":2094,"wal-append.run_wall_time_us":1055371}
I20260709 13:05:54.445928 17896 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.468562 17683 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.468348 17520 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:54.470255 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.470520 17914 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.387295 17894 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.471400 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.452486 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.475929 14970 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:05:54.477566 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.479525 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.480397 14963 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:54.481377 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.481508 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.482002 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:54.482534 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.477605 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:54.483704 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:54.484041 14961 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.484635 15543 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:54.485936 15548 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:05:54.432868 17528 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:54.488313 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.490288 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:54.491344 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.491930 14967 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:54.492198 17520 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.492714 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:54.493147 17970 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:54.493278 14967 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:54.494174 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:54.491345 17922 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.073s	user 0.006s	sys 0.011s
I20260709 13:05:54.499991 17971 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:54.500705 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2382) took 2148 ms. Trace:
I20260709 13:05:54.500627 17971 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.501714 17948 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.472579 17817 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.502962 17971 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.450907 17974 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 13:05:54.473835 17915 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.495126 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.505795 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.508937 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.509430 15039 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:05:54.501111 14892 rpcz_store.cc:276] 0709 13:05:52.352752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.900521 (+547769us) service_pool.cc:224] Handling call
0709 13:05:52.904216 (+  3695us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:52.904523 (+   307us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:52.904551 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:52.919053 (+ 14502us) log.cc:844] Serialized 26 byte log entry
0709 13:05:53.327125 (+408072us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:53.327166 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:53.327245 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:54.486460 (+1159215us) spinlock_profiling.cc:243] Waited 38.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:05:54.500438 (+ 13978us) raft_consensus.cc:1685] finished
0709 13:05:54.500457 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:54.500653 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":225003,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":77,"spinlock_wait_cycles":89231744,"thread_start_us":407727,"threads_started":1,"wal-append.queue_time_us":492266}
I20260709 13:05:54.489723 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.510082 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:54.510831 14963 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:54.510434 14967 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:54.511731 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.513350 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:54.516592 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.517284 15038 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.517313 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.518101 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.518821 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.477244 17894 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.510056 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.517333 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:54.534813 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 148833us
I20260709 13:05:54.535895 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.536815 14968 raft_consensus.cc:2368] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:05:54.536890 14961 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:54.537053 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:54.537768 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.503000 17671 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.542500 14968 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:54.541198 14967 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:05:54.544021 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.514119 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.545753 14963 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 3.
I20260709 13:05:54.514648 17869 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:54.550271 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:54.552182 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:54.553133 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.552780 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.554214 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.554834 14968 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:05:54.546195 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.553702 14967 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:54.571558 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.538511 17832 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:54.572201 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:54.567346 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:54.573419 14968 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.551333 17671 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:54.588725 17931 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.002s
I20260709 13:05:54.591655 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.593643 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.594334 15040 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:05:54.597484 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:54.595268 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.604050 15545 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:54.605985 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.551324 17869 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.560390 17815 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:54.612188 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.614738 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.615262 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:54.614303 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 199245us
I20260709 13:05:54.560606 17974 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:54.575567 17832 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:54.619786 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.561131 17948 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
W20260709 13:05:54.622998 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 90315.6us
I20260709 13:05:54.625231 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.625783 15040 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.626019 15544 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:54.623930 15038 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:54.629397 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:54.611318 17869 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.617022 17815 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:54.631062 17815 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:54.619483 17914 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:05:54.634423 17985 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:54.634740 17931 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:54.635136 17985 consensus_queue.cc:1243] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:05:54.620702 17832 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:54.639918 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.614053 17979 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.618202 17974 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:54.551765 17528 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.649917 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.650848 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.653831 15040 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:54.657771 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:54.658744 15550 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:54.660348 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.661582 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:54.662437 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.663189 15042 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:54.664351 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.669121 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:54.677662 15549 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:05:54.689425 17968 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.690310 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:54.692571 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.694737 17825 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.696435 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:54.699620 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 70326.2us
I20260709 13:05:54.648209 17974 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:54.707948 15549 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:05:54.714682 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 94180.5us
I20260709 13:05:54.715723 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:54.705464 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:54.703123 17898 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.283s	user 0.017s	sys 0.059s
I20260709 13:05:54.725224 15543 raft_consensus.cc:2410] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:05:54.711862 17825 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.727317 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:54.730018 17529 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:54.733451 17968 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.733634 17529 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:54.704074 17969 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:54.708125 17528 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.738962 17529 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.742458 17946 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:54.742883 17946 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:54.743762 17946 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:54.728735 17982 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 13:05:54.726776 17898 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.306s	user 0.018s	sys 0.060s
I20260709 13:05:54.725581 17894 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:54.725167 17505 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:54.725926 17939 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:54.757536 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:05:54.758513 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89500.6us
I20260709 13:05:54.761264 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.762104 14889 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:54.724128 17815 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.771622 17997 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:54.772231 17997 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:54.773754 17825 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.774513 17997 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:54.779052 14894 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:54.780942 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.782492 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:54.783262 14895 raft_consensus.cc:2376] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6. Re-sending same reply.
I20260709 13:05:54.778103 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.789291 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.790442 17832 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.791829 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1603) took 2512 ms. Trace:
I20260709 13:05:54.792349 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.792222 15043 rpcz_store.cc:276] 0709 13:05:52.279477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.313752 (+ 34275us) service_pool.cc:224] Handling call
0709 13:05:52.334086 (+ 20334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:53.243681 (+909595us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:54.791595 (+1547914us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54001ce654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:54.791755 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2089951616}
I20260709 13:05:54.792841 17987 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:54.793254 17987 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:54.793123 14892 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:05:54.793707 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.794255 15043 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.794107 17987 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.795397 17987 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.795166 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.796136 14892 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:54.796140 15547 raft_consensus.cc:1217] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Deduplicated request from leader. Original: 4.6->[5.7-6.8]   Dedup: 5.7->[6.8-6.8]
I20260709 13:05:54.797767 15547 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: [5.7-6.8]
I20260709 13:05:54.799805 15547 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:54.761145 17505 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.759166 17939 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:54.807546 15043 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:05:54.807917 17939 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:54.808841 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.810093 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.812438 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:54.822227 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44193.4us
I20260709 13:05:54.814906 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.813813 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:54.824687 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:54.816205 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.811378 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.827317 17761 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.828078 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:54.828524 17861 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:54.830137 17995 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:54.819892 17997 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:54.830561 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:54.830813 17997 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:54.830734 17995 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.831471 17997 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:54.833326 17995 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.833878 17995 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:54.834654 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.834445 17995 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.836956 15044 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:54.881070 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:54.881827 14886 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:05:54.884502 17995 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.885586 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:54.886010 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 69872.8us
I20260709 13:05:54.887045 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:54.844612 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.845453 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.848011 17997 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:54.852425 17505 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.835223 15038 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:05:54.795154 17869 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:54.860656 17815 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:54.862140 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:54.865128 17581 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:54.880250 17838 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:54.881717 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.897521 15044 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:54.844053 15547 pending_rounds.cc:85] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 6
I20260709 13:05:54.898375 15547 pending_rounds.cc:107] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 13:05:54.898708 15547 raft_consensus.cc:2889] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.892056 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.900940 15043 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:05:54.895524 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 71304.4us
I20260709 13:05:54.901898 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.903138 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:54.907292 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:54.908107 14888 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:54.922478 14886 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:54.928792 15042 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:54.933368 15545 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:05:54.933869 15545 pending_rounds.cc:85] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 7
I20260709 13:05:54.934134 15545 pending_rounds.cc:107] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:05:54.934425 15545 raft_consensus.cc:2889] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:54.940253 14887 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:54.941951 15038 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:54.943972 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:54.945025 15040 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:05:54.948698 14894 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:54.948889 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.950277 14961 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:05:54.950429 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47349.6us
I20260709 13:05:54.951292 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:54.951638 14859 leader_election.cc:400] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:05:54.951977 14859 leader_election.cc:403] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:54.953935 14968 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:54.929966 17996 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:54.939289 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:54.939086 17505 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:54.958025 17838 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.964535 17838 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:05:54.940059 17995 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:54.929253 17581 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:54.983081 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 43894.1us
I20260709 13:05:55.043398 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.044032 14962 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:55.042837 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.046072 15044 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:55.048801 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:55.053555 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.054831 14966 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:54.961431 17996 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:55.058341 17529 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:05:55.059321 17522 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:55.059722 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:55.060330 15543 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:05:54.986882 17505 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:54.970222 15542 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:05:55.027464 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.066447 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 60489.9us
I20260709 13:05:55.069067 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:55.069446 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:55.071945 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:55.073196 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.075543 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:55.076794 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:55.078814 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:55.029448 17843 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:55.061518 17996 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.086489 17430 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:55.089488 17946 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.089593 17723 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:55.093583 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.094766 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.132678 14961 raft_consensus.cc:2410] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:05:55.133698 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:55.109432 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.134682 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.096863 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.097040 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:55.075459 17838 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:55.121922 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:55.137754 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:55.138425 15035 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:55.123517 15036 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:05:55.126965 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:55.139750 14970 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:55.130707 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:55.135684 14965 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:55.138772 14962 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:55.140578 15044 raft_consensus.cc:606] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:55.141000 15044 raft_consensus.cc:614] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:55.137761 17832 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:55.131588 17825 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:55.142771 17832 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:55.143466 17832 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:55.143887 17832 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:55.144708 17832 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.131335 17723 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:55.038547 17581 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:55.148797 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51826.8us
I20260709 13:05:55.153723 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:55.120391 17976 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:55.138047 17838 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:55.133839 17430 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:55.147707 17723 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.133647 18001 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.160043 17928 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:55.186530 15041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2242) took 2066 ms (client timeout 1595 ms). Trace:
I20260709 13:05:55.187376 15035 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:55.103471 17843 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.163429 17976 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:55.197646 15041 rpcz_store.cc:269] 0709 13:05:53.120178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.168232 (+ 48054us) service_pool.cc:224] Handling call
0709 13:05:55.186290 (+2018058us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540008a2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:55.186443 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361575808}
I20260709 13:05:55.167907 17563 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:55.178948 17838 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.142915 17825 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.108881 17939 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.182163 17581 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:55.201612 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 250061us
I20260709 13:05:55.182286 17997 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:55.182466 17869 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:55.163786 17974 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.197508 17928 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:55.170223 17823 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:05:55.233434 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:55.249310 14968 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:55.250459 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:55.254596 17939 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:55.253373 14965 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:55.255376 17823 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:55.255798 17823 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:55.256529 15042 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 3. Current term is 5. Ops: []
I20260709 13:05:55.256603 17823 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.257810 17823 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.259863 17869 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:55.260191 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:55.260408 17869 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:55.261251 17869 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.234953 17821 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:55.263799 17821 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:55.265633 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:55.270735 18005 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:05:55.271279 18005 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:55.271749 18005 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:55.275295 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:55.275665 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.277185 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:55.278439 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:55.285050 14969 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:55.249083 17928 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.254653 17974 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:55.253373 17976 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.250378 17997 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:55.344597 14966 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 13:05:55.351634 18003 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:05:55.389372 14966 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:55.274734 17430 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.347770 17976 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.334861 17997 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.383502 17843 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:55.339564 17821 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.429147 17749 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:55.429566 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:55.429790 17749 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.430250 15547 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:55.413067 17832 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.421587 17843 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:55.437862 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 308646us
I20260709 13:05:55.445734 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:55.429225 17821 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:55.431854 17825 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:55.464766 17861 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.636s	user 0.003s	sys 0.008s
I20260709 13:05:55.468648 17843 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.492308 15037 raft_consensus.cc:2410] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:05:55.484279 17749 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:55.512041 17905 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.533185 18004 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:05:55.528798 18010 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:05:55.552667 18009 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:05:55.552934 18000 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.469s	user 0.003s	sys 0.000s
W20260709 13:05:55.554541 18008 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 13:05:55.556885 18006 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.165s	user 0.001s	sys 0.001s
I20260709 13:05:55.544778 18013 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:05:55.555212 18002 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 13:05:55.558120 18013 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.559685 18013 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:55.546224 17997 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:55.547679 18010 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:55.562842 18010 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:55.572679 18013 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.567025 18005 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.578358 18005 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:55.578547 18013 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:55.575088 17996 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.587715 17996 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:55.625830 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 347246us
W20260709 13:05:55.628371 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.068s	sys 0.113s
W20260709 13:05:55.876894 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.068s	sys 0.114s
W20260709 13:05:55.878710 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 801870us
W20260709 13:05:55.636243 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 170606us
I20260709 13:05:55.646747 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1818) took 3226 ms. Trace:
W20260709 13:05:55.647900 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.649014 15037 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2253) took 2076 ms (client timeout 2400 ms). Trace:
W20260709 13:05:55.652760 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.654534 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.654904 14969 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:55.682837 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:55.684494 14967 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:55.687448 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:55.689757 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:55.705638 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.707867 15043 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:55.710493 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 693) took 1034 ms. Trace:
I20260709 13:05:55.713927 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:55.882467 15545 rpcz_store.cc:276] 0709 13:05:54.675860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:54.675986 (+   126us) service_pool.cc:224] Handling call
0709 13:05:54.676292 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.934907 (+258615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.709773 (+774866us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54005d0f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:55.710178 (+   405us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590156032}
W20260709 13:05:55.715663 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.760015 17563 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:05:55.790077 17723 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.008s
W20260709 13:05:55.886754 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:55.887287 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.887053 17723 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.887362 15035 raft_consensus.cc:2376] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6. Re-sending same reply.
I20260709 13:05:55.889552 17723 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:55.593119 18010 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.888787 15039 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
W20260709 13:05:55.793599 17763 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.011s	sys 0.015s
W20260709 13:05:55.891676 17763 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.012s	sys 0.016s
I20260709 13:05:55.838266 17819 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.855989 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.856554 18007 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:05:55.862771 17581 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.013s
W20260709 13:05:55.870500 17823 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.012s
I20260709 13:05:55.870281 15036 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:05:55.872746 17912 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:55.880566 15037 rpcz_store.cc:269] 0709 13:05:53.572267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:53.579650 (+  7383us) service_pool.cc:224] Handling call
0709 13:05:55.648263 (+2068613us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b54001b80d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:55.648637 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4329891200}
I20260709 13:05:55.849619 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:55.881582 14965 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:55.880069 14964 rpcz_store.cc:276] 0709 13:05:52.420460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:52.470976 (+ 50516us) service_pool.cc:224] Handling call
0709 13:05:52.471369 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:54.186808 (+1715439us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:55.646106 (+1459298us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b5400307ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:55.646495 (+   389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3531228544}
I20260709 13:05:55.896273 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:55.882153 15043 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:55.898227 15036 pending_rounds.cc:85] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 7
I20260709 13:05:55.901121 15036 pending_rounds.cc:107] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:05:55.902220 15036 raft_consensus.cc:2889] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.905550 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:55.905476 15043 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.537331 17905 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:55.907356 15043 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:55.907855 17823 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:55.908639 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:55.913148 17823 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:05:55.924774 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:55.896267 17819 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:55.926469 17823 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:55.951745 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55750.3us
I20260709 13:05:55.926656 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:05:55.960525 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 452735us
I20260709 13:05:55.973755 15042 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:05:55.974222 15042 pending_rounds.cc:85] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 4
I20260709 13:05:55.974504 15042 pending_rounds.cc:107] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:05:55.974748 15042 raft_consensus.cc:2889] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:55.981868 17430 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:55.987044 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:55.988330 17756 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:55.992818 14965 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:55.999676 17962 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:56.003758 18010 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:55.921614 18007 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:56.015619 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58804.9us
I20260709 13:05:55.969280 17939 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:55.926556 17912 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:56.036718 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 139853us
W20260709 13:05:56.036705 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 138309us
I20260709 13:05:56.040828 17821 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:56.041416 17821 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.041862 17821 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.037444 17939 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.048705 17939 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.051630 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2270) took 1344 ms. Trace:
I20260709 13:05:56.053833 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:56.058570 14892 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:56.060665 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:56.065636 17976 consensus_meta.cc:287] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.658s	user 0.008s	sys 0.005s
I20260709 13:05:56.066726 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:56.055748 15043 rpcz_store.cc:276] 0709 13:05:54.707293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.096476 (+389183us) service_pool.cc:224] Handling call
0709 13:05:55.096719 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:55.707454 (+610735us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b54004a1620. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d781c0 00007f5534d79231 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c
0709 13:05:56.018065 (+310611us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:56.018091 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:56.018115 (+    24us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:56.018131 (+    16us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.025351 (+  7220us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:56.051566 (+ 26215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3290,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":12617,"spinlock_wait_cycles":8087296}
I20260709 13:05:56.093972 18007 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.094287 17819 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.072077 15039 raft_consensus.cc:606] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:56.099574 15039 raft_consensus.cc:614] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.101176 17912 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.116024 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:05:56.121141 17718 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 13:05:56.121922 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91306.8us
I20260709 13:05:56.024883 17996 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.157s
I20260709 13:05:56.135150 18010 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:05:56.136513 18010 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:56.136716 14894 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:56.137048 18010 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:56.091826 17843 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.138548 18010 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.152788 17759 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:05:56.156230 17832 consensus_meta.cc:287] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.002s
W20260709 13:05:56.158805 17928 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.856s	user 0.014s	sys 0.002s
I20260709 13:05:56.105963 17905 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:05:56.161901 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 200884us
I20260709 13:05:56.162643 18020 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:56.163204 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:56.166215 17978 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:56.173009 17962 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:56.140106 17563 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:56.091589 17920 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.219942 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
W20260709 13:05:56.188511 17838 consensus_meta.cc:287] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.955s	user 0.008s	sys 0.008s
W20260709 13:05:56.188944 17946 consensus_meta.cc:287] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.056s	user 0.015s	sys 0.001s
I20260709 13:05:56.190227 17823 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:56.149801 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54773.9us
I20260709 13:05:56.150458 17843 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.221133 15044 raft_consensus.cc:606] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:56.166854 14788 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 1 to 4, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 4 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:56.228582 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 167009us
I20260709 13:05:56.230155 15544 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.236378 15039 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:05:56.224071 18025 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 13:05:56.224423 18020 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:56.226864 17843 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:56.244874 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 184434us
I20260709 13:05:56.227761 17832 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:56.257954 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:56.259305 17891 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:56.260267 17891 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.262286 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:56.264144 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:56.264672 18012 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:56.265821 18012 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:56.229610 17759 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.268838 17823 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.269308 17430 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:56.263025 17891 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.219424 17928 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.279488 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:56.254297 18010 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.269989 17430 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.285171 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:56.285818 15546 raft_consensus.cc:2376] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6. Re-sending same reply.
I20260709 13:05:56.286162 17430 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.281139 17529 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.281255 17819 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:56.287063 17529 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.288362 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:56.289311 14964 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:56.289516 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:56.289820 17529 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.291200 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:56.292243 17976 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:56.292814 17976 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:56.293875 17976 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.294994 17815 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.295729 17581 raft_consensus.cc:993] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:56.293430 18012 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:05:56.296276 17581 raft_consensus.cc:1081] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:05:56.243547 17821 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.230918 17838 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.275841 17905 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 13:05:56.321117 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:56.323937 15044 raft_consensus.cc:606] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:56.324276 15044 raft_consensus.cc:614] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.341470 17520 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:05:56.342406 17520 consensus_queue.cc:1243] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
W20260709 13:05:56.345815 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54781.2us
I20260709 13:05:56.347043 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:56.352376 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.338507 17819 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.356635 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:05:56.362599 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:56.362133 18034 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.363194 17718 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:56.359280 17759 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.379984 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:56.380617 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.381611 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:56.401207 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.381747 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.383697 17978 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:56.403420 17978 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.404012 17978 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.405236 14889 pending_rounds.cc:85] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 3
I20260709 13:05:56.405723 14889 pending_rounds.cc:107] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:05:56.406077 14889 raft_consensus.cc:2889] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:56.387626 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:56.388002 17821 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.388118 15041 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.389022 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:56.409878 17581 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.410306 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:56.410578 17581 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:56.411373 17581 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.411748 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:56.412436 17894 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.413125 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:56.413295 17894 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:56.414149 17894 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:56.389954 17823 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.390192 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:56.415910 17670 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:56.416335 17670 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:56.417368 17670 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.418603 17670 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.422976 14892 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.422878 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:56.432808 14966 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:05:56.434020 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:56.434605 14966 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.438700 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:56.336496 18020 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.390981 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.391606 14894 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:05:56.357154 17430 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 13:05:56.455788 14788 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 3 to -1, term changed from 4 to 3, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) evicted. New cstate: current_term: 3 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:05:56.456878 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 59408.5us
W20260709 13:05:56.457082 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 118634us
I20260709 13:05:56.458830 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:56.459611 17759 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:56.444797 17869 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.460314 17869 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:56.461305 17869 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:56.462502 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.463177 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:56.367902 17819 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.464567 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:56.465646 17815 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:56.465780 17819 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.451789 17823 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.466650 17430 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:56.467073 17430 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:56.398298 17718 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.467552 18034 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.470268 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 477) took 1022 ms. Trace:
I20260709 13:05:56.451447 15544 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:56.474112 15041 rpcz_store.cc:276] 0709 13:05:55.448305 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.450748 (+  2443us) service_pool.cc:224] Handling call
0709 13:05:55.451097 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:56.409008 (+957911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:56.464230 (+ 55222us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54004047d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:56.470213 (+  5983us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1974820096}
W20260709 13:05:56.494892 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.470829 17821 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:56.473519 17718 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.505115 15044 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:56.494056 17815 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:56.525274 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50096us
W20260709 13:05:56.526852 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 68136.6us
I20260709 13:05:56.466668 17823 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.528911 14892 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:56.498724 17905 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:56.515542 17869 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:56.499521 17946 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:05:56.528239 17759 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:56.443356 17978 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.522691 17928 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.543145 15541 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 13:05:56.550088 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 170200us
I20260709 13:05:56.550755 17522 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:56.551684 18001 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.553097 18001 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:05:56.554026 18001 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:56.554438 18001 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:56.555903 17815 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.557842 17430 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.551376 17522 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.536247 17838 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.562515 14966 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:56.540958 17821 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.570492 17823 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.571105 17821 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.573777 17581 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.547849 17759 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:56.575704 17759 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.562093 17939 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.578289 17939 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.575127 17563 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.581624 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.537364 17529 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:05:56.597373 14895 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.600221 15039 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:56.602739 17522 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.593698 17430 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.598346 17939 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:05:56.587175 17962 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:56.617990 17962 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:56.619064 17962 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.620100 18052 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.620450 17962 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:56.620673 18052 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.591008 18011 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:05:56.622900 18052 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.587590 17905 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.625036 17905 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.625167 18034 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.627071 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.627781 14894 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.628846 14887 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.629050 14894 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:56.593055 17670 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:05:56.631274 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.555295 18001 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:56.661131 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 153955us
I20260709 13:05:56.666231 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.667006 17894 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:56.667440 17894 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:56.668442 17894 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.669597 17894 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:56.670131 14895 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:56.606688 17581 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.671996 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:56.676049 14965 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.676182 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:56.678731 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.681445 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.683125 14894 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.685520 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:05:56.646407 17978 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.686107 15039 raft_consensus.cc:606] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:05:56.688810 15039 raft_consensus.cc:614] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:05:56.645485 18052 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.685316 17563 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.679358 17939 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:56.717710 14887 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:56.713536 17563 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.717790 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:56.718812 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:56.719347 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 53784.3us
I20260709 13:05:56.719933 17563 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.719805 18052 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.697690 14788 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 2 to 3, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 3 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:05:56.722214 18052 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.729417 17939 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.731674 17939 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.731704 18001 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:56.689982 17529 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:05:56.733069 14894 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:56.655779 17718 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:56.764782 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.763839 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:05:56.771694 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.773644 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.773495 15545 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:56.777113 14893 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:56.757129 14895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38806
I20260709 13:05:56.778385 14895 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:05:56.778728 14895 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:56.783964 18058 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:56.784655 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.786257 17825 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:05:56.787809 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:05:56.788087 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.788443 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 280) took 9339 ms. Trace:
I20260709 13:05:56.789789 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.790517 14887 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:56.790827 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:05:56.794814 14893 raft_consensus.cc:1217] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-8.8]   Dedup: 8.8->[]
I20260709 13:05:56.795563 18059 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:56.796185 18059 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.797032 18051 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.797549 18051 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.798278 18059 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.795331 14893 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [6.7-8.8]
I20260709 13:05:56.799849 17718 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.800551 17718 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.801010 17718 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.802867 17718 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:56.806447 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:56.784451 14788 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 2 to 3, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 3 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:05:56.780298 17843 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.000s
W20260709 13:05:56.825769 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.829689 14965 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:56.832106 14894 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:56.835292 17772 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:05:56.828600 17520 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:05:56.769999 17759 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.826808 14895 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.848413 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.851824 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.852494 14895 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:56.853920 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.852520 14893 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:56.857120 17718 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:56.858180 17718 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:56.858542 17718 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:56.859450 17718 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.860678 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.862123 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:56.864936 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:56.875501 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:56.876261 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 65857.1us
I20260709 13:05:56.877676 18052 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:56.877827 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.878137 18052 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.878528 18052 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:56.878866 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.879010 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.837342 17843 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.879999 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.860889 17825 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:56.884843 17563 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.885524 18047 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:56.886271 18052 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.887182 14893 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:56.902765 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.888123 14888 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:56.904265 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:05:56.911886 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50354.6us
W20260709 13:05:56.912905 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:56.916837 14893 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:56.917845 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:56.919698 14895 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:56.924971 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.925963 14893 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:56.928656 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.929320 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.930043 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.930759 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.930876 14892 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:56.932125 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:56.888586 18051 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:56.935595 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:56.936497 14892 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:05:56.934518 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 408199us
I20260709 13:05:56.784543 18058 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:56.962574 14895 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 10. Ops: []
I20260709 13:05:56.964509 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:56.934506 17815 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:56.970764 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:56.918219 17563 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:56.973642 14892 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:56.974125 14891 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
W20260709 13:05:56.974630 18054 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:05:56.974792 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:56.971254 18047 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.966040 18051 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:56.977604 17976 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:56.986748 14892 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:56.980355 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:56.981499 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 175109us
I20260709 13:05:56.958128 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:56.985145 18051 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:56.978051 17815 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:57.047268 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:56.968549 17825 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:56.788820 14792 rpcz_store.cc:276] 0709 13:05:47.449187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:47.457707 (+  8520us) service_pool.cc:224] Handling call
0709 13:05:48.452035 (+994328us) spinlock_profiling.cc:243] Waited 64.9 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:05:56.788241 (+8336206us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:53.224902 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:53.225464 (+   562us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:53.225502 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:05:53.225523 (+    21us) tablet.cc:662] Decoding operations
0709 13:05:53.226880 (+  1357us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:53.226967 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:53.226995 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:05:53.435548 (+208553us) tablet.cc:701] Row locks acquired
0709 13:05:53.435566 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:05:53.446496 (+ 10930us) write_op.cc:270] Start()
0709 13:05:53.466646 (+ 20150us) write_op.cc:276] Timestamp: P: 1783602353444324 usec, L: 0
0709 13:05:53.466667 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:05:53.489970 (+ 23303us) log.cc:844] Serialized 5543 byte log entry
0709 13:05:54.362932 (+872962us) op_driver.cc:464] REPLICATION: finished
0709 13:05:54.639930 (+276998us) write_op.cc:301] APPLY: starting
0709 13:05:54.643762 (+  3832us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:54.722819 (+ 79057us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:54.727250 (+  4431us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:54.730988 (+  3738us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:54.731347 (+   359us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 13:05:54.731399 (+    52us) write_op.cc:312] APPLY: finished
0709 13:05:54.731746 (+   347us) log.cc:844] Serialized 101 byte log entry
0709 13:05:54.731907 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.732057 (+   150us) write_op.cc:454] Released schema lock
0709 13:05:54.732116 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:54.732457 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:54.732482 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":543939,"reported_tablets":48,"spinlock_wait_cycles":149326080,"child_traces":[["op",{"apply.queue_time_us":253881,"apply.run_cpu_time_us":3972,"apply.run_wall_time_us":110930,"num_ops":14,"prepare.queue_time_us":1530946,"prepare.run_cpu_time_us":17938,"prepare.run_wall_time_us":429228,"raft.queue_time_us":560842,"raft.run_cpu_time_us":19811,"raft.run_wall_time_us":246307,"replication_time_us":841421,"thread_start_us":1423527,"threads_started":4,"wal-append.queue_time_us":229543,"wal-append.run_cpu_time_us":11632,"wal-append.run_wall_time_us":2107940}]]}
I20260709 13:05:57.001755 17749 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:56.990931 14894 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:56.967509 17772 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:56.991451 18068 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:57.043226 14888 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:57.044051 14892 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:57.045492 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:57.051864 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 71601.6us
I20260709 13:05:57.053066 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.053299 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:57.088490 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:57.056679 15035 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:57.045639 18051 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.108777 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.088713 14889 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.095112 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:57.110988 14890 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:57.111104 14886 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:57.099709 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.099874 17772 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.101111 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.101970 18058 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:57.102728 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.102968 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.104343 17928 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:57.104103 17815 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.105439 17563 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:57.105180 17825 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.106474 15037 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:57.106746 17718 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:05:57.107893 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52613.3us
I20260709 13:05:57.053221 18047 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:57.361264 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.112164 15039 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:05:57.264513 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:57.363801 14887 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.115810 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.122471 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.365939 15040 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:57.267825 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.237067 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.120245 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:57.129674 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.368275 14966 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:05:57.326593 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.120932 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.368952 15043 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:57.120581 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.115618 15036 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:05:57.152779 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.249514 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:57.231173 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.046068 17894 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.118681 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.317714 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.056823 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.051241 15541 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:57.207208 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.338141 14889 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:57.328063 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:57.386158 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.121681 14969 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:05:57.119184 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.177465 15545 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEARNER]: Advancing to term 6
I20260709 13:05:57.186398 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.207484 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.379328 15044 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:05:57.187747 18068 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.381737 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.381973 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.176237 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.314147 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:57.266619 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.393991 14890 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:05:57.394644 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66671.5us
I20260709 13:05:57.315063 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.402031 15040 raft_consensus.cc:2368] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:57.088733 17749 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:57.409572 14965 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:57.410112 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.412375 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.414454 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:57.403383 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.404256 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:57.314502 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:57.309794 17522 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:57.423250 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.189563 17905 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:57.089344 17759 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:57.364607 17976 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:57.418023 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.316395 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.113118 18052 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:57.411391 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.449242 15039 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:05:57.421548 14967 raft_consensus.cc:2368] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:57.252851 17843 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:57.091027 17821 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.454030 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.118182 18053 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.328s
I20260709 13:05:57.430059 15547 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:57.432354 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.459967 14963 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:57.459980 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.434828 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.455658 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.461264 14888 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:57.188133 17939 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:57.435736 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:57.253280 17823 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:05:57.445623 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:57.434166 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.446009 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.446707 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.447566 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.409003 18071 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:57.469540 14891 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:57.408263 17962 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:05:57.315789 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.487964 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.312577 18051 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.451714 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:57.452236 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.452358 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.453022 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.492231 14886 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:57.407567 17928 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:57.429162 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.451174 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.457691 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.434906 14892 raft_consensus.cc:2368] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8.
I20260709 13:05:57.493618 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.462291 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.466943 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.496477 14966 raft_consensus.cc:2410] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:05:57.402582 18034 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:05:57.449662 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 200204us
I20260709 13:05:57.407428 17894 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.489907 14962 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:57.497498 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:57.472934 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.508189 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:57.485172 18071 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:57.488438 17946 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:57.454187 18047 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:57.458909 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:05:57.522908 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 65835.5us
I20260709 13:05:57.526046 15035 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:57.528846 15550 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:57.462736 17905 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.467494 18020 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.535833 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:57.537506 15041 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:05:57.542009 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.460045 17978 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:05:57.455202 17522 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.489328 17939 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.491889 17821 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.524160 18071 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.459354 17976 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.543009 15542 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:05:57.550092 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:57.560138 18068 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:57.561282 17928 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.545799 15541 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:57.518537 17843 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 13:05:57.578354 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:57.582145 15043 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:57.589354 14961 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:57.613778 15043 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:57.589962 15545 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEARNER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:57.610327 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:57.615360 15043 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.541639 17563 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:05:57.616780 15043 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:05:57.618033 14859 leader_election.cc:400] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:57.623185 14859 leader_election.cc:403] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:57.533290 17749 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.599771 17823 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:57.667150 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 122832us
I20260709 13:05:57.547283 18020 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:57.669495 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 80907.4us
I20260709 13:05:57.671190 14968 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:57.686940 17843 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:57.688239 17894 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:57.691738 18084 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:05:57.692358 18084 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:57.693758 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 244577us
W20260709 13:05:57.694284 14861 connection.cc:256] RPC call timeout handler was delayed by -2.4266536439999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
I20260709 13:05:57.723595 17939 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:57.712203 18083 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:57.727840 18083 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.729952 18083 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:57.730191 17772 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:57.733181 18076 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:05:57.733486 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.734807 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:57.735924 15043 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:05:57.737453 14887 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:05:57.745635 14888 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:05:57.747902 14861 connection.cc:256] RPC call timeout handler was delayed by -2.3738883780000606s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 13:05:57.748560 14861 connection.cc:256] RPC call timeout handler was delayed by -2.3331100510000624s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260709 13:05:57.749020 14861 connection.cc:256] RPC call timeout handler was delayed by -2.2359100510000189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1756s for a response
W20260709 13:05:57.750169 14861 connection.cc:256] RPC call timeout handler was delayed by -1.8975100510000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21320000000000003s for a response
W20260709 13:05:57.750903 14861 connection.cc:256] RPC call timeout handler was delayed by -1.8030100510001148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2237s for a response
W20260709 13:05:57.756675 14861 connection.cc:256] RPC call timeout handler was delayed by -1.2098536440000771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32610000000000006s for a response
W20260709 13:05:57.757067 14861 connection.cc:256] RPC call timeout handler was delayed by -1.0362100510001255s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3089s for a response
I20260709 13:05:57.757377 17962 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.757676 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:57.693295 18084 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.683521 17823 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:57.748261 18058 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
W20260709 13:05:57.785104 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:57.793495 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 257706us
I20260709 13:05:57.755788 18051 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:57.797477 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 219188us
I20260709 13:05:57.771675 17946 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:57.760603 18071 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.792114 17843 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:57.820686 17823 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:57.823597 18095 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:57.824317 18095 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:57.826819 18095 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:57.829609 17723 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:57.830106 17723 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:57.798241 18052 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:57.849093 14961 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:05:57.850028 15042 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
W20260709 13:05:57.813283 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 55687.1us
I20260709 13:05:57.809872 18053 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:57.855741 14970 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
W20260709 13:05:57.858119 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 218884us
I20260709 13:05:57.849318 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:57.848677 17905 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:57.848376 17821 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:57.851305 17976 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:57.870867 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:05:57.854178 18053 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:05:57.874701 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 187093us
I20260709 13:05:57.831095 17723 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.854698 18052 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:57.884737 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:57.887873 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:57.873605 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 297944us
I20260709 13:05:57.889240 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:57.880403 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 200658us
I20260709 13:05:57.886433 17522 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:57.902916 14969 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:05:57.875773 18053 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:05:57.921980 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57865.1us
I20260709 13:05:57.918939 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:57.923797 17718 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.541s	user 0.003s	sys 0.007s
I20260709 13:05:57.925019 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:57.927099 17843 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.933907 15037 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:05:57.881265 17962 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:05:57.934996 15550 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:57.938846 15038 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:05:57.954684 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.956552 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:57.957260 15545 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.960433 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:57.931020 18079 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.299s	user 0.000s	sys 0.004s
I20260709 13:05:57.917575 17976 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:57.970043 17976 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:57.971352 17759 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.971468 17946 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.971992 17759 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:57.935571 18080 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:05:57.974232 17759 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:57.955987 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:57.917335 17894 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:57.917183 17905 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:57.976362 17905 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:57.976784 17905 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.978351 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.980616 17894 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:57.981212 17894 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:57.967944 17723 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:57.968456 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:57.969055 14895 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:05:57.921547 18020 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:57.979118 15042 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:57.989465 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.004973 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:58.006837 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.012461 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.015424 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.016229 14961 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:57.958844 17821 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:58.016582 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.017796 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.015354 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:57.961897 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.044787 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:05:58.029965 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 99382.8us
I20260709 13:05:58.042174 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:58.044378 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.032902 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.046806 14886 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:57.965539 18096 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.007615 18097 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.051710 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.051914 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.052336 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.052525 14961 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:05:58.052851 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.053318 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.048333 17823 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:05:58.054230 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.055043 14964 raft_consensus.cc:2410] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 10 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 13:05:58.057361 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:58.058743 14886 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:58.058930 18103 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:58.059399 18103 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.059650 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:58.059821 18103 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.060583 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.063630 17821 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.064597 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.065268 14887 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:05:58.065881 17821 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.016783 17718 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:58.066802 17718 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.067171 18052 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.068766 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.069744 18103 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.071709 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.073796 18071 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.077661 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:57.999162 18101 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:58.078399 15037 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:05:58.082995 15545 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:05:58.078567 18101 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.045336 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.026857 17976 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:05:58.107969 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 92691.6us
I20260709 13:05:58.114319 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:57.964813 18088 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:05:58.116813 14890 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
W20260709 13:05:58.122576 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 223806us
W20260709 13:05:58.127503 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 243502us
I20260709 13:05:58.129032 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.129686 15038 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:05:58.113004 17843 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.139739 15035 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:58.152812 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.154202 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:05:58.133724 14859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.618s (SENT) [suppressed 24 similar messages]
I20260709 13:05:58.119140 17825 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:58.162024 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.151036 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:05:58.174324 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 114739us
I20260709 13:05:58.178098 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:58.179199 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:58.175704 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 52303.8us
I20260709 13:05:58.182467 15007 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.182890 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:58.136778 17976 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.114246 17905 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:58.188815 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:05:58.164716 18047 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.009s	sys 0.009s
I20260709 13:05:58.197840 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.199606 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:58.200279 14894 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.160269 17825 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:58.180250 18075 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:58.243824 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46098.7us
I20260709 13:05:58.252691 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.245539 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:58.261967 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 76815.2us
W20260709 13:05:58.222270 18047 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.010s	sys 0.009s
I20260709 13:05:58.192252 18051 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:05:58.159051 18096 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.085s
I20260709 13:05:58.291006 15038 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:05:58.297183 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44612.5us
I20260709 13:05:58.250633 18095 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.259208 17825 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:58.237185 17894 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.258823 17520 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:58.307651 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62202.3us
I20260709 13:05:58.346769 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:58.256932 17843 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.251641 17821 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.252599 18058 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:05:58.309728 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 148209us
I20260709 13:05:58.272553 18047 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:58.286616 17563 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.196707 17976 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:58.360257 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 177445us
I20260709 13:05:58.303301 17928 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:05:58.349967 18107 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.170s	user 0.001s	sys 0.001s
I20260709 13:05:58.370618 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:58.362411 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 206992us
I20260709 13:05:58.286725 18083 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 13:05:58.344228 18052 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:58.303844 17898 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:58.365676 17894 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:58.380067 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.365056 17772 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.381047 14933 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:05:58.382831 18075 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:05:58.383715 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.389380 14933 leader_election.cc:403] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:05:58.389866 15543 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:05:58.399235 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.402652 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:58.431954 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55630.8us
I20260709 13:05:58.392064 17843 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:05:58.433494 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.383955 18072 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:58.396180 18084 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.435391 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58912.7us
I20260709 13:05:58.395243 18052 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:58.455363 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 166573us
I20260709 13:05:58.458958 17905 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:58.437372 18071 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.459703 17756 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:58.460309 17756 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:05:58.461102 18122 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:05:58.392653 17898 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.395083 17772 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.468799 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2292) took 1210 ms. Trace:
I20260709 13:05:58.445469 18072 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:58.448277 18126 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.402060 17723 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:05:58.471788 15043 rpcz_store.cc:276] 0709 13:05:57.258723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.736663 (+477940us) service_pool.cc:224] Handling call
0709 13:05:57.736929 (+   266us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.737227 (+   298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.737252 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.737630 (+   378us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.921724 (+184094us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:57.921767 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:57.921849 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.468517 (+546668us) raft_consensus.cc:1685] finished
0709 13:05:58.468542 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.468719 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8884,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":4761,"thread_start_us":150173,"threads_started":1,"wal-append.queue_time_us":364146}
I20260709 13:05:58.500108 14890 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:58.500798 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:58.505944 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1549) took 1383 ms. Trace:
I20260709 13:05:58.474987 17522 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:58.475694 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:58.472119 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.451894 18020 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:58.482235 18119 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:05:58.481881 17756 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:58.482963 18108 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:05:58.483705 18115 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:05:58.451716 18084 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.480669 18072 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:58.494856 18126 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:58.534024 18126 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.536907 18126 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.471246 18101 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.453845 17430 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:58.471491 18100 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:05:58.465471 17843 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
W20260709 13:05:58.586388 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.468636 18047 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.587533 18139 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:05:58.588110 18139 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:58.588999 18139 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.592897 17718 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.595094 17898 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.595669 17946 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:58.596098 17946 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:58.595875 18052 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.596997 17946 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.598356 17946 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.598515 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 1632) took 1281 ms. Trace:
I20260709 13:05:58.549924 17723 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:05:58.493764 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.600286 17723 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.598910 15044 rpcz_store.cc:276] 0709 13:05:57.317553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.434273 (+116720us) service_pool.cc:224] Handling call
0709 13:05:58.598333 (+1164060us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540003f2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:58.598461 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1635323136}
I20260709 13:05:58.509720 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:58.511300 14894 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:05:58.512883 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:05:58.494050 18112 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
W20260709 13:05:58.500728 18053 consensus_meta.cc:287] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
W20260709 13:05:58.501999 15541 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.835s	user 0.010s	sys 0.000s
I20260709 13:05:58.529096 18084 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:58.607950 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95163.3us
W20260709 13:05:58.531437 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.495393 17976 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:58.537848 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 87548.6us
I20260709 13:05:58.506376 14963 rpcz_store.cc:276] 0709 13:05:57.122814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.490404 (+367590us) service_pool.cc:224] Handling call
0709 13:05:57.490668 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.571601 (+ 80933us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:05:57.571918 (+   317us) log.cc:844] Serialized 14 byte log entry
0709 13:05:57.886466 (+314548us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:57.886526 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:05:57.886568 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.505727 (+619159us) spinlock_profiling.cc:243] Waited 68.5 ms on lock 0x7b540009abd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:58.505774 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.505887 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":707,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":2736,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":22755,"spinlock_wait_cycles":157569792,"thread_start_us":311638,"threads_started":1,"wal-append.queue_time_us":483249}
I20260709 13:05:58.511329 18083 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:58.602314 17723 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.603899 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1638) took 1269 ms. Trace:
W20260709 13:05:58.610212 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 100564us
I20260709 13:05:58.611948 14936 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:05:58.519847 17522 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.612831 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:58.661262 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 48522.8us
W20260709 13:05:58.657822 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.501s (SENT)
I20260709 13:05:58.663033 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.603897 17954 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:05:58.659911 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50307us
I20260709 13:05:58.665885 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:05:58.665925 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.668211 18075 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:58.668651 18075 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.676204 18075 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.679601 18140 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:58.658211 15041 rpcz_store.cc:276] 0709 13:05:57.334551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.853938 (+519387us) service_pool.cc:224] Handling call
0709 13:05:57.854284 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.854815 (+   531us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:05:58.169209 (+314394us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.603473 (+434264us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:05:58.603521 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:58.603560 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.603620 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.603720 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8528,"prepare.queue_time_us":111340,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":24135,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":2366,"thread_start_us":615832,"threads_started":3,"wal-append.queue_time_us":401494}
W20260709 13:05:58.695259 15513 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.511s (SENT)
I20260709 13:05:58.695345 15544 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:05:58.695851 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.696161 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.696504 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.696905 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.697336 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.697471 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.697976 15544 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:05:58.698611 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.699519 15041 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:05:58.684006 18084 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.701102 18137 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:58.701845 18137 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.704483 18137 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.705675 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.705956 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2293) took 1382 ms. Trace:
I20260709 13:05:58.706456 18034 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:05:58.706784 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.707685 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.709005 18124 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:05:58.709470 18124 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:58.710672 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:58.710419 18124 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.711598 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:58.713744 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:05:58.613636 18103 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:58.609426 15541 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:05:58.716153 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 640) took 1300 ms. Trace:
I20260709 13:05:58.716495 15541 rpcz_store.cc:276] 0709 13:05:57.416055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.429296 (+ 13241us) service_pool.cc:224] Handling call
0709 13:05:58.716048 (+1286752us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:05:58.696237 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:58.718097 15543 raft_consensus.cc:2368] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:05:58.719058 17522 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.612002 17898 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:58.719702 17898 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.720062 17898 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.706387 15039 rpcz_store.cc:276] 0709 13:05:57.323923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.791651 (+467728us) service_pool.cc:224] Handling call
0709 13:05:57.801421 (+  9770us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:05:57.808005 (+  6584us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.808048 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:05:57.852737 (+ 44689us) log.cc:844] Serialized 52 byte log entry
0709 13:05:58.116108 (+263371us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:05:58.175960 (+ 59852us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.190748 (+ 14788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.190853 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.705761 (+514908us) raft_consensus.cc:1685] finished
0709 13:05:58.705778 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.705900 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64844,"prepare.queue_time_us":276680,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":21100,"raft.queue_time_us":23476,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":70184,"thread_start_us":235104,"threads_started":1,"wal-append.queue_time_us":441767}
I20260709 13:05:58.722597 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1868) took 1478 ms. Trace:
I20260709 13:05:58.722958 14969 rpcz_store.cc:276] 0709 13:05:57.244367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.521119 (+276752us) service_pool.cc:224] Handling call
0709 13:05:57.902698 (+381579us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:57.920824 (+ 18126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.722389 (+801565us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b540031b350. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:58.722518 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835487616}
I20260709 13:05:58.612712 18053 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.723443 18072 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.724952 15547 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:05:58.725293 18053 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.725553 18072 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.666919 17954 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:58.726119 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 496) took 1610 ms. Trace:
I20260709 13:05:58.726251 15543 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:58.726491 15035 rpcz_store.cc:276] 0709 13:05:57.115671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.586388 (+470717us) service_pool.cc:224] Handling call
0709 13:05:57.586661 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:05:58.155846 (+569185us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.725871 (+570025us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b5400187254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:58.726044 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271399296}
I20260709 13:05:58.726555 17954 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.727315 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:58.727702 17954 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:58.698735 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.730777 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:58.671662 17772 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.732182 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:58.660586 17718 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:05:58.742179 14894 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:05:58.743239 14886 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:58.743841 14861 leader_election.cc:400] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6.
I20260709 13:05:58.743855 14890 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:58.744417 14893 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 3. Current term is 4. Ops: []
I20260709 13:05:58.745529 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.746408 15044 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:05:58.746781 15044 pending_rounds.cc:85] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 7
I20260709 13:05:58.747028 15044 pending_rounds.cc:107] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:05:58.747282 15044 raft_consensus.cc:2889] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:05:58.749225 18102 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:05:58.749686 18102 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:58.752801 18103 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:05:58.762669 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.764799 15035 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:58.750640 18102 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.772610 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:05:58.773648 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 78404.9us
I20260709 13:05:58.775722 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.740396 18140 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:05:58.741328 18053 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:58.784600 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.738351 18034 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:58.747331 18095 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:58.759583 18126 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.799484 14965 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:05:58.760912 17718 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.776413 17772 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.765250 18097 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:58.740782 18101 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 13:05:58.796504 18140 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.740531 17928 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:05:58.812498 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:58.801420 15513 leader_election.cc:336] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.773s (SENT)
I20260709 13:05:58.814184 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:58.784034 18072 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:05:58.819905 15035 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:58.804407 18095 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:58.807621 18125 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:58.820950 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.821856 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:58.822703 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.812474 17718 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.819355 18140 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:05:58.839655 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:58.843036 18104 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:05:58.813829 18126 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.829181 18095 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:58.850287 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2295) took 1525 ms. Trace:
I20260709 13:05:58.827855 18097 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:05:58.861886 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 116078us
I20260709 13:05:58.836294 17522 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:58.838475 18053 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.829700 18071 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:05:58.815178 17772 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.863101 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:05:58.863451 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62006.2us
I20260709 13:05:58.828212 17825 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.883936 14968 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:58.872236 18097 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:58.875247 18146 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:05:58.885818 14893 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
W20260709 13:05:58.882167 15513 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.895s (SENT)
I20260709 13:05:58.854948 18020 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:05:58.887097 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75502.5us
I20260709 13:05:58.887287 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:58.859593 15040 rpcz_store.cc:276] 0709 13:05:57.324572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.793158 (+468586us) service_pool.cc:224] Handling call
0709 13:05:57.810983 (+ 17825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.841437 (+ 30454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.841480 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.854943 (+ 13463us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.111847 (+256904us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:58.138071 (+ 26224us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.156830 (+ 18759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.849849 (+693019us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b540014c8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:58.849911 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.849970 (+    59us) raft_consensus.cc:1685] finished
0709 13:05:58.850082 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.850238 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28834,"prepare.queue_time_us":238615,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":20327,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8270,"spinlock_wait_cycles":69333376,"thread_start_us":212561,"threads_started":1,"wal-append.queue_time_us":430087}
I20260709 13:05:58.888576 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.853083 18104 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:58.885164 17825 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.892655 14963 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10.
I20260709 13:05:58.894200 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.852217 18034 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.877228 17898 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.915166 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.917727 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.900543 17928 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:58.912812 18160 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:05:58.928959 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.929831 17459 raft_consensus.cc:2764] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:05:58.930152 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:58.931033 17459 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:05:58.933091 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:58.929101 18160 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:05:58.938874 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 498) took 1822 ms. Trace:
I20260709 13:05:58.938832 18153 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 13:05:58.947607 18110 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.690s	user 0.002s	sys 0.000s
I20260709 13:05:58.941922 17843 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.943573 15036 rpcz_store.cc:276] 0709 13:05:57.116292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:57.712399 (+596107us) service_pool.cc:224] Handling call
0709 13:05:57.731387 (+ 18988us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:57.731736 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:57.731766 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:57.732228 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 13:05:57.917929 (+185701us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:05:58.236365 (+318436us) log.cc:844] Serialized 14 byte log entry
0709 13:05:58.243212 (+  6847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.243291 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:58.536058 (+292767us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b1800434e00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:58.937097 (+401039us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b1800434e00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:05:58.938672 (+  1575us) raft_consensus.cc:1685] finished
0709 13:05:58.938692 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:58.938822 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22449,"prepare.queue_time_us":131176,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":10813,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":19754,"spinlock_wait_cycles":65416704,"thread_start_us":451383,"threads_started":2,"wal-append.queue_time_us":321826}
I20260709 13:05:58.926679 17954 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.984197 18090 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:05:58.985479 18090 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:58.985410 18075 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:58.987560 18051 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:58.988082 18051 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:58.990239 18051 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:58.992266 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:58.993137 14967 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:58.994179 18075 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:58.999267 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:58.999890 15036 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:58.949443 17928 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.029979 17928 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:59.040343 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.042580 18126 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.042838 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1641) took 1675 ms. Trace:
I20260709 13:05:59.043212 15037 rpcz_store.cc:276] 0709 13:05:57.367979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.079075 (+711096us) service_pool.cc:224] Handling call
0709 13:05:58.083481 (+  4406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.118960 (+ 35479us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.119003 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.131911 (+ 12908us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.435266 (+303355us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:05:58.435317 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:59.042463 (+607146us) spinlock_profiling.cc:243] Waited 35 ms on lock 0x7b54001ce654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:05:59.042509 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.042555 (+    46us) raft_consensus.cc:1685] finished
0709 13:05:59.042569 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.042779 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5710,"spinlock_wait_cycles":80552192,"thread_start_us":239081,"threads_started":1,"wal-append.queue_time_us":350301}
I20260709 13:05:59.046383 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:59.046804 14961 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:59.047683 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.047878 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:59.047953 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47503.4us
I20260709 13:05:59.048826 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:05:59.004138 18150 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:05:59.050302 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.050916 14965 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:05:59.051668 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.053876 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
W20260709 13:05:59.055256 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.057548 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:59.058240 15041 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.064883 15036 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.066984 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:59.068312 15035 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:05:59.071347 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 156233us
I20260709 13:05:59.072960 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:59.077039 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:58.934748 18156 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:58.949839 18160 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:58.986136 18090 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:59.026800 18095 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.083563 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.084827 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:59.084080 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:59.085938 15037 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:59.086251 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:59.085951 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:59.092278 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:05:59.096673 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.100080 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:59.097258 14961 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:59.078050 18047 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:05:59.105800 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:59.072062 18051 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.107136 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:59.078738 18120 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:05:58.960096 17843 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.109786 15040 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:59.160449 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:59.201608 17898 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.205278 18034 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:05:59.203226 15041 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:59.265153 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:59.265789 14967 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:59.266389 17522 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.202214 18092 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:05:59.161975 14886 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:05:59.110471 17825 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:59.093277 18103 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.060s
I20260709 13:05:59.269812 17843 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.162578 18139 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.139968 14891 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:05:59.153568 18135 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.095853 18084 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:59.152572 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 60326.5us
I20260709 13:05:59.154577 18051 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.097582 17718 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.163322 17772 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.149752 18140 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.095695 18058 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:59.146199 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2302) took 1232 ms. Trace:
I20260709 13:05:58.956521 18104 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.219540 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:59.429533 15038 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.172925 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:59.154387 18098 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:05:59.108888 17430 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
W20260709 13:05:59.436867 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73993.2us
I20260709 13:05:59.159744 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:59.203675 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:59.438256 15543 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:59.109064 17520 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.161100 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:05:59.147382 18095 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.152150 18143 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:05:59.253559 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.257891 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:05:59.260507 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.342149 14967 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:05:59.358950 18092 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.224139 18125 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.266932 17522 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:59.427452 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.428582 15042 rpcz_store.cc:276] 0709 13:05:57.913794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.006571 (+ 92777us) service_pool.cc:224] Handling call
0709 13:05:59.146017 (+1139446us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b540014aad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:05:59.146139 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1690014592}
W20260709 13:05:59.452333 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.272131 17825 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:05:59.443533 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.445343 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:59.554410 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 109176us
W20260709 13:05:59.474108 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.439925 18143 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.359117 18135 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.451321 18053 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:05:59.364578 18139 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:59.496502 18145 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.546s	user 0.001s	sys 0.000s
I20260709 13:05:59.450029 17520 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.553654 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:59.559350 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:05:59.508641 18166 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 13:05:59.458854 18125 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.527849 17522 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.528281 18113 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:05:59.532318 18051 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.536396 18140 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:05:59.537638 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 99445.7us
W20260709 13:05:59.559943 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 198686us
I20260709 13:05:59.455864 18092 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.558009 17976 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:05:59.558393 18143 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.614758 17756 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.575506 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1937) took 1076 ms. Trace:
I20260709 13:05:59.615602 14895 rpcz_store.cc:276] 0709 13:05:58.499019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.500975 (+  1956us) service_pool.cc:224] Handling call
0709 13:05:58.501266 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:05:58.501549 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:05:58.501575 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:05:58.502060 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:05:58.799984 (+297924us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:05:58.801806 (+  1822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:05:58.802012 (+   206us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:05:59.575232 (+773220us) raft_consensus.cc:1685] finished
0709 13:05:59.575255 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:05:59.575390 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36009,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":297480,"threads_started":1,"wal-append.queue_time_us":329719}
I20260709 13:05:59.578837 17976 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:59.620383 17976 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.621517 18020 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:05:59.621938 18020 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:59.579489 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.580017 18102 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.625841 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:59.626622 15037 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:05:59.584630 17520 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.586565 18092 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.588841 15038 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:59.565383 17823 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:59.630131 17823 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.631381 15038 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:05:59.632282 17823 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:59.564127 17954 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:05:59.633179 18058 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.633474 17954 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:05:59.633659 18058 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.634464 17954 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.635463 18052 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.635762 18058 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:59.635978 18052 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.638671 15041 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:05:59.638669 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.642379 14961 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:59.622745 18020 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.591459 17825 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:59.592398 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.597962 18104 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:59.598519 14933 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:59.599769 18125 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.644264 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:59.646215 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:59.652566 18052 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.633539 18103 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.653447 18103 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:05:59.654062 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55634.6us
I20260709 13:05:59.655750 18103 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:59.645146 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:59.657823 18098 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:59.658140 18125 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:59.658178 18098 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.659240 18098 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.661913 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.663822 15544 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:05:59.664080 18125 consensus_queue.cc:1243] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:05:59.664597 17520 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:59.664930 17520 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:05:59.665690 17520 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.666689 17520 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:05:59.667146 18139 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.668771 18020 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:05:59.671186 14970 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:05:59.674414 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.677819 14968 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:05:59.677929 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:59.606532 15543 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:05:59.681792 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.684700 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.685607 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.685830 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.686949 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.609503 18135 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.697629 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:05:59.674149 18160 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.576s	user 0.005s	sys 0.006s
I20260709 13:05:59.690260 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.700609 14967 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 3.
I20260709 13:05:59.697324 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:05:59.698342 14965 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:59.701085 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:59.701941 14968 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:05:59.706326 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.707000 14967 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:59.717036 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.719203 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.719827 14961 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:05:59.729228 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.729832 15546 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:59.702730 18103 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:05:59.766686 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:05:59.772135 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46883us
I20260709 13:05:59.723335 18084 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:05:59.781113 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:05:59.764918 15548 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:05:59.782543 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:59.784312 18097 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:05:59.785768 18097 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.786108 18097 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.787382 18103 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.790102 18103 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:59.790803 18103 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:05:59.701586 18052 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:05:59.793545 18097 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.797183 18097 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:59.800956 18132 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:05:59.802918 17823 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:05:59.803368 17823 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.784404 18034 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.803830 17823 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.804138 18034 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:05:59.780810 18164 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:05:59.717414 18160 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.816802 14968 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:05:59.791254 18103 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:05:59.841886 14889 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.831378 18103 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:05:59.851341 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 68855us
I20260709 13:05:59.852859 14970 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:05:59.856590 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:59.857154 14968 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:05:59.858876 18120 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:05:59.852461 15542 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:05:59.868464 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:05:59.871613 14968 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:05:59.875182 14970 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:05:59.880180 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:05:59.868093 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:05:59.830857 18098 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.891997 14889 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:05:59.895109 18160 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.881768 18132 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:05:59.895319 18090 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.871121 18103 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.900090 18103 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:05:59.906246 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:59.908139 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:05:59.884863 18120 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:05:59.909307 14970 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:05:59.910419 15545 raft_consensus.cc:2368] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7.
I20260709 13:05:59.899243 17718 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.896752 18090 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:59.867398 17823 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.915169 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:05:59.916255 18098 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.916752 18162 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:05:59.916862 18101 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:59.917382 18156 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:05:59.917486 14969 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:05:59.933327 14969 pending_rounds.cc:85] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 6
I20260709 13:05:59.933573 14969 pending_rounds.cc:107] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:05:59.933784 14969 raft_consensus.cc:2889] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:05:59.918769 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:05:59.919715 18143 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.906507 18126 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:05:59.921118 18163 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:05:59.921872 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 821944us
I20260709 13:05:59.938441 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:05:59.922016 18170 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.943166 18170 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.945272 18170 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.932346 18162 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:05:59.946540 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:05:59.947314 15547 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:05:59.946825 18162 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.947819 18162 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:05:59.922410 17843 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:05:59.923022 18020 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:59.923076 18153 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:05:59.923566 18140 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:05:59.923694 18161 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:05:59.924278 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:59.925099 14859 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10.
I20260709 13:05:59.926389 18165 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:05:59.932343 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:05:59.957464 14859 leader_election.cc:403] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:05:59.958076 15043 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:05:59.936808 18101 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.935177 18120 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:05:59.955940 15038 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:05:59.963447 14970 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:05:59.955188 18020 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.972424 18120 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.973425 18020 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.954329 18167 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:05:59.956612 18153 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.955598 17843 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:05:59.976348 18101 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.976590 18153 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.977758 17843 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.978317 14895 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:05:59.959800 18140 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:05:59.982836 18140 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.983656 15043 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:05:59.987231 18163 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:05:59.987623 18163 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:05:59.987953 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62970.4us
I20260709 13:05:59.988421 18163 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:05:59.989416 17823 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:05:59.997593 18179 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.107s	user 0.003s	sys 0.000s
I20260709 13:06:00.000732 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.001478 14892 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:00.002552 14892 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:00.003757 18143 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:05:59.989616 18163 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.006739 14889 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:05:59.991784 14891 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:05:59.991987 18034 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:05:59.993192 15541 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
W20260709 13:06:00.016028 18184 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:06:00.017269 18167 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:00.017684 17976 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:00.018232 18167 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.018347 17976 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.020967 17976 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.021675 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:00.022042 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:00.022993 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:00.023813 17823 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:00.027999 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 242531us
I20260709 13:06:00.029212 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:00.030737 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.031509 17825 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:00.031872 17825 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:00.032258 17825 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.032449 17522 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:00.036767 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:00.035292 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 715) took 1288 ms. Trace:
I20260709 13:06:00.037348 15548 rpcz_store.cc:276] 0709 13:05:58.746816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.746943 (+   127us) service_pool.cc:224] Handling call
0709 13:06:00.035146 (+1288203us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b540059d3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:00.035240 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2273361664}
I20260709 13:06:00.037927 18084 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:00.038383 18084 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.038738 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.039850 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 661) took 1048 ms. Trace:
I20260709 13:06:00.040217 15541 rpcz_store.cc:276] 0709 13:05:58.991838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:58.992001 (+   163us) service_pool.cc:224] Handling call
0709 13:06:00.039717 (+1047716us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54004c45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:00.039802 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2300309376}
I20260709 13:05:59.994158 14890 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:05:59.994066 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.041508 14886 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:05:59.994868 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:05:59.960992 18156 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:00.040434 18135 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:00.042546 14894 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:00.014554 14892 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:00.043788 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.044035 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.044777 15038 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:00.044826 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:00.046150 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:00.039885 14933 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:00.047876 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.050676 15010 leader_election.cc:400] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7.
I20260709 13:06:00.050983 15010 leader_election.cc:403] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:00.052554 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.052575 15038 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:00.052713 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:00.053965 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.049835 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:00.046579 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.058492 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:00.060793 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.061260 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.062168 14963 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:00.041141 17763 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.062774 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:00.066349 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.064108 14892 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:06:00.069713 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.071496 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.075497 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:00.077323 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.038758 17976 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:00.078476 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.077471 17898 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:00.060139 18058 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:06:00.081881 18126 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:00.082249 18126 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:00.084602 17718 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.057548 18143 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7.
I20260709 13:06:00.085820 18051 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.085870 18139 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.087659 17976 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:00.088718 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.088531 17976 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.089429 17939 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:00.090351 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.090950 14890 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:00.092434 18099 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:00.092978 18099 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:00.093508 18074 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:00.058701 18125 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:00.100986 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:00.101881 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.063382 18053 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:00.111395 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.107635 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.112308 14895 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:00.067837 18103 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:00.109028 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:00.076844 18124 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.076987 18071 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:00.059899 18104 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:06:00.060207 18098 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 13:06:00.063706 18075 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
W20260709 13:06:00.132436 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 179166us
I20260709 13:06:00.133078 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:00.124663 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:00.134794 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:00.113058 18155 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:00.082984 18126 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.147701 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.126231 17563 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:00.115149 18103 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.110134 17759 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:00.127028 18125 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:00.129323 18173 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:00.129650 17815 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.115931 17718 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:06:00.111760 18058 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
W20260709 13:06:00.180614 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47598.5us
I20260709 13:06:00.141798 17772 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:00.126111 18051 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 13:06:00.181782 14895 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:00.142102 18052 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.115608 18053 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.113267 18047 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:06:00.193921 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.163846 14893 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:06:00.217710 14893 pending_rounds.cc:85] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 5
I20260709 13:06:00.217972 14893 pending_rounds.cc:107] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:06:00.218240 14893 raft_consensus.cc:2889] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.130170 18055 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:06:00.168325 17563 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:00.219835 17563 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.168706 18103 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.168881 18155 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:00.213112 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63146.1us
I20260709 13:06:00.161237 18182 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:00.195313 17772 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:00.205328 18161 raft_consensus.cc:2764] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:06:00.183698 17759 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:00.253873 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 60023.1us
I20260709 13:06:00.215276 17522 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.223264 18047 consensus_queue.cc:1243] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:06:00.180742 18099 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:00.255709 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 119310us
W20260709 13:06:00.257155 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 111173us
I20260709 13:06:00.217576 18074 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:00.266414 18074 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.235821 18126 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.227519 18182 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:00.279909 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.270635 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.270797 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.192009 17815 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:00.271047 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.272301 14967 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:00.272994 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.205857 17825 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.271188 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:00.288323 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.293080 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:00.292790 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:00.282099 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:00.297154 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 126645us
W20260709 13:06:00.319582 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:00.263636 18193 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.268420 18192 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:00.279594 18163 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.287490 18162 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.346930 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:00.350916 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 91660.3us
I20260709 13:06:00.272644 18095 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:06:00.284227 18182 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:00.346447 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.347460 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:00.352694 15043 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:00.292810 18170 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Leader election lost for term 9. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10.
I20260709 13:06:00.336903 18142 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:00.276407 18173 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 13:06:00.319963 18167 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:00.366132 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:00.363180 15043 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
W20260709 13:06:00.367190 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66234.1us
I20260709 13:06:00.376442 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.344408 18193 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.367637 18090 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:00.360289 18163 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.350066 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:00.292984 18084 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.392822 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.379370 15039 raft_consensus.cc:2368] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7.
W20260709 13:06:00.386518 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 104491us
I20260709 13:06:00.280161 18125 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.439574 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:00.384034 18191 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:06:00.435581 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:00.388792 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.370735 18142 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:00.382103 18188 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 13:06:00.349992 17954 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 13:06:00.443188 14887 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:00.443687 14861 leader_election.cc:400] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:00.451722 14861 leader_election.cc:403] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:06:00.445986 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 85489.8us
I20260709 13:06:00.381688 18193 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.390265 17825 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.389765 17759 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.385093 17815 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.294585 17772 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.389294 18163 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.380529 18090 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.387017 18074 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.378516 18034 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:06:00.371033 18162 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.465512 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:00.484649 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 125585us
I20260709 13:06:00.465101 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:00.454836 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.446040 18192 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:00.471148 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.447835 18142 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.480583 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:00.320422 18155 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.461057 18053 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.461346 18165 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:00.499130 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.516384 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:00.525169 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.526432 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.527113 14888 raft_consensus.cc:2376] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8. Re-sending same reply.
I20260709 13:06:00.528093 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.534302 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.535166 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.536242 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:00.536522 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.537278 14891 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:00.538383 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.539005 14891 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.539572 14888 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 4.
I20260709 13:06:00.534191 18193 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:00.548852 18193 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.549235 18193 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:00.550057 18193 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.552348 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.552783 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.553411 14889 raft_consensus.cc:2376] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8. Re-sending same reply.
I20260709 13:06:00.554435 14889 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:00.523783 17772 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.555629 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.557505 18084 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.551257 18193 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.559883 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:00.561968 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:00.502422 18199 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:00.498828 18051 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:00.567000 15039 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:06:00.568146 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.534750 18192 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.541884 18167 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:00.576462 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.578352 14861 leader_election.cc:400] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7.
I20260709 13:06:00.578799 14861 leader_election.cc:403] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:00.579362 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.573220 18160 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.565739 18098 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:00.580056 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.570228 18051 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.497977 18182 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.577859 18203 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:00.621594 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.626091 14969 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:00.582552 18165 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:00.621466 17749 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.634620 17749 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.582414 17843 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7.
I20260709 13:06:00.622792 18051 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.624359 18203 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:00.623359 18126 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:00.652772 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:00.674317 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:00.650076 18098 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.650400 18203 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:00.681986 15547 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:00.650218 18020 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:00.652983 18165 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:06:00.703729 14891 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:00.631875 18163 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.716907 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.706135 17928 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:00.739727 17563 consensus_meta.cc:287] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.519s	user 0.008s	sys 0.003s
I20260709 13:06:00.728441 18163 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.742188 17563 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.743569 18163 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:00.744313 17563 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.745712 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.758389 14891 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:00.766840 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.755609 18165 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:00.735350 18162 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.711680 18098 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.767045 18140 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.792943 14891 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:00.774726 17976 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.767707 18193 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.793792 18207 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:00.801569 18200 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.801904 18207 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.802239 18200 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.804201 18207 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:00.791839 17749 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.781840 18165 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:00.793799 18216 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:00.792953 18182 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:00.798723 18212 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 13:06:00.827944 18213 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 13:06:00.832680 14893 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:06:00.833067 14893 pending_rounds.cc:85] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 6
I20260709 13:06:00.833307 14893 pending_rounds.cc:107] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:06:00.833585 14893 raft_consensus.cc:2889] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.834931 14893 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:00.838925 15038 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:06:00.841583 18098 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:00.841958 18103 consensus_meta.cc:287] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.603s	user 0.007s	sys 0.003s
I20260709 13:06:00.842474 18103 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.843798 15040 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:00.845504 18103 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.846805 18126 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.849468 18126 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:00.857059 18052 consensus_meta.cc:287] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.639s	user 0.008s	sys 0.002s
I20260709 13:06:00.857542 18052 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:00.864316 14969 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:00.867103 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:00.871515 14963 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:06:00.818706 18221 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:06:00.869228 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.869684 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:00.873976 14967 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:00.868244 14962 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:00.868743 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:00.876665 14966 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:00.867004 18132 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:00.804718 18200 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.882939 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.888418 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.895165 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:00.895874 14886 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:00.891894 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 270572us
I20260709 13:06:00.896883 14893 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:00.799628 17976 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.888031 18182 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.885164 18132 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:00.842532 18165 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.808722 18193 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.909976 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.909493 14967 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:00.910948 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.911722 14891 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:00.908236 18126 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.913748 18132 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.914851 18132 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:00.912040 18162 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:06:00.910872 18201 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:06:00.919200 17976 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:00.920605 18165 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:00.920872 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.924158 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:00.911641 18052 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:06:00.926781 18193 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:00.907894 18182 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.928298 15042 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:00.928956 18126 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:00.929477 18126 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.931468 18126 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:00.932049 18162 consensus_queue.cc:1243] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:00.932529 18162 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:00.932680 17718 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:00.932879 18162 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:00.933282 17718 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:00.933725 18162 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:00.934116 17718 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:00.935078 18162 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:00.943815 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:00.950448 14886 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 7. (term mismatch)
I20260709 13:06:00.950830 14886 pending_rounds.cc:85] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 6
I20260709 13:06:00.954214 14886 pending_rounds.cc:107] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 13:06:00.954573 14886 raft_consensus.cc:2889] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:00.955215 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.955794 14965 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:00.954506 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.956053 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.953022 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.943753 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:00.959313 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:00.971540 15037 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:00.978755 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:00.980731 14965 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:06:00.989653 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:00.990723 15545 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:01.027726 14891 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:00.960304 18113 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:01.029764 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:01.037273 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:00.993726 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:00.985608 18193 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:00.994104 18162 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:01.053865 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60242.5us
I20260709 13:06:01.029811 18201 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:01.054502 18193 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:01.058601 18098 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:01.079154 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:01.058841 18182 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:01.078572 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:01.087895 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:01.077404 18142 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 13:06:01.088593 18142 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.090744 18142 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:01.077546 18193 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:01.099764 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:01.101369 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:01.098924 18193 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.103293 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:01.103631 14891 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:01.104101 15544 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:01.106408 14891 pending_rounds.cc:85] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 5
I20260709 13:06:01.106743 14891 pending_rounds.cc:107] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:06:01.106993 14891 raft_consensus.cc:2889] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:01.111713 18090 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:01.112993 18193 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:01.129693 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.144378 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:01.133126 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:01.148077 14892 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:01.148568 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:01.149055 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:01.136137 18231 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:01.141862 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:01.142251 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:01.152346 15040 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:01.145207 15037 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:01.150197 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:01.151805 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:01.152484 14888 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:01.079348 18098 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.193979 14888 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:01.151147 18208 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.193723 18098 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:01.193132 18084 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:01.195204 17759 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:01.180575 18141 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:06:01.233402 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:01.235353 18113 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:01.231532 17759 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.240381 17759 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:01.204392 18208 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.242066 18139 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:01.242540 18208 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:01.244319 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:01.245152 14891 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
W20260709 13:06:01.232576 18051 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.001s
I20260709 13:06:01.247821 18051 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:01.250042 18051 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:01.250806 15035 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:06:01.254233 18203 consensus_meta.cc:287] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.002s
I20260709 13:06:01.255040 15043 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: [4.5-6.6]
I20260709 13:06:01.255674 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:01.254730 18203 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.271869 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:01.264817 14891 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:01.276738 15039 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:01.280478 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96492.4us
I20260709 13:06:01.283522 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:01.297611 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:01.305507 15547 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 5: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:01.311108 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:01.311698 15548 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:01.299775 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:01.314339 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 144547us
I20260709 13:06:01.259886 18084 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.310745 18051 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:01.310897 18141 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:01.339874 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:01.313081 18090 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:01.344691 15039 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:01.331856 18192 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:01.348052 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:01.326426 18201 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 13:06:01.341634 18024 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:01.341377 18200 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:01.344895 18097 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:01.363399 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:01.348461 18051 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:01.346206 17772 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:06:01.353277 18141 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:01.371325 15542 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:01.376048 17902 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:01.350142 18090 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.376616 17902 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.377218 18245 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:01.377672 18245 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:01.378029 18090 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:01.378852 17902 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:01.378022 18245 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:01.365906 18024 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.348788 18239 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:06:01.390255 18051 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.392445 18052 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:01.364153 18143 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:01.402638 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:01.404721 14894 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:01.408459 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:01.409173 15043 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:01.411392 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:01.413080 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:01.417420 15040 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:01.419723 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:01.423746 14889 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:01.366534 18097 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.427742 15039 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:01.418147 18055 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:01.427289 18140 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:01.415046 18207 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:06:01.453647 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:01.439837 17843 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:01.431640 17756 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:06:01.496246 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 78665.6us
W20260709 13:06:01.713979 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 260387us
I20260709 13:06:01.489763 18203 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:01.721616 17939 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:01.740921 17939 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.710839 18140 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:01.724023 18047 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:01.723693 18162 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.725806 18172 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.715147 17843 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.753732 18203 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:01.781629 18232 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.602s	user 0.008s	sys 0.000s
I20260709 13:06:01.800534 18132 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:01.882239 18217 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.437s	user 0.001s	sys 0.000s
I20260709 13:06:01.737187 18246 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
W20260709 13:06:01.882081 18247 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 13:06:01.715586 18141 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.757912 18239 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:01.909783 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:01.853040 18234 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
W20260709 13:06:01.950583 15548 consensus_meta.cc:287] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.630s	user 0.010s	sys 0.000s
I20260709 13:06:01.968380 18132 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:01.969974 18245 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.001s
W20260709 13:06:01.970191 18098 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.737s	user 0.008s	sys 0.001s
W20260709 13:06:01.910804 18242 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.497s	user 0.000s	sys 0.001s
I20260709 13:06:01.853668 18203 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:02.032513 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2518) took 1153 ms. Trace:
I20260709 13:06:02.032717 18203 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.034087 18203 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.032931 14893 rpcz_store.cc:276] 0709 13:06:00.879153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.905788 (+ 26635us) service_pool.cc:224] Handling call
0709 13:06:00.906266 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.908193 (+  1927us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:00.923684 (+ 15491us) log.cc:844] Serialized 14 byte log entry
0709 13:06:01.309741 (+386057us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b180047c680. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f553491623a 00007f5534d80a2a
0709 13:06:01.409177 (+ 99436us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:01.409681 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:06:01.409830 (+   149us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:01.409862 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:01.409921 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:02.032221 (+622300us) raft_consensus.cc:1685] finished
0709 13:06:02.032314 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.032442 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17364,"prepare.queue_time_us":15287,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":11854,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":11769,"spinlock_wait_cycles":71284992,"thread_start_us":93701,"threads_started":1,"wal-append.queue_time_us":574139}
W20260709 13:06:02.035081 18192 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.684s	user 0.006s	sys 0.000s
I20260709 13:06:01.937703 18024 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.035727 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.036468 14890 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 4: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:01.847033 18172 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.973578 18084 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:01.979844 18201 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.037721 18201 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.038296 18172 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:01.990016 18239 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.040525 18201 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.040887 18239 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:01.935801 18047 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.041785 18047 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.975576 18140 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.045864 18098 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.913992 18170 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:02.047907 18098 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.048003 18170 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.908463 17939 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:01.846784 18160 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:01.976188 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1961) took 1688 ms. Trace:
I20260709 13:06:01.939074 18137 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:01.819087 18162 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:01.984867 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:02.012354 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:02.054883 14963 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.051898 14895 rpcz_store.cc:276] 0709 13:06:00.288035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:00.289309 (+  1274us) service_pool.cc:224] Handling call
0709 13:06:00.318749 (+ 29440us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:00.340935 (+ 22186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:00.340982 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:00.349275 (+  8293us) log.cc:844] Serialized 26 byte log entry
0709 13:06:00.592138 (+242863us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:00.633398 (+ 41260us) log.cc:844] Serialized 14 byte log entry
0709 13:06:00.649738 (+ 16340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:00.649813 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:00.846567 (+196754us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b180034f0c0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:06:01.389096 (+542529us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b180034f0c0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:06:01.974730 (+585634us) raft_consensus.cc:1685] finished
0709 13:06:01.975983 (+  1253us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:01.976127 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":44067,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":49951,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":32178,"spinlock_wait_cycles":8848640,"thread_start_us":214760,"threads_started":2,"wal-append.queue_time_us":312980}
I20260709 13:06:01.922454 18051 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:02.018775 14967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.027s	sys 0.034s
W20260709 13:06:02.056720 14967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.027s	sys 0.034s
I20260709 13:06:02.023882 17843 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:01.984261 18258 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.051702 18142 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.079648 18258 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.054869 18137 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:02.081023 18137 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.081736 18258 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.082151 18137 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.082433 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:01.977043 18034 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.083622 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.083712 18034 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.084852 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:02.027936 18132 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.028549 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.055076 18160 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:01.976689 18139 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.086328 18139 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.087343 18160 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.088493 18139 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.029124 18245 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.060326 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.090184 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.061658 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.090791 15039 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:02.062371 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.055507 17520 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.073532 18071 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.074118 17759 consensus_meta.cc:287] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.833s	user 0.007s	sys 0.003s
I20260709 13:06:02.052214 18192 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:02.111999 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.077713 18162 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.113090 14886 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:02.079756 18142 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.062798 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:02.104193 14970 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:02.110477 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:02.110658 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45700.1us
W20260709 13:06:02.115836 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53153.9us
I20260709 13:06:02.079056 18170 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.074322 18124 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:02.116500 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:02.123620 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.089697 18193 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.095885 18201 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.111657 14963 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:06:02.085933 18034 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.131903 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.137334 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:02.137993 15043 raft_consensus.cc:2368] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:06:02.112342 18258 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.132750 18193 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.134891 18142 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.110376 17843 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 13:06:02.139299 15040 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:02.112138 17772 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.142350 15039 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:02.143834 18256 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:02.092779 18051 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.148051 15548 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:06:02.148509 18208 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.121943 18172 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:02.166759 14890 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:02.150619 18120 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:02.151660 14961 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.053s	sys 0.068s
I20260709 13:06:02.140375 18201 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.169060 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:02.114494 17759 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.112371 17520 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:02.161630 18103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.021s	sys 0.047s
I20260709 13:06:02.114809 18071 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.151859 18072 raft_consensus.cc:2764] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:02.158380 18245 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.196126 15039 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:06:02.156805 18170 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.124568 18124 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.168756 18172 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.221131 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.222072 15550 raft_consensus.cc:2368] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9.
I20260709 13:06:02.231091 15545 raft_consensus.cc:2368] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:06:02.235594 14969 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:02.162701 17772 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.159695 18258 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:02.237550 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.003s	sys 0.011s
I20260709 13:06:02.167997 18047 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:02.245036 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.003s	sys 0.011s
I20260709 13:06:02.160174 18202 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:02.249583 18124 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.267721 17759 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.173581 18208 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.235617 18172 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.275195 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:02.217216 18103 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.281592 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.294088 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.196826 18120 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.300076 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.234576 18170 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.167435 18256 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:02.316162 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 199503us
I20260709 13:06:02.295334 17954 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:02.317034 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:02.322306 15545 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:06:02.327389 15513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.012s	sys 0.024s
W20260709 13:06:02.327828 15513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.012s	sys 0.024s
W20260709 13:06:02.328071 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 970764us
I20260709 13:06:02.328651 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:02.329366 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 202325us
I20260709 13:06:02.297596 18103 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.332557 14936 leader_election.cc:400] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:06:02.332887 14936 leader_election.cc:403] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:06:02.323527 17522 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:02.334673 14936 leader_election.cc:400] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9.
I20260709 13:06:02.334991 14936 leader_election.cc:403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:02.337853 14936 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:02.328128 17954 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:02.331739 18132 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:02.353451 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 288772us
W20260709 13:06:02.353451 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 182219us
I20260709 13:06:02.354389 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:02.336102 18125 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.359764 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:02.338898 17939 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.334088 18102 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:06:02.335736 18207 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:06:02.355253 18053 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:02.356026 18193 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.362063 18140 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:02.419263 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44052us
W20260709 13:06:02.422662 18261 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:06:02.425707 18103 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.427389 18170 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.413000 18201 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.428570 18053 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.418020 18162 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.371335 17520 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.416908 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.360956 18051 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.410759 18071 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.431672 14964 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:02.371270 17522 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:02.415663 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52699.9us
W20260709 13:06:02.441202 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.441553 18053 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.441967 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:02.442463 18271 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:06:02.442612 15541 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:02.445019 18256 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.433297 17772 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.448560 17522 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.451678 18258 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.412990 18265 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:02.452481 18265 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.438889 18274 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:02.454797 18274 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.441218 17902 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:06:02.413682 18160 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:02.459681 14936 leader_election.cc:400] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
W20260709 13:06:02.460709 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 43869.9us
I20260709 13:06:02.471586 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.472860 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.473351 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.473701 15043 raft_consensus.cc:2410] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:06:02.475512 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.476227 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.476807 15042 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:02.478317 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.479923 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.457801 18170 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:02.429738 18162 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.484468 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.484529 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.486857 14967 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:02.461385 18262 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.466432 18160 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.492604 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:02.494050 14892 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:02.494688 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.494846 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.495272 15042 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:02.495381 15043 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:02.497586 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.498286 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.438514 17954 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.494499 18124 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:06:02.499646 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.489167 17759 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:06:02.500769 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.501255 18262 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.503358 18262 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.505358 18125 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7.
I20260709 13:06:02.506735 14961 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:02.506973 18162 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.498936 18160 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.489483 18193 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.510958 18201 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.511137 18193 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.512243 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.513785 18193 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.514776 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.511485 18201 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.515354 14963 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:02.489321 18140 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.516968 18201 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.517514 18140 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.520274 18103 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.520752 18103 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.522672 18103 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.523134 18103 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.496549 17823 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.524197 18280 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.524358 17823 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.524719 18280 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.526728 18280 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.526829 17823 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.523687 18103 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.530328 18103 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.540251 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.543946 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.544597 15043 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:02.544826 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:02.532146 14968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.013s	sys 0.005s
W20260709 13:06:02.545780 14968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.013s	sys 0.005s
I20260709 13:06:02.546415 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1931) took 1148 ms. Trace:
I20260709 13:06:02.549243 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:02.546756 14968 rpcz_store.cc:276] 0709 13:06:01.398097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.398205 (+   108us) service_pool.cc:224] Handling call
0709 13:06:01.398521 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:01.398746 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:01.761728 (+362982us) log.cc:844] Serialized 14 byte log entry
0709 13:06:02.546136 (+784408us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:02.546180 (+    44us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:02.546224 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:02.546284 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:02.546373 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":572763,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"spinlock_wait_cycles":7963520,"thread_start_us":1146714,"threads_started":2,"wal-append.queue_time_us":551311}
I20260709 13:06:02.553318 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.554688 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.555424 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.556509 18193 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.557163 18193 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.559495 18192 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:02.560477 18193 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.561856 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.563779 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:02.565179 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.565863 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.567162 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.568739 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:02.569351 18097 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:02.569518 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:02.573292 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.581480 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:02.582559 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.583307 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.585723 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.600297 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.602392 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.620949 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.799515 14888 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.646204 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:02.800203 15036 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
W20260709 13:06:02.800815 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 154676us
I20260709 13:06:02.801229 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:02.801941 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 238225us
I20260709 13:06:02.802775 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.606573 14892 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:06:02.804065 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.642220 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:02.804495 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 221996us
I20260709 13:06:02.638563 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.807981 14895 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.603283 14970 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:02.571281 18200 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.811749 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:02.813424 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:02.817664 15038 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:02.818087 14962 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:02.647127 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.815665 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.820166 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:02.579015 18170 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:02.620632 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.836386 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.782691 18120 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.833972 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.608122 18140 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.842818 15545 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:06:02.756467 17520 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:02.834508 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.834661 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.835273 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.832060 15547 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:02.849638 14968 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:02.840227 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:02.850298 17520 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:02.851315 17520 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:02.852190 18266 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.521s	user 0.003s	sys 0.000s
I20260709 13:06:02.852792 17520 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.841801 18274 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.732947 17939 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9.
I20260709 13:06:02.854909 18274 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.781651 18265 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.855787 18265 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:02.835114 18051 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:02.842316 18263 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.856606 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.856690 18263 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.858371 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:02.858851 18263 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.846719 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.859400 18124 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:02.859838 18124 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:02.860219 18124 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:02.861366 17772 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:02.861752 17772 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.862085 17772 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.815063 17563 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:02.841987 17823 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:06:02.842175 18215 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:02.838850 18139 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:02.801404 18207 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:06:02.819729 18192 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:02.855436 18274 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.866636 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.868083 18274 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.870539 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:02.871944 18051 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:02.872328 18051 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:02.872535 14788 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 286) took 35801 ms (client timeout 15000 ms). Trace:
I20260709 13:06:02.872762 17718 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:02.876648 18051 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.876829 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.878365 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.879745 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.880023 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.881132 18075 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.881626 18075 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.753563 18268 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:02.867231 14893 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:02.884265 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.885143 14963 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:02.844929 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:02.872946 14788 rpcz_store.cc:269] 0709 13:05:27.071593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:27.078326 (+  6733us) service_pool.cc:224] Handling call
0709 13:05:27.733623 (+655297us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:06:02.872445 (+35138822us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:05:57.595835 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:05:57.839484 (+243649us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:05:57.839552 (+    68us) write_op.cc:435] Acquired schema lock
0709 13:05:57.839580 (+    28us) tablet.cc:662] Decoding operations
0709 13:05:57.885384 (+ 45804us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:05:57.931838 (+ 46454us) write_op.cc:641] Partition lock acquired for write op
0709 13:05:57.934762 (+  2924us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:05:57.981776 (+ 47014us) tablet.cc:701] Row locks acquired
0709 13:05:57.981843 (+    67us) write_op.cc:260] PREPARE: finished
0709 13:05:57.982069 (+   226us) write_op.cc:270] Start()
0709 13:05:57.982279 (+   210us) write_op.cc:276] Timestamp: P: 1783602357981998 usec, L: 0
0709 13:05:57.982311 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:05:58.071793 (+ 89482us) log.cc:844] Serialized 1684 byte log entry
0709 13:05:58.839657 (+767864us) op_driver.cc:464] REPLICATION: finished
0709 13:05:58.939802 (+100145us) write_op.cc:301] APPLY: starting
0709 13:05:58.939931 (+   129us) tablet.cc:1367] starting BulkCheckPresence
0709 13:05:58.940166 (+   235us) tablet.cc:1370] finished BulkCheckPresence
0709 13:05:58.940330 (+   164us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:05:58.941223 (+   893us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:05:58.941589 (+   366us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:05:58.941655 (+    66us) write_op.cc:312] APPLY: finished
0709 13:05:58.947989 (+  6334us) log.cc:844] Serialized 41 byte log entry
0709 13:05:58.948222 (+   233us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:58.948316 (+    94us) write_op.cc:454] Released schema lock
0709 13:05:58.948379 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:05:58.948802 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:05:58.948831 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":204,"mutex_wait_us":2279426,"reported_tablets":35,"spinlock_wait_cycles":542597376,"child_traces":[["op",{"apply.queue_time_us":97610,"apply.run_cpu_time_us":3235,"apply.run_wall_time_us":8998,"num_ops":4,"prepare.queue_time_us":431631,"prepare.run_cpu_time_us":62917,"prepare.run_wall_time_us":805440,"raft.queue_time_us":340452,"raft.run_cpu_time_us":46731,"raft.run_wall_time_us":100019,"replication_time_us":834622,"thread_start_us":802198,"threads_started":4,"wal-append.queue_time_us":338194,"wal-append.run_cpu_time_us":76791,"wal-append.run_wall_time_us":1538997}]]}
I20260709 13:06:02.840420 15035 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:02.890991 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:02.892055 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 108127us
I20260709 13:06:02.832765 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:02.894212 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:02.894690 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:02.644759 18172 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.901270 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.895401 14886 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:02.895577 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.902590 15543 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:02.602555 18193 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.281s
I20260709 13:06:02.645955 18208 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.905485 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.906244 14887 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:02.908486 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:02.909219 18055 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:02.910128 17772 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:02.910629 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:02.911352 18120 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:02.911756 18120 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:02.912091 18120 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.919836 18172 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.930130 17976 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:02.903510 18075 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.937793 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:02.942642 18120 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.948310 14886 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:02.765321 18160 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.949975 14966 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:06:02.950806 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52018.2us
I20260709 13:06:02.893630 18262 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:02.961658 18120 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.961869 18160 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.963158 17772 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.965605 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:02.966317 15546 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:02.950421 18124 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.891433 18265 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:02.973068 18265 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:02.973901 18124 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:02.898424 18268 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.978370 15544 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:02.979601 18268 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:02.982549 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:02.983183 15043 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:02.830777 18200 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:02.985152 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:02.985428 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 172064us
I20260709 13:06:02.988767 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:02.990940 14962 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:02.993631 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.998330 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:02.999743 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.006333 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:03.009461 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:03.014582 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:03.020246 14895 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:03.025776 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:03.058431 14888 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
W20260709 13:06:03.085996 15037 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.014s	sys 0.029s
W20260709 13:06:03.086632 15037 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.014s	sys 0.029s
I20260709 13:06:03.089649 14887 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:03.090206 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:03.090883 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:03.095212 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 142631us
I20260709 13:06:03.160218 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.221071 14969 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:03.160797 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.161408 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.236505 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.337920 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:03.471084 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:03.133445 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61682.7us
I20260709 13:06:03.472906 15038 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:03.218338 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.447489 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:03.473992 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:03.321086 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:03.384143 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:03.168411 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:03.192790 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:03.163626 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:03.236543 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 72269us
I20260709 13:06:03.477406 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:03.171762 15546 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:03.222059 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:03.459786 15042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.000s	sys 0.010s
I20260709 13:06:03.472651 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:03.478910 15042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.000s	sys 0.011s
I20260709 13:06:03.236914 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.113144 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:03.482127 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 98079.2us
W20260709 13:06:03.482769 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 314428us
I20260709 13:06:03.483180 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:03.430300 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:03.478900 14888 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:03.479216 15036 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.486451 14890 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:03.485822 15035 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:03.479036 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:03.496704 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 333139us
I20260709 13:06:03.035063 18207 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:03.480908 18302 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:06:03.034616 17756 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:03.502743 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:03.504531 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:03.063437 18140 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:03.065060 18160 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:03.312803 18262 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.088879 17522 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:03.516490 15036 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:03.479532 18120 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:03.384198 18124 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:03.319702 18200 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:03.527741 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:03.487830 18268 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.517613 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:03.608417 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 90940.3us
I20260709 13:06:03.609272 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:03.432293 18162 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:03.353313 14789 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:03.487704 17843 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:03.495707 18139 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:03.525712 17756 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.525182 17976 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:03.532955 18140 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:03.588824 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:03.509687 18137 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:03.500624 18292 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.528733 18160 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.596920 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.311538 18051 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:03.605406 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77780.3us
I20260709 13:06:03.383752 17763 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:03.717350 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:03.573354 18090 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:03.573192 18262 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.610281 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:03.495244 18290 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:03.620786 14892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.007s	sys 0.019s
I20260709 13:06:03.621894 14887 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:03.626188 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 88932.1us
I20260709 13:06:03.619664 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 544) took 1083 ms. Trace:
I20260709 13:06:03.312091 18265 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:03.607456 17759 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:03.582929 18172 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:03.583210 18120 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:03.644389 14890 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:03.642406 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:03.587844 17522 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:03.523243 18207 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:03.631337 17902 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:03.652472 14789 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:03.630239 18256 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:03.628964 18097 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:03.724862 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:03.741093 14892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.009s	sys 0.020s
I20260709 13:06:03.739904 15042 rpcz_store.cc:276] 0709 13:06:02.536062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.570318 (+ 34256us) service_pool.cc:224] Handling call
0709 13:06:02.570651 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:02.570866 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:03.480414 (+909548us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.619333 (+138919us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.619397 (+    64us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:03.619460 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.619518 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.619614 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89721,"prepare.queue_time_us":681177,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2057,"raft.queue_time_us":21385,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":15047,"thread_start_us":1024119,"threads_started":2}
I20260709 13:06:03.647123 18303 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:03.732812 18311 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:03.646025 18052 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:03.646996 17756 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.836336 18120 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.730726 17763 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:03.607793 18124 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:03.650695 18137 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:03.648892 18140 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.841549 15039 raft_consensus.cc:606] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:03.916849 15039 raft_consensus.cc:614] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:03.632687 18162 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:03.718101 17976 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:03.844482 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:03.844604 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 235414us
I20260709 13:06:03.720736 18317 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:03.857630 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:03.641151 17843 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:03.974113 17843 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:03.865175 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:03.655122 18160 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.976496 14966 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 4.
I20260709 13:06:03.851063 17902 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:03.887856 18307 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:06:03.979945 18317 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:03.887699 18052 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:03.982542 18317 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:03.983367 18052 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:03.984365 18319 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:03.984474 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 485) took 1360 ms. Trace:
I20260709 13:06:03.985051 14891 rpcz_store.cc:276] 0709 13:06:02.623997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.899813 (+275816us) service_pool.cc:224] Handling call
0709 13:06:02.900069 (+   256us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:02.900382 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:06:03.381915 (+481533us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.404447 (+ 22532us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.515181 (+110734us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b2c000014c8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:03.515613 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:06:03.515760 (+   147us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:03.515804 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.515886 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:03.984103 (+468217us) raft_consensus.cc:1685] finished
0709 13:06:03.984221 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:03.984405 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":83597,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":155,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":48359,"spinlock_wait_cycles":165008128,"thread_start_us":419511,"threads_started":2,"wal-append.queue_time_us":154506}
I20260709 13:06:03.883826 14789 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 4 to 6, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:03.987905 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:03.988286 14789 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 4 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 6 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:03.836900 18310 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:03.859547 18316 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:04.013152 15514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.550s (SENT) [suppressed 5 similar messages]
W20260709 13:06:03.923815 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 313580us
W20260709 13:06:03.939191 18300 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:06:03.925484 18137 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:03.939626 18051 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:03.884610 18256 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:03.944074 18207 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:03.945573 18265 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:03.947429 17522 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:03.955739 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.956702 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.047169 14969 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:03.957553 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.047821 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.721179 18292 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:03.961004 18162 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:03.949576 17976 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:03.961707 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.964846 18315 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:03.965370 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:03.965472 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.966432 14886 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:03.967794 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.053504 14887 raft_consensus.cc:2368] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:03.968815 18323 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:03.969273 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:03.899183 18303 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:03.837303 18172 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:03.893571 17759 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:03.979641 17902 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:03.990151 17763 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:03.988672 15039 raft_consensus.cc:606] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:03.998739 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:04.070853 14961 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:04.016921 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:04.020649 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 378303us
I20260709 13:06:04.049103 18314 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:03.866276 18291 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:03.905579 17954 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:04.091962 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 1964) took 1104 ms. Trace:
I20260709 13:06:04.031783 14789 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:04.051507 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:03.913820 18311 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.056157 14886 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:04.058694 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.096827 14966 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:06:04.076783 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.023510 14890 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:04.072109 15039 raft_consensus.cc:614] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:04.079371 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.079946 15042 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:04.050572 18200 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:04.071700 17759 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.134308 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:04.135012 15544 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.081466 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:04.082665 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65826us
I20260709 13:06:04.137486 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.027676 18310 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.086716 14969 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:04.090874 14968 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
W20260709 13:06:04.035239 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 489489us
I20260709 13:06:04.051885 18090 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:04.092414 14970 rpcz_store.cc:276] 0709 13:06:02.987728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.987937 (+   209us) service_pool.cc:224] Handling call
0709 13:06:02.988221 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.094674 (+106453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.094719 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.134348 (+ 39629us) log.cc:844] Serialized 26 byte log entry
0709 13:06:03.607230 (+472882us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:03.607271 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.607685 (+   414us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:04.091761 (+484076us) raft_consensus.cc:1685] finished
0709 13:06:04.091780 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.091902 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":106014,"raft.queue_time_us":128057,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":25951,"spinlock_wait_cycles":118144,"thread_start_us":472447,"threads_started":1,"wal-append.queue_time_us":514665}
I20260709 13:06:04.060310 18323 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.080920 14965 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:04.132758 18200 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.133407 18172 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.138657 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.165148 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.166287 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.083611 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.148247 15544 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:04.148980 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:04.030440 18316 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.168664 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:04.151947 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 75226.9us
I20260709 13:06:04.169128 15044 raft_consensus.cc:606] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:04.093043 18328 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.170009 14789 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:04.174840 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:04.176090 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:04.063033 18315 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.149715 18162 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.153476 18265 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.193006 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.162115 18034 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.212010 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.191784 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.212932 14789 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 5, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 5 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:04.213866 14970 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.197108 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:04.196970 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53336.8us
I20260709 13:06:04.197886 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.214562 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.206555 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.213317 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.097708 17954 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:04.220330 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 65615.8us
I20260709 13:06:04.222344 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.223817 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:04.220018 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.163046 18323 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:04.229583 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 178159us
I20260709 13:06:04.231295 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.220392 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.234364 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.176885 18321 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.242439 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:04.243628 14970 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:04.200654 17843 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.247839 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:04.248150 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:04.115983 18256 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.249630 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.198976 18331 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:04.093577 18291 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.198529 18320 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.180768 18324 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:04.211373 18207 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:04.211704 18318 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.262080 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.096333 18314 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.275312 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.200647 17823 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 13:06:04.276819 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.278074 15544 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:04.171618 18325 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
W20260709 13:06:04.264003 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 76830.9us
I20260709 13:06:04.223495 18125 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:04.283098 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:04.288353 14933 leader_election.cc:400] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:04.294203 14933 leader_election.cc:403] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.259760 18052 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:04.257961 18047 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.258790 18331 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:04.315932 18336 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:06:04.285772 18317 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:04.308542 18208 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:04.316562 18337 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.285109 18318 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.288755 18140 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.320101 18324 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.341439 18331 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.264211 18090 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.304080 18052 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:04.228282 18303 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.340057 18208 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:04.296036 18207 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:04.240283 18328 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:06:04.292423 18102 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:04.309551 18139 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:04.349023 18317 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:04.343212 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.287750 18262 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.374245 14966 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:04.311599 14789 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:04.395190 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 175864us
I20260709 13:06:04.371425 18052 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:06:04.402667 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 213597us
I20260709 13:06:04.407680 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.402043 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.410998 18320 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.355919 17522 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
W20260709 13:06:04.413169 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 105204us
I20260709 13:06:04.420357 14789 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 3 to 5, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 5 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:04.424676 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 130993us
I20260709 13:06:04.425942 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:04.428270 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 207946us
I20260709 13:06:04.428494 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.467806 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.431864 14789 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 3 to 5, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 5 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:04.432634 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 240960us
I20260709 13:06:04.365641 18324 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.411329 18317 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:04.461027 17756 consensus_meta.cc:287] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.544s	user 0.005s	sys 0.006s
W20260709 13:06:04.461604 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 214736us
I20260709 13:06:04.462790 18160 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.427223 18311 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.433403 18139 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:04.456534 17843 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.465952 18124 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.493309 14789 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 5, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 5 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:04.457129 18200 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.502709 18316 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:04.494460 17756 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.492938 18339 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.519028 14891 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:04.512343 14789 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 3, term changed from 3 to 4, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to <none>, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 4 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:04.523365 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.524137 15043 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:04.516296 18329 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:04.525327 18318 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.525363 18329 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.491951 17520 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:04.545212 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 56684.8us
W20260709 13:06:04.546977 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 133170us
I20260709 13:06:04.492657 18315 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:04.558001 15514 leader_election.cc:336] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.568s (SENT)
I20260709 13:06:04.558635 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:04.605950 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50688.1us
W20260709 13:06:04.623051 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 213680us
I20260709 13:06:04.517416 17843 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.651701 18124 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:04.655328 18316 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:04.656220 18075 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:04.668545 18208 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.671993 17772 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:04.719563 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 161587us
I20260709 13:06:04.719753 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.721722 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.722510 14970 raft_consensus.cc:2376] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8. Re-sending same reply.
W20260709 13:06:04.706223 18312 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.758s	user 0.002s	sys 0.000s
W20260709 13:06:04.708021 18322 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.766s	user 0.000s	sys 0.006s
I20260709 13:06:04.729923 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.541435 17520 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:04.737027 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 270285us
I20260709 13:06:04.731611 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.750972 14970 raft_consensus.cc:2376] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9. Re-sending same reply.
I20260709 13:06:04.742408 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:04.485976 18207 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.754721 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.756947 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:04.758627 14789 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 5, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:04.761641 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.758600 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.765127 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.729295 18203 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.729434 18256 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:04.752897 18321 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:04.759549 17902 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.010s
I20260709 13:06:04.753105 18328 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:04.755802 18160 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.756918 18320 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.767354 18203 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.769615 14970 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
W20260709 13:06:04.799836 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45317.7us
I20260709 13:06:04.772701 18356 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:06:04.802364 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 1992) took 2220 ms. Trace:
I20260709 13:06:04.822813 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.778419 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.801237 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1677) took 1310 ms. Trace:
I20260709 13:06:04.828358 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:04.806406 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47897.9us
I20260709 13:06:04.823221 14889 rpcz_store.cc:276] 0709 13:06:02.582278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:02.817120 (+234842us) service_pool.cc:224] Handling call
0709 13:06:02.817482 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:03.294672 (+477190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.294704 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:03.514095 (+219391us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b2c000014c8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:03.514567 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 13:06:03.643701 (+129134us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:03.718945 (+ 75244us) log.cc:844] Serialized 14 byte log entry
0709 13:06:03.833881 (+114936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.833964 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:04.705403 (+871439us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:04.802062 (+ 96659us) raft_consensus.cc:1685] finished
0709 13:06:04.802099 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.802285 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9,"prepare.queue_time_us":76666,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":3469,"raft.queue_time_us":242316,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":37974,"spinlock_wait_cycles":514909440,"thread_start_us":707752,"threads_started":3,"wal-append.queue_time_us":383482}
W20260709 13:06:04.832624 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54322.1us
I20260709 13:06:04.833202 14789 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:04.834261 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.825709 15040 rpcz_store.cc:276] 0709 13:06:03.490611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.491171 (+   560us) service_pool.cc:224] Handling call
0709 13:06:03.491535 (+   364us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:03.626117 (+134582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.626159 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:03.626870 (+   711us) log.cc:844] Serialized 52 byte log entry
0709 13:06:03.741577 (+114707us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:03.741612 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:03.741687 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:04.707164 (+965477us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:04.800869 (+ 93705us) raft_consensus.cc:1685] finished
0709 13:06:04.800892 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.801156 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31934,"raft.queue_time_us":103735,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":10473,"spinlock_wait_cycles":37716224,"thread_start_us":190767,"threads_started":2,"wal-append.queue_time_us":290342}
I20260709 13:06:04.836066 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.759372 18262 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.760015 18311 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.836894 18075 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:04.752741 17772 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.850597 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.850898 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.849148 17823 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.851501 14965 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:04.851881 18310 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:04.832515 17759 consensus_meta.cc:287] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.003s
I20260709 13:06:04.773471 17520 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:04.840440 18308 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.878s	user 0.005s	sys 0.000s
I20260709 13:06:04.831576 18303 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:04.837153 18317 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.841375 18203 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.841558 18329 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.825158 17902 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:04.847570 18125 consensus_meta.cc:287] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.559s	user 0.021s	sys 0.000s
I20260709 13:06:04.854677 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.868242 18125 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.852255 17772 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.869027 17759 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.869448 14962 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:04.871014 17759 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.763640 18208 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:04.859293 18309 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.974s	user 0.004s	sys 0.004s
I20260709 13:06:04.824291 18314 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.854003 17756 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:04.873432 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:04.845696 14789 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 1 to 5, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:04.824920 18137 consensus_meta.cc:287] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.792s	user 0.008s	sys 0.004s
I20260709 13:06:04.849699 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.876449 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.857016 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2010) took 1315 ms. Trace:
I20260709 13:06:04.875753 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.836593 18356 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.802825 18342 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:04.873893 17902 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.877195 14895 rpcz_store.cc:276] 0709 13:06:03.542083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.583450 (+ 41367us) service_pool.cc:224] Handling call
0709 13:06:03.583923 (+   473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.584197 (+   274us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:06:03.612147 (+ 27950us) log.cc:844] Serialized 14 byte log entry
0709 13:06:04.856610 (+1244463us) spinlock_profiling.cc:243] Waited 9.21 ms on lock 0x7b1800310ae0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f5534d6e060 00007f5534d80716 00007f5534d91287
0709 13:06:04.856708 (+    98us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:04.856751 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:04.856797 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.856869 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.856968 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65077,"prepare.queue_time_us":34970,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":225033,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":26794,"spinlock_wait_cycles":21174528,"thread_start_us":213399,"threads_started":2,"wal-append.queue_time_us":212929}
W20260709 13:06:04.861703 18120 consensus_meta.cc:287] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.935s	user 0.008s	sys 0.003s
I20260709 13:06:04.771250 18352 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:04.864840 15540 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eec3351a3e94e158c79a8784e2c6574 with delete_type TABLET_DATA_TOMBSTONED (TS 58ee9fe38eb8453098f6d964e7675e79 not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:48910
W20260709 13:06:04.867381 18331 consensus_meta.cc:287] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.003s
I20260709 13:06:04.880237 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.892809 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:04.884701 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.836802 18328 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.890379 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:04.890769 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.857071 18290 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:04.894080 18331 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.894722 14968 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:04.801070 18321 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:04.896466 18326 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.956s	user 0.002s	sys 0.001s
I20260709 13:06:04.897902 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.898716 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:04.882688 18137 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.891678 18120 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:04.902228 18304 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.931s	user 0.003s	sys 0.001s
I20260709 13:06:04.778295 18256 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.900211 18342 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:04.913452 14962 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:04.914664 14964 raft_consensus.cc:2368] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11.
I20260709 13:06:04.909560 17759 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.910745 18342 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:04.917073 18292 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.917385 18342 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:04.919698 18137 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.922441 18203 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:04.923229 18090 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:04.923461 18203 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:04.923861 18203 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:04.924723 18203 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.925864 18203 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:04.927618 14895 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:04.927131 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.928398 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:04.928517 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:04.928942 14890 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.929416 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.930272 18329 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:04.932760 18120 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.933369 15037 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:04.937011 17902 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:04.937325 14887 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:04.938084 18303 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:04.938436 18303 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:04.938643 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 754) took 1285 ms. Trace:
I20260709 13:06:04.939193 18303 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.940814 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.941550 18256 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:04.939031 15546 rpcz_store.cc:276] 0709 13:06:03.653429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.717073 (+ 63644us) service_pool.cc:224] Handling call
0709 13:06:04.938458 (+1221385us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540068e554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:04.938588 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2662696192}
I20260709 13:06:04.941813 17520 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:04.935359 14890 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:04.947978 18328 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:04.950757 18323 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.002s
I20260709 13:06:04.956173 14970 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:04.957284 17843 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.957722 14969 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:06:04.958400 18331 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:04.958863 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:04.911465 18052 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:04.960021 18321 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.951200 18323 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:04.959879 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.960382 18324 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:04.908615 18311 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:04.962433 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 703) took 1001 ms. Trace:
I20260709 13:06:04.965065 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:04.967990 14968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:04.977056 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2014) took 1368 ms. Trace:
I20260709 13:06:04.970393 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.008734 14892 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:04.971055 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.971498 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.973341 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:04.973707 14893 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:05.008211 14968 raft_consensus.cc:606] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:04.992183 14964 rpcz_store.cc:276] 0709 13:06:03.960639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.047553 (+ 86914us) service_pool.cc:224] Handling call
0709 13:06:04.962248 (+914695us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b54003e5654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:04.962380 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991609088}
I20260709 13:06:04.973985 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.004835 14895 raft_consensus.cc:2368] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:05.012857 14891 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:04.997552 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:05.003999 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 119378us
W20260709 13:06:05.004050 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67214.1us
W20260709 13:06:05.004305 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 68595.2us
I20260709 13:06:05.008395 14888 rpcz_store.cc:276] 0709 13:06:03.608793 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:03.610622 (+  1829us) service_pool.cc:224] Handling call
0709 13:06:03.610946 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:03.951190 (+340244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:03.951234 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:03.951284 (+    50us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:03.951325 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:04.976776 (+1025451us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b54000f7154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:04.976840 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:04.976994 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":781904768}
W20260709 13:06:04.978490 18359 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.177s	user 0.003s	sys 0.000s
W20260709 13:06:04.982023 18355 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:06:05.024974 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.028378 15039 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:05.025820 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:04.983667 18357 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.183s	user 0.002s	sys 0.000s
I20260709 13:06:04.970294 17954 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.004724 18055 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:05.036077 17520 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:05.036793 14933 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.037714 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:05.039314 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.039979 15036 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:05.041230 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.042385 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.045693 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:04.982471 18316 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.047384 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:05.047792 17520 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:05.053952 17520 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:05.047668 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.049075 14933 leader_election.cc:400] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:05.003539 17522 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:04.985685 18291 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.052534 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:04.980582 18052 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:05.054867 14933 leader_election.cc:403] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:04.984910 18140 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:05.057116 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.084075 15036 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:05.059718 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.058027 17520 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.061270 15043 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 13:06:05.086750 15043 pending_rounds.cc:85] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 5
I20260709 13:06:05.087126 15043 pending_rounds.cc:107] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 13:06:05.087460 15043 raft_consensus.cc:2889] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:05.061342 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46241us
I20260709 13:06:05.063779 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:05.064671 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.090536 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.054483 18172 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.004283 18311 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 13:06:04.984910 18321 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 13:06:05.074520 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.076301 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:05.077521 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.080061 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.080000 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.103790 15044 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:05.105535 15038 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:05.030145 18290 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.092154 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:05.066725 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.114493 15042 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:05.115105 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:05.115375 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.093369 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.094849 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:05.097505 14962 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:05.120080 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:05.097695 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:05.102144 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:05.122812 15544 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:05.125545 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96739.4us
I20260709 13:06:05.127734 18372 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:05.132246 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:05.132355 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:04.967384 18342 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.100042 18139 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.134408 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.096870 18329 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.073287 17522 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.145790 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:05.138198 15546 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:05.140219 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.150049 18162 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.105264 18268 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:05.161787 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:05.155792 15544 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:05.168061 14895 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:05.128958 18256 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:05.131105 18372 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.102699 18052 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:06:05.196375 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:05.197150 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.174961 14894 raft_consensus.cc:2368] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8.
I20260709 13:06:05.128789 17843 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:05.175945 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:05.177875 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:05.182960 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.204711 14891 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:05.183820 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.185333 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.186137 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.187031 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.184653 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.210716 14893 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:05.199179 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.145336 18311 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:05.199949 15044 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:05.150833 17763 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:05.145525 18265 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.152159 18140 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.168546 18280 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:06:05.223282 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 61592.7us
W20260709 13:06:05.235685 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45292.4us
I20260709 13:06:05.158066 18268 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.196499 17939 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:05.212563 17843 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:05.259519 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 86588.2us
I20260709 13:06:05.157665 17954 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
I20260709 13:06:05.231554 18364 tablet_replica.cc:333] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:06:05.265429 17843 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.137641 18369 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.113s
I20260709 13:06:05.222615 17763 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.202745 18372 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.128494 18290 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.242166 18265 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.231087 18071 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.170152 18162 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.232429 18328 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:05.158170 18329 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.274648 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.275668 14886 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:05.236083 17772 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:06:05.305454 18162 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.243458 18268 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.307684 18329 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.279330 14963 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:05.310144 18361 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.280740 18323 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:05.281490 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 153449us
W20260709 13:06:05.301051 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61905.4us
I20260709 13:06:05.302975 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.303974 18327 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:05.304561 18290 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:05.304736 18369 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:05.317595 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.318763 15513 leader_election.cc:400] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8.
I20260709 13:06:05.281772 17763 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:05.321663 15513 leader_election.cc:403] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:05.323814 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.323347 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:05.325243 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.281507 18280 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:05.338505 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.320690 18369 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:05.315572 18268 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.325133 18361 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.328236 18208 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.331054 18051 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.327395 18327 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:05.340492 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:05.363262 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:05.363849 14964 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:05.363853 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:05.366676 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:05.373032 15037 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:05.375946 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:05.373935 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:05.380841 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.382298 15550 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:06:05.354705 18365 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 13:06:05.383922 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:05.383989 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 206156us
I20260709 13:06:05.352190 18303 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.390678 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:05.393092 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:05.393963 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:05.395449 14964 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.348661 18380 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.379148 18323 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:05.379323 18318 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:05.404181 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:05.416491 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:05.404780 18051 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:05.418812 14964 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:05.325191 18052 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 13:06:05.394486 17976 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:05.412026 18256 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:05.413599 18323 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.392338 18075 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:06:05.324457 18377 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:05.421926 18382 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:05.419634 18339 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:06:05.423929 18318 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:05.468339 18203 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.542s	user 0.010s	sys 0.001s
I20260709 13:06:05.482474 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.483958 15043 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:05.473448 18323 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:05.483549 18373 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
W20260709 13:06:05.488593 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 98083.2us
I20260709 13:06:05.488740 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:05.483961 18371 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 13:06:05.506958 18377 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:05.507779 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.508263 18388 raft_consensus.cc:993] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:05.508713 18344 raft_consensus.cc:1081] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:05.411528 18369 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.516898 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:05.494517 18372 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.518064 14887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:06:05.518603 14887 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:05.519001 14887 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.519451 18372 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.520711 18280 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:05.521147 18280 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:05.522204 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 123908us
I20260709 13:06:05.486594 18328 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:05.510215 18268 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:05.571988 18375 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 13:06:05.522624 18265 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:05.715214 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 189502us
I20260709 13:06:05.733117 18323 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.735355 18323 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.718672 14887 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.558920 18318 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.720582 17763 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.739814 15548 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:05.740864 14887 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:05.722445 18365 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.197s	user 0.003s	sys 0.008s
I20260709 13:06:05.723558 18377 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.741717 14962 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:06:05.741887 18377 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.742403 18055 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:05.742832 15550 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:05.744150 18377 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.725061 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:05.745362 14895 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:05.745589 17522 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:05.724901 17843 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.747906 14892 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:05.749522 17843 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.751138 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.751684 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:05.752451 18342 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:05.755028 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:05.467069 18327 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:05.728518 18290 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:05.729792 15544 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:05.741067 17763 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.716583 18328 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.718729 18280 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:05.742798 18055 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:05.728062 18380 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8.
I20260709 13:06:05.756049 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:05.757939 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 231471us
W20260709 13:06:05.723770 18139 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.581s	user 0.007s	sys 0.008s
I20260709 13:06:05.779248 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:05.759939 18330 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:05.787461 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:05.785909 14964 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:05.783819 18139 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:05.770105 18340 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:05.769970 18290 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.771914 18052 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:06:05.785944 18200 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:05.806740 14963 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:05.796196 18207 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:05.789127 18330 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.812250 18328 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:05.802192 18200 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:05.824039 18348 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:05.835263 14886 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:05.852679 14891 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:06:05.854764 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59470.4us
I20260709 13:06:05.851483 18200 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:05.850826 18348 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:05.803016 18055 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:05.892184 18055 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:05.859771 18381 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 13:06:05.885322 18364 raft_consensus.cc:2243] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:05.886824 18383 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:05.830754 18207 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:05.896512 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:05.901006 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:05.902261 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:05.903903 14888 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:05.895072 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:05.928648 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:05.941247 18364 pending_rounds.cc:70] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Trying to abort 2 pending ops.
I20260709 13:06:05.941694 18364 pending_rounds.cc:77] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Aborting op as it isn't in flight: id { term: 6 index: 6 } timestamp: 7305635261289852928 op_type: NO_OP noop_request { }
I20260709 13:06:05.942204 18364 raft_consensus.cc:2889] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:06:05.942616 18364 pending_rounds.cc:77] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Aborting op as it isn't in flight: id { term: 4 index: 5 } timestamp: 7305635228283600896 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "6eec3351a3e94e158c79a8784e2c6574" old_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } } new_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } } }
I20260709 13:06:05.944319 18364 raft_consensus.cc:2917] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Aborting config change with OpId 4.5: Aborted: Op aborted
I20260709 13:06:05.944921 18364 raft_consensus.cc:2889] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:06:05.945453 18364 raft_consensus.cc:2272] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEARNER]: Raft consensus is shut down!
I20260709 13:06:05.871879 18318 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:06:05.916625 18328 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.940538 17843 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:05.893967 18339 consensus_queue.cc:1175] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e4938453819c469599f515b22d92fe27" responder_term: 9 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.6-8.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:05.930217 18262 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:06.051869 14891 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:06.052421 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:05.932612 18342 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:06.084196 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 155632us
I20260709 13:06:06.236147 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.243098 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:06.246975 14861 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Tablet error from VoteRequest() call to peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:06:06.284701 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:06.194001 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 252978us
I20260709 13:06:06.187866 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.302371 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:06.189297 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.169623 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.308369 15036 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:06.299540 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 52776us
W20260709 13:06:06.310803 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 141151us
I20260709 13:06:06.189136 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.176353 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1688) took 1125 ms. Trace:
I20260709 13:06:06.190147 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.190068 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.324314 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:06.324767 15041 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:06.185751 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.328109 15042 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.187800 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.329947 15043 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.186807 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.335013 17759 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:06.187100 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.346843 14894 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:06.314031 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.315795 15035 raft_consensus.cc:606] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:06.348251 15035 raft_consensus.cc:614] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:06.349560 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.350138 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:06.316001 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.351770 14891 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:06.313141 15039 rpcz_store.cc:276] 0709 13:06:05.050910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.051156 (+   246us) service_pool.cc:224] Handling call
0709 13:06:05.051508 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:05.062908 (+ 11400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:05.062941 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:05.825607 (+762666us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:05.825951 (+   344us) log.cc:844] Serialized 26 byte log entry
0709 13:06:05.927844 (+101893us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:05.927881 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:05.927970 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:06.176067 (+248097us) raft_consensus.cc:1685] finished
0709 13:06:06.176086 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:06.176293 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10996,"raft.queue_time_us":30679,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6208,"spinlock_wait_cycles":23387392,"thread_start_us":101628,"threads_started":1,"wal-append.queue_time_us":348155}
I20260709 13:06:06.322270 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.323539 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.332809 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.333834 17522 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:06.088973 17976 consensus_queue.cc:1175] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25b8f0cc46f748468395543b8b174bf4" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:06.395648 17823 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:06.127519 18125 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:06.155828 18200 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.398640 14961 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [7.5-9.6]
I20260709 13:06:06.399926 18200 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.112267 18207 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.056826 18208 raft_consensus.cc:993] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:06:05.969452 18290 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.128993 18291 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:06.402315 18291 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:06.037736 18327 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:05.972229 18328 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.415758 18208 raft_consensus.cc:1081] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:06:06.415956 15035 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:06.416646 18328 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.048530 18330 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:05.976696 18348 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.061473 18364 ts_tablet_manager.cc:1916] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:06.418074 18327 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.420790 18327 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.137228 18369 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.117717 18382 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:06.424072 18382 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:06.425604 18382 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.426896 18382 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.427014 18335 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:06.040654 18396 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:06.046912 18403 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:06:06.428894 18396 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.429509 18403 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:06.429944 18403 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:06.387326 18329 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:06.432013 18329 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.403981 18291 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.433924 18291 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.434531 18329 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.359740 15043 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:06.361250 15036 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:06.370137 14895 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:06.370502 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 86497.6us
I20260709 13:06:06.375723 17522 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.377141 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:06.386502 18256 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:06.413213 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56124.5us
I20260709 13:06:06.387830 14792 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.417397 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:06.391978 17939 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.443871 15044 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:06.444270 17939 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.392067 17759 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:06.347247 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.392976 17843 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:06.394807 18090 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.396361 17823 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.397332 18125 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:06.378736 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:06.407866 15042 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
W20260709 13:06:06.411334 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44194.5us
I20260709 13:06:06.427969 15040 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:06:06.417310 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:06.423175 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.459584 15035 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:06.462505 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.457743 18090 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.446897 17939 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.448305 17759 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:06.471427 17759 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.473177 17759 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.476723 14967 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:06.478022 18090 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.479986 18125 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.481582 18125 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.484252 14961 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:06.485390 17823 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.495692 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.497090 17522 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.461966 18396 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.495070 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.498102 18348 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.431116 18403 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.518321 18356 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:06.519757 18397 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:06.519681 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.517454 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.520816 17843 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.524140 15042 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:06.523882 17843 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.521915 18397 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:06.526463 17843 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.528205 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.521196 18090 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:06.538491 17522 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:06.539109 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.540107 17772 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:06.526059 18397 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.546217 15544 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:06:06.547920 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125016us
I20260709 13:06:06.548688 14895 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:06.546139 18328 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.551985 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.555913 15544 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:06.550390 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.552006 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.558368 14967 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
W20260709 13:06:06.559584 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49255us
I20260709 13:06:06.560429 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:06.552212 14792 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.553277 18265 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:06.563879 14889 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:06.564028 18403 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.568914 18397 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.574870 14968 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:06.577520 14792 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 8, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.579478 14792 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.581029 14792 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.587961 18408 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:06.588624 18408 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.591697 17823 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:06.591902 18052 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.592022 18200 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:06.582544 14792 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 8, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 8 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.592463 17823 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.592727 18200 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.597291 15041 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:06.602103 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.602600 15043 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:06.603976 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.606132 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.606976 14967 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:06.608762 15040 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:06.609131 18200 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.610136 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.610857 14967 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:06.610874 17823 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.611992 14792 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 8, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.611459 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.622040 14961 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:06.613242 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.625419 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.626777 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.626945 17823 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:06.627568 17823 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:06.628026 17823 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.628334 14894 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:06.629933 17756 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:06.630079 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:06.632539 17756 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:06.632917 17756 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:06.633038 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 164479us
I20260709 13:06:06.633369 17756 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.633988 18330 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:06.634249 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.635190 18328 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:06.634858 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.635668 18328 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:06.636162 18328 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.635478 18330 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.636397 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 7, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 7 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.638077 14792 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 7, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.640446 18330 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.642771 14792 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.643731 17823 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.645089 18265 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.645728 18265 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.647320 17823 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.641808 17756 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.648280 18408 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.649111 18265 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.649633 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.649731 15546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52838
I20260709 13:06:06.650267 15550 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:06.650521 15544 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:06.650324 15546 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:06.651116 15546 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.653548 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:06.652491 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.654628 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.656019 15041 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:06.644542 14792 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.665261 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:06.667907 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.671936 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.663600 18090 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:06.683143 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.681370 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:06.685045 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.679020 18291 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.692991 18207 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:06.693970 18207 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.694331 18207 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.695879 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:06.682915 17756 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:06.687587 18256 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:06:06.681493 18090 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.698527 18256 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:06.698869 18256 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:06.699817 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.700212 18391 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.700517 15544 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:06.699860 18090 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.702138 17520 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:06.699780 18256 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.705276 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.707448 14895 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:06.708781 14792 catalog_manager.cc:5697] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 6, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.690712 18369 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:06:06.711345 17772 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:06.715715 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.719147 15546 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.720119 14968 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:06.721204 18256 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:06.726006 15546 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:06.727115 14895 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:06.731899 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.735965 18207 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.738186 14967 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:06.739226 18207 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.743377 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:06.744534 18125 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:06.745677 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.746255 14895 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.748317 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.749011 15036 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:06.752244 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:06.752231 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.754333 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.755223 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:06.755795 15040 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:06.756088 15040 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:06.756958 15040 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.757838 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:06.753791 18396 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:06:06.759323 18408 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:06.759717 18408 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:06.760066 18408 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:06.752420 17772 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:06.763388 17772 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.763810 17772 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.763949 18396 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:06.764405 18396 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.764737 18396 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:06.768033 18090 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:06.768858 18090 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:06.769198 18090 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:06.757998 15040 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.771363 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.770078 18090 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.774771 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:06.775198 18090 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.778834 18330 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:06.778683 18396 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.781490 17823 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:06.782032 17823 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:06.781623 14792 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.782420 17823 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:06.783242 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 7, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:06.784732 14792 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 6, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 6 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:06.786232 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 10, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 10 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:06.789834 14789 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 281) took 17390 ms (client timeout 15000 ms). Trace:
I20260709 13:06:06.790570 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.793794 14895 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:06.798447 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.799885 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:06.801939 17763 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:06:06.803702 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:06.792455 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84576.1us
I20260709 13:06:06.805637 14888 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:06.804121 18391 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:06.810149 18391 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:06.810549 18391 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.794646 18330 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:06.814356 18330 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.816205 18291 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:06.817273 18265 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:06.817703 18265 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:06.818570 18265 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.819684 18265 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:06.822335 17823 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.814868 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:06.829282 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:06.829962 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:06.830744 17843 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:06.831223 17843 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:06.832260 17843 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.839792 17522 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:06.842679 18290 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:06.843250 18290 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:06.844368 18290 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.851393 17522 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:06.851680 18388 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:06.852234 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:06.852494 17522 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.853101 18291 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:06.853607 18291 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:06.854378 18291 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.857142 14967 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:06.857074 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.859654 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:06.859813 18348 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:06.860205 18348 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:06.860544 18348 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:06.859654 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:06.861672 15546 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:06.792835 18328 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:06.868093 14892 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:06.848940 14792 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.875877 17823 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:06.880780 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:06.883610 18369 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:06.884846 18369 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:06.886451 18369 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.887645 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.888615 18342 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:06.893863 18408 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:06.896121 18125 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:06.916461 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:06.943698 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 93317.4us
I20260709 13:06:06.891518 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.825721 18207 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:06.934520 14792 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 8, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:06.948436 15040 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:06.949803 14894 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 13:06:06.950042 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.952591 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:06.977154 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.978164 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:06.980973 14891 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:06.985460 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:06.985770 15544 raft_consensus.cc:2410] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:06:06.986016 14893 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:06.987946 17772 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:06.994992 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:06.983686 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:06.989357 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:07.003557 18290 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:07.011721 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:07.014659 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:07.018505 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73223.5us
I20260709 13:06:06.954418 18207 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:07.023996 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 132668us
I20260709 13:06:07.013577 14889 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:07.025020 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 6, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:07.048837 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:07.049717 14963 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:07.040102 17520 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:07.054275 17520 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:07.055269 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43641us
W20260709 13:06:06.790274 14789 rpcz_store.cc:269] 0709 13:05:49.399753 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:49.440946 (+ 41193us) service_pool.cc:224] Handling call
0709 13:06:06.789560 (+17348614us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:05.394380 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:05.404837 (+ 10457us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:05.404884 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:06:05.404908 (+    24us) tablet.cc:662] Decoding operations
0709 13:06:05.406605 (+  1697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:05.406681 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:05.406719 (+    38us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:06:05.730357 (+323638us) tablet.cc:701] Row locks acquired
0709 13:06:05.730378 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:05.730508 (+   130us) write_op.cc:270] Start()
0709 13:06:05.730634 (+   126us) write_op.cc:276] Timestamp: P: 1783602365730466 usec, L: 0
0709 13:06:05.730658 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:06:05.731434 (+   776us) log.cc:844] Serialized 5907 byte log entry
0709 13:06:06.092305 (+360871us) op_driver.cc:464] REPLICATION: finished
0709 13:06:06.200163 (+107858us) write_op.cc:301] APPLY: starting
0709 13:06:06.200253 (+    90us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:06.200952 (+   699us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:06.201085 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:06.206256 (+  5171us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:06.206582 (+   326us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=15
0709 13:06:06.206646 (+    64us) write_op.cc:312] APPLY: finished
0709 13:06:06.207057 (+   411us) log.cc:844] Serialized 107 byte log entry
0709 13:06:06.207864 (+   807us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.208038 (+   174us) write_op.cc:454] Released schema lock
0709 13:06:06.208098 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:06.208448 (+   350us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:06.208479 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":750264,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":107636,"apply.run_cpu_time_us":7620,"apply.run_wall_time_us":8272,"num_ops":15,"prepare.queue_time_us":227206,"prepare.run_cpu_time_us":30730,"prepare.run_wall_time_us":426695,"raft.queue_time_us":263008,"raft.run_cpu_time_us":4383,"raft.run_wall_time_us":111049,"replication_time_us":361497,"spinlock_wait_cycles":1280,"thread_start_us":351891,"threads_started":4,"wal-append.queue_time_us":95186}]]}
I20260709 13:06:07.106370 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:07.107055 15042 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:07.103078 14792 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 6, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:07.149461 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 77490.7us
W20260709 13:06:07.161914 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 178309us
I20260709 13:06:07.167395 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:07.170976 17520 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:07.138064 17772 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:07.144481 18327 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:07.217587 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:07.218451 14792 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 5, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 5 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:07.238370 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 71047us
I20260709 13:06:07.245671 14893 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:07.251688 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 9. New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:07.183591 18396 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:07.188316 18291 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:07.272775 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:07.265558 18055 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.266556 18327 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.268898 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:07.294468 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 152135us
I20260709 13:06:07.268332 18328 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:07.285238 18290 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:07.202350 18207 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:07.324493 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67039.2us
I20260709 13:06:07.325668 15042 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:07.329172 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:07.307018 18391 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.313040 18102 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:07.339589 18265 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:07.310904 18408 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:07.347833 18376 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:07.313845 18396 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:07.316151 18290 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.351820 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:07.356633 15548 raft_consensus.cc:2368] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:07.293227 18055 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.339196 18391 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:07.379990 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52321.5us
I20260709 13:06:07.356815 18290 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.395735 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:07.320979 18348 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.399276 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:07.399564 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:07.399869 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:07.400115 14968 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:07.400218 14961 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:07.373302 18265 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:07.414212 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:07.415611 18429 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.267s	user 0.000s	sys 0.001s
I20260709 13:06:07.414242 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:07.421222 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:07.424736 14890 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:07.426589 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:07.427073 15547 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:07.427136 14888 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:07.427922 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 159081us
I20260709 13:06:07.416342 17902 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:07.422801 18265 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.435719 18437 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.436254 18437 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.436750 18120 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.437316 18265 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:07.438546 18327 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:07.442723 18055 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:07.447642 17902 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:07.453254 17902 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:07.454155 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.419714 18396 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:07.433437 14792 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 9, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:07.468354 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:07.468930 15038 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:07.476959 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 110016us
I20260709 13:06:07.481515 14792 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 5, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:07.496484 14792 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:07.488731 18437 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:07.585235 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.582469 14792 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 7, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:07.586102 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:07.603440 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 203457us
I20260709 13:06:07.605582 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:07.573060 18376 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:07.608441 15010 leader_election.cc:400] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:07.610435 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:07.623925 15010 leader_election.cc:403] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:06:07.578928 18102 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:07.624748 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:07.638072 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:07.638998 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:07.641331 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:07.641806 15544 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:07.642038 15543 raft_consensus.cc:2368] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:07.642705 15038 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:07.643352 15546 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:07.647023 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:07.650084 18328 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:07.650660 18328 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:07.651125 18328 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:07.594924 18290 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.657567 18290 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:07.635917 18348 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:07.620970 14792 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 4, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 4 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:07.643224 18356 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:07.672583 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:07.675675 14792 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:07.679847 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:07.648039 18438 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:07.669888 18256 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.948s	user 0.011s	sys 0.001s
I20260709 13:06:07.694427 15546 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:07.696988 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:07.698225 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:07.698944 15038 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:07.699982 14888 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:07.694950 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:07.704857 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:07.708482 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:07.709122 14961 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:07.716457 14963 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:07.696007 18438 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:07.651166 18376 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.705651 18256 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:07.705771 17823 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:07.754901 18256 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:07.755430 18290 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:07.755818 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:07.757891 18102 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.758430 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:07.757908 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:07.759516 18450 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:07.716391 18055 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:07.765022 18075 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:07.765997 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:07.767318 18364 ts_tablet_manager.cc:1929] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 13:06:07.768934 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:07.802429 17520 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:07.897651 14861 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:07.878876 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:07.810272 14895 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:07.927707 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 83302.1us
I20260709 13:06:07.809507 14961 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:07.829936 15038 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:07.830986 15035 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:07.830266 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:07.838475 18435 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.457s	user 0.001s	sys 0.005s
I20260709 13:06:07.809963 18443 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:07.942015 15036 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:07.830646 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:07.937460 18450 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:07.956128 15543 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:07.815941 18364 log.cc:1199] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root/wals/6eec3351a3e94e158c79a8784e2c6574
I20260709 13:06:07.921075 18328 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:07.961673 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 267343us
I20260709 13:06:07.886013 18388 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:07.815900 18075 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:07.974587 14889 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:07.835448 18256 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.978978 18075 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:07.981158 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 741) took 1103 ms. Trace:
I20260709 13:06:07.982264 14967 rpcz_store.cc:276] 0709 13:06:06.878109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:06.883227 (+  5118us) service_pool.cc:224] Handling call
0709 13:06:06.883556 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:06.910676 (+ 27120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:06.910709 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:06.911233 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 13:06:07.128713 (+217480us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:07.128763 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:07.128848 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:07.837785 (+708937us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:07.980842 (+143057us) raft_consensus.cc:1685] finished
0709 13:06:07.980865 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:07.981073 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26654,"raft.queue_time_us":27948,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":23923,"spinlock_wait_cycles":14308096,"thread_start_us":216988,"threads_started":1,"wal-append.queue_time_us":390522}
I20260709 13:06:07.986932 15010 leader_election.cc:400] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:07.987323 15010 leader_election.cc:403] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:07.996181 18328 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:07.899349 18438 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:07.997279 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:08.015650 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:07.958910 18443 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.022980 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.024397 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.025542 18457 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:08.026072 18457 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.026494 18457 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:08.034019 18120 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.034669 18458 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:08.034608 18120 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.035322 18458 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.036643 18457 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.037176 18120 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.037511 18458 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.039314 14964 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:08.040396 18457 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.021962 18397 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:08.022644 18403 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:07.962677 18450 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.049510 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.051662 15546 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:08.052713 18459 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.053225 18459 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.043604 18075 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:08.055888 18075 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.056274 18075 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:07.988627 18388 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.023798 18382 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:06:08.050467 18403 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.060133 18403 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:08.061048 18388 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.067430 18328 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.068066 18328 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.068396 18265 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.068949 18265 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.069552 18443 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.070214 18328 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.070876 18265 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.071954 18450 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.055310 18459 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.072202 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.072543 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.073022 18265 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.073545 18265 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.072039 18382 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:08.080070 18382 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:08.080909 18382 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.081836 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:08.083391 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.084174 15543 raft_consensus.cc:1803] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEARNER]: voting while tombstoned based on last-logged opid 6.6
I20260709 13:06:08.084746 15543 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:08.084904 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.085498 15546 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:08.086668 18459 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:08.087116 18459 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:08.087528 18459 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:08.082090 18382 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:08.093719 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.092796 18328 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.094802 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.094945 18328 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.096411 18265 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.097445 18137 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.097549 18328 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.097941 18137 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.098443 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.099968 18137 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.102228 18364 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:48910 (request call id 0) took 3239 ms. Trace:
W20260709 13:06:08.104254 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.116967 14965 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:08.105979 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:08.117237 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.144891 14966 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.124224 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:08.106290 14967 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:08.107549 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:08.113741 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.102658 18364 rpcz_store.cc:276] 0709 13:06:04.863153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:04.864668 (+  1515us) service_pool.cc:224] Handling call
0709 13:06:05.128954 (+264286us) ts_tablet_manager.cc:1151] Deleting tablet 6eec3351a3e94e158c79a8784e2c6574
0709 13:06:05.157952 (+ 28998us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:06.816261 (+1658309us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:07.766998 (+950737us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:08.102078 (+335080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":569847,"tablet-delete.queue_time_us":209930,"thread_start_us":134540,"threads_started":1}
I20260709 13:06:08.106676 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.116829 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:08.158473 14963 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:08.107002 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.161273 14969 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:06:08.108363 18452 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
W20260709 13:06:08.161990 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 54499.3us
I20260709 13:06:08.172924 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.157927 18265 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.146340 18450 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.178881 18450 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.180078 18456 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.180579 18456 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.180920 18450 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.182636 18456 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.183594 18265 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.185977 18265 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.188010 14968 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:08.188189 14895 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:08.189337 18265 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.189906 18265 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.192940 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.192983 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.193542 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.193738 15036 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:08.194538 18290 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:08.159963 18291 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:08.193614 15035 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
W20260709 13:06:08.200817 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.197898 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:08.198539 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.201956 14895 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:08.199680 14780 catalog_manager.cc:5028] TS 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): tablet 6eec3351a3e94e158c79a8784e2c6574 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:06:08.203429 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.067011 18403 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.218288 15038 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:08.219995 15036 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:08.224346 18449 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:08.227294 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.229302 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:08.173693 18075 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:08.230579 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62462.2us
I20260709 13:06:08.219375 18291 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:08.241377 18265 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.241199 18291 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.190511 18459 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.247568 18075 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.224761 18397 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.239617 18403 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.250171 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:08.261721 14895 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:08.250773 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:08.237442 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.250641 14969 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:08.252831 14966 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:08.264072 17520 raft_consensus.cc:2764] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:06:08.257201 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.264005 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.263240 14963 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:08.236322 18388 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:08.265336 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:08.271035 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.272941 15550 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:08.273311 15550 pending_rounds.cc:85] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 8
I20260709 13:06:08.258178 18265 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:08.390901 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.273523 15550 pending_rounds.cc:107] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:08.403599 15550 raft_consensus.cc:2889] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:08.410622 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.411491 14961 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:08.412768 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:08.413491 14966 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:08.272500 18388 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.380077 18120 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:08.271606 18470 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:08.265604 18397 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.393033 18449 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.274931 17823 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.178s
I20260709 13:06:08.452559 18388 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.416754 18265 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.459780 18459 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.467566 18120 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:08.467990 18470 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:06:08.582528 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 317286us
I20260709 13:06:08.587332 14966 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:08.470103 18449 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.589713 18457 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.593308 18327 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.594615 18474 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:08.622941 18468 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:08.627357 18265 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.625995 18327 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.662202 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.662801 15042 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:08.662995 18327 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.635816 18120 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.665424 18477 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.665979 18477 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.623044 18467 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:08.668021 18467 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:08.668912 18467 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:08.672046 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.653158 18397 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.654956 18449 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.610803 18291 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:08.644579 18470 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.681993 14891 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:08.690146 18265 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:08.701848 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.701673 18265 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.698431 18328 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.703754 18265 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.704329 18265 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:08.704041 18328 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.706598 18328 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.707705 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.708425 15044 raft_consensus.cc:2368] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:08.714670 18291 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.717267 18291 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.717958 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.719380 18408 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.719820 18408 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.720149 18408 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.720477 18477 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.722954 18437 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.723639 18437 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.725063 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.725524 14966 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:08.728380 18437 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.728251 18438 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:06:08.723168 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.719058 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.746572 18444 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:08.747012 18444 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:08.747040 18408 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.747968 18444 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.748950 18444 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.749223 18437 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:08.751490 17823 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:08.752074 17823 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:08.752521 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.753157 15044 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:08.753245 17823 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.749238 18408 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.754889 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.755462 15041 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:08.756314 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.757375 15040 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:08.757843 15036 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:08.758801 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.759372 15038 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:08.759562 15043 raft_consensus.cc:2410] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:08.764838 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:08.766188 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:08.768711 18207 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:08.772362 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.773049 14961 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:08.660617 18457 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.774982 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:08.781629 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.707211 18328 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:06:08.782222 14889 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:08.791270 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:08.782697 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.791821 15546 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:08.793157 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:08.794153 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:08.796676 14961 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:06:08.797981 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:08.798267 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.798535 14967 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.769059 18450 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:08.800822 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:08.775529 18265 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.812477 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.799607 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.810285 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:08.815774 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:08.813495 14891 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:08.835899 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:08.835532 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:08.839115 15548 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:08.796108 18477 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:08.673192 18474 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.795909 18291 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.850253 15036 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:08.853117 15041 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:08.827076 18137 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:08.790812 18090 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 13:06:08.862161 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:08.862537 18290 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:08.805022 18450 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:08.792032 18445 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:06:08.804378 18456 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:08.840945 18265 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.825811 18449 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:08.879791 15548 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:08.879814 18456 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.881285 18265 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.882753 18456 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:08.872449 18441 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:06:08.867210 18481 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:08.889531 18481 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.890268 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:08.796157 18437 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:06:08.893704 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:08.894984 18450 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.896008 18443 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.896330 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.896512 18443 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.896936 18443 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.896977 18291 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.899084 18291 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:08.902412 18477 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:08.902864 18477 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:08.873137 18290 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:08.853926 18403 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.905332 18403 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:08.905750 18403 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:08.905882 18290 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.908614 18457 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.910297 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.912628 18474 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.873005 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:08.916602 14936 leader_election.cc:400] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8.
I20260709 13:06:08.918422 14887 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:08.918531 15546 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:08.918965 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:08.920107 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:08.920907 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 230333us
I20260709 13:06:08.921553 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:08.937045 14967 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:08.938843 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:08.945830 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.923060 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:08.948678 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:08.953613 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:08.963366 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:08.964834 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:08.967517 14968 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:08.887161 18388 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.970316 14964 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:08.930681 17522 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:08.931247 18468 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:08.972884 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.962481 18055 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:08.936077 18291 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:08.896363 18450 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:08.973593 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.988922 14966 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:08.970119 18265 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:08.973587 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.974687 15546 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:08.867689 18137 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:08.967154 18290 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:08.923883 17763 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:08.966857 18474 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:08.943053 18481 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:08.971982 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.912683 18443 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.003451 14963 raft_consensus.cc:2368] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:08.991956 18486 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:09.012862 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.978013 17522 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:09.019291 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:08.988592 18291 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:09.022549 18291 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:09.023309 14969 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:09.020722 17522 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:09.025518 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 183241us
I20260709 13:06:09.030812 14966 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:09.008304 18055 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:09.032804 14970 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:09.023584 18481 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:09.035187 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.040071 15544 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:06:09.041702 15544 pending_rounds.cc:85] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 8
I20260709 13:06:09.041996 15544 pending_rounds.cc:107] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:06:09.042263 15544 raft_consensus.cc:2889] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:09.045195 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:09.032346 17759 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.083676 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:09.088627 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 219456us
I20260709 13:06:09.097890 18478 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:09.024048 18467 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
W20260709 13:06:09.102885 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 54159.7us
I20260709 13:06:09.041404 18481 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.048096 17772 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:06:09.110056 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 97104.4us
I20260709 13:06:09.129338 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:09.137024 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:09.138523 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:09.040562 18207 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 13:06:09.143568 14888 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:09.145506 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.151633 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.152402 15041 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:09.153650 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.155277 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.157228 18265 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:09.104553 17759 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.159281 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.161223 18403 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.132995 18481 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.163069 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.141567 18467 consensus_queue.cc:1243] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 5.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:09.166427 14886 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:09.106833 18120 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:09.167513 18486 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.168047 18486 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.168517 18486 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.176136 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.174355 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:09.180558 18487 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:06:09.181988 18376 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:09.185570 18388 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.188980 18498 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:09.189683 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.189553 18498 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.193447 18498 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:09.193203 18481 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.195313 18481 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:09.190313 18467 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:09.195930 18481 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:09.196211 18467 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.196502 18481 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.197793 18137 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.199101 18481 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.206907 18470 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:09.208461 18494 ts_tablet_manager.cc:933] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:06:09.215113 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:09.216291 18470 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:09.217599 18467 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:09.132236 18468 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.220907 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.140125 18474 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:06:09.225288 18481 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:09.225847 18481 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.173920 18485 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 13:06:09.230754 18485 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:09.231202 18485 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:09.232391 18481 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.232232 18485 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.234695 14888 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:09.235140 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.238220 18485 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.198501 18055 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.238788 18481 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:09.240223 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.241340 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.242020 18467 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:09.242383 18481 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:09.235834 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 86891.2us
I20260709 13:06:09.236801 14886 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:09.148151 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.243957 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:09.244038 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.244516 14888 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:09.245527 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.249330 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:09.249859 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:09.255641 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:09.257027 18443 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.255632 14969 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:09.257740 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:09.258946 18403 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:09.247347 18438 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:09.262421 14859 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:09.262616 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:09.264991 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.265538 15038 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:09.265671 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.266332 15040 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:09.272831 18474 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:09.244886 18481 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:09.274585 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 126538us
I20260709 13:06:09.275923 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.281198 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.275132 15040 pending_rounds.cc:85] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 4
I20260709 13:06:09.276628 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:09.278153 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.282747 15040 pending_rounds.cc:107] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 13:06:09.246685 18137 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:09.279192 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:09.283097 15040 raft_consensus.cc:2889] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:09.284298 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:09.285466 15043 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:09.293030 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:09.292224 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.311439 14968 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:09.318873 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:09.279770 18474 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:09.320658 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:09.322327 14969 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:09.282332 18457 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:09.279709 18498 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:06:09.325259 14967 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:09.329058 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:09.311400 18468 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:09.311822 18137 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:09.284960 18265 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:06:09.336964 15044 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:09.291951 18391 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260709 13:06:09.342818 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63680.6us
I20260709 13:06:09.326319 18457 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:09.363569 18457 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:09.363201 18477 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.364789 14888 raft_consensus.cc:2368] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:09.335789 18492 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:06:09.368495 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.373337 18265 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.337554 18468 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:09.375023 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.376436 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.376514 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:09.380959 14969 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.373780 18265 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:09.382697 18498 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:09.376741 18468 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.378100 18474 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:09.393968 18477 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.383811 18265 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.412752 14969 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:09.413719 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:09.392197 18498 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:09.394165 18075 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:09.431576 18485 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:09.432288 18485 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:09.433373 18485 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.408778 18137 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.436926 17759 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:09.437577 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 2046) took 1047 ms. Trace:
I20260709 13:06:09.437955 14963 rpcz_store.cc:276] 0709 13:06:08.390529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.390647 (+   118us) service_pool.cc:224] Handling call
0709 13:06:09.437415 (+1046768us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54003084d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:09.437528 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1380172032}
W20260709 13:06:09.439242 18505 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:09.443907 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:09.447532 18480 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:09.448042 18480 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.426263 18075 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.451814 18075 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:09.451931 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:09.452461 18491 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.268s	user 0.003s	sys 0.000s
I20260709 13:06:09.456344 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.456418 17522 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.459106 17522 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:09.461351 18477 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:09.461228 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:09.462783 15041 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:09.465437 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:09.465516 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:09.470490 15035 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:09.473443 15038 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:06:09.473788 15038 pending_rounds.cc:85] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 5
I20260709 13:06:09.474049 15038 pending_rounds.cc:107] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:06:09.474327 15038 raft_consensus.cc:2889] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:09.516465 18484 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.434s	user 0.003s	sys 0.007s
I20260709 13:06:09.519773 18481 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:09.463912 18200 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:09.567112 15035 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:09.455229 18291 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:09.477710 18328 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:09.473228 18477 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:09.426497 18498 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:09.671432 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:09.477295 18290 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.152s
I20260709 13:06:09.683607 14895 raft_consensus.cc:2410] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:06:09.481176 18396 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.167s
I20260709 13:06:09.648269 18477 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:09.631969 18200 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:09.837904 18502 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:06:09.646727 18457 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:09.908900 14968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.006s	sys 0.032s
W20260709 13:06:09.924810 14968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.032s
I20260709 13:06:09.472046 18494 tablet_copy_client.cc:323] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
W20260709 13:06:09.846295 18499 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 13:06:09.925722 15545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.006s	sys 0.034s
W20260709 13:06:10.014142 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 548697us
W20260709 13:06:10.017596 15545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.006s	sys 0.038s
W20260709 13:06:10.027478 14888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.016s	sys 0.016s
W20260709 13:06:10.028043 14888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.016s	sys 0.016s
W20260709 13:06:10.033027 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 571810us
W20260709 13:06:10.019443 18137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.016s	sys 0.027s
W20260709 13:06:10.034051 18137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.017s	sys 0.027s
I20260709 13:06:10.035564 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.036209 15035 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:10.037571 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.038641 15036 raft_consensus.cc:2410] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:06:10.040962 18492 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:10.042958 18492 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.043174 15035 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:10.043941 18382 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:09.988276 18265 consensus_meta.cc:287] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.574s	user 0.010s	sys 0.000s
W20260709 13:06:10.055791 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 384460us
I20260709 13:06:10.058323 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.059005 15038 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:10.046849 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.061895 15007 leader_election.cc:400] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:10.062263 15007 leader_election.cc:403] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:10.063711 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.069522 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.049185 18498 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:10.061076 18486 consensus_meta.cc:287] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.892s	user 0.010s	sys 0.002s
I20260709 13:06:10.052492 18203 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.049026 18474 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:06:10.068012 18450 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:10.050678 18382 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.052138 18492 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.056121 18265 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.076551 18437 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:10.085758 18486 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.125070 18457 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.127893 18492 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:10.129341 18265 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.129383 18486 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.086025 18203 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.136924 18291 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.137826 18203 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.138964 18382 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.140307 18200 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:10.143321 18477 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:10.144433 18468 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.001s
I20260709 13:06:10.145123 18468 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.146626 14892 raft_consensus.cc:2368] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:10.147505 18328 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:10.147930 18328 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:10.148449 18468 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.144479 18480 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.200455 17520 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.201253 17520 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.205240 17520 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.155108 18492 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.148820 18328 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:10.212988 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 109346us
I20260709 13:06:10.212426 18492 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.306725 17520 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.212051 18529 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.211798 18328 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.313378 17520 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:10.315366 14889 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.054s
W20260709 13:06:10.315889 14889 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.009s	sys 0.054s
I20260709 13:06:10.326350 18492 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:10.320191 18477 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.319533 18529 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.307989 18485 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.315917 18531 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.355948 18531 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.359302 17520 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.399935 18450 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:10.349014 18529 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.349504 18485 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.423290 18531 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:10.404904 18480 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.403430 18470 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.407655 18444 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.426635 18485 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.426419 18444 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.427386 18470 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.428822 18444 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.430183 18470 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.430079 18480 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.430931 18485 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.431577 18485 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.432701 18480 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:10.437534 18485 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.440732 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.441366 15040 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:10.445189 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.446477 18388 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.446791 17520 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.447070 17763 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.447434 17520 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.447813 17763 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.449645 17520 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.453016 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:10.460983 14891 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:10.501896 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 544) took 1368 ms. Trace:
I20260709 13:06:10.502332 14891 rpcz_store.cc:276] 0709 13:06:09.133651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.133782 (+   131us) service_pool.cc:224] Handling call
0709 13:06:09.157504 (+ 23722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.458089 (+1300585us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b540001dc20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d781c0 00007f5534d79231 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c
0709 13:06:10.501552 (+ 43463us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.501802 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155529984}
W20260709 13:06:10.516547 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:10.518517 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:10.519353 14888 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:10.520314 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.523808 17520 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:10.525277 17520 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:10.447146 18388 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.526160 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 548) took 1371 ms. Trace:
I20260709 13:06:10.525960 17520 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.528554 15547 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:06:10.530699 18525 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.531309 18525 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.531951 15544 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:10.533263 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:10.523968 18470 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:06:10.533804 14889 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:10.535372 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:10.537230 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.539752 18490 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:06:10.542580 18528 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.332s	user 0.002s	sys 0.010s
I20260709 13:06:10.524691 17763 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.530311 18443 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.528056 14895 rpcz_store.cc:276] 0709 13:06:09.136696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.136811 (+   115us) service_pool.cc:224] Handling call
0709 13:06:10.460183 (+1323372us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54000cdd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:10.508044 (+ 47861us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1254930816}
I20260709 13:06:10.546502 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.546887 14889 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:10.547255 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.540025 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.549724 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.550321 15038 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.555385 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.556180 15041 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:10.559953 18529 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:10.561414 18388 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.565019 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.566052 18485 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.566540 18485 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.568480 18485 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.570432 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:10.570647 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.544148 18443 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.571118 15036 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:10.572289 15041 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:10.573506 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:10.533726 18525 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:10.578938 15039 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:10.582247 15042 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:10.594002 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:10.594471 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:10.594672 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.594851 15545 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:10.595760 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.595880 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:10.599853 18388 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.600442 18388 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.602149 18328 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.602633 18388 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.602702 18328 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.604038 18125 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.604512 18125 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.604936 18328 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.605443 18328 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.606071 18328 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.609061 18328 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.606424 18125 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.609958 18438 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:10.615466 18438 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.615857 18438 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:10.616910 18443 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.611618 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 6eec3351a3e94e158c79a8784e2c6574 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:06:10.612979 14887 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:06:10.622648 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.623696 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.614040 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:10.652889 14888 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:10.653142 18408 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.657734 18408 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.660171 18408 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:10.661238 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47263.5us
I20260709 13:06:10.571774 17763 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.663528 18485 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.663348 17763 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.664124 18485 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.665747 17763 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:10.666133 18485 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.667094 18485 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.666240 14967 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.663568 18433 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:10.668249 18433 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:10.666581 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.653959 14891 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:06:10.654884 18438 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.668715 18433 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:10.667618 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.670331 14889 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:10.671033 18328 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.655978 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.672389 18348 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.673763 15038 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:10.667574 18485 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.675333 18137 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.676273 17522 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.676834 18479 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.719514 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.676915 18438 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.677793 18442 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:10.677984 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:10.722388 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.681902 14889 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.684258 14961 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:10.697180 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 542) took 1564 ms. Trace:
I20260709 13:06:10.698122 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.739830 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.701874 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.704506 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:10.741674 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63765.5us
I20260709 13:06:10.741988 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:10.742923 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:10.708801 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.744633 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.746397 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.746605 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1721) took 1482 ms. Trace:
I20260709 13:06:10.747949 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.708828 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.709877 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.711786 15035 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:10.711081 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.711088 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.734158 17522 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.736835 14965 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:10.734405 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.680660 18433 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.773094 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.773852 14886 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:10.773808 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:10.774649 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:10.739804 14893 rpcz_store.cc:276] 0709 13:06:09.133044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.142257 (+  9213us) service_pool.cc:224] Handling call
0709 13:06:09.195633 (+ 53376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:09.197289 (+  1656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:09.197320 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:09.197359 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:09.197394 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.696922 (+1499528us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5400148054. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:10.696985 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:10.697116 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3371264}
I20260709 13:06:10.746927 15044 rpcz_store.cc:276] 0709 13:06:09.264392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.264514 (+   122us) service_pool.cc:224] Handling call
0709 13:06:09.291841 (+ 27327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:09.352108 (+ 60267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:10.746393 (+1394285us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b540014afd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:10.746556 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":93075840}
I20260709 13:06:10.779811 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.752815 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:10.780834 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.719821 18490 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.787074 17522 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.737243 18536 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.793848 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.791553 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.792361 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.795090 14933 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:10.779172 18477 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:10.779994 18443 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.717418 18348 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.786238 18125 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:10.787520 18203 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.813124 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 2073) took 1495 ms. Trace:
I20260709 13:06:10.739892 18479 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.772989 18442 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.790169 17763 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:10.741811 18137 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.826687 14892 rpcz_store.cc:276] 0709 13:06:09.318169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:09.318297 (+   128us) service_pool.cc:224] Handling call
0709 13:06:10.812962 (+1494665us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b54003d59d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:10.813065 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878435712}
I20260709 13:06:10.725703 18328 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:10.884407 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 131658us
I20260709 13:06:10.793780 18408 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:06:10.795846 18490 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.897611 18125 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:10.804289 18536 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.879199 18529 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:10.896492 18445 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.937726 17759 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:10.938464 17759 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.940871 17759 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.941821 17759 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.942484 17759 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.944890 17759 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:10.946877 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 233022us
I20260709 13:06:10.947916 15008 leader_election.cc:400] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:10.948314 15008 leader_election.cc:403] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:10.951514 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 156481us
I20260709 13:06:10.878908 18203 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.896272 17763 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.957460 17756 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:10.973224 18125 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:10.973733 18125 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.973966 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.975092 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.975874 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.976145 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.976567 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:10.976568 18531 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.978523 14895 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:10.978479 18125 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:10.978538 18531 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.980911 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.979851 18550 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:10.983512 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:10.985652 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.987447 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.001948 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:10.967724 18391 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:11.004101 14936 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Tablet error from VoteRequest() call to peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Illegal state: cannot vote while shut down
I20260709 13:06:11.006867 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:10.967324 18480 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:10.949690 18445 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:10.967500 18443 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:11.002703 14892 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:10.949927 18529 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:10.986809 18055 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:10.994125 18551 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:11.055616 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 109464us
I20260709 13:06:11.003629 18485 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:11.057220 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:11.007266 18438 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:10.983317 17756 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.006719 18391 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:06:11.053104 18544 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 13:06:11.072846 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:11.069219 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 71101.1us
W20260709 13:06:11.070044 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75590.9us
I20260709 13:06:11.048955 18388 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.106508 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:11.112367 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.112963 14893 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:11.073905 14887 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:06:11.078840 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.113359 14887 pending_rounds.cc:85] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 5
I20260709 13:06:11.113871 14887 pending_rounds.cc:107] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:06:11.114212 14887 raft_consensus.cc:2889] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:11.114843 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:11.116345 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.117157 14895 raft_consensus.cc:2410] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:06:11.118098 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.119115 14887 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:11.106674 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.062415 18450 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:11.122501 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.051180 18480 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.073455 18485 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:11.058449 18443 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.234534 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.119382 18483 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:11.155206 17520 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.157579 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 6eec3351a3e94e158c79a8784e2c6574 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-6eec3351a3e94e158c79a8784e2c6574
W20260709 13:06:11.167034 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50828.3us
I20260709 13:06:11.159277 18200 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:11.060359 18055 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.117806 18550 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:11.067193 18470 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:11.171777 18376 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:11.249722 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.272604 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.063778 18551 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:11.251381 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 211477us
W20260709 13:06:11.249269 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 130455us
W20260709 13:06:11.250221 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 351291us
I20260709 13:06:11.256145 14962 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:11.221870 18492 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:11.258844 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.259430 15036 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:11.235905 18529 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:11.282343 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:11.247648 18137 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.296624 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.297369 15038 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:06:11.150195 18442 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.290657 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:11.149739 18557 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:11.295940 15035 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:11.300439 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.314791 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.173930 18075 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.301915 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.302589 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.302665 15036 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.304059 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.307905 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.318007 14966 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:11.173298 18562 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:11.324540 18562 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:11.290186 18376 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.296041 18492 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.329316 18492 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.329370 18376 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.333421 18442 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:11.259116 18200 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.150449 18531 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.336081 18529 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:06:11.339922 18543 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.261s	user 0.000s	sys 0.000s
I20260709 13:06:11.340793 15037 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:06:11.341952 18547 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260709 13:06:11.344364 18541 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
W20260709 13:06:11.345794 18545 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260709 13:06:11.290622 18550 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.349432 18550 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.351883 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.352460 18445 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.310462 18536 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.353312 18536 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:11.353785 18536 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.354566 15007 leader_election.cc:400] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:11.354864 15007 leader_election.cc:403] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:11.356324 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.356884 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.357448 14895 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:11.358215 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.263612 18391 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.351099 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:11.360834 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43505.3us
I20260709 13:06:11.366603 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.368295 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.323208 15038 raft_consensus.cc:2410] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:06:11.370639 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.366624 18490 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:11.372219 18490 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:11.372802 18490 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:11.373484 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.374209 18550 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11.
I20260709 13:06:11.375898 18391 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:11.378783 18348 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:11.378307 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.381590 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.187844 18450 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.351788 18443 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.382783 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.257903 18559 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.109s
I20260709 13:06:11.380697 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:11.397722 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.398967 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.281594 18437 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:11.356376 18480 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:11.403249 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.338476 18562 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.400204 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.401633 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.408388 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.380282 18203 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:11.366833 17763 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.414386 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.300850 18470 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.415299 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.247545 18483 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:11.422770 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.427574 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:11.428834 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:11.429507 14961 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:06:11.430240 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.430380 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.430775 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.431392 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.401646 18535 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.432716 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.431329 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.432022 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.401818 18348 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:11.412792 18550 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:11.412909 18490 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:11.445432 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:11.417454 18536 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.462054 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.492544 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.492900 14961 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:11.494140 14967 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:11.462945 18509 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:11.463609 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:11.496366 14964 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:11.467085 18565 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:11.471969 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:11.473773 18551 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:11.479939 18554 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.292s	user 0.001s	sys 0.001s
I20260709 13:06:11.480793 17756 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:11.421918 18534 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:11.486732 18470 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:11.488399 18055 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:11.415727 18562 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:11.490963 18550 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:11.551050 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:11.554740 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 122136us
I20260709 13:06:11.606323 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:11.566010 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 120688us
W20260709 13:06:11.587496 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 304815us
I20260709 13:06:11.614877 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.618180 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:11.618970 14964 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:11.584700 18529 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:11.621356 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.622016 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.614512 18207 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:11.640117 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.623342 18566 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:11.613930 15036 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:11.620093 18565 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:06:11.624825 18568 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 4, Time since last communication: 0.074s
I20260709 13:06:11.628556 18556 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:11.600440 18559 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:11.599958 18536 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:11.630851 18524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.805s	user 0.007s	sys 0.000s
W20260709 13:06:11.609702 18477 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.001s	sys 0.007s
I20260709 13:06:11.637132 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:11.612077 18562 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:11.644008 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:11.875792 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:11.752317 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 142183us
W20260709 13:06:12.034456 14969 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.010s	sys 0.016s
W20260709 13:06:12.068235 14969 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.010s	sys 0.016s
I20260709 13:06:12.066207 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:11.612227 18550 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:12.069756 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 450755us
W20260709 13:06:12.034181 15044 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.014s	sys 0.012s
W20260709 13:06:12.112792 15044 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.014s	sys 0.012s
W20260709 13:06:11.670969 18467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.023s	sys 0.021s
I20260709 13:06:12.073293 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:12.123867 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:12.124001 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49613us
I20260709 13:06:12.125332 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:11.955597 18485 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.027s	sys 0.060s
I20260709 13:06:11.644379 18531 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:12.098208 18524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.270s	user 0.007s	sys 0.010s
I20260709 13:06:12.135008 14892 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:12.111443 18477 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.201s	user 0.003s	sys 0.014s
I20260709 13:06:12.130477 15040 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:12.135790 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2069) took 1539 ms. Trace:
I20260709 13:06:12.065194 18563 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:11.671726 18534 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.141095 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:11.927735 18055 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:12.034403 18557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.001s	sys 0.023s
I20260709 13:06:11.898983 18450 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.142329 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:11.931034 18581 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:06:12.128768 18467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.027s	sys 0.032s
I20260709 13:06:11.930716 18551 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.214s
I20260709 13:06:12.121544 18559 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:12.136533 18485 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.031s	sys 0.064s
I20260709 13:06:12.122121 18536 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.225004 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:12.226234 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 589358us
I20260709 13:06:12.224747 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.224251 14891 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:12.247087 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 818) took 1472 ms. Trace:
I20260709 13:06:12.247201 18207 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:12.247367 18200 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.149834 14970 rpcz_store.cc:276] 0709 13:06:10.596044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.599813 (+  3769us) service_pool.cc:224] Handling call
0709 13:06:10.600117 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:10.664841 (+ 64724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.664870 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:10.665292 (+   422us) log.cc:844] Serialized 26 byte log entry
0709 13:06:10.800270 (+134978us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:10.800309 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:11.345219 (+544910us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:12.126381 (+781162us) spinlock_profiling.cc:243] Waited 64.4 ms on lock 0x7b54003e6554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.126444 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:12.126492 (+    48us) raft_consensus.cc:1685] finished
0709 13:06:12.126503 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.135733 (+  9230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":633,"raft.queue_time_us":817,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":74,"spinlock_wait_cycles":152856192,"thread_start_us":134331,"threads_started":1,"wal-append.queue_time_us":260232}
I20260709 13:06:12.328608 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2500) took 1024 ms. Trace:
W20260709 13:06:12.250717 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 108496us
I20260709 13:06:12.431797 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:12.432539 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.433291 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.434360 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.431201 15037 rpcz_store.cc:276] 0709 13:06:11.303735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.303840 (+   105us) service_pool.cc:224] Handling call
0709 13:06:12.328410 (+1024570us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5400088ed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:12.328538 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":46651264}
I20260709 13:06:12.325505 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 632) took 1009 ms. Trace:
I20260709 13:06:12.445101 15542 rpcz_store.cc:276] 0709 13:06:10.750825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.750963 (+   138us) service_pool.cc:224] Handling call
0709 13:06:10.788652 (+ 37689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.902535 (+113883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.902578 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.902642 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:10.902690 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.222694 (+1320004us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54004de9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.223358 (+   664us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.223541 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261309824}
I20260709 13:06:12.444020 15035 rpcz_store.cc:276] 0709 13:06:11.315686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.315810 (+   124us) service_pool.cc:224] Handling call
0709 13:06:11.316127 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.412745 (+ 96618us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.412785 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.412824 (+    39us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:11.412858 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.325273 (+912415us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b540014b9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.325320 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.325447 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221882752}
I20260709 13:06:12.137787 18433 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:12.148067 18477 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:12.250159 18557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.002s	sys 0.023s
I20260709 13:06:12.263088 18581 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.301914 18450 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.435137 17772 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:12.469838 15040 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:12.310557 18529 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:12.302479 14859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.538s (SENT) [suppressed 5 similar messages]
W20260709 13:06:12.161162 18391 consensus_meta.cc:287] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.778s	user 0.011s	sys 0.000s
I20260709 13:06:12.483561 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2503) took 1145 ms. Trace:
I20260709 13:06:12.349843 18579 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:12.448570 18443 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:12.488937 18569 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.224666 18563 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.309051 18577 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.262888 18556 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.309358 18586 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.349202 18583 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.490422 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2073) took 1809 ms. Trace:
I20260709 13:06:12.349460 18553 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.442960 18485 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:12.498721 15040 rpcz_store.cc:276] 0709 13:06:11.338002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.358548 (+ 20546us) service_pool.cc:224] Handling call
0709 13:06:12.073151 (+714603us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800144398. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:06:12.483501 (+410350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25502976}
I20260709 13:06:12.479229 18581 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:12.242765 18534 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.537952 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.362306 18055 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.538443 15039 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
W20260709 13:06:12.516287 18578 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 13:06:12.539469 14968 rpcz_store.cc:276] 0709 13:06:10.681031 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.681973 (+   942us) service_pool.cc:224] Handling call
0709 13:06:10.682224 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:10.925891 (+243667us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:10.925931 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:10.925982 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:10.926032 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.490193 (+1564161us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540009a1d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.490235 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.490351 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559880064}
I20260709 13:06:12.517210 18579 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:12.501930 18529 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.518128 18582 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.497884 18450 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.545815 18588 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.558964 18579 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.559617 18567 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:12.560062 18567 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:12.560439 18567 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:12.561035 18483 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:12.548318 18562 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:12.547910 18560 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.576298 18560 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.544337 18583 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.578877 18583 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.547205 18477 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.583716 18492 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.583866 18534 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:12.564788 18590 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:12.584247 18492 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.585034 18588 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.586210 18492 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.587133 18588 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.565882 18485 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.588656 18450 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:12.551362 18553 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.592168 18553 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.536006 18577 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.575301 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:12.593672 17522 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:12.554394 18582 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.592916 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:12.596710 14888 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:12.593999 17522 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.594002 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:12.597648 17522 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:12.603104 18598 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:12.605526 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2089) took 1493 ms. Trace:
I20260709 13:06:12.605999 14887 rpcz_store.cc:276] 0709 13:06:11.111732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.119933 (+  8201us) service_pool.cc:224] Handling call
0709 13:06:11.120208 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.309480 (+189272us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.309509 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.309546 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:11.309580 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.605268 (+1295688us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b54002ebdd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.605321 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.605460 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435038080}
I20260709 13:06:12.607818 17763 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:12.608500 17763 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:12.609299 18563 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:12.541267 18586 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.609393 17763 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.611558 18586 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:12.543907 18556 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.613806 18556 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.614439 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.614776 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.615715 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 788) took 1221 ms. Trace:
I20260709 13:06:12.616148 15550 rpcz_store.cc:276] 0709 13:06:11.394756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.395193 (+   437us) service_pool.cc:224] Handling call
0709 13:06:11.412671 (+ 17478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.489472 (+ 76801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.489517 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.489571 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:11.489615 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.615501 (+1125886us) spinlock_profiling.cc:243] Waited 76.5 ms on lock 0x7b54004c45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.615549 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.615648 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176027008}
I20260709 13:06:12.616957 18328 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:12.618366 18075 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:12.618644 18582 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:12.618785 18075 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:12.607887 18536 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.595237 18568 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.619707 18075 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.619968 18568 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.541685 18559 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.556485 15037 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:12.614848 18391 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.624642 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.626355 18391 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.628304 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 636) took 1292 ms. Trace:
I20260709 13:06:12.628686 15038 rpcz_store.cc:276] 0709 13:06:11.336055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.410414 (+ 74359us) service_pool.cc:224] Handling call
0709 13:06:12.329031 (+918617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.329261 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.329294 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.329346 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:12.329386 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.329452 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.628105 (+298653us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b5400088ed0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:12.628236 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2112732416}
I20260709 13:06:12.634094 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.635260 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.629660 18391 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:12.637773 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.649333 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.651393 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.652012 14970 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:12.652770 18529 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:12.655990 18550 consensus_meta.cc:287] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.000s
I20260709 13:06:12.661429 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.666499 14888 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:12.670269 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.614476 18577 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.599632 18583 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.674525 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.676353 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.688385 15546 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:12.678946 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 634) took 1362 ms. Trace:
W20260709 13:06:12.682448 14962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 773) took 1702 ms (client timeout 1565 ms). Trace:
I20260709 13:06:12.683274 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:12.690783 14962 rpcz_store.cc:269] 0709 13:06:10.974149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.975662 (+  1513us) service_pool.cc:224] Handling call
0709 13:06:12.676640 (+1700978us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54001969d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:12.676776 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643376384}
I20260709 13:06:12.689512 15042 rpcz_store.cc:276] 0709 13:06:11.316221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.323943 (+  7722us) service_pool.cc:224] Handling call
0709 13:06:12.678175 (+1354232us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b5800144398. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:06:12.678387 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.678574 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.678618 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.678669 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:12.678711 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.678775 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.678884 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":105362816}
I20260709 13:06:12.697916 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:12.682135 18550 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:12.687537 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 187289us
I20260709 13:06:12.706624 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 790) took 1307 ms. Trace:
I20260709 13:06:12.708400 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.670332 18560 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.731161 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:12.731854 14887 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:12.732892 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.734192 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:12.734781 14886 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
W20260709 13:06:12.684350 14888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 2734) took 1708 ms (client timeout 2000 ms). Trace:
W20260709 13:06:12.702772 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 400443us
I20260709 13:06:12.736013 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:12.736562 14886 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:12.707140 15547 rpcz_store.cc:276] 0709 13:06:11.399120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.399289 (+   169us) service_pool.cc:224] Handling call
0709 13:06:11.399632 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.491679 (+ 92047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:11.491716 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:11.491754 (+    38us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:11.491779 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.706318 (+1214539us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54003c91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.706383 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.706543 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211252608}
I20260709 13:06:12.740211 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.740881 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.742010 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.744274 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.744814 14967 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 4.
I20260709 13:06:12.744951 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.745236 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.745501 14962 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:12.745623 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.745858 14970 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:06:12.752750 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:12.747622 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.753381 14893 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:12.754396 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:12.749547 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:12.749975 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.752477 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:12.749126 17522 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.751868 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:12.762068 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.762538 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.759280 14886 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
W20260709 13:06:12.748981 14888 rpcz_store.cc:269] 0709 13:06:10.976228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.592675 (+1616447us) service_pool.cc:224] Handling call
0709 13:06:12.684276 (+ 91601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:12.746718 18524 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:12.768347 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.768931 15550 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:12.769543 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.770900 18550 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:12.747196 18551 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:12.772578 18551 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:12.725903 18577 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.774434 18577 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.776191 18479 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.776398 18577 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.746901 18601 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.777774 15036 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:12.786288 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.786334 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.787875 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.704789 18570 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.792204 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.794481 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.794636 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.795951 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.803733 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:12.807008 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:12.810683 15040 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:12.800244 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:12.777406 18572 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.738404 18583 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:12.852798 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46302.8us
I20260709 13:06:12.950611 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.777406 18586 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:12.804097 15513 connection.cc:256] RPC call timeout handler was delayed by -1.2805635250000478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2872s for a response
I20260709 13:06:12.961014 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:12.962297 17520 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:06:12.888448 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 88308.8us
I20260709 13:06:12.964751 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.965639 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.777251 18601 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.972316 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.972630 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.836822 18485 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.934746 18559 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:12.801043 18536 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.175s
I20260709 13:06:12.905680 18477 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.887565 18524 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:12.892349 18553 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.991652 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:12.878332 18582 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:12.982273 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:12.993855 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.970095 18437 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.966480 18586 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:12.996651 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46136.5us
I20260709 13:06:12.999800 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2491) took 1741 ms. Trace:
I20260709 13:06:12.962500 18568 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:12.971833 18556 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:12.876094 18535 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:12.881522 18562 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.004838 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.025303 18535 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.991540 18485 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:12.962724 18572 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.008968 18557 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:12.992072 18559 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:13.009985 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.011s	sys 0.014s
I20260709 13:06:13.016268 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:13.052731 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.011s	sys 0.014s
W20260709 13:06:13.053179 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 604250us
I20260709 13:06:12.997025 18577 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.002758 18588 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:12.853168 18606 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:13.025677 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49279.7us
I20260709 13:06:13.027878 18568 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.098857 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:12.809187 18570 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.020089 18586 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.014138 18571 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:13.025627 18562 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.020255 18553 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:13.083127 18610 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 13:06:13.013123 18524 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.058145 18551 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.055302 18559 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.088871 18614 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:13.089413 18596 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:06:13.089341 18572 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.052482 18557 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:13.089885 18602 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:13.090297 18594 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260709 13:06:13.091518 18556 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.095750 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.098731 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.007467 18581 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:13.112573 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56532.9us
I20260709 13:06:13.115028 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:13.182300 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 86683.2us
W20260709 13:06:13.182582 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67653.9us
I20260709 13:06:13.006469 18477 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.017832 18582 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.026559 18328 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 13:06:13.015395 15044 rpcz_store.cc:276] 0709 13:06:11.257994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.258139 (+   145us) service_pool.cc:224] Handling call
0709 13:06:11.290428 (+ 32289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:11.415549 (+125121us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:12.113253 (+697704us) log.cc:844] Serialized 14 byte log entry
0709 13:06:12.385010 (+271757us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.385087 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:12.385149 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.999600 (+614451us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003331d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:12.999642 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:12.999749 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":472,"prepare.queue_time_us":945578,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":63411,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":20307,"spinlock_wait_cycles":287335296,"thread_start_us":944073,"threads_started":2,"wal-append.queue_time_us":431758}
I20260709 13:06:13.026813 18536 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:06:13.020061 18437 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.140738 18603 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:13.167790 18609 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:06:13.168560 18562 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.169646 18535 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:13.170449 18605 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:06:13.170325 18583 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.171670 18625 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:13.178647 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 80007.6us
I20260709 13:06:13.232805 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:06:13.168591 18611 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:06:13.183373 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.190567 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.235528 14886 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
W20260709 13:06:13.235729 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 52441.7us
I20260709 13:06:13.236397 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:13.236800 18618 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 13:06:13.237442 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:13.238392 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.241310 18075 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:13.245924 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 231415us
I20260709 13:06:13.196712 18551 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:13.201395 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 207684us
I20260709 13:06:13.211540 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.206136 18483 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.141952 18571 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.112277 18606 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.217696 14889 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:13.223488 14893 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:13.207901 18603 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:13.213059 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.239213 18614 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:13.208876 18509 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.271015 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.289515 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.290215 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.291520 14969 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:13.271551 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.272733 14967 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:13.292780 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.211855 18463 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.244788 18621 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:13.264819 18583 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.263149 18562 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:13.283831 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.285784 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.286530 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.294104 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 1749) took 1673 ms. Trace:
I20260709 13:06:13.190457 18602 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.259133 18536 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:06:13.191357 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.301669 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.265128 18625 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.264671 18483 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:13.310349 15041 rpcz_store.cc:276] 0709 13:06:11.620970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.645019 (+ 24049us) service_pool.cc:224] Handling call
0709 13:06:12.070637 (+425618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:12.120871 (+ 50234us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.120901 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:12.129081 (+  8180us) log.cc:844] Serialized 26 byte log entry
0709 13:06:12.446899 (+317818us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:06:12.446937 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.447000 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.293931 (+846931us) raft_consensus.cc:1685] finished
0709 13:06:13.293950 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.294052 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79769,"raft.queue_time_us":50762,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10365,"thread_start_us":317491,"threads_started":1,"wal-append.queue_time_us":419368}
I20260709 13:06:13.334529 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:13.285095 18467 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.337276 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:13.341778 14964 raft_consensus.cc:2376] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11. Re-sending same reply.
I20260709 13:06:13.289494 18614 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.302692 18583 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:13.349031 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 65320us
I20260709 13:06:13.344290 18467 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.315233 18562 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:13.330294 18536 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:13.342808 18483 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.309273 18463 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.362761 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.363984 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.348038 18614 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.275626 18557 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.350495 18551 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.371011 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:13.354166 18583 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.356348 18536 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.354269 18562 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.355959 18485 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.351210 18603 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.390501 18559 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.391578 18553 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.391877 14892 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:13.392110 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2084) took 2078 ms. Trace:
I20260709 13:06:13.392570 18467 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.393759 18571 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:13.395886 18623 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:06:13.397047 18581 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.397878 18437 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:13.398368 18557 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.399875 18582 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.400664 18463 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:13.402100 18613 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:06:13.402915 18608 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
I20260709 13:06:13.404197 18559 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.406042 17522 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:13.383364 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 149245us
I20260709 13:06:13.408120 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:13.408708 15548 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:13.408893 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.407780 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.416414 18602 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.417629 18483 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.418483 18606 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.421000 18551 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.422479 18055 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.428124 18483 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.392458 14965 rpcz_store.cc:276] 0709 13:06:11.314108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:11.314221 (+   113us) service_pool.cc:224] Handling call
0709 13:06:12.676894 (+1362673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:12.677098 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.677132 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:12.677185 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:12.677227 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:12.677293 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.391954 (+714661us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54001969d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:13.392057 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3134429568}
W20260709 13:06:13.436774 18567 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.876s	user 0.007s	sys 0.004s
I20260709 13:06:13.437423 18567 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.438527 14968 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:11.604235 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:13.436820 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:13.442788 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 226671us
I20260709 13:06:13.443722 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.441651 18586 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.434823 14788 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 3 to 8, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 8 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:13.469584 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61909.3us
I20260709 13:06:13.470361 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.471009 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.471585 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.442458 18388 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.474722 15544 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:13.473905 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.472508 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.474472 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:13.476444 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.481520 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:13.454476 18550 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:13.483160 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.486999 14969 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:13.452248 18567 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.488126 18463 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:13.519652 18463 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.520045 18463 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.488818 18634 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:13.524343 18055 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:13.524708 18055 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:13.489553 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:13.490248 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.527829 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:13.494073 18586 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.494621 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.495973 14892 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 13:06:13.483731 18627 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:13.496780 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:13.497382 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:13.531271 18627 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:13.531756 18627 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:13.531812 15550 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.532874 18627 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.534379 18627 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.499471 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.507077 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.510618 18536 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.535725 14886 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.514492 18583 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.518594 18562 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.474493 18635 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:13.538683 15010 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Tablet error from VoteRequest() call to peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Illegal state: cannot vote while shut down
I20260709 13:06:13.525499 18055 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.570098 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:13.545197 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:13.483780 18388 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.546985 18583 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:13.538228 18615 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.272s	user 0.002s	sys 0.001s
I20260709 13:06:13.548866 18562 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.538228 18536 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.584030 18055 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:13.550513 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 43540us
I20260709 13:06:13.555169 14905 tablet_copy_source_session.cc:215] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:13.584923 14933 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.585433 14905 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:51176 (request call id 567) took 2977 ms. Trace:
I20260709 13:06:13.585795 14905 rpcz_store.cc:276] 0709 13:06:10.607552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:10.611341 (+  3789us) service_pool.cc:224] Handling call
0709 13:06:11.157400 (+546059us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51eee 0000000000375939 00007f5539cc51e0 00007f5539d8e0c4 00007f5539d8e131 00007f5539d0a3d8 00007f5538dbe4b4 00007f5538dbe442 00007f5538dbe371
0709 13:06:13.554696 (+2397296us) spinlock_profiling.cc:243] Waited 2.22 s on lock 0x7b540015b154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d803f7 00007f5539d16036 00007f5539d1fa3e 00007f55315e327b 00007f5539d1f9ba 00007f5539d1aacc 00007f5539d15c7b 00007f5539d0a8d1 00007f5538dbe4b4 00007f5538dbe442
0709 13:06:13.585339 (+ 30643us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5108214016}
I20260709 13:06:13.586534 18601 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.550560 17772 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:13.587587 17772 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:13.588153 18630 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.588845 15042 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:13.588984 18524 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.589356 18630 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:13.587988 17772 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.591249 18634 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:13.592391 18586 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:13.592724 18586 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:13.593405 18612 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.478s	user 0.002s	sys 0.000s
I20260709 13:06:13.593497 18586 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.560220 15038 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:13.561685 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.562341 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.596969 18137 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:13.597975 18137 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:13.598410 18137 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:13.599505 18137 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.600348 18388 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.601025 18137 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.563020 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.566425 15041 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:13.568361 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.611635 14967 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:13.611869 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.611903 14965 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:13.612488 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.613564 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:13.614511 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.614005 14788 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 4 to 7, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.544622 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.607510 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.577831 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.486159 18550 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:13.581288 18614 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.617103 18550 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.618505 18614 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:13.562819 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.619261 15546 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:13.619387 14970 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:06:13.602946 18125 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:13.618336 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.620571 18125 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:13.620798 18588 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.620980 18125 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:13.621506 18588 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.622706 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.571579 18580 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:06:13.623600 18588 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:13.616986 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75181.8us
I20260709 13:06:13.624863 18477 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.625316 18550 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.626394 15035 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:13.627795 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.628023 18586 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.628417 14889 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:13.612188 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:13.630775 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85710.1us
I20260709 13:06:13.631676 14895 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:13.608279 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.609269 15042 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:13.615761 14788 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:13.633839 17772 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.630859 18635 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.636945 18635 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.637296 18635 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.638938 18555 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:13.640614 18570 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:13.642500 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.643554 14893 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:13.607568 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.644857 18550 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.647689 15036 raft_consensus.cc:2410] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:06:13.648711 18483 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:13.648977 17772 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.650110 18603 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.650908 14961 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:13.655473 14893 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:13.655876 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:13.535027 18463 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.672194 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.665300 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.678440 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.680121 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:13.621876 18125 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.661643 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:13.680191 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:13.680857 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:13.687319 15044 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:13.691637 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.667689 14886 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:13.682590 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.685047 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.683044 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.692695 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.692982 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.693254 14890 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.693568 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:13.690892 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.695000 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.699144 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.700953 15041 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:13.701567 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.701793 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.702067 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.703500 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:13.703933 14969 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:13.704350 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.702677 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.681502 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:13.696728 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:13.677659 18634 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.709669 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.711978 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.691228 18597 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:13.714408 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:13.715631 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.716183 14887 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:13.700153 18444 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:13.716123 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 245493us
I20260709 13:06:13.700348 18568 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.705485 18470 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.687474 17756 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:06:13.721415 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:13.720037 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.707640 18509 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.706837 18490 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.717546 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.716869 18125 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:13.716519 18438 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.708905 18479 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:06:13.728370 18631 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:13.716302 18634 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.716586 18200 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.723233 18580 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:06:13.731629 18348 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:13.768360 18348 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:13.768769 18348 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.769388 18463 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.777879 18635 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.731302 15550 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:13.709697 18571 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.715422 18560 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:13.736490 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.785869 14887 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:13.718317 17902 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:13.724064 18509 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:13.738140 18137 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:13.739727 14890 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:13.739034 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.741217 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.740278 18444 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:13.757594 18479 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:13.759147 15038 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:06:13.759673 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.761358 18634 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.740913 18631 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:13.802527 18631 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.807632 18137 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:13.808168 18137 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.785239 14891 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:13.788444 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:13.789685 15039 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:13.734313 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.726207 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:06:13.791788 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50671.8us
W20260709 13:06:13.793242 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 55576.6us
I20260709 13:06:13.811173 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.794521 18556 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.796010 14888 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
W20260709 13:06:13.812451 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 86376.8us
I20260709 13:06:13.812853 14888 pending_rounds.cc:85] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 4
I20260709 13:06:13.813135 14888 pending_rounds.cc:107] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:06:13.796409 18479 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:13.791113 18509 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.791179 18444 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.816870 18444 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:13.816702 18479 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.817030 18348 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.817836 18479 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:13.819078 18348 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:13.813328 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.825517 18620 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:13.826388 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:13.827183 18614 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:13.827569 18614 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:13.827899 18614 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.828032 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:13.829519 18529 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:13.829948 18603 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:13.832165 18580 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:13.833112 18477 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:13.833457 18477 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:13.834370 18477 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.835354 18477 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:13.837589 14964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:13.838160 14964 raft_consensus.cc:606] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.838487 14964 raft_consensus.cc:614] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:13.811614 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.816419 18535 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.840250 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.800894 17902 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:13.819960 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2088) took 1595 ms. Trace:
I20260709 13:06:13.820257 18438 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:13.842563 18625 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:13.842245 18328 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.840545 18535 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.844198 18535 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.796452 18586 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:13.847689 18477 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:13.843230 17902 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.848398 18477 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.848785 18137 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.850183 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.847617 18438 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:13.850515 18477 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.813360 14888 raft_consensus.cc:2889] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:13.841354 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:13.857237 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:13.851522 18646 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:13.859512 18646 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.841109 14963 rpcz_store.cc:276] 0709 13:06:12.225007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:12.225137 (+   130us) service_pool.cc:224] Handling call
0709 13:06:12.225435 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:12.225785 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:12.225818 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:13.527002 (+1301184us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b2c00010828. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:13.527383 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:06:13.704521 (+177138us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:13.704562 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:13.704635 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:13.809470 (+104835us) raft_consensus.cc:1685] finished
0709 13:06:13.809500 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:13.819905 (+ 10405us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21210,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":34475776,"thread_start_us":176079,"threads_started":1,"wal-append.queue_time_us":280035}
I20260709 13:06:13.859897 18646 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:13.862888 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:13.852490 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.865453 18200 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:13.866775 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:13.867508 18556 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:06:13.867681 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.868770 18125 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:13.869266 18571 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:13.852509 18563 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:13.871290 18563 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:13.871707 18563 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.874559 18535 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.853641 18348 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:13.855768 18494 ts_tablet_manager.cc:1916] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:06:13.927611 18635 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:13.927521 18563 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.931046 18563 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.918809 18348 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:13.934412 18348 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:13.915733 18586 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:13.917184 18535 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:13.904204 14969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
W20260709 13:06:13.909682 15513 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletCopyService.BeginTabletCopySession -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54759.1us
I20260709 13:06:13.945596 14969 raft_consensus.cc:606] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:13.945938 14969 raft_consensus.cc:614] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:13.947010 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:13.947721 14890 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:13.914584 18646 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.920727 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:13.922863 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:13.823957 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89756.1us
I20260709 13:06:13.852906 18438 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.934150 18603 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:13.917073 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.937887 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:06:13.948982 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 247797us
I20260709 13:06:13.950730 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.952188 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.954699 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.955273 18477 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:13.955348 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.914623 18444 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:13.964936 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:13.989408 14886 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:13.993624 18580 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:13.994141 14792 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 281) took 12022 ms (client timeout 15000 ms). Trace:
I20260709 13:06:13.994282 18580 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:13.995616 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:13.996691 18580 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:13.997370 18477 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:13.941681 18328 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.002030 18328 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.005841 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:14.012620 15038 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:14.020882 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.022106 14895 raft_consensus.cc:2410] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:14.006120 14788 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 5 to 7, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.026821 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:14.027878 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.036968 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.040334 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.045085 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.041529 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.048568 14886 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
W20260709 13:06:14.042409 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 121808us
I20260709 13:06:14.050802 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.052953 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:13.994581 14792 rpcz_store.cc:269] 0709 13:06:01.971820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:01.972772 (+   952us) service_pool.cc:224] Handling call
0709 13:06:13.994043 (+12021271us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:08.026002 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:08.026786 (+   784us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:08.026841 (+    55us) write_op.cc:435] Acquired schema lock
0709 13:06:08.026861 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:08.030372 (+  3511us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:08.030457 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:08.030487 (+    30us) tablet.cc:685] Acquiring locks for 30 operations
0709 13:06:08.033154 (+  2667us) tablet.cc:701] Row locks acquired
0709 13:06:08.033209 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:06:08.033404 (+   195us) write_op.cc:270] Start()
0709 13:06:08.033572 (+   168us) write_op.cc:276] Timestamp: P: 1783602368033336 usec, L: 0
0709 13:06:08.033599 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:06:08.042207 (+  8608us) log.cc:844] Serialized 11692 byte log entry
0709 13:06:08.256020 (+213813us) op_driver.cc:464] REPLICATION: finished
0709 13:06:08.592690 (+336670us) write_op.cc:301] APPLY: starting
0709 13:06:08.609148 (+ 16458us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:08.627131 (+ 17983us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:08.627296 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:08.659523 (+ 32227us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:08.883471 (+223948us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=30
0709 13:06:08.883523 (+    52us) write_op.cc:312] APPLY: finished
0709 13:06:08.884088 (+   565us) log.cc:844] Serialized 200 byte log entry
0709 13:06:08.884284 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:08.884493 (+   209us) write_op.cc:454] Released schema lock
0709 13:06:08.884572 (+    79us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:08.884970 (+   398us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:08.884997 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":699926,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":303310,"apply.run_cpu_time_us":7342,"apply.run_wall_time_us":303928,"num_ops":30,"prepare.queue_time_us":41531,"prepare.run_cpu_time_us":23639,"prepare.run_wall_time_us":136916,"raft.queue_time_us":8292,"raft.run_cpu_time_us":34341,"raft.run_wall_time_us":147039,"replication_time_us":222015,"thread_start_us":290054,"threads_started":4,"wal-append.queue_time_us":179826,"wal-append.run_cpu_time_us":4569,"wal-append.run_wall_time_us":1697524}]]}
I20260709 13:06:14.037729 18633 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:06:14.049343 18055 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.057371 18633 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:14.057765 18633 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:14.003298 18646 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:14.025303 18603 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.062086 18603 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:14.062554 14969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:14.064788 18477 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:14.052321 18572 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:14.060726 18348 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.069563 14888 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:14.073274 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.029507 14788 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 4 to 6, leader changed from <none> to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2), now has a pending config: VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1), VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2), VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:14.080343 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.080794 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.081245 15041 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:14.085194 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.085423 14895 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:14.058698 18633 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.089633 14893 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 4. Current term is 5. Ops: []
I20260709 13:06:14.090984 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.091920 14886 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:14.037240 18509 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.122396 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.121397 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.114504 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.123991 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.118721 14788 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 2 to 9. New cstate: current_term: 9 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.109584 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:14.074505 18614 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.074259 18560 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.143610 14788 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 6 to 7, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.092653 15038 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:14.126573 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.126940 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.127372 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.129107 14888 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:14.132108 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.140040 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.148731 14970 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:14.093767 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.150070 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.059113 18631 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.098843 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.093297 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.155037 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:14.153682 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 426793us
I20260709 13:06:14.154476 14968 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 13:06:14.156474 14968 pending_rounds.cc:85] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 5
I20260709 13:06:14.156752 14968 pending_rounds.cc:107] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 13:06:14.157025 14968 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:14.116429 18055 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:14.162411 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63703.7us
I20260709 13:06:14.164343 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.166144 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.091995 18586 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:14.141127 18444 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:14.145818 18200 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.192622 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.158771 17756 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:14.090605 18572 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:14.184620 15037 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:06:14.181488 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.181489 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:14.172155 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.167726 18600 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.167940 18437 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.213408 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.213964 18437 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:14.214469 18437 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:14.214956 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.215301 18437 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.168056 18649 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:06:14.171399 18633 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.218097 18525 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:14.218608 18525 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:14.188769 18639 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:06:14.201509 18631 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:14.220124 18639 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:06:14.220554 18639 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:14.166798 18348 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:14.210700 18632 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.202975 18200 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.212144 18620 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:14.213138 18555 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:14.221493 18639 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.188261 18125 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:14.225028 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.188964 18490 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.208447 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.227022 14788 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 2 to 11. New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:14.231042 15038 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:14.234089 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:14.234580 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.234952 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.235440 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:14.204151 18328 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:14.236552 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:14.237102 15550 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:14.237509 14788 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.239643 14788 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 1 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:14.241133 18580 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:14.241343 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.241595 18580 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.241964 18580 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.235841 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.242091 18572 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.244915 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.245806 15543 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:14.245992 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.246572 15546 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:14.247609 18639 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:14.241272 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.248554 18200 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:14.248821 15541 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:14.249082 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.249717 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.250311 15547 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:14.250838 18529 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.251386 15547 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:14.258455 15547 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:14.255410 14891 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:14.252089 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:14.260740 18477 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:14.255772 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:14.254225 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.257282 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:14.251890 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.252431 18463 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:14.268242 18463 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:14.269127 18463 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.270279 18463 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.255892 18391 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:14.264480 15548 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:14.246857 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:14.279495 15541 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:14.209036 17756 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:14.272294 15546 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 6: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:14.232394 18494 ts_tablet_manager.cc:1929] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 6.6
I20260709 13:06:14.272154 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:14.277796 15550 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:14.226318 18525 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.273830 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.280856 18490 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:14.282994 15545 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:14.285877 14963 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:14.286878 14969 raft_consensus.cc:606] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:14.287274 14969 raft_consensus.cc:614] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:14.296401 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.228044 18444 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:06:14.304877 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.305552 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:14.306816 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.254856 18650 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.313963 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.278898 18391 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:14.332594 18391 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.334692 18391 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.298636 18477 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.237133 18125 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.323802 14967 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:14.324260 18494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eec3351a3e94e158c79a8784e2c6574. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:14.325035 18444 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:14.325251 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.330312 18524 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:14.295989 18622 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:14.340953 14788 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:14.303911 18550 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:14.364060 14969 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:14.386793 14969 raft_consensus.cc:606] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:14.365571 18137 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:14.366186 18603 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:14.366655 15548 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:14.366974 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.354809 18525 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:14.370707 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 56848.1us
I20260709 13:06:14.309008 18556 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.374672 14788 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 6 to 9, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:14.388392 14961 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:14.369838 18568 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.395993 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.396333 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.397367 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.406972 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:14.364908 18580 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.358183 18444 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:14.359325 18524 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:14.410662 14788 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:14.413902 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:14.390189 18603 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:14.418186 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:14.386567 18550 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:14.387768 18137 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:14.432626 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:14.439505 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.320986 18625 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:06:14.394251 18509 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:14.442662 15039 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:14.438253 18524 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.403189 18622 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:14.410650 18614 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:14.412706 18328 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:14.411469 18477 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.467635 14895 raft_consensus.cc:2368] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10.
I20260709 13:06:14.444710 18563 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:14.358611 17756 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.412170 18200 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:14.465683 15039 raft_consensus.cc:614] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:14.481292 18550 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.482738 18550 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:14.461570 18120 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.499730 18125 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:14.505139 18580 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:14.538671 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.542634 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.543371 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:14.492096 18563 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:14.551731 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:14.553297 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 346683us
W20260709 13:06:14.557027 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 382622us
I20260709 13:06:14.546908 15542 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:06:14.485311 18597 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:06:14.562413 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.568696 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:14.572687 14888 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:14.557322 18639 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:06:14.627557 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65241.4us
I20260709 13:06:14.520017 18603 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:14.518689 18444 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:14.644142 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 80600us
I20260709 13:06:14.646230 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.634449 18572 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:14.666962 18477 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:14.667799 18477 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.672145 18477 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:14.672715 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.672514 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:14.554054 18137 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.673934 18444 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.583510 18622 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.715152 18597 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.675387 18563 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.682897 18509 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:14.739262 18509 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:14.683671 18603 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:14.687989 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.715713 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.716341 15007 leader_election.cc:400] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10.
I20260709 13:06:14.742998 15007 leader_election.cc:403] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 13:06:14.742924 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 96834.2us
I20260709 13:06:14.717068 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.721606 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.738217 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:14.744185 15039 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:14.744345 14963 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:14.741307 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95747.4us
I20260709 13:06:14.748409 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.750458 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.754921 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.736891 18494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52858 (request call id 697) took 5918 ms. Trace:
I20260709 13:06:14.761160 14963 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:14.762727 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.761425 15039 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
W20260709 13:06:14.764565 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.770744 15043 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:14.752604 18137 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:14.780506 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.780814 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.754227 18568 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.781984 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.787043 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.793195 14961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:14.793859 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:14.793895 14961 raft_consensus.cc:606] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:14.794934 14961 raft_consensus.cc:614] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:14.764673 18200 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10.
I20260709 13:06:14.789414 18660 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:14.740152 18509 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.807349 14963 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:14.790114 18580 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:14.825357 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:14.830322 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:14.796176 18328 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:14.844590 18570 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:06:14.849515 17772 raft_consensus.cc:993] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:14.834793 18524 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.849062 18663 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:14.824360 18568 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.853266 14891 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:14.824384 18664 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:06:14.860809 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 73883us
I20260709 13:06:14.863880 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.789901 18650 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 13:06:14.851094 18555 raft_consensus.cc:1081] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:14.869933 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.874325 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.879917 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.873652 18580 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.880395 18509 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:14.887054 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.901435 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.880985 18625 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:14.883430 18568 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:14.909807 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.911571 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.913811 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.916018 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.917532 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:14.919936 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.890498 18328 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.917691 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:14.938248 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:14.940759 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:14.941313 14891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:06:14.941877 14891 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:14.942258 14891 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:14.914728 18444 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:14.914942 18614 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:14.948424 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:14.919957 18639 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.922425 18580 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.922617 18477 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:14.942552 18666 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.186s	user 0.001s	sys 0.001s
I20260709 13:06:14.952739 14891 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:14.937438 18670 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:14.957698 14936 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Tablet error from VoteRequest() call to peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Illegal state: cannot vote while shut down
I20260709 13:06:14.959256 18679 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:14.762738 18494 rpcz_store.cc:276] 0709 13:06:08.806529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.806771 (+   242us) service_pool.cc:224] Handling call
0709 13:06:09.208925 (+402154us) ts_tablet_manager.cc:934] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
0709 13:06:09.365591 (+156666us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f5531c6c0ac 00007f553aac6ab9 00007f5531c8869b 00007f5531c85caa 00007f5531c85bd2 00007f5539cea131
0709 13:06:13.854993 (+4489402us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:13.957680 (+102687us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:14.225923 (+268243us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:14.298260 (+ 72337us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 13:06:14.684476 (+386216us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:14.684804 (+   328us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:14.685224 (+   420us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:14.714514 (+ 29290us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":56392,"spinlock_wait_cycles":60970368,"tablet-copy.queue_time_us":357678,"thread_start_us":404535,"threads_started":2}
I20260709 13:06:14.942788 18568 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:06:14.964203 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.968662 14891 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:14.965179 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49239.1us
I20260709 13:06:14.952637 18625 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.951398 18632 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:14.938475 18663 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:14.969480 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:14.991139 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.994182 15548 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:14.995805 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:14.996074 17902 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:14.996516 14967 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:14.999025 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 77307.9us
I20260709 13:06:15.000192 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.966787 18670 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:15.001641 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:14.989894 18525 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:15.005429 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:14.997365 18668 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 13:06:15.008457 14967 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:15.010865 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:14.992026 17772 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:14.993065 18639 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:14.987802 18679 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:14.998668 18568 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:15.007382 18625 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:15.009653 18525 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:15.010342 18477 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:15.005007 18524 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.003914 18670 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:15.023795 18494 tablet_copy_client.cc:806] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:15.029353 18672 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:15.032114 17772 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:15.062234 18625 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:15.064579 18524 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:15.073263 15043 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:15.074539 18494 tablet_copy_client.cc:670] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:15.075047 18524 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:15.076053 18524 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.081784 18639 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:15.086072 15544 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:15.024403 18673 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260709 13:06:15.081777 18681 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:15.025362 18683 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 13:06:15.096753 18556 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:15.144960 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44753.2us
I20260709 13:06:15.071924 17772 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.150452 17772 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.144448 18681 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.155136 18681 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.165000 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:15.166545 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 164126us
W20260709 13:06:15.168092 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 212171us
I20260709 13:06:15.168524 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.141124 18631 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.170207 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:15.170944 15042 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.142565 18556 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:15.089054 18525 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.210839 15042 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:15.212458 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:15.071218 18679 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.184090 18570 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:15.144615 18568 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:15.212859 18665 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.407s	user 0.008s	sys 0.000s
I20260709 13:06:15.177124 18686 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:06:15.231698 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44422us
I20260709 13:06:15.177464 18631 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.223546 18683 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:15.215464 18603 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:15.212863 18524 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.229835 18570 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.244264 18494 tablet_copy_client.cc:538] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:15.282043 18631 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:15.283365 14961 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:15.283636 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.251837 18683 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:15.284792 18683 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:15.277312 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44953.7us
I20260709 13:06:15.291370 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.292181 15042 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:15.296816 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:15.297600 14963 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:15.298007 14963 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:15.298985 14963 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.300801 14963 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.245127 18670 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.251597 18603 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.227221 18556 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.313963 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:15.323999 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.295845 18685 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.343845 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:15.275508 18524 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.353334 14892 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:15.351727 18509 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:15.364318 15041 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:15.355787 18685 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.314189 18660 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.113s
I20260709 13:06:15.442921 18555 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:15.348598 18681 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.479790 18684 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:15.493494 18684 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.482393 18603 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:15.486759 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.496579 18494 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:06:15.496801 15043 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:15.487561 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.481545 14963 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:15.488688 18524 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.489557 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.506496 15549 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:15.476352 18671 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:15.507298 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147792us
I20260709 13:06:15.507486 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:15.492905 18550 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.010s	user 0.013s	sys 0.008s
I20260709 13:06:15.484591 18685 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.498606 18684 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:15.491813 18555 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:15.525614 18525 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:15.527947 18479 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:06:15.513942 18681 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.564760 18670 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.565585 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.566232 14892 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:15.567356 18681 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:15.516952 18671 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.594528 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:15.602509 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:15.573894 18570 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:15.605305 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:15.608031 14962 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:15.605835 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:15.618645 15041 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:15.618878 15037 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:15.619284 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.620213 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.586246 18444 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:06:15.620919 15037 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 4.
I20260709 13:06:15.629724 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:15.630944 18694 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 13:06:15.631558 18671 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.584110 18555 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.635172 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:15.636054 14967 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:15.625710 18479 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:15.637141 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:15.640030 18555 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:15.637269 18660 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:15.644699 18660 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.645068 18660 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:15.613215 18570 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:06:15.629276 18704 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:15.635300 18681 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:15.649398 18709 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:15.652710 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.656083 15548 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:15.655108 18709 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:15.679848 18709 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.657382 18570 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
W20260709 13:06:15.688252 18697 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
W20260709 13:06:15.703177 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.698939 18571 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.701733 18630 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:15.726251 18571 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.759783 18571 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.761940 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.765240 18709 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.775887 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:15.776264 15543 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:15.776403 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.776675 15542 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:15.777027 15545 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:15.780051 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:15.732775 18630 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.742255 18438 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:15.814507 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:15.818725 15548 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.815834 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:15.828215 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49439.3us
I20260709 13:06:15.833663 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:15.834275 14961 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.777146 18571 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:15.827258 18597 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.857288 14961 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:15.863858 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:15.865309 15548 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:15.865650 18709 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.868726 18630 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:15.831962 18438 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.873248 18438 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:15.877043 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.878473 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.879209 15039 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:15.879246 18120 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:15.880061 18120 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:15.851233 18571 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.881210 18120 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.882227 18571 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:15.884124 18649 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.884589 18649 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.886555 18649 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:15.894580 14892 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:15.902302 18649 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:06:15.915560 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 80921.1us
I20260709 13:06:15.917711 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.907900 18586 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.919894 18570 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:15.919862 18586 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.920430 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.920539 18570 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.921130 14893 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:15.922147 18586 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.922744 18570 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:15.925120 18681 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:15.925158 18125 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:15.925908 18556 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:15.925936 18125 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:15.925851 18681 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.896087 18597 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:15.939035 15037 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:15.939855 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:15.849797 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:15.939850 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.944803 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.949525 14895 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:06:15.949842 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.950309 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.949944 14962 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:06:15.954156 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.955013 14963 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:06:15.955164 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.955649 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.955978 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.956226 14891 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:15.956514 15548 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:15.956625 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.954066 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.959384 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:15.958695 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:15.964005 14861 leader_election.cc:343] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Tablet error from VoteRequest() call to peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:06:15.964255 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:15.965495 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:15.965981 18706 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:15.966467 18706 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:15.966830 18706 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:15.967307 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:15.965993 15545 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:15.967913 15043 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:15.966075 15543 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:15.969755 15541 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:15.971163 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:15.971786 14963 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:15.972859 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:15.973764 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.974654 18689 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:15.975485 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.976055 15548 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:15.977136 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.977715 15549 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:15.978227 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:15.978391 18586 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:15.979297 18055 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:15.978502 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:15.979707 18055 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:15.972095 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.980547 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:15.981748 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:15.980157 18055 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:15.980300 18650 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:15.957653 18630 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:15.986609 15546 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 5: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:15.996191 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:15.996351 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:15.972365 18675 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:15.972234 18568 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:16.001596 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:16.002244 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:15.980813 18685 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:16.007654 18120 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:15.998714 18650 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.013813 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:16.010624 14893 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:16.011860 15039 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:15.957109 18328 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:15.998411 18597 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.000520 18676 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.032291 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:16.034384 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:16.009692 18679 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:16.013041 18675 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:15.997030 18660 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.044245 15545 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:16.011482 18568 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:16.011124 18524 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:16.014104 18120 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.031754 18709 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:16.012081 18555 raft_consensus.cc:2764] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:06:16.056146 15545 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:16.033514 18125 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.018092 18650 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.043044 18597 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:16.043299 18676 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:16.078510 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 106528us
I20260709 13:06:16.058486 18120 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.041378 18671 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:06:16.053740 18702 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:16.056619 18572 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:16.061000 18568 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:16.016013 18689 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:06:16.087131 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:16.088802 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:16.054951 18667 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:06:16.089439 15546 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:16.086990 18702 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.091991 18702 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.084059 18572 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.104007 18572 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.079726 18676 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.079324 18685 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 13:06:16.108768 18726 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:06:16.125042 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 70257.6us
I20260709 13:06:16.121011 18706 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.168809 18706 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.116621 18681 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.123811 18675 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:16.181466 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 71709.9us
I20260709 13:06:16.132941 18660 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.125924 18055 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.192772 14962 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:06:16.193534 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:16.197631 15039 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:16.181214 18120 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.197183 18702 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:06:16.206875 18660 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:16.252430 18660 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.252919 18660 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.313406 18622 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:16.313930 18622 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:16.314987 18622 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.317047 18120 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.316890 18572 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:16.317735 15544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 728) took 2063 ms (client timeout 2178 ms). Trace:
I20260709 13:06:16.319582 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 672) took 1160 ms. Trace:
I20260709 13:06:16.326993 15038 rpcz_store.cc:276] 0709 13:06:15.158802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:15.158914 (+   112us) service_pool.cc:224] Handling call
0709 13:06:15.168580 (+  9666us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:15.176592 (+  8012us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:06:15.653576 (+476984us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b180033ef20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f553876e3c7 00007f5534d809a7 00007f5534d900bf 00007f5534d90038
0709 13:06:15.769846 (+116270us) log.cc:844] Serialized 14 byte log entry
0709 13:06:15.975632 (+205786us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:15.976073 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:06:15.976301 (+   228us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:15.976332 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:15.976390 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:16.312420 (+336030us) raft_consensus.cc:1685] finished
0709 13:06:16.319309 (+  6889us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:16.319507 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7532,"prepare.queue_time_us":19953,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":8964,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":13115,"spinlock_wait_cycles":7168384,"thread_start_us":321558,"threads_started":2,"wal-append.queue_time_us":244100}
W20260709 13:06:16.326970 15544 rpcz_store.cc:269] 0709 13:06:14.243871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.257070 (+ 13199us) service_pool.cc:224] Handling call
0709 13:06:16.212046 (+1954976us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54006b12d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:16.307086 (+ 95040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370126080}
I20260709 13:06:16.331002 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:16.312633 18444 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.341318 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:16.343020 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:16.345846 14962 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:16.310292 18685 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:16.359789 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:16.360528 14967 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:16.361227 18572 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.363009 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:16.363636 14888 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.363302 18650 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.351503 18444 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.368818 18444 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.378875 18055 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.326143 18737 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:16.380091 18737 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.382333 18737 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.383347 18700 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:16.383863 18700 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:16.384734 18700 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.386003 18700 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.391852 18685 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.394488 18685 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.403656 14893 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.327891 18120 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.415222 14888 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:16.424873 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:16.421739 18650 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.463747 14893 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:16.482056 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:16.482834 14969 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.463770 14967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39056
I20260709 13:06:16.489777 14967 raft_consensus.cc:606] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Received request to transfer leadership
I20260709 13:06:16.490226 14967 raft_consensus.cc:614] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:16.494565 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:16.495509 14962 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:16.496645 17756 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:16.502976 14969 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:16.506594 18348 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.507306 18509 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.507122 18348 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.507792 17756 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.508687 17756 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.509956 18348 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.432135 18120 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.512185 18120 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.454527 18055 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:16.513358 18055 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:16.513579 17756 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.517344 14968 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:16.543326 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:16.543707 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:16.544028 15544 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.544399 15546 raft_consensus.cc:2368] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:16.486804 18660 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.549575 18660 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.551290 15544 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:16.553974 18622 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:16.514551 18055 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.502745 18568 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.507851 18509 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.571230 18676 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.633960 14892 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:06:16.637717 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:16.638144 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 444620us
W20260709 13:06:16.650858 14841 auto_rebalancer.cc:893] Removing replace marker failed: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:16.651366 14841 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:06:16.651741 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:06:16.656584 14962 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:06:16.665067 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 95604.5us
W20260709 13:06:16.669513 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:16.667135 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:16.674376 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:16.675251 15541 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.678042 18200 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.678598 15545 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:16.678985 18200 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.680740 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:16.682147 15546 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:16.682399 18200 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.685254 18328 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.686019 18328 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.688874 18328 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.689328 15541 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:16.689411 18328 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:16.691988 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.693953 18568 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.694942 18568 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:16.677109 15010 leader_election.cc:400] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:16.702953 15010 leader_election.cc:403] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:06:16.704717 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:16.706032 18625 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:16.707845 18509 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.708593 18509 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:16.709004 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:16.713148 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46339.9us
I20260709 13:06:16.726174 14888 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:16.724753 18509 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:16.742029 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:16.732086 18563 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:16.764307 18563 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:16.764966 18556 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:16.748530 18509 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.765936 18556 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.746433 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:16.768160 15549 raft_consensus.cc:2368] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:06:16.768529 18509 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.749153 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:16.755934 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:16.769630 18556 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.769582 18509 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:16.770758 18597 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:16.771209 18597 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:16.771591 18597 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:16.773414 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:16.774343 14895 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:16.776042 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.757061 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:16.755247 15546 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:16.760648 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:16.728652 18120 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.781693 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.782848 14888 raft_consensus.cc:2368] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:16.791316 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:16.792764 18625 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.793911 18667 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.794678 18667 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.796718 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.797251 18667 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.799281 18676 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.799710 18633 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:16.765817 18563 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.690405 18328 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:16.792847 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 108266us
I20260709 13:06:16.805946 14895 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:16.829602 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.801333 18633 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.833319 14888 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:16.833192 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:16.837503 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:16.829859 18328 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:16.824236 18625 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.841514 18749 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:16.842337 18749 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.839860 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:16.853425 18658 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:16.852705 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 148244us
I20260709 13:06:16.851192 18663 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:16.856459 18658 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.857041 18663 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:16.857080 14892 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:16.858326 18663 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.848968 18055 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.860395 18658 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.860596 18055 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.864091 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.866570 18055 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.832093 18671 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:06:16.869153 18671 consensus_queue.cc:1243] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:16.869740 18671 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:16.870132 18671 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:16.861788 18739 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.432s	user 0.000s	sys 0.003s
I20260709 13:06:16.872315 14895 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 6: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:16.847215 18328 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.873883 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:16.838260 18555 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:16.876945 18555 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.845384 18625 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.847571 18568 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.881846 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:16.885742 14792 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 10, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 10 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.889339 18749 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.886906 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:16.907585 14892 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:16.890751 18328 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.938105 14792 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:16.939906 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.871238 18671 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.940037 14792 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 11, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:16.943605 14894 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:16.954206 14892 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:16.947834 18555 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:16.961380 18650 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:16.962392 18758 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 13:06:16.962091 18650 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:16.964643 18650 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:16.964744 14967 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:16.965931 18671 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:16.966138 18328 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:16.977193 18759 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 13:06:16.937165 18568 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:16.956650 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.000104 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:16.956218 18563 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:16.998018 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.007292 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.007496 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.009306 18463 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.009838 18328 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:17.011274 18328 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.013929 18328 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.014429 18568 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:17.018009 15545 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.002267 14792 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:16.955346 18633 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.003185 18650 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.033298 18756 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
I20260709 13:06:17.035090 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.019124 18597 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.033428 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.036981 14792 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:17.044669 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.045218 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:17.050547 15037 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:17.029659 18563 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.051913 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.054459 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:17.034068 18650 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.056852 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:17.057713 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.056406 14969 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.050467 14792 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 7, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:17.067667 14861 leader_election.cc:400] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:06:17.068230 14861 leader_election.cc:403] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:17.068782 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 157658us
I20260709 13:06:17.072705 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.073988 14967 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:17.079457 15038 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:06:17.082306 18568 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9.
I20260709 13:06:17.089835 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.091952 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:17.094166 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:17.094919 14888 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 11
W20260709 13:06:17.095127 14788 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 171) took 11302 ms (client timeout 15000 ms). Trace:
W20260709 13:06:17.095644 14788 rpcz_store.cc:269] 0709 13:06:05.796962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:05.801840 (+  4878us) service_pool.cc:224] Handling call
0709 13:06:17.094904 (+11293064us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:14.961466 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:14.983929 (+ 22463us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:14.983964 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:14.983981 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:14.985050 (+  1069us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:14.985128 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:14.985155 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:06:14.986204 (+  1049us) tablet.cc:701] Row locks acquired
0709 13:06:14.986222 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:06:14.986359 (+   137us) write_op.cc:270] Start()
0709 13:06:14.986475 (+   116us) write_op.cc:276] Timestamp: P: 1783602374986310 usec, L: 0
0709 13:06:14.986497 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:14.987348 (+   851us) log.cc:844] Serialized 5399 byte log entry
0709 13:06:15.241344 (+253996us) op_driver.cc:464] REPLICATION: finished
0709 13:06:15.481217 (+239873us) write_op.cc:301] APPLY: starting
0709 13:06:15.489035 (+  7818us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:15.489294 (+   259us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:15.489424 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:15.597696 (+108272us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:15.597974 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:06:15.598018 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:15.598301 (+   283us) log.cc:844] Serialized 95 byte log entry
0709 13:06:15.598464 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.598603 (+   139us) write_op.cc:454] Released schema lock
0709 13:06:15.598650 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:15.598995 (+   345us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:15.599034 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":383639,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":175941,"apply.run_cpu_time_us":4323,"apply.run_wall_time_us":143755,"num_ops":13,"prepare.queue_time_us":188175,"prepare.run_cpu_time_us":18289,"prepare.run_wall_time_us":216838,"raft.queue_time_us":49843,"raft.run_cpu_time_us":15523,"raft.run_wall_time_us":64895,"replication_time_us":254669,"thread_start_us":357199,"threads_started":4,"wal-append.queue_time_us":191805,"wal-append.run_cpu_time_us":9300,"wal-append.run_wall_time_us":1614585}]]}
I20260709 13:06:17.108753 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.092295 18120 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
W20260709 13:06:17.112689 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.111105 14933 leader_election.cc:400] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:17.113883 14933 leader_election.cc:403] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:17.087818 18568 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 13:06:17.115942 15039 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:17.116997 14888 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:17.108667 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 8, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 8 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:17.124696 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.125497 18525 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.126060 18525 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.131533 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:17.118768 18597 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.142174 15043 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:17.133003 18055 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.136699 18633 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:17.129566 18494 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:17.145073 18570 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:17.145475 18494 tablet_bootstrap.cc:492] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:06:17.145632 18570 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:17.146404 18494 ts_tablet_manager.cc:1403] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 1.650s	user 0.042s	sys 0.013s
I20260709 13:06:17.148339 18684 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:17.128806 18734 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.152040 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:17.152664 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.153028 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.152691 14967 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:17.154807 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:17.155251 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.155598 18676 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:17.156924 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.157989 15545 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:17.158329 18328 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:17.158761 18328 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.159113 18328 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.167656 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:17.168376 18568 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:17.168735 18568 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:17.169140 18568 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.146706 18570 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.137367 14792 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 9 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:17.182891 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:17.184749 14792 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 9 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:17.186262 18494 raft_consensus.cc:359] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.187556 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:17.188524 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.193895 15044 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:17.195232 18650 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.195822 14963 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:17.197227 18563 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.202698 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:17.203548 18555 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:17.204290 18555 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:17.204980 18525 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.205551 18525 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.205471 18555 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.206105 18525 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.208168 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.207794 18494 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: FOLLOWER
I20260709 13:06:17.208904 18684 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.209769 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.210505 18684 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.210127 18494 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.211264 18645 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:17.211895 18645 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.213243 18494 ts_tablet_manager.cc:1434] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.066s	user 0.004s	sys 0.004s
I20260709 13:06:17.214104 18645 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.214654 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.218042 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.220288 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.221824 18568 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.223886 15038 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:17.225760 18677 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:17.226650 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:17.228204 18677 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:17.228827 18677 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:17.229549 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:17.230924 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.229877 18677 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.234480 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.235777 18650 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.236402 18650 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.239084 18650 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.241891 14888 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:17.244328 18586 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:17.191363 14969 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:17.234014 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.248303 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.365584 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:17.501922 14792 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 3 to 5, term changed from 6 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to <none>, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1), VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2), VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 9 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:17.503952 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.504170 14792 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 7, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:17.505566 14792 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:17.506073 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:17.506837 14792 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:17.520184 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 286325us
I20260709 13:06:17.520380 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.506834 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:17.529508 18463 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:17.530115 18463 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.532182 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.532799 15546 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:17.535046 18463 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.538246 18525 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.542399 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.544387 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.548781 15550 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:17.552603 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:17.555162 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 272895us
I20260709 13:06:17.563079 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:17.565106 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46867.8us
I20260709 13:06:17.567662 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:17.568230 15545 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.569545 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.573426 14968 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:17.575556 18683 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:17.575954 18683 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:17.576330 18683 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.579494 18586 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.580639 14892 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:17.581525 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.583571 15550 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:17.592532 15545 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:17.593479 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.526388 18120 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:17.603976 15043 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:17.606429 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:17.607487 18556 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:17.622081 18438 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:17.613219 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.615417 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.629626 15546 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:17.616187 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.616916 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:17.617727 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:17.638053 18769 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:06:17.624393 18509 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:06:17.640316 14892 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:17.655920 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.641776 14792 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:17.640187 18684 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:17.677024 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.687093 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.688328 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.682430 18580 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:17.641459 18055 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 13:06:17.672602 18556 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.696381 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.710177 18555 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:17.759315 18328 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260709 13:06:17.759482 18555 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.759868 18328 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.762059 18555 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.762656 18328 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.691247 18625 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:17.765461 14887 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:17.777206 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:17.774729 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:17.777974 15550 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.778801 18525 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:17.779254 18525 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:17.779727 18525 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:17.782538 15546 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:06:17.789978 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.769498 14792 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:06:17.796365 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 115349us
I20260709 13:06:17.796974 15543 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:17.799255 15544 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:17.705570 18580 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.782488 18120 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:17.770969 18556 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:17.821277 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:17.827416 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.854780 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:17.855664 14962 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:17.859221 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:17.853523 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:17.812433 18438 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:17.879967 15043 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
W20260709 13:06:17.880861 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53592us
I20260709 13:06:17.881280 15544 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:17.826498 14792 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 1 to 6, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:06:17.884509 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 275319us
I20260709 13:06:17.888396 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:17.887459 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:17.873167 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:17.890750 18765 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:06:17.891160 18684 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:17.891795 18684 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:17.892814 18772 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:06:17.892954 18684 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.895545 18661 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:17.881007 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43878.3us
I20260709 13:06:17.896134 18661 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.898233 18661 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:17.899032 18773 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:06:17.877262 18685 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.900988 18600 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:17.901777 18438 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.903180 18556 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.903429 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:06:17.913404 18771 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.232s	user 0.001s	sys 0.000s
I20260709 13:06:17.915550 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:17.915902 18580 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:17.885828 18734 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:17.916945 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:17.917114 18787 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:17.916903 18734 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.886327 18055 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:17.920424 18683 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:17.923378 14888 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:17.857129 18120 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:17.926095 18120 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:17.930065 14962 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:17.942022 15550 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:17.951982 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:17.953212 18774 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.433s	user 0.000s	sys 0.003s
I20260709 13:06:17.939126 14967 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:17.959863 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 10, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 10 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:17.940665 18120 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:17.939890 18683 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:17.978924 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:17.980644 14792 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 7, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:18.018200 14792 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 9, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:18.026321 14891 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:18.022933 14792 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:18.032639 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 180033us
I20260709 13:06:18.049942 18525 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.052649 18525 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.066419 15547 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:18.097283 18328 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.097853 18328 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.099972 18328 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:18.100940 18789 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:06:18.078549 18563 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:18.113216 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.012s	sys 0.014s
W20260709 13:06:18.133508 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 166397us
W20260709 13:06:18.133457 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 237062us
I20260709 13:06:18.136453 18580 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:18.136840 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:18.138321 18328 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:18.138950 18328 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:18.138221 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:18.134552 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.012s	sys 0.014s
W20260709 13:06:18.134145 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 156222us
I20260709 13:06:18.144006 15038 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:06:18.141695 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 635900us
I20260709 13:06:18.147030 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.147418 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:18.147751 15038 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:06:18.148105 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100737us
I20260709 13:06:18.140121 15548 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:18.148761 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:18.139807 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:18.157244 15542 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:18.156427 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:18.159902 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:18.164161 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.165508 18679 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:18.111373 18563 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.163741 18328 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.163255 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:18.178251 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:18.196936 18724 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:18.197402 18724 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.197763 18724 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:18.203055 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46727.5us
I20260709 13:06:18.203609 18633 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:18.213415 18793 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:18.218096 18679 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:18.246948 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 68770.5us
I20260709 13:06:18.248764 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-6eec3351a3e94e158c79a8784e2c6574 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:06:18.249337 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-6eec3351a3e94e158c79a8784e2c6574 on tablet 6eec3351a3e94e158c79a8784e2c6574 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:18.249493 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:18.250308 14892 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:06:18.253516 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.234493 18793 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.256341 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:18.257239 18796 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:18.257473 18792 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:06:18.257951 18679 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:18.266831 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 86951.1us
I20260709 13:06:18.270866 15044 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:18.271325 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:18.277967 15544 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:18.260133 18796 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.289528 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:18.290349 14969 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:18.280964 18055 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:18.293008 18328 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:18.293407 18791 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:18.293834 18328 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.296484 18734 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.296754 18328 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.298640 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.260553 18793 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.287791 18570 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.313884 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.313768 18570 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.314522 14970 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:18.315990 18570 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.317463 18525 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:18.317993 18525 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.301919 15548 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:18.302421 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:18.320271 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.303009 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.321375 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.304088 18645 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:18.306097 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:18.323025 15545 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:18.325157 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:18.328039 14967 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:18.330854 18800 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:18.300619 18796 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:18.336741 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:18.337809 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:18.343308 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:18.331175 18795 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:18.288357 18677 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:18.349491 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:18.349467 18804 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:06:18.339798 18685 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.383728 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.384410 14891 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:18.345240 18795 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:18.349965 18556 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:18.346107 18328 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:18.351946 18625 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:18.351969 18661 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 13:06:18.390564 18683 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.391101 18683 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:18.396607 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 89236.2us
I20260709 13:06:18.393108 18683 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.390173 18795 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:18.412490 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:18.395677 18328 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:18.437690 14969 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:18.353525 18677 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.443761 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:18.426956 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.414124 18683 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:18.458838 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.417228 18328 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:18.425597 18055 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:18.459726 14969 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:18.397519 18685 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.393358 18793 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.465059 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.451236 18625 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:18.467522 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59880.5us
I20260709 13:06:18.413687 18570 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:18.469501 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.464419 18055 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:18.471670 18808 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 13:06:18.466477 18805 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.478447 18819 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:18.469694 18580 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:18.479658 14967 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:18.481384 18806 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:18.481285 18580 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.481990 18806 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.478282 18805 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.483206 18818 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:18.470880 18625 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.473256 18055 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.466029 18683 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:18.514036 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 158890us
I20260709 13:06:18.515623 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:18.532967 18685 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:18.534345 18813 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:06:18.536186 18814 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:06:18.538079 18793 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:18.546356 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.547578 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.538802 18328 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.531653 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:18.551342 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:18.568171 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96709.7us
I20260709 13:06:18.618991 18794 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:18.635710 18822 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:18.569890 18821 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:18.703881 18633 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:18.632601 18463 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.707156 18463 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.709343 18463 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:18.715828 14967 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:18.717581 18568 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.716624 15036 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:06:18.842799 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 311660us
I20260709 13:06:18.848152 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.719730 18556 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:18.738425 18563 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:18.865839 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.866477 14962 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
W20260709 13:06:18.866726 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:18.843075 18328 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.819281 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.857834 18685 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.735050 18625 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.870563 18683 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.870327 18685 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.871062 18556 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.872557 18685 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.873698 18556 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.875850 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.877568 18055 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.877800 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.878925 14962 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:18.799549 18806 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.776871 18757 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.881130 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.881546 18757 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.887591 18757 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:18.888005 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:18.888279 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:18.883235 18796 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.550s	user 0.000s	sys 0.011s
I20260709 13:06:18.818185 18525 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.742434 18795 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.762356 18821 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.894989 14962 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:18.858644 18679 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.861356 18822 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:18.902513 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.904364 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.890178 15035 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:18.924144 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.949437 18679 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:18.951660 15514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.969s (SENT) [suppressed 10 similar messages]
I20260709 13:06:18.959353 14964 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:18.893865 18837 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.968710 18685 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:18.969118 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:18.969336 18685 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:18.972062 18625 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:18.951882 18679 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.973114 18837 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.974161 18795 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.974803 18832 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.975626 18685 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:18.975477 18832 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.964169 18556 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:18.976686 18556 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:18.978080 18832 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.978909 18556 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:18.979542 18556 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:18.979806 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.981287 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.913260 18055 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:18.953032 18724 consensus_meta.cc:287] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.755s	user 0.009s	sys 0.004s
I20260709 13:06:18.985108 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:18.988723 14894 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:18.990759 14888 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:18.991146 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.989504 14892 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:18.991883 14893 raft_consensus.cc:2368] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:18.996570 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:18.997145 14886 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:19.001441 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:18.992125 18556 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.003837 14967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:19.004498 14967 raft_consensus.cc:606] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:19.004823 14889 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:06:18.899097 18796 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.040459 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:19.048203 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.048935 14968 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.049727 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.053197 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.061956 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.062839 14893 raft_consensus.cc:2368] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:19.073661 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:19.080585 14888 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:19.018378 18055 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:19.084801 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:19.090529 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.097968 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.098556 14967 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:19.092094 18055 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.100458 18055 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.101284 14933 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.102486 18788 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:19.102572 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.102912 18663 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.103257 14970 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:19.092043 18556 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.091372 18555 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.104208 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.104385 18663 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.105343 18555 raft_consensus.cc:993] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:19.105803 18555 raft_consensus.cc:1081] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:19.105965 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:18.998307 18724 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.114600 14968 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:19.118122 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:19.072497 18786 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:19.121771 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:19.090509 18525 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:18.991859 18822 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.107908 18120 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:19.132627 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:19.133987 14962 raft_consensus.cc:606] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:19.134434 14962 raft_consensus.cc:614] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:19.137962 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 186488us
I20260709 13:06:19.142084 14933 leader_election.cc:400] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:19.124847 18801 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:19.123795 18786 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.103127 18788 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.131902 18556 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:19.143721 18818 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48910 (request call id 1) took 2125 ms. Trace:
I20260709 13:06:19.149176 18801 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.129575 18525 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.148886 18786 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:19.172040 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:19.149758 18509 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:19.147483 18795 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:06:19.185324 18796 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.192530 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:19.167129 18120 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:19.195566 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50419.1us
I20260709 13:06:19.197018 14933 leader_election.cc:400] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:19.185365 18580 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.197356 14933 leader_election.cc:403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:19.188777 18801 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.201843 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.202137 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.202673 14968 raft_consensus.cc:2376] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13. Re-sending same reply.
I20260709 13:06:19.203070 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.187752 18794 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:19.204252 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.206012 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.192345 18650 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:19.208030 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.208056 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.208631 14961 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:19.208863 14969 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:19.209683 18824 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.189908 18509 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:19.210193 18509 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.211042 15514 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.199687 18555 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.211858 18796 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.212003 18724 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.213641 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:19.214416 18724 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:19.214952 18724 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:19.197492 18825 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:06:19.215952 18724 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.220419 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:19.180635 18818 rpcz_store.cc:276] 0709 13:06:17.015202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:17.015518 (+   316us) service_pool.cc:224] Handling call
0709 13:06:17.047974 (+ 32456us) log.cc:844] Serialized 494 byte log entry
0709 13:06:17.185732 (+137758us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18003ed220. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:06:19.138613 (+1952881us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32,"raft.queue_time_us":614,"raft.run_cpu_time_us":1301,"raft.run_wall_time_us":32447,"spinlock_wait_cycles":2834816,"thread_start_us":53706,"threads_started":1,"wal-append.queue_time_us":340382,"wal-append.run_cpu_time_us":11261,"wal-append.run_wall_time_us":1297971}
I20260709 13:06:19.223009 18803 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.195957 18793 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:06:19.221212 18788 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.202673 14966 raft_consensus.cc:2376] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9. Re-sending same reply.
I20260709 13:06:19.196650 18819 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:19.228505 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59694.8us
I20260709 13:06:19.229808 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.230381 14965 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.172839 18556 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.227183 14888 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:06:19.238250 14888 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:19.238668 14888 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.231670 18580 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:19.234261 18120 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.236692 18837 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.200428 18821 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.228220 18794 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.246956 18556 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.242455 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.247706 18580 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.258186 18555 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:19.266580 14965 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:19.265146 14888 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:19.270507 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50179.5us
I20260709 13:06:19.276064 14890 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:19.282172 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:19.282867 15545 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.289861 15545 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:19.291882 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.292639 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.293180 15547 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:19.294641 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.296324 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.296900 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.298271 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.299206 18794 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.301211 18786 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.304077 18580 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.304558 18805 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.306820 18509 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.308848 18509 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.310225 18786 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.314347 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.313359 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:19.323874 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.324466 14965 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:19.325655 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.326732 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.326789 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.327276 14890 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:06:19.313038 18833 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.394s	user 0.002s	sys 0.002s
I20260709 13:06:19.332134 14888 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.332485 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66e4432ba29a43668db5483ebef3b522 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:06:19.331722 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.337249 14965 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:19.339268 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:19.310933 18801 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.340590 18828 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.341969 18801 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.342775 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:19.343557 18828 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:19.343559 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.344220 18828 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:19.345077 18828 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.349522 14890 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:19.350152 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:19.351750 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.334127 18794 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.356168 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:19.361297 18803 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:19.361920 18803 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:19.362869 18803 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.364267 15542 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:19.333034 18055 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.359974 14966 raft_consensus.cc:2955] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 6 to 9, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:19.355561 18556 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:19.358726 18819 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.368206 18580 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 13:06:19.354507 18835 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:06:19.391242 18556 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:19.409564 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:19.396580 18819 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:19.402704 18684 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.011s
I20260709 13:06:19.463065 14891 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:19.401890 18835 consensus_queue.cc:1243] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 13.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:06:19.500098 18625 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:19.459200 18684 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.011s	sys 0.011s
I20260709 13:06:19.516175 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.407146 18055 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.406267 18556 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.527256 18832 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:19.514859 18625 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.546104 18801 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.546800 18801 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.536860 18832 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.582779 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.593895 18801 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:19.601022 18830 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.682s	user 0.007s	sys 0.000s
I20260709 13:06:19.602309 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2597) took 1051 ms. Trace:
I20260709 13:06:19.602708 15044 rpcz_store.cc:276] 0709 13:06:18.550628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.550737 (+   109us) service_pool.cc:224] Handling call
0709 13:06:18.551004 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:18.555675 (+  4671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:18.555707 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:18.556158 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:06:18.917682 (+361524us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:18.917741 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:18.917805 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:19.600439 (+682634us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:19.601984 (+  1545us) raft_consensus.cc:1685] finished
0709 13:06:19.602012 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:19.602222 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3296,"raft.queue_time_us":15701,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":12051,"spinlock_wait_cycles":5609216,"thread_start_us":361147,"threads_started":1,"wal-append.queue_time_us":361991}
I20260709 13:06:19.609031 18525 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.611589 18677 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.617274 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.619339 18731 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:19.740523 18731 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:19.747539 18786 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.743779 18463 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:19.745786 18597 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.756361 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.756850 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.744801 18563 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.757866 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.758423 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.754124 18570 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:19.761282 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.762492 15545 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:06:19.762945 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.763695 15043 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:19.757169 18801 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.768731 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.758822 18463 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.772183 15037 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:19.754767 18786 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.773854 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.774550 14894 raft_consensus.cc:2410] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:19.755674 18731 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.777501 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.777523 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.763285 18570 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.759668 18597 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.773768 18801 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.781751 18731 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.783252 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.783627 15044 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:19.784219 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.784693 18801 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.784878 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.783138 18786 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.792052 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.775916 18463 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.785692 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.785113 18597 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.786087 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.793990 14888 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:19.794755 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.795357 15038 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:19.796828 15040 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.797863 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:19.798406 15038 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.803290 18525 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:19.803812 18525 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.805822 18525 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.806874 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.767264 18563 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.808238 15545 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.820623 18563 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.820869 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.821198 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.830076 15043 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.830286 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.783674 18570 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.831557 18731 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:19.832779 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.833992 18731 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:19.835619 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.836674 18731 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:19.840672 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.843950 18803 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:19.844473 18803 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.846207 18509 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.846500 18803 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.846745 18509 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:19.848390 18862 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.330s	user 0.004s	sys 0.005s
W20260709 13:06:19.849476 18866 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.323s	user 0.000s	sys 0.013s
I20260709 13:06:19.860023 15038 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:19.864804 18509 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:19.866799 18625 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.867903 18832 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.870599 18837 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:19.871587 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:19.874145 18597 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.874524 18597 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.874881 18597 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:19.878855 18837 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:19.879784 18837 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.880785 18837 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.887550 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:19.888206 15547 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.888363 18817 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.888862 18817 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.890793 18817 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:19.892899 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.896490 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:19.897238 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 394081us
I20260709 13:06:19.901206 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.902004 18438 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:19.902694 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.904018 18663 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:19.903578 18827 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 13:06:19.905104 18819 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:19.905403 18663 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:19.907569 18663 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:19.920244 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 47579.5us
W20260709 13:06:19.928071 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 87469.7us
I20260709 13:06:19.929004 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.930186 18832 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:19.931910 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:19.933023 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:19.934003 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.941286 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:19.947032 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:19.946537 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:19.937192 18837 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:19.938907 18832 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:19.932956 18563 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.956816 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:19.959138 15040 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:19.970294 15044 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:19.941481 18731 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:19.967804 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:19.961905 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.974532 15043 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:19.938747 18625 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:06:19.949411 18580 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:19.978039 15541 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:19.979606 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:19.982429 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.983081 14967 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.952699 18821 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:19.984135 15547 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:19.984455 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.984815 15543 raft_consensus.cc:2368] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:19.985922 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.987274 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.987920 14964 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:19.988174 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.948052 18805 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:06:19.981861 18580 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:19.989733 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:19.972831 18832 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.978159 18822 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:19.994503 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:19.993407 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:20.002257 15543 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:19.985634 18821 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:19.976068 18563 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:19.994794 18633 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:20.015213 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:19.995353 18580 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:19.996322 18832 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:20.020349 14967 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
W20260709 13:06:20.021018 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46160.5us
I20260709 13:06:20.030486 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.033275 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:20.035632 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 89187.3us
I20260709 13:06:20.008877 18821 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:20.038956 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:20.039729 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.036531 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:20.040832 14968 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:20.040943 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58950.2us
I20260709 13:06:20.043051 14966 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:20.043969 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.044328 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:20.045313 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:20.046437 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.047094 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.048820 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:20.049659 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.051726 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:20.052752 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.054200 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.052341 15036 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:20.057013 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.029970 18633 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.058344 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.517552 18563 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:20.033193 18877 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.069741 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.060779 14965 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:20.060276 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.059423 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:20.108418 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:20.337669 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:20.145855 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 87275.4us
I20260709 13:06:20.312899 14964 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:20.377825 14962 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:20.343761 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.067775 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:20.069514 18798 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:20.528971 18798 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.530310 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.530925 18798 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:20.057370 18834 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:20.531795 18834 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.532192 18650 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:20.510370 18784 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:20.534139 18834 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:20.047856 18837 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:20.534181 18784 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:20.536489 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 468879us
I20260709 13:06:20.537343 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:20.538556 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:20.539521 18816 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:20.539767 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.540273 18816 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:20.540901 18816 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:20.541939 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:20.542523 18821 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.543008 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:20.543723 18806 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.544343 18806 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:20.544654 18806 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:20.545034 18806 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:20.545081 14935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.006s	sys 0.008s
W20260709 13:06:20.545569 14935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.007s	sys 0.008s
W20260709 13:06:20.321579 18878 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260709 13:06:20.135915 18850 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:20.547900 18850 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.549932 18850 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:20.572973 14966 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:20.588040 14964 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:20.187959 18876 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 13:06:20.338851 18864 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.812s	user 0.004s	sys 0.012s
I20260709 13:06:20.590103 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.108418 18463 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:20.526729 18883 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:20.619390 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.555821 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.618988 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.623286 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.582831 18837 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:20.536499 18784 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:20.584544 18798 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:20.629194 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.629460 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:20.620503 18834 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.629701 18837 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.630515 18834 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.635036 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:20.110620 18597 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.606299 18509 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:20.616205 18821 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:20.661449 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:20.665668 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 140868us
I20260709 13:06:20.666857 18731 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:20.667853 18731 consensus_queue.cc:1243] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:20.668614 18556 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:20.669118 18556 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:20.671608 18556 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.673053 18556 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:20.638301 18850 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.681406 15042 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:20.682298 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:20.685889 14970 raft_consensus.cc:606] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:20.693439 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.626060 18463 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.673362 18877 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:20.634579 18883 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:20.704994 15545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.021s	sys 0.030s
W20260709 13:06:20.708949 15545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.022s	sys 0.030s
I20260709 13:06:20.654076 18509 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.651824 18798 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.701275 18563 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.726955 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.712582 18834 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:20.741425 18509 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:20.743789 18580 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.707s	user 0.004s	sys 0.006s
I20260709 13:06:20.751945 18633 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:20.753649 18883 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:20.754776 18580 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.755903 18806 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.756829 18580 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:20.763025 18832 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.727s	user 0.006s	sys 0.001s
I20260709 13:06:20.764276 18597 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:20.708685 18877 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.770174 18877 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:20.774878 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
W20260709 13:06:20.775713 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.775769 14970 raft_consensus.cc:606] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:20.776481 14970 raft_consensus.cc:614] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:20.776844 14893 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:06:20.779343 18463 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:20.796588 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:20.797433 14970 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:20.797814 14970 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:20.798228 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.799496 14969 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:20.800288 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.800602 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:20.802055 14962 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:20.798697 14970 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:20.835605 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 308491us
W20260709 13:06:20.840117 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 203720us
W20260709 13:06:20.841490 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:20.842595 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:20.817561 18806 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:20.852025 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 217489us
I20260709 13:06:20.837072 18580 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:20.875562 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 205217us
I20260709 13:06:20.895589 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.853031 18563 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:20.899811 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.825186 18832 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:20.904331 14887 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:06:20.906296 14887 pending_rounds.cc:85] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 11
I20260709 13:06:20.906330 14888 raft_consensus.cc:2368] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
W20260709 13:06:20.911499 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49283.8us
I20260709 13:06:20.906766 14887 pending_rounds.cc:107] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:06:20.914906 14887 raft_consensus.cc:2889] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:20.853816 18889 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:06:20.923435 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 222363us
I20260709 13:06:20.923568 14891 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:20.928279 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:20.928908 15043 raft_consensus.cc:606] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:20.929355 15043 raft_consensus.cc:614] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:20.896492 18580 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.939996 14968 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:20.941243 18580 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:20.931814 18835 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:20.943868 18835 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:20.916240 18663 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:06:20.945341 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89638.8us
I20260709 13:06:20.948204 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:20.951169 18889 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:20.955770 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2873) took 1013 ms. Trace:
I20260709 13:06:20.956161 14893 rpcz_store.cc:276] 0709 13:06:19.942501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.943080 (+   579us) service_pool.cc:224] Handling call
0709 13:06:19.949519 (+  6439us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:20.777368 (+827849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:20.955567 (+178199us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54003d59d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:20.955723 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1902530816}
W20260709 13:06:20.956650 18891 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:06:20.957899 18887 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 13:06:20.959018 14890 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:20.960126 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.960662 15042 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:06:20.965015 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:20.983543 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46403.3us
I20260709 13:06:20.967233 18597 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:20.963130 18883 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:20.983986 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 282) took 6704 ms. Trace:
I20260709 13:06:20.986891 18883 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:20.994454 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.990720 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:20.996948 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:20.990715 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:20.994323 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:20.998879 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58841us
I20260709 13:06:21.016234 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:21.017083 15036 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.018397 15038 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:21.021839 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.026193 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:20.985293 18734 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.988334 18684 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:20.944970 18835 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:21.014643 15010 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 599606a370ab4d629b9cac083be835da. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:21.031713 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 48612.8us
I20260709 13:06:21.031890 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:21.032001 15550 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:21.033459 18055 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:21.033926 18055 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.034636 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:20.988629 14792 rpcz_store.cc:276] 0709 13:06:14.268602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:14.268788 (+   186us) service_pool.cc:224] Handling call
0709 13:06:20.973137 (+6704349us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:18.375187 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:18.530931 (+155744us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:18.557307 (+ 26376us) write_op.cc:435] Acquired schema lock
0709 13:06:18.561116 (+  3809us) tablet.cc:662] Decoding operations
0709 13:06:18.728304 (+167188us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:18.728410 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:18.728457 (+    47us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:06:18.730552 (+  2095us) tablet.cc:701] Row locks acquired
0709 13:06:18.730609 (+    57us) write_op.cc:260] PREPARE: finished
0709 13:06:18.730827 (+   218us) write_op.cc:270] Start()
0709 13:06:18.731008 (+   181us) write_op.cc:276] Timestamp: P: 1783602378730740 usec, L: 0
0709 13:06:18.731041 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:06:18.794864 (+ 63823us) log.cc:844] Serialized 8228 byte log entry
0709 13:06:19.357220 (+562356us) op_driver.cc:464] REPLICATION: finished
0709 13:06:19.559875 (+202655us) write_op.cc:301] APPLY: starting
0709 13:06:19.559980 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:19.566504 (+  6524us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:19.566680 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:19.578125 (+ 11445us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:19.590784 (+ 12659us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:06:19.591713 (+   929us) write_op.cc:312] APPLY: finished
0709 13:06:19.598569 (+  6856us) log.cc:844] Serialized 145 byte log entry
0709 13:06:19.600332 (+  1763us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.600637 (+   305us) write_op.cc:454] Released schema lock
0709 13:06:19.600763 (+   126us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:19.601239 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:19.601259 (+    20us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":121106,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":198841,"apply.run_cpu_time_us":6677,"apply.run_wall_time_us":41343,"num_ops":21,"prepare.queue_time_us":104093,"prepare.run_cpu_time_us":40661,"prepare.run_wall_time_us":658189,"raft.queue_time_us":93968,"raft.run_cpu_time_us":10739,"raft.run_wall_time_us":187489,"replication_time_us":602590,"thread_start_us":450494,"threads_started":4,"wal-append.queue_time_us":334818,"wal-append.run_cpu_time_us":60653,"wal-append.run_wall_time_us":1477818}]]}
I20260709 13:06:21.036550 14791 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 5 to 8, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 8 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:21.038359 18798 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:21.038604 18818 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:20.987783 18563 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:06:21.039520 18898 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:21.040014 18898 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:21.040342 18684 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:21.040835 18898 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.041149 18684 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.042129 18684 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.042994 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:21.043816 14887 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:21.047370 15513 leader_election.cc:400] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:21.047698 15513 leader_election.cc:403] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:06:21.015494 18881 consensus_queue.cc:1175] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260709 13:06:21.049773 18901 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:21.023650 18905 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:06:21.052862 18905 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:21.029933 18828 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:06:21.053361 18905 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:21.055346 14966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:21.055915 18835 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.056241 18832 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.055924 14966 raft_consensus.cc:606] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:21.060371 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.062674 14891 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:21.065696 14889 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:06:21.066157 14889 pending_rounds.cc:85] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 9
I20260709 13:06:21.066438 14889 pending_rounds.cc:107] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:06:21.066715 14889 raft_consensus.cc:2889] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:21.066839 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:21.068771 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.070521 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:21.071203 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 217180us
I20260709 13:06:21.072192 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:21.073323 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.074498 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.075702 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.077513 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:21.070474 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:21.081723 14970 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.079172 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.079833 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 2871) took 1155 ms. Trace:
I20260709 13:06:21.084681 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:21.082240 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:21.088181 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:21.090109 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.093003 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.070394 18650 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:21.084052 14894 rpcz_store.cc:276] 0709 13:06:19.913526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:19.913636 (+   110us) service_pool.cc:224] Handling call
0709 13:06:20.732286 (+818650us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:06:20.732480 (+   194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:20.732661 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:20.922879 (+190218us) log.cc:844] Serialized 14 byte log entry
0709 13:06:21.068157 (+145278us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:21.068200 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:21.068237 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:21.068295 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:21.068387 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":179318,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":873,"raft.queue_time_us":103,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":11961,"spinlock_wait_cycles":6215552,"thread_start_us":327585,"threads_started":2}
I20260709 13:06:21.069849 18805 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:06:21.100772 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.082469 18850 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:21.078208 18509 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:21.109849 18055 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:21.082594 18798 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.110212 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:21.065214 18815 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:06:21.099128 18120 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.078493 18828 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:06:21.054534 18905 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:21.163980 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61980.7us
I20260709 13:06:21.122359 15043 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:21.102125 18625 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.107702 18597 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:21.117098 18837 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.087826 18787 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:06:21.172113 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.179167 14895 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:21.173465 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.171535 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.186411 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.187793 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.188625 18055 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:21.189379 18055 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.189996 18055 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.152099 18898 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:21.131011 18850 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:21.192608 18905 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:21.250687 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 154792us
I20260709 13:06:21.253476 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:21.257481 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.259114 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:21.261188 14970 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:21.199113 18806 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 13:06:21.265045 18463 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:21.292892 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 109690us
W20260709 13:06:21.297645 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 178462us
I20260709 13:06:21.297178 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.294965 18883 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:21.331075 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.337253 15036 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:21.339916 15041 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: [11.8-12.9]
I20260709 13:06:21.341667 18677 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.342145 18650 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:06:21.355170 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 254534us
I20260709 13:06:21.363674 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.355794 18563 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.364604 18920 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.365993 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.368251 18920 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.368562 18633 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:21.368981 18633 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:21.369746 18633 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.372407 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.299150 18463 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:21.356736 18902 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:06:21.387763 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.389426 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.389727 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:21.390264 18924 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:21.390504 18883 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.390668 18832 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:21.391377 18832 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:21.300181 18850 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.396447 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.386780 18625 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.394251 18832 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.408409 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.410696 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.421484 14895 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:06:21.443955 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 190600us
W20260709 13:06:21.454602 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 155144us
I20260709 13:06:21.458531 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:21.413389 18918 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.457046 18570 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:06:21.472998 18784 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:21.429379 18818 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:21.447183 18910 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:21.482432 18570 consensus_queue.cc:1243] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:06:21.486725 18818 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.486218 18910 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.482800 18918 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.556166 18918 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.485100 18677 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:21.556974 18677 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.558434 18633 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.533134 18921 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.559728 18921 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.562377 18921 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.533798 18881 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.563196 18881 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.565603 18881 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:21.573181 18895 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.408s	user 0.004s	sys 0.011s
I20260709 13:06:21.574352 18906 raft_consensus.cc:993] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:21.574995 18906 raft_consensus.cc:1081] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
W20260709 13:06:21.533532 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55332.9us
I20260709 13:06:21.534652 18925 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.575850 18925 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.578065 18925 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:21.457119 18889 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.545022 18910 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:21.585661 18663 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:21.586274 18663 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.588688 18663 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.588888 18877 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:21.589432 18877 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:21.590428 18877 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:21.592208 18903 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
I20260709 13:06:21.592490 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.594008 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.595785 18884 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.596330 18884 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.598316 18884 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:21.601043 18835 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
I20260709 13:06:21.602465 14893 raft_consensus.cc:1217] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 7.8->[9.9-13.11]   Dedup: 9.9->[11.10-13.11]
I20260709 13:06:21.603078 14893 pending_rounds.cc:85] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 9
I20260709 13:06:21.604512 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.547466 18818 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:21.552011 18463 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:21.558522 18597 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:21.609601 18597 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.526269 15042 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:21.612816 18597 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:21.613488 14895 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:06:21.613610 18556 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:21.614085 14895 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:21.614420 14895 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.614486 18877 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.603355 14893 pending_rounds.cc:107] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:06:21.618724 14893 raft_consensus.cc:2889] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:21.621196 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.625134 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:21.631065 18684 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.588s	user 0.011s	sys 0.000s
W20260709 13:06:21.656106 18901 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
W20260709 13:06:21.692400 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 231048us
I20260709 13:06:21.698050 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.699343 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.699370 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.699996 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.559391 18677 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:21.699708 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.707329 18806 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.708088 18806 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.711771 18806 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.712376 18806 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:21.712966 18806 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.720881 18806 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.733970 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.734593 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.735388 14962 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:21.734655 14967 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:21.738780 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:06:21.747824 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 376723us
I20260709 13:06:21.750154 18901 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:44380 (request call id 14) took 3038 ms. Trace:
I20260709 13:06:21.750669 18901 rpcz_store.cc:276] 0709 13:06:18.711942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.713915 (+  1973us) service_pool.cc:224] Handling call
0709 13:06:19.249253 (+535338us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367ea0a 00007f553367e693 00007f553367e631 00007f5534db13f1 00007f5534cea9fe 00007f5534d71749 00007f5534d7276a 00007f5534d7191b 00007f5534d7d03c 00007f5534d7c6b3
0709 13:06:19.906851 (+657598us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4c00472980. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5533042a20 00007f5533053a29 00007f5533019644 00007f5533040f2d 00007f5533040b93 00007f5534ccf1af 00007f5534ccef3e 00007f5534d54888 00007f5534d7175c 00007f5534d7276a 00007f5534d7191b
0709 13:06:19.907495 (+   644us) log.cc:844] Serialized 499 byte log entry
0709 13:06:21.750054 (+1842559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18928,"raft.queue_time_us":12178,"raft.run_cpu_time_us":955,"raft.run_wall_time_us":65132,"spinlock_wait_cycles":190796544,"thread_start_us":52009,"threads_started":1,"wal-append.queue_time_us":94841}
I20260709 13:06:21.753155 18937 ts_tablet_manager.cc:933] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.760397 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.761971 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.762188 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.764160 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.764958 14888 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:21.769829 18806 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.770470 18806 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:21.772243 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 296062us
I20260709 13:06:21.773242 18806 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.774823 18935 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:21.775285 18935 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:21.775837 18935 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:21.777694 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.780454 18944 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.779126 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.781920 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:21.782833 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.783612 18943 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.784317 18943 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.785063 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.633059 14895 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.801501 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.804243 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.805015 15042 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:21.805106 14895 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.800871 18556 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:21.806874 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.816568 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:21.817117 15036 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:21.823527 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:21.825896 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.841334 18818 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:21.851490 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 406734us
I20260709 13:06:21.852243 14936 leader_election.cc:400] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:21.853029 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.855835 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.853829 15036 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
W20260709 13:06:21.862957 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.864308 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.865120 14966 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:21.866640 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:21.867827 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:21.869700 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.873943 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:21.875976 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45251.5us
I20260709 13:06:21.878456 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.879199 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.880213 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.880962 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.883390 18832 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:21.876633 18889 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:06:21.884721 18884 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:21.887307 18625 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:21.887825 18625 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.854559 18898 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:21.890535 18625 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:21.872893 18905 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.891170 18832 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:21.892135 18832 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:21.879360 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.898891 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:21.898980 14966 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:21.904179 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.905205 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.826889 18935 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.907001 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.914940 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.915752 14963 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:21.912405 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:21.917028 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:21.917151 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:21.917846 14961 raft_consensus.cc:2410] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:06:21.916302 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.899822 18877 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.900038 18937 tablet_copy_client.cc:323] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:06:21.911805 18650 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:21.920899 18905 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:21.927606 18784 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:21.939356 18784 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:21.940524 18784 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.942067 18784 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:21.928323 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:21.933758 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:21.943748 14969 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:21.943997 18850 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:21.944392 18850 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:21.944787 18850 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:21.944924 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.945004 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:21.946008 18625 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:21.935725 15542 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:21.948267 15036 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:21.949560 18798 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.954264 18650 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:21.954512 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:21.955286 18916 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:21.955847 18916 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:21.959070 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.960337 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:21.961109 18798 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:21.961467 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:21.937497 18935 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:21.962154 18597 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:21.968552 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51541.1us
W20260709 13:06:21.968784 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 61879us
I20260709 13:06:21.970324 14895 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:21.972872 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:21.973824 14966 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:21.974609 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:21.978381 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:21.978978 14966 raft_consensus.cc:2376] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9. Re-sending same reply.
W20260709 13:06:22.011124 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 81598.8us
I20260709 13:06:22.013911 18633 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:06:22.014199 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44645.3us
I20260709 13:06:22.015653 18633 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:22.016004 18633 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:22.016142 14961 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:22.016701 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:22.016765 18633 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.017347 14963 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:22.017755 14963 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:22.018047 18633 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.018436 14963 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.019532 14963 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:22.021780 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:22.023005 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:22.023131 18901 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.023223 18798 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:22.024220 18900 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:22.024622 18900 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:22.028905 14963 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:22.032259 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:21.975670 18944 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:21.977223 18120 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:22.036753 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:22.040011 15041 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:21.975848 18920 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:06:22.042218 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:22.043445 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:22.045617 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.043344 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.011129 18597 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:22.044924 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.045665 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.050596 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.051318 18120 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:22.025449 18900 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:22.055985 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.058053 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.070752 18731 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.071497 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.073377 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.073764 18920 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.074468 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:22.080191 18900 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.080605 18684 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:22.080632 18556 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.081003 18850 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.117266 15039 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:22.084967 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:22.081197 18916 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:22.080205 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.093415 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 599606a370ab4d629b9cac083be835da from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:06:22.104557 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.075317 18120 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.059588 18889 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.059330 18597 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:22.148075 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43599.8us
W20260709 13:06:22.150066 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 69948.5us
I20260709 13:06:22.152050 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:22.146807 18597 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.059372 18821 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:22.146834 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 599606a370ab4d629b9cac083be835da from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-599606a370ab4d629b9cac083be835da
I20260709 13:06:22.114972 18684 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:22.118297 18850 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:22.184506 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.151229 18633 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:22.150800 18625 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.208439 18821 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.209090 18821 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.150893 18916 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 13:06:22.214524 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.185094 18684 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:22.151099 18889 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.211253 18821 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:22.245307 15054 tablet_copy_source_session.cc:215] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:22.198263 18835 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 13:06:22.267092 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 81416us
I20260709 13:06:22.271432 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:22.275722 14889 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:22.278357 14895 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:22.283898 18889 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:22.285642 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:22.286334 14891 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:22.292531 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:22.292690 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599606a370ab4d629b9cac083be835da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:22.299099 18684 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:22.299991 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 115635us
I20260709 13:06:22.300695 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.301452 18684 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:22.302150 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.302785 18784 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:22.302871 18898 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:22.303478 18784 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.303944 18784 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.304350 14969 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:22.305898 18784 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:22.305742 14962 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Committing config change with OpId 5.5: config changed from index -1 to 5, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:22.305897 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:22.309993 18936 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.311587 18964 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:22.318037 18901 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:22.302940 18905 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:22.327678 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:22.328802 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.331378 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:22.333315 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.339776 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:22.340569 14969 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:06:22.340932 14969 pending_rounds.cc:85] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 8
I20260709 13:06:22.341156 14969 pending_rounds.cc:107] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:06:22.341384 14969 raft_consensus.cc:2889] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:22.343173 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.351329 18832 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:22.351869 18832 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:22.352720 18832 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.355544 15036 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:22.355566 18905 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:22.360541 14961 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:22.379539 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:22.380307 15039 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:22.398818 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:22.401104 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:22.403321 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:22.373972 18784 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:22.409757 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.408313 18889 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.413743 18889 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:22.416335 18889 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:22.420840 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:22.421281 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:22.421998 15036 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:22.419981 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:22.423197 14889 raft_consensus.cc:2410] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:22.425938 15544 raft_consensus.cc:2410] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:22.407806 18818 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:22.430245 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:22.435324 18877 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:22.435952 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.437152 18898 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:22.445946 18832 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:22.453824 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.455224 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:22.461841 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:22.461349 18967 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:22.461390 18939 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:22.462304 18818 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:22.486057 18556 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:22.486227 18964 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:22.492419 18684 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:22.478073 18821 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:06:22.522698 18877 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:22.523155 18877 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:22.502198 18964 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.510581 18818 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:22.515897 18556 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:22.538071 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76219us
I20260709 13:06:22.543565 14969 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:22.546936 18597 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.629011 15043 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:22.628533 18960 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:06:22.629917 18974 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:06:22.652194 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:22.656330 18597 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:22.652043 18970 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:06:22.660733 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:22.570393 18556 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.674844 18966 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:22.675457 18966 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:22.679031 18937 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52838 (request call id 902) took 1270 ms. Trace:
I20260709 13:06:22.685952 18877 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:22.697558 18973 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.198s	user 0.009s	sys 0.004s
I20260709 13:06:22.714260 14970 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:22.730613 18877 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:22.689082 18937 rpcz_store.cc:276] 0709 13:06:21.420789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:21.428685 (+  7896us) service_pool.cc:224] Handling call
0709 13:06:21.753617 (+324932us) ts_tablet_manager.cc:934] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
0709 13:06:22.291328 (+537711us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:22.416437 (+125109us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:22.416555 (+   118us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:22.678312 (+261757us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:22.678588 (+   276us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:22.678889 (+   301us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:22.678942 (+    53us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":366,"tablet-copy.queue_time_us":323813,"thread_start_us":448268,"threads_started":2}
I20260709 13:06:22.732790 18937 tablet_copy_client.cc:806] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:22.733392 18937 tablet_copy_client.cc:670] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:22.841738 18969 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:22.847779 18969 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:22.855580 18969 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:22.857218 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:22.857981 15544 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:22.859447 18966 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:22.910243 18964 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:23.092026 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:23.116784 14895 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:06:23.213927 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 664399us
I20260709 13:06:23.220358 18684 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.269873 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.270637 15036 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:23.271791 15042 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:23.273183 15043 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:06:23.278796 18936 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:23.279331 18936 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.281292 18936 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:23.291044 18946 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.295775 18946 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:23.297564 14962 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:23.301820 18784 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.302282 18784 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.303246 14961 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:23.303503 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:23.305007 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.309196 14961 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:23.311761 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.313284 14964 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:23.315171 18784 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.311761 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.316244 14966 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:23.320364 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.320896 14968 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:23.322659 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:23.323244 15542 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:23.326671 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:23.328202 18975 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:23.328635 18975 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:23.328981 18975 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.297647 18946 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:23.337472 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.338124 15039 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:23.338744 14962 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:23.341367 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.342002 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:23.343743 18821 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.345194 18731 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.345695 18731 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:23.348287 18731 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:23.351432 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 72776.4us
I20260709 13:06:23.354221 18893 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:23.354796 18975 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.356815 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:23.369093 18946 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:23.369536 18946 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.369766 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:23.369946 18946 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:23.370121 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.370833 14970 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:23.372732 18884 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:23.375523 14968 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:23.357522 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.364265 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:23.378146 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:23.381987 14891 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:23.382249 18556 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.383271 18684 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:23.383636 18684 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:23.384435 18684 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:23.385670 18684 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:23.387724 18556 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:23.388859 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:23.389748 18975 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.390431 18556 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.391680 18943 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:23.404244 18877 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:23.404618 18877 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.404934 18877 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.410193 18946 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:23.413170 14791 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 170) took 39294 ms (client timeout 15000 ms). Trace:
I20260709 13:06:23.413448 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:23.414641 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.432125 15036 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:23.417513 18556 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.421274 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:23.433342 15542 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:23.418337 18877 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.445639 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.448521 15036 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:23.459586 18784 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.469347 14962 raft_consensus.cc:2368] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12.
W20260709 13:06:23.433545 14791 rpcz_store.cc:269] 0709 13:05:44.223521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:44.284746 (+ 61225us) service_pool.cc:224] Handling call
0709 13:06:23.413072 (+39128326us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:21.271291 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:21.345490 (+ 74199us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:21.345538 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:06:21.345564 (+    26us) tablet.cc:662] Decoding operations
0709 13:06:21.345988 (+   424us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:21.346067 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:21.346105 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:21.346332 (+   227us) tablet.cc:701] Row locks acquired
0709 13:06:21.346359 (+    27us) write_op.cc:260] PREPARE: finished
0709 13:06:21.346538 (+   179us) write_op.cc:270] Start()
0709 13:06:21.346674 (+   136us) write_op.cc:276] Timestamp: P: 1783602381346478 usec, L: 0
0709 13:06:21.346704 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:06:21.347542 (+   838us) log.cc:844] Serialized 533 byte log entry
0709 13:06:22.095938 (+748396us) op_driver.cc:464] REPLICATION: finished
0709 13:06:22.284865 (+188927us) write_op.cc:301] APPLY: starting
0709 13:06:22.288249 (+  3384us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:22.288346 (+    97us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:22.288467 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:22.288662 (+   195us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:22.288832 (+   170us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:22.288875 (+    43us) write_op.cc:312] APPLY: finished
0709 13:06:22.290488 (+  1613us) log.cc:844] Serialized 23 byte log entry
0709 13:06:22.290633 (+   145us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:22.290706 (+    73us) write_op.cc:454] Released schema lock
0709 13:06:22.290743 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:22.291072 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:22.291102 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1778439,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":177015,"apply.run_cpu_time_us":1695,"apply.run_wall_time_us":14925,"num_ops":1,"prepare.queue_time_us":202120,"prepare.run_cpu_time_us":199478,"prepare.run_wall_time_us":549634,"raft.queue_time_us":200506,"raft.run_cpu_time_us":47244,"raft.run_wall_time_us":156732,"replication_time_us":749034,"thread_start_us":826760,"threads_started":4,"wal-append.queue_time_us":545852,"wal-append.run_cpu_time_us":18705,"wal-append.run_wall_time_us":1400694}]]}
I20260709 13:06:23.473417 18946 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:23.473654 18784 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.475155 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.475751 15036 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:23.478837 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:23.479475 15542 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:23.480331 14789 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 5 to 8, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.486049 14789 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 11, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.489431 15542 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:23.489260 14789 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.490564 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:23.497371 14859 leader_election.cc:400] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12.
I20260709 13:06:23.497756 14859 leader_election.cc:403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:23.507025 15036 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:23.509581 14789 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:23.499514 18946 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:23.513900 15043 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:23.504599 18731 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.529342 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:23.529703 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:23.532433 18893 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:23.533604 18850 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:23.528221 18563 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:06:23.534817 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:23.535485 18563 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:23.535869 18563 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:23.536782 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:23.536715 18563 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.538398 18969 raft_consensus.cc:2764] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:23.538825 18798 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:23.538192 18563 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.539338 18798 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.541445 18798 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:23.543071 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:23.543967 18798 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:23.544845 18784 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.546383 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:23.547170 14895 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:23.547667 18877 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.548627 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:23.550343 18898 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:23.550707 18898 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.551023 18898 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:23.550956 14789 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 5 to 8, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.561285 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.561921 15043 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:23.563591 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:23.564272 14895 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:23.564507 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.564847 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.565414 15036 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:23.565371 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100007us
I20260709 13:06:23.529518 18946 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:23.568077 18850 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:23.579829 18850 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:23.580288 18850 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.580395 18731 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12.
I20260709 13:06:23.583729 18946 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:23.585783 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
W20260709 13:06:23.587813 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 136311us
I20260709 13:06:23.587783 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:23.588943 18784 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:23.589820 18784 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:23.590786 18784 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.596705 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:23.597658 18684 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:23.598027 18684 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.600318 14889 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:23.598392 18684 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.569124 18898 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.602530 14962 raft_consensus.cc:2368] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:23.606225 15008 leader_election.cc:400] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:23.606514 15008 leader_election.cc:403] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:23.610005 18900 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:06:23.611526 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 83761.9us
I20260709 13:06:23.621186 18935 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:23.622128 18937 tablet_copy_client.cc:538] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:23.634016 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:23.634646 14889 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:23.641098 14889 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:23.642400 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:23.638664 18850 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.648861 15043 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:23.652292 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:23.660681 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:23.662426 18731 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.663209 18731 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:23.663578 18731 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:23.663368 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:23.666419 18798 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:23.670571 18900 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:06:23.671756 18850 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:23.644830 18784 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:23.674042 18784 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:23.674793 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.674844 18784 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.664685 18731 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.682123 18898 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.692525 15043 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:23.692005 18684 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:23.696060 18821 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:23.719899 18821 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:23.720553 18684 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:23.722450 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:23.723016 15542 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.723328 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:23.723913 14968 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.724723 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.725534 18821 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:23.726024 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.728300 14861 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:23.728731 18937 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:06:23.729557 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:23.716023 18731 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:23.731959 18821 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:23.731693 15542 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:23.724682 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.734534 15043 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:23.740710 15043 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:23.743134 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:23.747537 18684 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:23.747972 18684 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.748366 18821 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:23.748903 18821 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:23.750174 18684 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.751520 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.751915 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:23.752122 15043 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:23.753954 14968 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:23.753388 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:23.750728 18821 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:23.757599 18556 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:23.757874 18556 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:23.758214 18556 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:23.776391 18556 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.779472 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:23.810019 18556 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:23.789090 19006 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:06:23.816635 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:23.817198 15036 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:23.850778 15036 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:23.851987 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:23.852865 18975 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:23.853370 18975 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:23.854153 18975 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.879871 18937 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:23.880858 18937 tablet_bootstrap.cc:492] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:06:23.881583 18937 ts_tablet_manager.cc:1403] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.153s	user 0.029s	sys 0.018s
I20260709 13:06:23.892906 18937 raft_consensus.cc:359] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:23.893863 18937 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:06:23.897214 18937 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:23.899659 18937 ts_tablet_manager.cc:1434] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 13:06:23.900310 18975 raft_consensus.cc:476] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:06:23.902194 14792 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:23.914649 14792 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.916275 14792 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.917897 14792 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:23.919512 14792 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:23.927819 18784 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:23.928404 18784 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:23.930524 18784 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:23.933488 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:23.934235 15036 raft_consensus.cc:2368] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
W20260709 13:06:24.062775 14991 debug-util.cc:398] Leaking SignalData structure 0x7b0800244a20 after lost signal to thread 13795
W20260709 13:06:24.063975 14991 debug-util.cc:398] Leaking SignalData structure 0x7b080021c0e0 after lost signal to thread 14827
W20260709 13:06:24.064312 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08002eb260 after lost signal to thread 14841
W20260709 13:06:24.065346 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08000aedc0 after lost signal to thread 14919
W20260709 13:06:24.065594 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4ee0 after lost signal to thread 14920
W20260709 13:06:24.066648 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08001b5940 after lost signal to thread 14994
W20260709 13:06:24.066916 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08000c7ca0 after lost signal to thread 14995
W20260709 13:06:24.068228 14991 debug-util.cc:398] Leaking SignalData structure 0x7b0800369d60 after lost signal to thread 15068
W20260709 13:06:24.069866 14991 debug-util.cc:398] Leaking SignalData structure 0x7b080037e6a0 after lost signal to thread 15574
W20260709 13:06:24.070119 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0840 after lost signal to thread 15575
I20260709 13:06:24.071633 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-599606a370ab4d629b9cac083be835da received from {username='slave'} at 127.0.0.1:44388
I20260709 13:06:24.072147 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-599606a370ab4d629b9cac083be835da on tablet 599606a370ab4d629b9cac083be835da with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:24.099902 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:24.100895 14895 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:24.103220 18784 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:23.920780 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.131212 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:24.132680 14792 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.134334 14936 leader_election.cc:400] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:24.134639 14936 leader_election.cc:403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:24.134167 14792 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 5, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:06:24.138779 14789 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 282) took 15343 ms (client timeout 15000 ms). Trace:
I20260709 13:06:24.138684 15542 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:24.136078 18884 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:06:24.141309 14789 rpcz_store.cc:269] 0709 13:06:08.905778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:08.911545 (+  5767us) service_pool.cc:224] Handling call
0709 13:06:24.138705 (+15227160us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:23.618500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:23.620086 (+  1586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:23.620125 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:06:23.620145 (+    20us) tablet.cc:662] Decoding operations
0709 13:06:23.621005 (+   860us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:23.621104 (+    99us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:23.621144 (+    40us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:06:23.621822 (+   678us) tablet.cc:701] Row locks acquired
0709 13:06:23.621860 (+    38us) write_op.cc:260] PREPARE: finished
0709 13:06:23.622041 (+   181us) write_op.cc:270] Start()
0709 13:06:23.622179 (+   138us) write_op.cc:276] Timestamp: P: 1783602383621979 usec, L: 0
0709 13:06:23.622208 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:23.622990 (+   782us) log.cc:844] Serialized 2069 byte log entry
0709 13:06:23.789847 (+166857us) op_driver.cc:464] REPLICATION: finished
0709 13:06:23.856235 (+ 66388us) write_op.cc:301] APPLY: starting
0709 13:06:23.856294 (+    59us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:23.856398 (+   104us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:23.856481 (+    83us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:23.856944 (+   463us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:23.857104 (+   160us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:06:23.857131 (+    27us) write_op.cc:312] APPLY: finished
0709 13:06:23.857290 (+   159us) log.cc:844] Serialized 47 byte log entry
0709 13:06:23.857466 (+   176us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:23.857566 (+   100us) write_op.cc:454] Released schema lock
0709 13:06:23.857604 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:23.860460 (+  2856us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:23.860489 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1374323,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":66171,"apply.run_cpu_time_us":1702,"apply.run_wall_time_us":3821,"num_ops":5,"prepare.queue_time_us":31262,"prepare.run_cpu_time_us":16259,"prepare.run_wall_time_us":67261,"raft.queue_time_us":100130,"raft.run_cpu_time_us":19376,"raft.run_wall_time_us":70648,"replication_time_us":167490,"spinlock_wait_cycles":787328,"thread_start_us":192499,"threads_started":4,"wal-append.queue_time_us":64706}]]}
I20260709 13:06:24.136576 15036 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:24.143996 14792 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:24.151329 14792 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 3 to 13. New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.152778 14792 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.156822 18884 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10.
I20260709 13:06:24.157528 14792 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 10, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 10 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.158957 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.160130 14792 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:24.161566 14893 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:24.161412 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 13, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.162650 14792 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 5, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 5 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.166445 14792 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 7, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 7 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.168993 14792 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 11 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.170202 14792 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.171320 14792 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 6, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 6 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.172627 14792 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 6, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:24.173828 14792 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.193441 15542 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:24.209149 18556 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:24.223248 14962 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:24.236284 18784 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:24.255053 15043 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:24.259158 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 283) took 2205 ms. Trace:
I20260709 13:06:24.265887 14788 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 8 to 12, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:24.274489 14788 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 6 to 8, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.276479 14788 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 4 to 6, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 6 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.259582 14792 rpcz_store.cc:276] 0709 13:06:22.053885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.054020 (+   135us) service_pool.cc:224] Handling call
0709 13:06:22.332315 (+278295us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:06:22.382763 (+ 50448us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b54002b0110. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c52640 00007f553ab29b76 00007f553ac33c3e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:06:24.259080 (+1876317us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:24.182108 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:24.182593 (+   485us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:24.182628 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:24.182645 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:24.192368 (+  9723us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:24.192431 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:24.192458 (+    27us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:06:24.194038 (+  1580us) tablet.cc:701] Row locks acquired
0709 13:06:24.194055 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:06:24.194186 (+   131us) write_op.cc:270] Start()
0709 13:06:24.194296 (+   110us) write_op.cc:276] Timestamp: P: 1783602384194140 usec, L: 0
0709 13:06:24.194325 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.194988 (+   663us) log.cc:844] Serialized 8983 byte log entry
0709 13:06:24.197810 (+  2822us) op_driver.cc:464] REPLICATION: finished
0709 13:06:24.198218 (+   408us) write_op.cc:301] APPLY: starting
0709 13:06:24.198294 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:24.198690 (+   396us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:24.198791 (+   101us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:24.200650 (+  1859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:24.201155 (+   505us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:06:24.201198 (+    43us) write_op.cc:312] APPLY: finished
0709 13:06:24.201582 (+   384us) log.cc:844] Serialized 158 byte log entry
0709 13:06:24.201736 (+   154us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.201919 (+   183us) write_op.cc:454] Released schema lock
0709 13:06:24.201974 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:24.202277 (+   303us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.202302 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":104285,"reported_tablets":27,"spinlock_wait_cycles":342619136,"child_traces":[["op",{"apply.queue_time_us":221,"apply.run_cpu_time_us":4027,"apply.run_wall_time_us":4026,"num_ops":23,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":5016,"prepare.run_wall_time_us":13129,"replication_time_us":3354}]]}
I20260709 13:06:24.290575 15544 raft_consensus.cc:1217] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.4->[5.5-5.5]   Dedup: 5.5->[]
I20260709 13:06:24.332537 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:24.339486 15036 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:24.360213 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 288) took 5410 ms. Trace:
I20260709 13:06:24.360651 14788 rpcz_store.cc:276] 0709 13:06:18.950451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:18.955621 (+  5170us) service_pool.cc:224] Handling call
0709 13:06:19.341118 (+385497us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:06:24.289495 (+4948377us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.289522 (+    27us) write_op.cc:454] Released schema lock
0709 13:06:24.360150 (+ 70628us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:24.282952 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:24.283494 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:24.283529 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:24.283543 (+    14us) tablet.cc:662] Decoding operations
0709 13:06:24.284070 (+   527us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:24.284128 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:24.284153 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:24.284442 (+   289us) tablet.cc:701] Row locks acquired
0709 13:06:24.284456 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:06:24.284592 (+   136us) write_op.cc:270] Start()
0709 13:06:24.284701 (+   109us) write_op.cc:276] Timestamp: P: 1783602384284543 usec, L: 0
0709 13:06:24.284717 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.285269 (+   552us) log.cc:844] Serialized 1293 byte log entry
0709 13:06:24.287032 (+  1763us) op_driver.cc:464] REPLICATION: finished
0709 13:06:24.287398 (+   366us) write_op.cc:301] APPLY: starting
0709 13:06:24.287482 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:24.287601 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:24.287678 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:24.287996 (+   318us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:24.288140 (+   144us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:06:24.288184 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:24.288366 (+   182us) log.cc:844] Serialized 35 byte log entry
0709 13:06:24.288481 (+   115us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.288554 (+    73us) write_op.cc:454] Released schema lock
0709 13:06:24.288592 (+    38us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":13634,"reported_tablets":49,"spinlock_wait_cycles":50835840,"child_traces":[["op",{"apply.queue_time_us":208,"apply.run_cpu_time_us":1440,"apply.run_wall_time_us":1439,"num_ops":3,"prepare.queue_time_us":2795,"prepare.run_cpu_time_us":2574,"prepare.run_wall_time_us":2573,"replication_time_us":2211}]]}
I20260709 13:06:24.369148 18898 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:24.374871 14793 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 9 to 12, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:24.377846 18821 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:24.382010 18556 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:24.383838 18556 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:06:24.416723 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49311us
I20260709 13:06:24.417913 18784 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:24.434022 15038 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:06:24.457728 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 68216.5us
W20260709 13:06:24.542781 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 122436us
I20260709 13:06:24.831375 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:24.832041 14970 raft_consensus.cc:606] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:24.847801 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:24.848563 14970 raft_consensus.cc:606] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:24.849013 14970 raft_consensus.cc:614] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:24.858585 14970 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:06:24.859192 14970 raft_consensus.cc:606] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:24.860798 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:24.872300 19028 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:24.874603 19028 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:24.880237 19028 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:24.884595 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 313900us
I20260709 13:06:24.902743 19022 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:24.931458 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 99314.6us
W20260709 13:06:24.934651 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 448327us
I20260709 13:06:24.929179 19022 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:24.956393 19022 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:24.964087 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 504257us
W20260709 13:06:24.991662 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49930.9us
I20260709 13:06:25.009335 14970 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:06:25.066948 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52039.1us
I20260709 13:06:25.066254 14962 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:25.070777 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 134922us
W20260709 13:06:25.076469 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 59340.6us
I20260709 13:06:25.080592 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:25.019371 19034 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.103286 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:25.104075 15042 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:25.113188 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:25.109717 19034 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.137270 19034 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:25.110004 19023 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:25.138376 19023 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:25.142120 15038 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:25.170517 19031 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:25.184798 19031 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.185230 19031 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.194319 19023 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:25.228017 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 160427us
I20260709 13:06:25.251767 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:25.258402 19031 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:06:25.269881 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 169513us
I20260709 13:06:25.313005 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:25.314018 14893 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:25.319932 14895 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:25.322188 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:25.322729 15041 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.328852 18898 raft_consensus.cc:993] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:25.329432 19048 raft_consensus.cc:1081] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:25.321017 19031 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.331502 15041 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:25.333457 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:25.333635 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 249549us
I20260709 13:06:25.334956 19022 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:25.334784 18939 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:25.335464 19022 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:25.336360 19022 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:25.342305 14891 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:06:25.342908 14891 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.343309 14891 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.349469 19031 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:25.349942 19031 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.351872 19031 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:25.329741 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 258371us
I20260709 13:06:25.353580 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:25.354418 15041 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:25.356093 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:25.360837 19031 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:25.361621 14891 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.369904 14933 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:25.370247 14933 leader_election.cc:403] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.361251 19031 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.372138 19031 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:25.378515 14891 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.379390 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:25.379966 15041 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.397804 19039 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:25.399084 18731 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:25.371665 19024 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:25.403815 19024 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.406062 19024 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.407864 15041 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:25.408756 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:25.409574 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:25.410785 19056 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.070s	user 0.005s	sys 0.003s
I20260709 13:06:25.410611 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:25.410626 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 386740us
I20260709 13:06:25.419919 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:25.420572 14970 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:25.416283 18731 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:25.417084 19031 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.421896 18731 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:25.422781 18731 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.426477 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:25.426932 14895 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:25.427089 15039 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:25.412569 19028 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:25.435588 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:25.436298 15041 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:25.437054 18943 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:25.437598 18943 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:25.438521 19023 raft_consensus.cc:993] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:25.438964 19023 raft_consensus.cc:1081] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:06:25.439760 18943 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:25.441013 14893 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:06:25.415827 19048 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:25.441655 14893 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:25.444308 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:25.444618 14893 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:25.447077 15038 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:25.447513 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:25.428179 19031 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.455663 14936 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:06:25.446903 19048 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.466014 19048 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.432355 19028 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:25.466533 19053 raft_consensus.cc:1064] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:06:25.466719 19028 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:25.469249 19053 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 3, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:25.478500 14893 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.480708 14893 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.484117 19020 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:25.487171 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:25.488569 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:25.488734 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:25.488806 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:25.489171 14967 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:25.489604 14970 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:25.493775 19047 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:25.494175 19047 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:25.494316 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:25.494546 19047 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.496977 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:25.498888 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:25.502681 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:25.503844 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:25.504317 14969 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:25.504576 14969 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:25.505290 14969 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.506457 14969 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:25.509145 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:25.509687 15036 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:25.516094 15036 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:25.518361 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:25.520079 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:25.520586 14961 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:25.533170 19031 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:25.533752 19031 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:25.534577 19031 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.535084 14961 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
W20260709 13:06:25.541836 14790 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 287) took 29543 ms (client timeout 15000 ms). Trace:
I20260709 13:06:25.542726 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:25.543614 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:25.545171 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 4 to 11, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:25.536639 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:25.551944 14933 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:25.554754 14933 leader_election.cc:403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.552821 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:25.557618 14969 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
W20260709 13:06:25.553798 14790 rpcz_store.cc:269] 0709 13:05:55.998262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:05:55.998627 (+   365us) service_pool.cc:224] Handling call
0709 13:06:25.541633 (+29543006us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8473,"reported_tablets":49}
I20260709 13:06:25.513041 19047 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:25.569142 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08001c84c0 after lost signal to thread 13795
W20260709 13:06:25.570559 15065 debug-util.cc:398] Leaking SignalData structure 0x7b0800194f40 after lost signal to thread 14827
W20260709 13:06:25.571066 15065 debug-util.cc:398] Leaking SignalData structure 0x7b0800390480 after lost signal to thread 14841
W20260709 13:06:25.572646 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08000df300 after lost signal to thread 14919
W20260709 13:06:25.582145 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08000df4a0 after lost signal to thread 14920
W20260709 13:06:25.584213 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2e80 after lost signal to thread 14994
W20260709 13:06:25.584609 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08003884c0 after lost signal to thread 14995
W20260709 13:06:25.585500 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3b00 after lost signal to thread 15068
W20260709 13:06:25.585745 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08003da980 after lost signal to thread 15069
W20260709 13:06:25.586615 15065 debug-util.cc:398] Leaking SignalData structure 0x7b0800201ca0 after lost signal to thread 15574
W20260709 13:06:25.587257 15065 debug-util.cc:398] Leaking SignalData structure 0x7b0800308dc0 after lost signal to thread 15575
I20260709 13:06:25.588896 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:25.596385 14963 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:25.579628 19037 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:25.596740 14963 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:25.580245 18821 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:25.598018 18821 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:25.561720 18935 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:25.601771 19023 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:25.602375 19047 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:25.598842 18821 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.603713 19028 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.616885 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:25.617609 14895 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.627599 14895 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:25.628110 19028 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:25.636889 14963 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:25.638005 14963 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:25.642493 15036 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:06:25.643734 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:25.644415 15041 raft_consensus.cc:2368] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:06:25.645120 15542 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:25.647292 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:25.647583 19054 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.061s	user 0.002s	sys 0.001s
I20260709 13:06:25.647924 14967 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:25.650620 19049 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:25.635286 15039 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
W20260709 13:06:25.654569 19063 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 13:06:25.655247 14962 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:25.656523 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:25.656936 14861 leader_election.cc:400] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:06:25.657253 14861 leader_election.cc:403] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:06:25.658941 14895 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:06:25.661197 19040 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:06:25.662532 18964 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:06:25.657848 19064 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:25.665930 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 172) took 4963 ms. Trace:
I20260709 13:06:25.667912 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.669325 14792 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 8, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 8 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:25.672449 14963 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:25.673087 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:25.670930 14792 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 12, leader changed from <none> to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:25.677868 14792 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 9 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:25.683841 14967 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:25.679031 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:06:25.693511 19061 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:06:25.668404 19039 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
W20260709 13:06:25.687033 19023 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:06:25.691931 18964 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:25.691537 18893 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:06:25.718314 18964 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:25.666332 14793 rpcz_store.cc:276] 0709 13:06:20.702592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:20.710996 (+  8404us) service_pool.cc:224] Handling call
0709 13:06:24.385335 (+3674339us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.385363 (+    28us) write_op.cc:454] Released schema lock
0709 13:06:25.665870 (+1280507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:24.379369 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:24.379891 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:24.379926 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:06:24.379942 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:24.380239 (+   297us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:24.380290 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:24.380313 (+    23us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:06:24.380472 (+   159us) tablet.cc:701] Row locks acquired
0709 13:06:24.380487 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:06:24.380614 (+   127us) write_op.cc:270] Start()
0709 13:06:24.380744 (+   130us) write_op.cc:276] Timestamp: P: 1783602384380572 usec, L: 0
0709 13:06:24.380766 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:24.381314 (+   548us) log.cc:844] Serialized 533 byte log entry
0709 13:06:24.383075 (+  1761us) op_driver.cc:464] REPLICATION: finished
0709 13:06:24.383478 (+   403us) write_op.cc:301] APPLY: starting
0709 13:06:24.383547 (+    69us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:24.383641 (+    94us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:24.383733 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:24.383905 (+   172us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:24.384047 (+   142us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:06:24.384091 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:24.384255 (+   164us) log.cc:844] Serialized 23 byte log entry
0709 13:06:24.384394 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:24.384466 (+    72us) write_op.cc:454] Released schema lock
0709 13:06:24.384505 (+    39us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":114965,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":226,"apply.run_cpu_time_us":1267,"apply.run_wall_time_us":1266,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2197,"prepare.run_wall_time_us":2197,"replication_time_us":2210}]]}
I20260709 13:06:25.729481 14968 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:25.727535 18964 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:25.780460 19068 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
I20260709 13:06:25.813535 15043 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:25.829698 19040 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.008s
W20260709 13:06:25.845048 19070 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.139s	user 0.005s	sys 0.011s
W20260709 13:06:25.840426 19071 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.132s	user 0.003s	sys 0.000s
I20260709 13:06:25.861898 19036 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:25.863494 14961 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:25.883632 14889 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:25.885123 14861 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13ff541fc966499ea2706d34cfb2c964. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:25.901938 15544 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 5 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:25.927420 19031 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:26.383162 14782 maintenance_manager.cc:419] P d930a2d37e98496a8994b1d260968086: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033373
W20260709 13:06:27.623353 14824 debug-util.cc:398] Leaking SignalData structure 0x7b080016d180 after lost signal to thread 13795
W20260709 13:06:28.103494 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 2.18024e+06us
I20260709 13:06:28.154898 19082 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.228272 19082 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.240449 19082 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.266935 19081 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.269286 19081 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.265163 19083 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.378512 19083 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.383320 19081 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.385645 19032 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.385874 19025 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.386451 19041 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.386816 19032 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.387871 19081 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.388746 19081 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.390385 18939 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.390604 19032 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.391247 19081 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.391527 19083 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.391876 19081 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.392853 19081 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:28.393667 19037 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.391595 19039 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.391273 19032 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.395931 19081 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.396121 18884 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.403906 19084 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.403723 19039 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.404069 18884 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.404750 19084 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:26.557029 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:28.406772 18884 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.397893 19023 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.407637 19084 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.408324 19084 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.408109 19023 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.409190 19084 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.410732 19023 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.394415 19037 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.411644 19084 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.411717 19032 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.413489 19037 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.414124 19037 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.414477 19032 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.415581 18884 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.411327 19023 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.420077 19027 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.414914 19037 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.429159 18821 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.432401 19027 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.434945 19027 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.386832 19025 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.391286 18939 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.437731 19025 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.437906 18939 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.416234 19082 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.438719 19082 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.442997 19082 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.439838 18821 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.445479 18821 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.439229 18884 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.448356 19083 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.448778 18975 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.449092 19083 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.449659 18884 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.450366 19087 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.431555 19041 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.451193 19087 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.453768 19087 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.453884 19041 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.449719 18975 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.462167 18975 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.462749 18975 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.466828 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.467993 15042 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:28.471597 18975 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.472493 19039 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.474330 19083 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.475286 18975 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.479290 19023 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.481899 19023 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.485687 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 980) took 2584 ms. Trace:
I20260709 13:06:28.489181 19037 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.486222 15544 rpcz_store.cc:276] 0709 13:06:25.901274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:25.901407 (+   133us) service_pool.cc:224] Handling call
0709 13:06:25.901658 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:25.901841 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:06:25.930054 (+ 28213us) log.cc:844] Serialized 14 byte log entry
0709 13:06:26.120255 (+190201us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:26.120420 (+   165us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:06:28.485047 (+2364627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.485225 (+   178us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.485393 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":143160,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97}
I20260709 13:06:28.503989 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.504917 15037 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:28.506100 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.506949 15042 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:28.520622 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.521310 15044 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:28.522210 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.523192 15035 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:28.521323 15042 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:28.519713 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.525321 15037 raft_consensus.cc:1813] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Handling vote request from an unknown peer e4938453819c469599f515b22d92fe27
I20260709 13:06:28.535635 15037 raft_consensus.cc:2410] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:28.543339 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.548763 19047 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.549726 19047 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.553359 19036 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.554363 19036 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.556651 18936 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.557544 15038 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:28.558836 19041 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.544631 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:28.557574 18936 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.565179 19086 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.565363 18939 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.565992 19086 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.567013 19023 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.566097 18939 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.567552 19032 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.571954 19024 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.559655 19041 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.576709 18936 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.583729 19024 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.588269 18939 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.588402 19024 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.589634 18936 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.590365 18936 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.592101 19084 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.592796 19084 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.584525 19081 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.592849 18936 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.598809 19027 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.599740 19047 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.599546 19027 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.600137 19087 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.600939 19087 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.600960 19023 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.601991 19027 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.602552 19027 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.596719 19083 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.605391 19083 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:28.604238 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 62957.7us
I20260709 13:06:28.610186 18975 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:28.610764 18975 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.594426 19086 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.603086 19087 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.615698 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:28.617270 19032 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.619796 19032 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.603175 19027 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.603585 19040 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.628046 19040 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.628749 19027 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.603703 19082 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.630472 19082 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.631639 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:28.603086 19036 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.601984 19041 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.603358 19023 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.611263 18975 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:28.603652 19088 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.637879 19087 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:28.603297 19081 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.639358 15039 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:28.613701 19084 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.641736 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:28.634747 19082 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.636216 19027 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:28.643452 19088 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.647565 18936 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:28.648569 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08003d4aa0 after lost signal to thread 14827
I20260709 13:06:28.648329 18936 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:28.649037 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002810e0 after lost signal to thread 14841
I20260709 13:06:28.649434 19028 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.650033 19028 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.650619 18936 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.651477 19090 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.652247 19028 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.652058 19090 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.646313 19027 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.655113 19027 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.658499 19023 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.659271 19050 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.659579 19085 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.659911 19086 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.660449 19024 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.660986 19025 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.661211 19024 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.661760 18784 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.660542 19085 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.662478 18784 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.639806 19087 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.663724 19087 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:28.661650 19025 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.665482 18784 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.665761 19025 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.664880 15043 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:28.659487 19039 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.659734 19038 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.660737 19086 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.659994 19050 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.672129 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:28.673552 19041 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.668562 19024 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.668699 19084 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.667315 19039 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.672314 19049 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.675450 19082 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:28.672284 18821 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.678536 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.659286 19023 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.685734 19083 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.674923 19036 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.685241 19084 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.673009 18936 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.688505 15041 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:28.678609 19038 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.694664 19086 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.695047 19085 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.692883 18821 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.696106 19038 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.687454 19082 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.678666 19041 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.700866 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.701701 19040 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.703490 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3001) took 2783 ms. Trace:
I20260709 13:06:28.697956 19049 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.703635 19040 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:28.703914 14889 rpcz_store.cc:276] 0709 13:06:25.920258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:28.702485 (+2782227us) service_pool.cc:224] Handling call
0709 13:06:28.702862 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:28.703036 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:28.703064 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:28.703118 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:28.703148 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:28.703203 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:28.703294 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:28.693908 19028 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:28.708827 19039 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.699518 19082 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.687989 19089 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 13:06:28.707738 19036 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.714417 19084 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.698554 19088 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.715418 18884 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.693043 19050 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.715749 18898 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.723493 18884 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.723987 18898 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.725304 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.726030 18898 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.716626 18939 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.727494 14893 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:28.727738 18939 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.728430 19091 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:28.728968 19091 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.729430 19091 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:28.729790 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:28.730252 18939 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.730500 14968 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:28.731310 19090 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:28.740561 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08003aacc0 after lost signal to thread 14919
I20260709 13:06:28.742282 18784 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.743067 18784 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.742491 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:28.744550 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08000d09a0 after lost signal to thread 14920
I20260709 13:06:28.742286 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.725883 18884 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:28.751118 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08003e05a0 after lost signal to thread 14994
I20260709 13:06:28.739331 19081 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.716337 18936 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.772787 19089 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.772825 19028 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.773726 19089 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.774250 19028 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.775553 19083 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.776139 19083 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.776546 19028 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.777024 19028 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.777522 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:28.777717 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:28.778115 19083 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.750617 18898 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.778611 19083 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.757900 18821 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.778887 18898 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.779421 18936 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.780061 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:28.780990 18898 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.760876 19023 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.782339 19024 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.768119 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:28.782970 19024 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.783697 14962 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
W20260709 13:06:28.784054 19031 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 2.663s	user 0.022s	sys 0.030s
I20260709 13:06:28.768499 19041 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.746003 18784 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.771792 19092 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.773496 18556 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.743487 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:28.777490 19028 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.785143 19024 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:28.769101 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 69901.8us
W20260709 13:06:28.769603 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd7e0 after lost signal to thread 14995
I20260709 13:06:28.791086 18556 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.791842 14966 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
W20260709 13:06:28.820344 14824 debug-util.cc:398] Leaking SignalData structure 0x7b080031c080 after lost signal to thread 15068
W20260709 13:06:28.820811 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002f7ae0 after lost signal to thread 15069
I20260709 13:06:28.739424 18975 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.779196 19083 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.824128 18556 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.825701 14966 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:28.826094 19084 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.826290 18821 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:28.826488 19024 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.827576 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.828747 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.828646 19092 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:28.828744 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.829627 19088 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.830016 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.831373 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.831804 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.832703 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.833004 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.835803 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.836962 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.837886 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.839874 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.839900 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:28.823694 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.840230 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:28.852372 18784 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.864701 19049 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:28.868985 19052 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:28.792281 19028 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.858980 19087 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:28.960284 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.233543 15039 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:29.234516 14895 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:29.232132 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:29.233217 14892 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:29.232461 14891 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:29.238580 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.264386 18556 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.264783 18556 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.265161 18556 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:28.970604 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 284) took 4671 ms. Trace:
I20260709 13:06:28.974465 19082 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.269207 14893 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:29.268669 14792 rpcz_store.cc:276] 0709 13:06:24.299451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.299613 (+   162us) service_pool.cc:224] Handling call
0709 13:06:28.970358 (+4670745us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:25.833117 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:25.833694 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:25.833728 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:06:25.833749 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:25.841233 (+  7484us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:25.841322 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:25.841351 (+    29us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:06:25.841877 (+   526us) tablet.cc:701] Row locks acquired
0709 13:06:25.841898 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:06:25.842050 (+   152us) write_op.cc:270] Start()
0709 13:06:25.842155 (+   105us) write_op.cc:276] Timestamp: P: 1783602385842000 usec, L: 0
0709 13:06:25.842177 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:06:25.842834 (+   657us) log.cc:844] Serialized 2521 byte log entry
0709 13:06:26.128068 (+285234us) op_driver.cc:464] REPLICATION: finished
0709 13:06:26.129829 (+  1761us) write_op.cc:301] APPLY: starting
0709 13:06:26.129910 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:26.130085 (+   175us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:26.130198 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:26.130873 (+   675us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:26.131014 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:26.131040 (+    26us) write_op.cc:312] APPLY: finished
0709 13:06:26.131216 (+   176us) log.cc:844] Serialized 53 byte log entry
0709 13:06:26.131378 (+   162us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:26.131510 (+   132us) write_op.cc:454] Released schema lock
0709 13:06:26.131540 (+    30us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:26.131858 (+   318us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:26.131883 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1146754,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":1486,"apply.run_cpu_time_us":1842,"apply.run_wall_time_us":2027,"num_ops":6,"prepare.queue_time_us":128438,"prepare.run_cpu_time_us":10833,"prepare.run_wall_time_us":71675,"raft.queue_time_us":202424,"raft.run_cpu_time_us":1554,"raft.run_wall_time_us":1617,"replication_time_us":285723,"spinlock_wait_cycles":470400,"thread_start_us":375813,"threads_started":4,"wal-append.queue_time_us":62075}]]}
I20260709 13:06:29.273502 18556 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:29.243923 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800390ee0 after lost signal to thread 15574
I20260709 13:06:28.962121 19031 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46280 (request call id 0) took 6694 ms. Trace:
I20260709 13:06:28.988018 19095 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.897692 18821 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.275601 18556 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:29.274816 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08003a1380 after lost signal to thread 18994
I20260709 13:06:29.274614 19031 rpcz_store.cc:276] 0709 13:06:22.267395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:22.267554 (+   159us) service_pool.cc:224] Handling call
0709 13:06:22.384156 (+116602us) spinlock_profiling.cc:243] Waited 7.35 ms on lock 0x7b2c000014c8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367ea0a 00007f553367e693 00007f553367e631 00007f5534db13f1 00007f5534cea9fe 00007f5534d71749 00007f5534d7276a 00007f5534d7191b 00007f5534d7d03c 00007f5534d7c6b3
0709 13:06:22.403507 (+ 19351us) log.cc:844] Serialized 499 byte log entry
0709 13:06:22.684236 (+280729us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800012640. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:06:22.696776 (+ 12540us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:28.961930 (+6265154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2636,"raft.queue_time_us":8041,"raft.run_cpu_time_us":2205,"raft.run_wall_time_us":78048,"spinlock_wait_cycles":26425216,"thread_start_us":130344,"threads_started":2,"wal-append.queue_time_us":80623,"wal-append.run_cpu_time_us":17463,"wal-append.run_wall_time_us":1201438}
W20260709 13:06:29.276415 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08001d4ae0 after lost signal to thread 19029
I20260709 13:06:28.882097 19081 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:28.989259 19083 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.286576 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.230626 18650 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.017807 19036 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.099313 18936 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.966856 18935 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.017136 18975 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.973658 19000 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.300957 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.301020 19000 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.301707 15038 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:06:29.302702 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.303649 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.303752 18936 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.304248 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.305442 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.305966 14892 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:29.306147 18936 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.306751 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.306850 15035 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:29.307722 18650 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.309118 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:29.309732 15035 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:29.310127 18650 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:28.987757 19084 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.296286 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.312309 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.312739 14893 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:29.313562 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.313632 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.314694 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.314826 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.316016 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.317408 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.318066 14891 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:29.318812 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.319725 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.288916 14888 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:29.320371 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.321759 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.232249 19047 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.246583 19090 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.940088 19038 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:28.873778 19089 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:28.970638 18943 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:29.284488 19027 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.629s	user 0.009s	sys 0.002s
I20260709 13:06:29.294143 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.281626 19088 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.286366 18893 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:28.987351 19091 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.297086 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.297714 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.298501 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.299232 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.296232 19099 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.299923 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.300367 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.315353 14890 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:29.323973 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.246351 18784 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.322357 14889 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:29.304248 15040 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:29.307308 14892 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:29.382090 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.295519 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.383816 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.283207 19024 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.337759 19000 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.393777 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.404893 14963 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:29.395241 15036 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:29.392911 14887 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:29.407024 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.407605 14887 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:29.407531 18943 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.408519 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.408843 19106 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.410048 18943 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.395598 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.389715 18570 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
I20260709 13:06:29.398707 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:29.416314 15039 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.399880 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:29.416981 15037 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.400460 18784 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.400725 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.419864 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.420596 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.394098 14967 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:29.389907 19027 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.428732 14791 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 6 to 9, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 8 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:29.429518 19088 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.429780 19027 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.403749 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.404116 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.380766 19082 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.431239 19024 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.327960 19095 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.412516 14886 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:29.401467 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:29.432590 19092 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.433104 14895 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:29.433312 19095 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.381572 19081 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.438695 19081 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.422963 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.421208 14891 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:29.431293 14893 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:29.423593 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:29.423857 18821 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.443818 15035 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:29.394068 18893 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:29.452131 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62044.8us
I20260709 13:06:29.452859 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:29.452469 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.415977 18975 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:29.457736 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.457969 14894 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:29.420214 19089 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.464380 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.394661 19047 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.406032 19099 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.288733 19052 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.474484 19052 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.475507 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.476998 14887 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:29.477273 18893 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.477559 19047 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.466639 19024 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:29.478466 19024 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.478845 19024 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.479315 19091 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.457926 18784 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.480306 19084 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.480562 18784 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.480991 18784 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.462752 19089 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.482002 19089 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.409451 19106 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.472725 19099 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:29.493224 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100497us
I20260709 13:06:29.471328 19093 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 13:06:29.491834 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.471318 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:29.493535 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.494438 15037 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:29.497855 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.394870 19090 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.462703 18975 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.396147 19038 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.498893 18943 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.412248 18935 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.511134 19052 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:29.512737 19100 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:29.513103 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54290.2us
I20260709 13:06:29.513669 19087 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.513592 19107 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:29.514691 19038 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.514470 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.515456 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.517011 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.520759 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.527731 19052 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.544864 19090 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.545393 19107 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.546540 19052 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.528244 19106 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.501004 19084 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.547369 19084 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.547500 19107 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.547853 19084 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.549292 19111 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:29.549914 19101 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:29.549854 19111 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.552148 19111 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.552690 19111 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.553174 19111 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.554625 19037 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:29.555660 18650 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.556464 18650 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.539944 19031 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:29.557974 19031 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.558344 19031 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:29.515522 18975 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:29.560617 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet 77cfe8a6078741239e2d788a50d260dc: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:29.559135 18650 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.536288 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.537436 19093 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:29.567798 19093 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.542531 19100 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.568197 19093 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:29.568116 14791 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:29.569761 19100 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.570858 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.571571 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:06:29.572494 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62410.2us
I20260709 13:06:29.573302 19089 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.573743 19081 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:29.574191 19081 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:29.574645 19081 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:29.576924 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.576716 18943 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.578197 18650 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.579015 18943 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.550653 19101 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.579500 19100 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:29.581342 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.580134 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.581933 15545 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:29.582263 15543 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:29.507218 19047 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:29.581005 19100 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.578769 18650 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.498754 19112 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.582283 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.616779 18975 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.620319 19024 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.621891 18975 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:29.586279 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 115098us
I20260709 13:06:29.618491 14895 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:29.619185 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.581043 19101 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:29.641825 19087 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:29.633927 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.670032 19087 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.636646 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.672724 19087 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:29.673408 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.674593 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.612766 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.640892 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.637241 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.654585 19031 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.676532 18821 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.676975 18821 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.677325 18821 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.677821 19031 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.633900 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.680361 15038 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:29.627826 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:29.681910 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54201.5us
I20260709 13:06:29.639315 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.634310 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.676148 15545 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:29.622605 19024 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.681188 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.682529 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.734275 15039 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:29.646584 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.712217 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.637511 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.644342 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:29.790728 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 108283us
I20260709 13:06:29.792632 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.634248 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.584220 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:29.582808 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.633450 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.571275 14791 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:29.734897 15548 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
W20260709 13:06:29.682765 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 70112.7us
I20260709 13:06:29.792385 15543 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:29.795881 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.796417 19090 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:29.799643 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.796536 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.639129 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.799892 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.800885 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:29.801635 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.801019 15541 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:06:29.555073 19111 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:29.799985 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 215915us
I20260709 13:06:29.805589 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.800944 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.637702 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.622484 18935 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.808485 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:29.631942 19089 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.630985 19100 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.555140 19037 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:29.735869 19046 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:29.812240 14933 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:29.834410 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.823957 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.793870 19047 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:29.832181 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.833012 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.812865 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.833214 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:29.834316 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.833371 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.766897 18943 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.799867 19090 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.836666 14968 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:29.835851 15547 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:29.799425 18893 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:29.802485 19041 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:29.837631 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:29.661885 19093 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.839520 15043 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:29.840080 14962 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:29.832379 19082 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:06:29.841701 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:29.843626 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.844589 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.844053 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.897433 15550 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:29.845307 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.845729 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.847095 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.849874 14966 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:29.898509 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:29.848896 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.849133 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.848627 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.848281 14965 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:29.848767 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.809845 19024 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.847882 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.848294 18570 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:29.839247 19047 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.908433 18570 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:29.908485 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 72433.6us
I20260709 13:06:29.908995 18570 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:29.909353 19031 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:29.909854 19031 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:29.910732 19031 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.870375 18936 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:29.911695 18936 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.911499 18943 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.912122 18936 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.913825 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.914003 18943 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.914976 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.871747 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.915678 15547 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:29.916077 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.916198 19093 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:29.916484 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.848997 18650 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.849861 19114 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:29.872594 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.917994 19114 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.874074 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.918519 19114 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:29.871780 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.847338 18784 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.919489 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.920704 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.921046 18784 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.847872 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.921734 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.919297 14967 raft_consensus.cc:1813] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Handling vote request from an unknown peer e4938453819c469599f515b22d92fe27
I20260709 13:06:29.922650 14967 raft_consensus.cc:2410] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:29.923398 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.923892 14967 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:29.923940 18821 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.924677 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.925215 14967 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:29.929888 14961 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:29.835081 19049 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:29.886835 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.667755 19084 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.932605 15044 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:29.933501 15037 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:29.840971 19087 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.868606 19090 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:29.894153 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:29.894819 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61666.8us
I20260709 13:06:29.838613 19088 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:29.936057 15545 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:29.936486 19088 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:29.937501 19088 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.896474 15546 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:29.906766 19115 ts_tablet_manager.cc:933] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:06:29.907262 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:29.940737 18986 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:29.879369 19037 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.941943 19037 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.903853 19024 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:29.942781 19024 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:29.944795 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.946128 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.947350 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.947314 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.948482 14962 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:29.948582 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.949767 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.949939 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.950982 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.931720 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.952445 14966 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:29.952284 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.954526 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.809214 19112 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.955608 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.956096 15543 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:29.837931 19046 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:29.888111 19041 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:29.962101 19041 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:29.963596 19087 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.963831 14968 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:29.966394 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.951686 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:29.922727 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.955997 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:29.957981 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:29.960038 19112 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:29.960696 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.961231 19082 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:29.963526 19046 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:29.977843 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:29.982806 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.955123 19090 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:29.976612 18986 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:29.992483 19082 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.993994 19038 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:30.007507 19038 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:30.007882 19038 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.008780 19038 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.009939 19038 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.009713 19024 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.010917 18975 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:29.995714 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.970961 19047 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.995565 19093 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:30.012202 15040 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:30.013051 18784 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:30.013236 19047 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.013536 18784 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.014519 18784 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:29.997002 19081 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.015972 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:30.017473 19081 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.018280 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.019496 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.020591 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:29.998920 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:29.975723 19037 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.004777 19092 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:30.005008 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:30.005290 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.006534 19097 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.039186 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:30.055516 19097 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:30.056032 19097 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.056205 19117 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.056735 19117 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:30.057126 19117 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.021368 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.060426 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.060966 19090 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.062252 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.064621 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.069373 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.069980 14962 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:30.072129 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.072724 14962 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:30.075048 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:30.080173 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 246915us
I20260709 13:06:30.083267 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.084043 15043 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.083741 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.092175 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.096956 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.097035 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.109697 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.111886 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.111977 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.112473 14964 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:30.113161 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.108145 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.114912 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.115566 14970 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:30.119148 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.083727 19037 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.121352 14967 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:30.120581 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.072992 18570 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:29.992411 18936 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.094300 19092 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.125272 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:30.127097 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:30.129487 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:30.128782 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.130684 15038 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.133437 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.135506 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.136906 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:30.140709 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:30.141655 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.151734 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.151836 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.123833 19037 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.152608 14894 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.153254 14859 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.153693 15037 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:30.154909 15043 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
W20260709 13:06:30.159631 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.160581 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.115424 18650 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:06:30.128702 19117 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:30.187422 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 193899us
I20260709 13:06:30.161823 19024 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:30.139164 19115 tablet_copy_client.cc:323] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:06:30.196866 15043 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.161666 19092 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.187462 18821 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:30.218561 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65429.3us
I20260709 13:06:30.219288 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:30.225924 18936 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.227609 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:30.228631 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 78214.4us
I20260709 13:06:30.229409 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.233119 19092 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.234277 19114 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.235291 18570 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.235510 14969 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:30.236114 18975 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:30.236778 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.259759 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.257232 14894 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:30.270360 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.276331 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.276561 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:30.279337 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.284535 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.285300 19082 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:30.260773 19090 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.245688 19049 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:30.292836 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.300441 19049 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:06:30.297612 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 87064.6us
I20260709 13:06:30.298914 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:30.286998 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.301534 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:30.302687 19087 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:30.304991 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:30.305282 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.306316 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.306648 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.307435 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.307653 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.307783 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.308045 14891 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.301666 18821 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.279428 19047 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:30.341336 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.340248 14966 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:30.277674 19091 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:30.348659 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.278885 19117 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.354875 14890 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:30.355861 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.356459 14968 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:30.357957 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.309922 19092 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.267577 19097 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.339520 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:30.363900 14892 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:30.364570 15038 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:30.355398 14895 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:30.342249 19087 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.349406 18975 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.280092 19024 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:06:30.391180 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:30.393458 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 86942.3us
I20260709 13:06:30.406172 19114 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:30.407296 15040 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:30.395298 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 55931.5us
I20260709 13:06:30.387625 19084 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:30.421845 19124 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:30.426283 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.427738 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.396476 18975 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:30.429143 18975 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.429458 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.430886 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.389997 19126 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.431648 19126 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.431977 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.432600 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.433408 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.433653 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.433975 19041 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.434738 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.434852 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.393146 19091 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.435879 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.447494 19091 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.440416 19121 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:30.450871 18943 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:30.451309 18943 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:30.452245 18943 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.453441 18943 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.439632 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.456658 14891 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:30.457414 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.440703 14962 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:30.441927 19118 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 13:06:30.459445 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 154244us
I20260709 13:06:30.460891 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.470599 15038 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:30.472427 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 75270.9us
I20260709 13:06:30.473073 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.473987 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.475168 19114 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.475216 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.475720 19114 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.475939 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.476188 19114 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.476657 15043 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.476953 19121 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:30.476657 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.476148 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.478250 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.478577 19121 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.478709 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.479045 19121 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.479507 19121 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.480062 19093 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:30.481595 19037 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.455245 18784 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.432003 19126 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:30.407485 18821 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:30.441315 19127 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:30.487109 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.487248 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.494233 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.495028 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.493433 14963 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:30.500751 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:30.502096 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.502591 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.503607 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.436102 19041 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.507887 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:30.506186 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 229755us
I20260709 13:06:30.512849 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.508899 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.525373 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.529335 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:30.500919 19132 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.205s	user 0.002s	sys 0.000s
I20260709 13:06:30.530524 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.530700 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.531718 14895 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.491746 18821 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:30.530850 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.500679 19031 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.537684 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.538348 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.538815 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.539312 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.540053 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.528196 19028 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:30.556152 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.556770 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:30.556915 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.567034 15037 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:30.567497 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80252.7us
I20260709 13:06:30.557379 19031 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.542184 19137 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.558290 19135 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.561893 19093 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.528644 19130 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.562707 19024 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.536527 19027 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:30.534458 18821 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.566578 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.518913 19092 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:30.576686 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:30.572098 19046 consensus_meta.cc:287] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.593s	user 0.005s	sys 0.005s
I20260709 13:06:30.579737 19038 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:30.580713 19097 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.581087 19100 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.581714 19112 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:30.584048 14936 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:30.530934 19037 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:30.661854 19142 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.566787 19028 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:30.663311 19138 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 13:06:30.671000 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 145708us
W20260709 13:06:30.673642 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 82664.4us
I20260709 13:06:30.589303 19137 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.589442 19135 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.590536 19093 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.594012 19024 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.683714 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.670612 19100 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:30.695860 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 111909us
I20260709 13:06:30.668994 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:30.682827 19028 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.696564 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:30.697278 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.699874 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.686071 19093 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.689956 19024 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:30.686576 19135 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:30.703454 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.687165 19137 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.706915 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.710064 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.710282 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.698639 19100 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.711680 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.670799 19046 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.712699 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.702914 19090 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:30.711448 19037 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.723593 19090 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:30.724078 19090 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.733749 19046 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.713501 19049 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:30.734689 19049 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.723881 19037 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.735100 19049 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.716214 19151 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.716377 18975 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.717082 14967 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:30.717463 19116 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.752110 19116 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.752565 19116 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.753264 18821 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.717864 19148 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:30.755158 19148 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.755586 19148 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:30.718254 19145 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.760071 14891 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.718761 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.760686 14970 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.719725 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:30.721292 19129 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:30.721897 19141 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.708992 18935 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:06:30.766220 18935 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:30.766588 18935 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:30.735270 19037 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.767565 19147 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:30.740006 19027 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.771193 14970 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:30.762053 19129 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.771708 19027 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.772315 19129 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.773041 19111 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:30.773422 19111 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:30.773521 19129 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.775580 14965 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:30.734015 19130 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:30.784152 18935 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.788084 14888 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:30.790874 18935 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.735011 15043 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.701592 19088 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.748914 19142 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:30.749127 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.761351 14962 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:30.796237 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47200.8us
I20260709 13:06:30.739607 19028 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.763634 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.722817 19091 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:30.765265 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 256470us
I20260709 13:06:30.781263 18975 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.774333 19111 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.796962 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.761298 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:30.805502 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44297.7us
I20260709 13:06:30.805667 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.808228 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.807499 18943 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
W20260709 13:06:30.816470 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 309233us
I20260709 13:06:30.814198 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.818403 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.815055 19151 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.819242 18650 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:30.819660 18650 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:30.820362 19126 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.820860 18650 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.822321 19126 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.813217 19041 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:06:30.822511 18650 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.822712 14969 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:30.823177 19125 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:30.815151 19145 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.823627 19125 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.824033 19125 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.826901 14962 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:30.797866 19088 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:30.827587 19088 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.764606 19121 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.813995 19087 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:30.829779 14966 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:30.830097 19087 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.830688 19087 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:30.832188 18893 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:30.832557 18893 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:30.813290 19117 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:06:30.833652 19117 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:30.834079 19117 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:30.826936 19091 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.797781 19142 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.836244 19142 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.837744 19142 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.795392 19114 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.804489 19141 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.833359 18893 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.848081 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.848794 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.797412 18821 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.849012 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:30.854460 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.829450 19121 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.851776 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.852962 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.852682 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.881232 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.881956 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.882251 19140 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:30.882946 19140 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.883004 14893 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:30.883322 14895 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:30.884359 19038 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:30.884625 19141 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:30.884917 19126 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.885231 19141 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.885614 19126 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:30.886215 19141 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.887034 19151 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:30.887516 19151 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.888347 19151 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:30.889269 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.889583 19151 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:30.889748 19121 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:30.890847 19121 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:30.891225 19121 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.855865 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.891863 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.856251 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.892129 19121 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.856436 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.856767 19046 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:30.893885 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.894297 19046 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:30.894649 19046 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:30.895460 19046 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.896526 19046 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.857074 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.899575 19126 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:30.854074 19081 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:30.858429 19136 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:30.851456 18784 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:30.900094 18936 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:30.859375 19143 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.900739 19136 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:30.901417 19143 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:30.901786 19143 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:30.901623 19136 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.902535 19143 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.900185 19126 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.834954 19117 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.904301 19117 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:30.859824 14891 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:30.860283 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.849632 19097 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.860736 19028 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.861793 19093 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.862833 19114 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.864681 19027 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.865576 19037 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.865892 19100 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.866308 19145 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:30.867817 18893 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:30.939632 19027 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:30.943719 19114 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:30.944111 19114 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:30.944908 19114 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.945132 19125 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.868273 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.847967 19024 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.855367 19111 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:30.876363 19049 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.907104 19116 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.946828 15543 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:30.947669 19135 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.973701 15041 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.878530 19090 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:30.883368 19140 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:30.975776 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:30.978873 15037 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:30.850420 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.909008 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:30.979969 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 129645us
W20260709 13:06:30.980082 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 71140.6us
I20260709 13:06:30.980249 15038 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:30.981269 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.981345 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.982322 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:30.982514 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.983063 19097 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:30.983572 19145 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:30.916270 14891 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.984436 19145 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.984504 19117 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.985141 19145 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:30.985567 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.948585 19024 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.917450 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:30.986665 19090 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:30.986996 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:30.987533 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.988498 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.988873 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.920650 14892 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:30.920580 19143 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.925007 19037 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.989840 19037 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:30.990106 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.990235 19037 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:30.926841 19093 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.950155 19049 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.959874 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.930810 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.930161 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.992472 14889 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:30.992782 14887 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:30.993564 14889 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:30.993911 14887 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:30.932245 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.928812 19148 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.934175 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet 13ff541fc966499ea2706d34cfb2c964 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:06:30.995764 14893 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:30.935238 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:30.938520 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.997419 19148 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.997678 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:30.946990 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 148553us
I20260709 13:06:30.983610 19097 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:30.998642 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.931470 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:30.999742 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.990301 19153 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:31.000425 19112 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:30.999346 19097 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:30.995785 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet 13ff541fc966499ea2706d34cfb2c964 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-13ff541fc966499ea2706d34cfb2c964
I20260709 13:06:31.002786 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.986665 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:31.001106 19101 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:30.952142 19100 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:31.001117 19112 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:31.010751 18943 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.989109 14890 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:30.990720 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:30.897905 19137 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.006937 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.990856 19037 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:30.912611 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:31.014246 18943 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:31.014199 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.946234 19114 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:30.947825 18935 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:30.932559 19087 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:31.019047 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 106554us
I20260709 13:06:31.019878 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.029979 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.031323 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.033265 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.033948 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.034049 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.020429 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.971952 19135 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:30.900221 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:31.018181 14905 tablet_copy_source_session.cc:215] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:31.052361 14968 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:31.025668 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:31.045096 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.045907 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:31.046393 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 146249us
I20260709 13:06:31.063071 15042 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:31.064744 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.066179 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.053831 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.069413 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.018388 19137 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.050532 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:30.960290 19116 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.082484 14888 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:31.071749 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:30.958019 19121 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:31.079169 15043 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:31.079964 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.080307 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.080866 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.023692 19112 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:31.054302 14965 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:06:31.085243 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.085402 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.085536 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.026264 19100 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:31.099458 14967 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:31.100121 14965 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.054807 19153 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.099503 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.026846 19129 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:06:31.098388 19092 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.102275 19139 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:31.070168 19093 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 13:06:31.141631 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56174.2us
I20260709 13:06:31.018450 19140 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.067574 18650 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.054997 19101 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:06:31.063480 19148 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:06:31.097728 19112 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:31.140750 18943 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:31.096767 18935 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 13:06:31.101307 19111 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:06:31.150336 19125 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.157706 14968 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:31.157938 14961 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:31.159160 14970 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.144325 19031 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:31.163748 14933 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.152954 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.188227 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.189491 14962 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:31.156893 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 55877.8us
I20260709 13:06:31.192356 19027 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:06:31.205559 14961 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:31.207240 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:31.199864 14968 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:31.200423 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 117826us
W20260709 13:06:31.200654 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47831.9us
I20260709 13:06:31.209183 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 283) took 7302 ms. Trace:
I20260709 13:06:31.157226 19088 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.209142 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.156940 19139 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:31.154420 19116 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:06:31.185103 19112 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:31.232893 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.205688 19145 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.211025 19135 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:31.239727 14886 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:31.216344 19093 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:31.211695 19141 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:31.246263 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44431.1us
I20260709 13:06:31.247629 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.251670 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.223719 14788 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.239173 19027 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:31.255462 15037 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:31.209661 14791 rpcz_store.cc:276] 0709 13:06:23.906688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:23.909196 (+  2508us) service_pool.cc:224] Handling call
0709 13:06:31.209121 (+7299925us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:30.215755 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:30.216423 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:30.216481 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:06:30.216500 (+    19us) tablet.cc:662] Decoding operations
0709 13:06:30.217117 (+   617us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:30.217211 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:30.217244 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:30.217709 (+   465us) tablet.cc:701] Row locks acquired
0709 13:06:30.217770 (+    61us) write_op.cc:260] PREPARE: finished
0709 13:06:30.217939 (+   169us) write_op.cc:270] Start()
0709 13:06:30.218064 (+   125us) write_op.cc:276] Timestamp: P: 1783602390217873 usec, L: 0
0709 13:06:30.218104 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 13:06:30.225242 (+  7138us) log.cc:844] Serialized 1293 byte log entry
0709 13:06:30.743886 (+518644us) op_driver.cc:464] REPLICATION: finished
0709 13:06:30.955563 (+211677us) write_op.cc:301] APPLY: starting
0709 13:06:30.955651 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:30.956064 (+   413us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:30.956184 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:30.956525 (+   341us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:30.956812 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:06:30.956868 (+    56us) write_op.cc:312] APPLY: finished
0709 13:06:30.957154 (+   286us) log.cc:844] Serialized 35 byte log entry
0709 13:06:30.957335 (+   181us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.957422 (+    87us) write_op.cc:454] Released schema lock
0709 13:06:30.957476 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:30.968702 (+ 11226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:30.968736 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":83247,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":169282,"apply.run_cpu_time_us":2420,"apply.run_wall_time_us":13117,"num_ops":3,"prepare.queue_time_us":288026,"prepare.run_cpu_time_us":12470,"prepare.run_wall_time_us":79968,"raft.queue_time_us":182773,"raft.run_cpu_time_us":70227,"raft.run_wall_time_us":98987,"replication_time_us":525615,"thread_start_us":498647,"threads_started":4,"wal-append.queue_time_us":70240}]]}
W20260709 13:06:31.257988 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 202610us
I20260709 13:06:31.241828 19087 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.257958 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.211710 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:31.260082 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:31.259928 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 204073us
I20260709 13:06:31.250262 19031 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:31.274693 15043 raft_consensus.cc:606] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:31.263463 14788 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 9 to 10, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 10 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:31.278949 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:31.252301 19092 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:31.288334 19088 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.242478 19152 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 13:06:31.294036 19152 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:31.294370 19152 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:31.295162 19152 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:31.296419 19152 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:31.296569 19140 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.242332 19139 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:31.290997 19089 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.245383 19100 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:06:31.253767 19093 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:31.257028 19027 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:31.276085 19135 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:31.315804 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55832.6us
I20260709 13:06:31.317549 15041 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:31.301142 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:31.318886 14888 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:31.317642 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.323720 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:31.327044 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 73852.8us
I20260709 13:06:31.302752 19088 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:31.317691 19155 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:06:31.339232 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.340137 14968 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:31.326781 19089 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:31.343829 14961 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:31.299546 19160 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:06:31.347600 14788 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:31.325829 19031 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:06:31.377205 19161 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:31.392409 19163 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.102s	user 0.002s	sys 0.001s
I20260709 13:06:31.394006 19093 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:31.396697 19159 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 13:06:31.399555 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.400995 19146 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:31.322559 19162 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:06:31.401527 19146 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:31.402068 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.402421 19146 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.403741 19089 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:31.405082 19087 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.403611 19092 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:31.408392 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.409260 19037 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.411707 14966 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.411957 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:31.350744 19088 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:31.424561 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 105839us
W20260709 13:06:31.425700 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.418061 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:31.420038 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 407346us
W20260709 13:06:31.426616 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.426694 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:31.427742 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:31.430119 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:31.411175 19037 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:31.436975 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.437047 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:31.440058 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.346786 19130 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 13:06:31.349160 19135 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 13:06:31.449327 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.450768 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.435911 19090 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:31.460871 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:31.462248 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 184905us
I20260709 13:06:31.463812 14965 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:31.443902 19136 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:31.463220 19131 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:31.475920 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:31.476981 14965 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:31.478766 19092 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:31.479327 19092 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:31.452028 19160 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:31.441354 19143 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 13:06:31.605099 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 122045us
I20260709 13:06:31.483536 19160 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:31.610958 19171 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:31.610776 19160 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.612134 19160 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:31.616590 19121 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 13:06:31.618366 19116 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:31.606442 19169 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:31.480481 19092 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:31.624194 19142 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:31.624636 19142 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:31.625490 19142 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:31.629092 14970 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.619073 19116 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:31.648867 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.649075 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.649855 15548 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:31.650043 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.650629 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.651614 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.651749 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.652212 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.652560 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.670029 15037 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.673911 14963 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:31.682011 14890 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:31.683043 14894 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:31.693066 15038 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:31.575796 19088 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.695458 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:31.696689 14895 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:31.666019 19027 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:31.709306 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:31.682691 19143 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:31.709911 15039 raft_consensus.cc:606] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:31.710276 15039 raft_consensus.cc:614] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:31.713610 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.682461 19112 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:31.726668 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.730271 19090 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:31.733991 19125 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.700708 19181 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 13:06:31.698648 19135 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:06:31.714326 19143 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:31.711400 19168 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:06:31.745152 19162 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:31.747481 19097 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:31.749010 19116 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:31.750013 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:31.888479 14966 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:31.741768 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:31.759017 15547 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:06:31.759377 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 329396us
I20260709 13:06:31.890467 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:31.736266 19136 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:31.891532 19136 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:31.851995 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:31.740765 19090 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:31.856755 19183 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:06:31.905829 15039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da044c14437c4be087d871f129926239"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:31.906620 15039 raft_consensus.cc:606] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:31.907044 15039 raft_consensus.cc:614] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:31.915622 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:31.917932 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:06:31.920509 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:31.765098 19162 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:31.854239 19097 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:31.752784 19125 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:31.755432 19049 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.145s
I20260709 13:06:31.895643 19101 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:31.895879 19129 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:31.957243 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51882.6us
I20260709 13:06:31.756912 19139 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.176s
I20260709 13:06:31.989125 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.904000 18893 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:31.993772 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 931) took 1062 ms. Trace:
I20260709 13:06:31.994108 14962 rpcz_store.cc:276] 0709 13:06:30.919762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:30.919898 (+   136us) service_pool.cc:224] Handling call
0709 13:06:30.920185 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:31.198193 (+278008us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:31.982217 (+784024us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b5400109ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:31.982549 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":619040640}
I20260709 13:06:31.996722 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:31.901149 19173 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.000396 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.001080 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.003736 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:32.010522 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:32.011341 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.015960 15548 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:31.903298 19171 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.095s
I20260709 13:06:31.982555 19101 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:31.986876 19129 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:32.034667 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.023546 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.023841 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:31.999225 19184 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:06:32.028591 19185 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:06:32.042814 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.026893 19168 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.020774 18893 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:32.043846 19168 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.044251 18893 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.024680 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.030027 19121 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:32.045254 18893 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.045878 19168 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:31.990500 19049 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:32.046360 19112 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.023584 19093 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:32.027973 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.051571 19188 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:32.053812 14890 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.053985 19136 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.054826 19136 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:32.027083 19114 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.056273 19114 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.057142 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.058197 19114 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.058375 19182 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.059211 18935 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.027503 14969 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:32.021102 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.018930 18650 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.037788 14895 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:32.026939 19037 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.026301 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 284681us
I20260709 13:06:32.022596 19153 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.026314 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.072237 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.063041 14891 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:32.058215 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.073268 14890 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:32.065783 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.046627 19049 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.044402 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.077024 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.078480 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.079568 19112 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:32.075191 14894 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:32.046559 18893 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:32.083664 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61216.5us
I20260709 13:06:32.086189 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:32.055274 19136 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.088430 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:32.045897 19121 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:32.082160 19093 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:32.117147 15546 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:32.068450 18650 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:32.075105 19038 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:32.120223 14964 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:32.080664 19140 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.008116 19090 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:32.131378 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 45277.2us
I20260709 13:06:32.088902 19171 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:06:32.126250 19193 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:32.116240 19168 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:32.116595 19114 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.082860 19139 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
W20260709 13:06:32.142498 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76832.2us
I20260709 13:06:32.124354 19112 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.084898 19169 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:06:32.075930 19037 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:32.163223 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.081871 19153 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.171669 19121 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.172842 19093 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.175688 19164 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.178246 19173 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:32.082731 19129 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.180462 19198 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:32.155073 19189 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:06:32.186721 19170 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:32.187639 19125 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:32.192041 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 113679us
I20260709 13:06:32.179366 19191 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:32.224974 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 92442.9us
I20260709 13:06:32.225876 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:32.208078 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 149942us
I20260709 13:06:32.204386 14965 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:32.213466 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:32.163530 19137 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:32.223614 14970 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:06:32.227339 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.226358 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.231580 19195 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.231510 19192 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.232837 19201 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:32.233587 19116 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.234099 19116 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.236027 19116 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.237253 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.237970 14895 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:32.238518 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.239840 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 66e4432ba29a43668db5483ebef3b522 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:34356
I20260709 13:06:32.240625 19153 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.242161 19142 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:32.246363 19089 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.246824 19089 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:32.247804 19089 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.248971 19089 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.249495 19037 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.133864 19101 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.249217 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.187865 18650 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.250217 18935 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:32.232676 19192 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.159861 19136 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.273837 19192 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.274379 19192 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.274979 19192 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.164191 19112 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.280282 19049 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.248217 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:32.260972 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163315us
I20260709 13:06:32.264097 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.270335 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:32.291496 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64278.9us
I20260709 13:06:32.291497 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:32.215365 19173 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:32.292250 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.293191 19100 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.294623 19198 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:32.295694 19115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ff541fc966499ea2706d34cfb2c964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:32.296341 19198 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.297134 19198 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.297544 19198 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.298445 19198 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.299571 19201 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:32.302850 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.303620 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.304352 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.306245 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:32.307303 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.228773 19191 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.310580 19191 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.290483 19182 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.228426 19137 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:32.311880 19164 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:32.312225 19137 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.313140 19170 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.313519 19137 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.314574 18650 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.312711 19196 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.315589 19130 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:32.301652 19049 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:06:32.284176 19037 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:06:32.305833 19169 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.320150 19100 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.317562 19145 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.319926 19169 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.322714 19192 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.324796 19169 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.315747 19153 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.325599 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:32.306279 19084 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.326328 15041 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:32.331693 14887 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:32.332197 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:32.332986 15550 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:32.333822 19153 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:32.334328 15038 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:32.333860 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.337409 15547 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:32.337035 19162 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.337764 15547 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:32.338362 19162 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:32.338794 19130 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:32.338558 15547 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.342576 15547 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.344275 19196 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.346000 19125 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:32.346426 19125 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.346676 19196 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.348526 19129 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.348872 14970 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:06:32.351789 19198 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.361999 15041 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:32.363082 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.365375 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.365983 15038 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:32.366868 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.368635 19087 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:32.370096 19087 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:32.370394 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.371833 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.366044 19111 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:32.373574 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.373929 14895 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:32.375098 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.375723 15041 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:32.377127 14891 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:32.380302 19112 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.380178 19173 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.381278 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.381713 19173 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.384390 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.347295 19125 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.387676 19121 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.388170 19121 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:32.388798 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.390736 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.396348 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.390318 19121 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.397820 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.373867 19111 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:32.398461 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.398627 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.404496 19111 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.399950 15038 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:32.405645 19111 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.404852 14891 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:32.407927 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:32.408454 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.402909 19143 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.410386 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1938) took 1370 ms. Trace:
I20260709 13:06:32.410760 14963 rpcz_store.cc:276] 0709 13:06:31.040149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.065904 (+ 25755us) service_pool.cc:224] Handling call
0709 13:06:32.410224 (+1344320us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b54002175d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:32.410313 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271436544}
I20260709 13:06:32.412076 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:32.434577 19112 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:32.433720 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.318606 19139 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:06:32.435206 19112 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.436173 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.437506 19112 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.438937 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.439910 14891 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:32.357542 19191 consensus_queue.cc:1175] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "58ee9fe38eb8453098f6d964e7675e79" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
I20260709 13:06:32.439246 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:32.447886 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.449168 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.449790 14890 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:32.450641 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.451303 14895 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:32.452484 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.442871 19121 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:06:32.411844 19129 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:32.459146 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:32.461510 19088 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:32.462066 19088 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:32.463055 19088 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.464844 19204 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:32.465131 19208 tablet_replica.cc:333] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:06:32.465420 19204 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.466370 19197 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.466913 19197 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.467573 15039 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:32.468225 19205 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.130s
I20260709 13:06:32.445618 19093 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 13:06:32.469010 19172 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.469431 19172 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:32.444631 19199 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:32.442947 19142 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:32.470521 19027 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.470257 19172 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.470820 19142 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.471308 19142 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.465188 14894 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
W20260709 13:06:32.474895 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 167005us
I20260709 13:06:32.474924 15547 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:32.475687 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:32.476477 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.477301 14888 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:32.478389 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.481120 15542 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:32.480118 14781 maintenance_manager.cc:643] P d930a2d37e98496a8994b1d260968086: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.092s	user 0.171s	sys 0.050s Metrics: {"bytes_written":29728,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":242012,"dirs.run_cpu_time_us":557,"dirs.run_wall_time_us":56812,"drs_written":1,"lbm_read_time_us":417,"lbm_reads_lt_1ms":4,"lbm_write_time_us":615947,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":5,"lbm_writes_gt_100_ms":1,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":76273,"threads_started":1,"update_count":3}
I20260709 13:06:32.487700 19204 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.459259 19190 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.166s
I20260709 13:06:32.489295 19172 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.494033 14782 maintenance_manager.cc:419] P d930a2d37e98496a8994b1d260968086: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10949 bytes on disk
I20260709 13:06:32.496233 19197 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.501453 14893 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:06:32.478291 18943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:06:32.470323 19199 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.507762 19199 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.509001 19199 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.514165 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.514783 14963 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:32.519361 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.521710 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.521907 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.522208 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.522526 14964 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:32.521790 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.523838 14969 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:32.524727 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.526819 14888 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:32.531808 19142 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.534773 14968 raft_consensus.cc:2368] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:06:32.472440 19195 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:06:32.502483 19169 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:32.541180 14781 maintenance_manager.cc:643] P d930a2d37e98496a8994b1d260968086: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.027s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":304,"lbm_reads_lt_1ms":4}
I20260709 13:06:32.541565 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:32.542513 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:32.544427 15041 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:32.544795 19024 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:32.545337 19024 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.545802 19024 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:32.546598 19090 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.540130 19213 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.548441 19213 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.550691 19213 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.545634 15038 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:32.528240 19204 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:32.551365 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 109093us
I20260709 13:06:32.555927 19125 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:32.558288 19202 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.284s	user 0.000s	sys 0.002s
I20260709 13:06:32.576032 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:32.576617 14891 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.561931 19204 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:32.577497 19204 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.566462 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:32.581806 19097 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.583033 19097 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.588548 14891 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
W20260709 13:06:32.589576 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:32.591048 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48618.6us
I20260709 13:06:32.567371 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.568555 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.569779 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.597121 15043 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:32.597327 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.597815 15042 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:32.570053 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.599308 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:32.571378 15044 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:32.572300 14966 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:32.572710 15037 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.602981 15036 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:32.567831 15548 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:32.598505 19121 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:32.606508 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.570482 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:32.570160 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:32.612457 15040 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.573833 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:32.590497 19093 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.639859 15039 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
W20260709 13:06:32.640452 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 66692.1us
I20260709 13:06:32.573884 19101 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.567169 19142 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.575016 19136 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:32.643679 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:32.643338 15035 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:06:32.615789 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.652635 15037 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:32.595744 19151 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.567760 19192 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.641047 19220 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.569012 19137 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:32.652704 15040 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:32.558799 19116 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:32.607590 19121 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.574282 19049 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:32.660858 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46630.5us
I20260709 13:06:32.663234 15044 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
W20260709 13:06:32.671831 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 101754us
I20260709 13:06:32.673674 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.643743 19145 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.646669 19208 raft_consensus.cc:2243] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:06:32.674642 15040 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:32.675678 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.648021 19195 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:06:32.659870 19111 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.672041 19121 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.679518 19090 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.613361 19191 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:06:32.643548 19153 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:32.645931 19115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52858 (request call id 848) took 3067 ms. Trace:
I20260709 13:06:32.681354 19167 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:32.670571 19220 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.659226 19093 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.659991 19142 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:32.670533 19192 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.688858 18893 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:32.696557 19090 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:32.693638 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:32.674273 19049 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:32.698052 15010 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 13ff541fc966499ea2706d34cfb2c964. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:06:32.722276 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49439.7us
I20260709 13:06:32.700178 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:32.671507 19088 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:32.690529 19169 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:32.707998 19208 raft_consensus.cc:2272] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:06:32.708679 19140 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.701366 19115 rpcz_store.cc:276] 0709 13:06:29.578877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.580141 (+  1264us) service_pool.cc:224] Handling call
0709 13:06:29.939750 (+359609us) ts_tablet_manager.cc:934] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
0709 13:06:32.294243 (+2354493us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:32.552889 (+258646us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:32.553021 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:32.645117 (+ 92096us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:32.645417 (+   300us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:32.645774 (+   357us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:32.645839 (+    65us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":39634,"tablet-copy.queue_time_us":325931,"thread_start_us":378501,"threads_started":2}
I20260709 13:06:32.693648 19145 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.699687 19153 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.672297 19116 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.672260 19137 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.694455 19129 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.719388 15542 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:32.696363 19147 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.690501 19111 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.732383 19169 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.716756 19167 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.711822 19092 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:32.712071 19188 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:32.725780 14861 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.4:39473 timed out after 1.762s (SENT) [suppressed 8 similar messages]
I20260709 13:06:32.729135 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.760507 19190 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:32.719451 18893 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.722421 19090 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:32.720880 19037 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:32.663106 19151 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.737588 19191 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:32.721683 19084 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.047s
W20260709 13:06:32.785996 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 189146us
I20260709 13:06:32.765202 19153 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:32.780685 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51664.9us
I20260709 13:06:32.786736 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.737727 19125 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:06:32.736954 19088 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.784361 19038 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:32.792450 19189 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:06:32.792987 19221 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:32.785300 19191 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:32.801215 19191 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:32.804458 19220 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.806643 19137 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.807308 19137 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:06:32.809365 19145 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.811110 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.758605 19140 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.780016 19196 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:32.821168 19204 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.821633 19038 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.783936 19213 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:32.786113 19218 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:32.773960 19147 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.863391 19196 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:32.863993 14893 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:32.865428 19147 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.796257 19189 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:32.787774 19024 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:32.831291 19223 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 13:06:32.796284 19205 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.832098 19093 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.823979 19115 tablet_copy_client.cc:806] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:32.833007 19111 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.834290 19208 ts_tablet_manager.cc:1916] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:32.836262 18893 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.837554 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.882923 14964 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:32.883176 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:32.777696 19129 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.841277 19164 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:32.843714 19049 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.848968 19192 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.849077 19038 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.907027 19115 tablet_copy_client.cc:670] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:32.788825 19037 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.902463 19090 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.913002 19037 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.913436 19090 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:32.852144 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.852692 19167 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.856802 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.914919 19151 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.862375 19146 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.795434 19188 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:32.874430 15008 leader_election.cc:400] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:06:32.923580 15008 leader_election.cc:403] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:32.924360 18893 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.924932 19121 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.925550 19129 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.925981 14968 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260709 13:06:32.928536 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 100649us
W20260709 13:06:32.878103 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 105928us
I20260709 13:06:32.834311 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.838442 19204 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:32.864003 19196 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:32.887383 19093 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:32.886264 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:32.873289 19142 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:32.887650 19164 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:32.917450 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.866954 19189 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.930836 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.932418 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:32.857005 19088 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.936846 15040 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:32.940546 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:32.923005 19212 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:32.941182 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:32.951843 15547 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:32.936851 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50704.9us
I20260709 13:06:32.952371 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:32.944257 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:32.880760 19205 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.944506 15041 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:32.944307 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.936094 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:32.881551 19213 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 13:06:32.945901 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.956148 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:32.959383 14969 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:32.960207 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:32.960829 14895 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:32.960507 15036 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:32.961905 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:32.962579 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.963794 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:32.964097 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:32.961920 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.974850 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.029603 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.030594 15546 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:32.972187 15038 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:32.937671 19093 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:32.935757 19199 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8.
I20260709 13:06:32.944963 19101 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:06:33.032315 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 306614us
I20260709 13:06:32.943740 19192 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.104380 19192 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.106523 19151 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:32.974785 18943 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:33.032735 19093 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.107122 19151 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:33.109140 19191 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.942678 19111 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.107118 18943 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.109910 19192 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.110325 18943 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.110136 19111 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:32.975093 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.112416 15037 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:33.113039 19205 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.116312 19093 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.118455 19093 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.120183 19084 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:33.123647 19142 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:32.932086 19146 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:33.126505 19146 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.099200 19167 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.127633 19167 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.129570 19167 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:32.980072 15035 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:33.033092 14966 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:32.949076 19121 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.109552 19151 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.021874 15547 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:33.033654 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:33.146821 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54132.9us
I20260709 13:06:32.950718 19204 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:33.144286 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:32.936045 19216 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:33.154664 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.148322 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.148998 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:33.039886 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.033715 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.156315 14893 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:33.147884 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:32.962040 19212 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:33.156831 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.157503 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.164825 14962 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.161420 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:33.165482 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.166220 14888 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.167107 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.168406 14887 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:33.170367 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:32.975979 18935 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.172370 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.170912 15036 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:33.173681 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.099768 19101 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.175395 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.178826 14894 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.144169 19188 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.090677 19218 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:33.149709 19172 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:33.181681 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.177613 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.185098 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:33.171228 19136 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.515s	user 0.011s	sys 0.000s
I20260709 13:06:33.185896 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.189121 15039 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:33.152456 19137 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.032788 19097 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.153s
I20260709 13:06:33.196933 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.089681 19169 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.172571 19084 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.170827 19129 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.173450 18935 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:33.180253 19101 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.144044 19164 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.179306 19125 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.182578 19121 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.203301 15541 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:33.204105 14894 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:33.208355 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:33.189668 19214 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.196535 19115 tablet_copy_client.cc:538] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:33.215762 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.216578 14887 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:33.187860 19024 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.218199 15044 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:33.219156 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.220209 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.211298 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:33.220757 14894 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:33.223847 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.176358 19192 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260709 13:06:33.224958 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.202406 19220 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.203552 19136 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:33.207005 18935 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.201197 19129 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:33.224454 14889 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:33.206930 19093 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.227864 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.229586 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.231966 14964 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:33.229337 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.190835 19188 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.200313 19137 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.261699 15548 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:33.262158 14963 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.231556 19121 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.262972 19121 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:33.264189 19121 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.211699 19125 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.232605 19129 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.196488 19218 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.271577 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.272318 14965 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
W20260709 13:06:33.272446 19231 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:06:33.240674 19140 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.223412 19142 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.274156 19142 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:33.274580 19142 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.239820 19196 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.244161 18943 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.247697 15040 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.249228 19115 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:06:33.250977 19111 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.252470 19220 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:33.254626 19169 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.225734 19214 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.203949 19084 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.215530 19037 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:06:33.256620 19136 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.233491 19212 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.260365 14967 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:33.234071 19164 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:33.290599 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 142824us
W20260709 13:06:33.296859 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 148624us
I20260709 13:06:33.297400 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.300747 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:33.302492 19111 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:33.302942 19111 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:33.304008 19111 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.300747 14964 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:33.312094 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:33.313169 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.314262 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.316067 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.316339 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.316918 14962 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:33.318516 14965 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:33.311345 19038 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.326499 15041 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:33.322957 14965 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:33.300371 19151 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.328511 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:33.329152 15035 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.299562 18943 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.333916 19188 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.334911 19220 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.336887 19214 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.337581 19218 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.312379 19140 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:06:33.343346 14888 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:33.308334 19145 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
W20260709 13:06:33.367722 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 156566us
I20260709 13:06:33.321323 19191 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.381664 18935 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.383589 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.384214 15548 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:33.384650 19084 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:33.388856 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.389205 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.332780 19212 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.395641 15035 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:33.397209 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.347647 19196 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.311625 19136 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.372180 19151 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.411656 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:33.411998 19216 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:33.412483 19216 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.417605 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:33.411667 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.421430 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.425558 19093 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:33.408358 19121 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:33.426256 19228 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.431952 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.434075 15541 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:33.435889 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:33.437729 14888 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.439123 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.427839 19143 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.429087 19233 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.427977 19242 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:33.445900 14888 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:33.445803 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.448189 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.432904 19137 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.460037 15035 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:06:33.445875 19092 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.662s	user 0.009s	sys 0.002s
I20260709 13:06:33.441404 19028 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.441969 19153 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.000s
I20260709 13:06:33.465274 14893 raft_consensus.cc:2410] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:33.430117 19228 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.449276 19024 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.449541 19101 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.445540 19143 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:33.451635 18935 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.460619 19242 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.440515 19116 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.486745 15545 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:33.474511 19024 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.472983 19188 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.468173 19028 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.496168 19116 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:33.467935 19153 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.498579 19101 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.473683 19143 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.507517 19196 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:33.509673 18943 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.512677 18943 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.515568 18943 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.520125 19143 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.509980 19188 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.522954 19143 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.524430 19251 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:33.524967 19028 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.525297 19125 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.501498 18935 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.528236 18935 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.530784 18935 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.500089 19136 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.502884 19024 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.532863 19228 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.503247 19240 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.547675 19188 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.549528 19153 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.550100 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.550738 15035 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:33.550638 19240 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.524987 19251 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.552037 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.552901 19240 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.554255 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.554389 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.554917 15545 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
W20260709 13:06:33.550302 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.555316 19228 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:33.552995 19251 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.482818 19242 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:32.962301 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:33.556170 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:33.557338 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.568252 15041 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:33.555816 19228 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.570463 19228 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.570350 14793 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 7, term changed from 9 to 11, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:33.572435 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.575731 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.576296 14965 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.576717 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:33.577718 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.578373 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.578948 14964 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:06:33.511513 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80115us
I20260709 13:06:33.580735 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.581288 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.581851 14891 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:33.581312 14893 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:33.488334 19093 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:33.591146 18821 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:33.592437 19146 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:33.592896 19146 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:33.593938 19146 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.595633 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:33.462802 19233 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.569895 19153 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:33.597402 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:06:33.584496 19249 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
I20260709 13:06:33.603056 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:33.618474 15035 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.562224 18935 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.586099 19140 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.599566 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.582798 19252 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:33.612038 14892 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:33.612586 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.647482 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:33.625001 19129 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.646998 14895 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:33.629475 15035 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:33.631810 14969 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.633541 19233 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.617856 19153 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.642976 19247 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 13:06:33.644255 19151 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.631296 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:33.653930 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:33.649858 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67496.6us
I20260709 13:06:33.648043 19252 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:33.657130 19252 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.657434 19028 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:33.657809 19028 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.658187 19028 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:33.651925 19253 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:33.659950 19253 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:33.660442 19253 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.654214 19164 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:06:33.667721 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:33.673552 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.639303 19208 ts_tablet_manager.cc:1929] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:06:33.668529 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.676219 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.677302 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.678159 14887 raft_consensus.cc:2410] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:33.671267 14892 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:33.671952 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.679459 15041 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:33.679558 14888 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:33.655119 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.681445 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.681640 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.683219 15548 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:33.683645 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.652423 19153 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.684017 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.685865 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.688194 19142 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.690162 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.690925 15545 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:33.654078 19049 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.692094 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.695535 14890 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:33.686918 14886 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:33.696213 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:33.646230 18935 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.673029 19111 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.699199 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.699146 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.700063 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.709051 14961 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:33.700840 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:33.710148 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.648485 19140 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.716328 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:33.656791 19203 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:06:33.675948 19027 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:33.684646 19208 log.cc:1199] T 66e4432ba29a43668db5483ebef3b522 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/66e4432ba29a43668db5483ebef3b522
I20260709 13:06:33.721387 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.725672 14968 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:33.728116 15041 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:33.729095 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.729604 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:33.684315 19199 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:33.719898 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.729852 14886 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:33.732441 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.732824 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.735890 15038 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:33.689509 19212 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:33.738960 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.733959 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:33.739884 15040 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:33.685192 19147 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.685375 19257 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:33.740338 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.740654 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.694393 19251 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.743206 14890 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:33.705875 19233 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:33.707780 19240 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:33.750165 14966 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:33.750908 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:06:33.757884 19245 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.313s	user 0.001s	sys 0.000s
I20260709 13:06:33.760439 19146 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:33.761580 19266 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.762168 19266 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.689605 19151 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 13:06:33.764816 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49018.3us
I20260709 13:06:33.732421 19204 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:33.739027 19212 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:33.768007 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 81440us
I20260709 13:06:33.707515 19145 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:06:33.673309 19093 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.744561 18893 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:33.749076 19218 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.717295 19167 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:06:33.800225 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.778625 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.725741 19228 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.749842 19198 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:33.729298 19111 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:33.829437 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59270.9us
I20260709 13:06:33.803249 15040 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:33.748421 19240 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.717123 19049 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.766932 19090 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:33.778102 19164 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.772440 19212 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.830238 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:33.845001 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:33.773485 19199 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:33.800586 19233 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:33.804435 19218 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.823683 14890 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:33.746800 19147 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:33.829144 19198 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:33.860113 19208 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34356 (request call id 0) took 1625 ms. Trace:
I20260709 13:06:33.830667 18943 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.827569 19092 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:06:33.848543 14793 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:33.853160 19267 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:33.853757 19268 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:33.832580 19240 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:33.834230 19090 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.848845 19216 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.884856 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.860555 19198 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:33.868116 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.858152 19129 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.870559 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:33.836352 18893 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:33.871685 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.872252 15549 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:33.844441 19142 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.772037 19260 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:06:33.901759 19260 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:33.901643 18893 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.902129 19260 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:33.849658 19199 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:33.881029 19270 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.857900 19218 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.883209 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.857399 19153 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.864058 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:33.885556 14892 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.836120 19214 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.873773 18943 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.850330 19164 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.887840 19028 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.889582 15545 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:33.889520 19252 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:33.890126 19259 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:06:33.834779 19264 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:06:33.892549 14891 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:33.869644 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:33.894871 14888 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 5.
I20260709 13:06:33.848317 19024 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.874401 19267 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.885037 19090 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:33.914578 15546 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:33.871256 19242 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.914701 15541 raft_consensus.cc:2376] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6. Re-sending same reply.
I20260709 13:06:33.905445 19203 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:33.921715 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 51284.5us
I20260709 13:06:33.914558 19199 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:33.926978 14970 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:33.921676 19140 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:33.919950 19214 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:33.915437 19233 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.918202 19270 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:33.902935 19260 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:33.972604 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:33.954887 19049 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.960522 19252 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.928342 19116 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.962489 19216 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:33.935353 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:33.939611 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:33.860559 19208 rpcz_store.cc:276] 0709 13:06:32.235147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:32.239554 (+  4407us) service_pool.cc:224] Handling call
0709 13:06:32.376520 (+136966us) ts_tablet_manager.cc:1151] Deleting tablet 66e4432ba29a43668db5483ebef3b522
0709 13:06:32.398224 (+ 21704us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 13:06:33.448739 (+1050515us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:33.639124 (+190385us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:33.860007 (+220883us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149344,"tablet-delete.queue_time_us":118845,"thread_start_us":60214,"threads_started":1}
I20260709 13:06:34.029834 15041 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:34.037062 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:33.948064 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.037787 15542 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.035044 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:34.042384 15545 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:06:34.030529 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 95327.7us
I20260709 13:06:33.932986 19267 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:33.934345 19274 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.048208 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:34.048787 19268 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:34.051141 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:34.049659 19167 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:34.052349 19167 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:34.052802 19167 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.053078 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:34.053186 19167 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.054229 15041 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:06:34.056340 19268 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:34.056931 19268 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:34.057968 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.061290 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.063694 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.050669 19274 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.064396 15041 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:34.066541 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:33.955459 19153 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.067318 15545 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 5.
I20260709 13:06:34.034698 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:33.932735 18935 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.002985 19125 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:33.972065 19228 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.028542 19116 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.099197 19253 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.100992 19116 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.101169 19253 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.103286 14886 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:34.041463 19027 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:33.955358 19266 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.034593 19270 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.034793 19271 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.082422 19213 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:34.083388 19031 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:06:34.041800 19115 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 13:06:33.974684 19242 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.086254 19251 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:34.026180 19024 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:33.942718 19241 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.136828 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:33.944767 19028 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:34.071859 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.137468 14966 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:34.092195 19214 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.077507 15542 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:34.109602 15546 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:34.110472 19285 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:34.111678 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58670.7us
I20260709 13:06:34.069957 19093 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.073064 19252 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.094971 19198 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.112567 19027 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.102587 18935 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:34.182132 19241 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:34.195921 19279 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:34.197022 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.197546 19241 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.197628 15039 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:34.142963 19153 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.198562 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.198518 19153 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.102146 19125 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.200672 19153 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.057971 19268 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.127401 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:33.943149 19203 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.139940 19031 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:34.116604 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:33.946720 19164 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.137791 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.138361 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.139564 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.139848 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.141057 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.183462 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.102079 19090 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.183878 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:34.184348 14962 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:34.186473 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.187618 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.306062 14892 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
W20260709 13:06:34.188922 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.189214 19252 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.189669 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.134366 19275 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:06:34.201016 19125 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.191504 19198 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.142292 18893 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.135898 19213 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.204630 15548 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:34.206599 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.207588 14966 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:34.209159 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:34.209436 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.205786 19242 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.291778 19214 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.287060 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.281589 19268 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.302242 15042 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:34.275168 15039 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:34.307080 14968 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:06:34.314877 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 131095us
I20260709 13:06:34.330726 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.346153 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.343236 19242 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.281459 19115 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:34.347419 19233 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.348259 19115 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:06:34.348824 19242 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.349583 19115 ts_tablet_manager.cc:1403] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 1.101s	user 0.044s	sys 0.006s
I20260709 13:06:34.325037 14890 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.325918 15546 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:34.328651 14891 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:34.252580 19251 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.326187 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 116864us
I20260709 13:06:34.305019 18935 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:34.262161 19216 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.248296 19271 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.273082 19203 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.317466 19153 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:34.289072 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 172562us
I20260709 13:06:34.349915 19198 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.317670 19101 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:34.356942 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:34.306937 19277 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:34.352900 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:34.404345 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51573.4us
W20260709 13:06:34.404975 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.319615 19037 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.382906 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:34.374948 19286 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.255158 19167 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.257745 19218 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.397535 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.260943 19240 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.271499 19212 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.370376 19125 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.427677 19125 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.428164 19125 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.400666 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:34.429615 15545 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:34.405586 19024 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:34.401304 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44486.1us
I20260709 13:06:34.352137 19214 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:34.397490 19130 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.024s	sys 0.058s
I20260709 13:06:34.356366 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:34.280813 19031 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.410044 15546 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:34.395766 19198 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.409780 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.411163 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.412843 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.448129 14892 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:34.329135 18893 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.415719 14891 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:34.203634 19285 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.405474 19101 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.463711 19101 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.464075 19285 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.402336 19153 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.425262 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2759) took 1113 ms. Trace:
W20260709 13:06:34.440135 19130 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.025s	sys 0.059s
I20260709 13:06:34.400228 14890 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:34.403534 19277 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:34.483376 19277 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.486500 19196 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.433127 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:34.487785 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54735.8us
I20260709 13:06:34.494664 15038 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:34.495421 19199 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.497087 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.497745 15039 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:34.498248 19199 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.384179 19216 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.500588 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:34.491138 19283 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:34.382035 18935 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.501748 19283 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:34.502758 19283 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.503266 18935 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:34.437085 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80813.5us
I20260709 13:06:34.215102 19093 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.504421 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:34.452032 19276 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:34.505455 19093 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:34.439252 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.435473 19090 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.441412 19213 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.443781 15041 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:34.444555 19240 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.444729 19212 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.445308 15044 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:34.411255 19269 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.514381 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.510218 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.453501 19292 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.454252 19198 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.460510 19218 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.513623 14893 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:06:34.461653 18893 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.394904 19271 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:34.281836 19092 consensus_queue.cc:1175] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 11 status { last_received { term: 9 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: [10.11-10.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:34.474380 19189 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:34.476639 19167 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.410624 19037 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.477896 19101 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.471102 19153 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.467561 15037 rpcz_store.cc:276] 0709 13:06:33.312035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.315582 (+  3547us) service_pool.cc:224] Handling call
0709 13:06:33.330333 (+ 14751us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:33.330766 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:33.330806 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:33.331323 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:06:33.436050 (+104727us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:33.455545 (+ 19495us) log.cc:844] Serialized 14 byte log entry
0709 13:06:33.461674 (+  6129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:33.461770 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:34.374076 (+912306us) spinlock_profiling.cc:243] Waited 7.17 ms on lock 0x7b1800481de0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:06:34.424892 (+ 50816us) raft_consensus.cc:1685] finished
0709 13:06:34.425022 (+   130us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:34.425170 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14906,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":8640,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":9434,"spinlock_wait_cycles":16489856,"thread_start_us":66402,"threads_started":1,"wal-append.queue_time_us":111261}
I20260709 13:06:34.628218 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.629703 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.630442 14892 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.479600 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.481890 19111 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.482568 19262 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.495729 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.500699 19216 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.375073 19251 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.504060 19267 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.497087 15040 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:06:34.509198 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.442677 19214 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.676918 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:34.417009 19286 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.509538 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.690272 14890 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.510782 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.511126 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.443351 19027 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:34.517125 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.691360 14963 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:34.691494 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 180460us
I20260709 13:06:34.691802 14962 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:34.547911 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.429301 19115 raft_consensus.cc:359] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:34.634897 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.487071 19196 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.632884 14961 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:34.747144 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.748062 14961 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:34.505484 19276 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:34.753961 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:34.754679 15037 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.738893 19101 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.755898 19101 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.756235 19101 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.756359 19271 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.760546 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.761282 15039 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:34.763116 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:34.729094 19037 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.661042 15038 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:34.514333 19269 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.681201 19090 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.681665 14895 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:34.760799 19204 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.879s	user 0.033s	sys 0.060s
I20260709 13:06:34.682622 19251 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.682803 19267 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.684119 19260 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.626489 19093 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.697835 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:34.698832 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.702023 19027 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.703198 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.703850 19147 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.522257 19228 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.169s
I20260709 13:06:34.626174 19292 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.775902 19269 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.729344 19257 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.729070 19277 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.733794 19130 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:06:34.734314 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44790.8us
I20260709 13:06:34.675686 19262 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.743589 14894 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:34.779394 19276 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:34.749670 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.752862 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.665943 14892 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:34.767591 14890 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:34.751251 19153 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:06:34.779603 19204 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.033s	sys 0.061s
I20260709 13:06:34.743934 19115 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:06:34.682325 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.804349 14933 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:34.827113 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 144896us
I20260709 13:06:34.828051 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.807569 14887 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:34.829370 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.777480 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:34.783541 19090 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.786586 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:34.800118 14963 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 6.
I20260709 13:06:34.813537 14793 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 7, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 7 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:34.845235 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.845891 14963 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:34.801187 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.808305 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 2449) took 1111 ms. Trace:
I20260709 13:06:34.812938 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:34.813555 14961 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
W20260709 13:06:34.835131 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57771.1us
I20260709 13:06:34.849822 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.836108 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.799974 15542 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:34.806855 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:34.825346 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.851984 14890 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:34.784871 19125 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.845885 14793 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 5 to 6, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:34.863261 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:34.847765 14965 rpcz_store.cc:276] 0709 13:06:33.696930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.700594 (+  3664us) service_pool.cc:224] Handling call
0709 13:06:34.808134 (+1107540us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54001978d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:34.808250 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391768320}
I20260709 13:06:34.863878 14961 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:34.195091 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 66e4432ba29a43668db5483ebef3b522 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:06:34.868686 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:06:34.861153 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56900.9us
I20260709 13:06:34.861333 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.864979 14793 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:34.858333 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.881083 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.803879 19292 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.816188 19266 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:34.876083 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3086) took 1093 ms. Trace:
W20260709 13:06:34.876317 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 69539.9us
I20260709 13:06:34.876821 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.862697 19216 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.883605 14895 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:34.883761 14894 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:34.855934 19218 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:34.806106 19130 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:34.801920 19228 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.808023 19262 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.888741 19285 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:34.982924 19285 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.983736 19262 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:34.984112 19262 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.984447 19262 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:34.984944 19285 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.801677 19101 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.970582 19283 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:34.988270 19283 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.990177 19283 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.990629 19283 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:34.889183 14777 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 752019us
I20260709 13:06:34.973263 19115 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:34.993835 19115 ts_tablet_manager.cc:1434] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.644s	user 0.009s	sys 0.001s
W20260709 13:06:34.994109 19115 ts_tablet_manager.cc:1467] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Tablet startup took 644ms
I20260709 13:06:34.995782 19153 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:34.996201 19153 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.877871 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:34.999775 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 122024us
I20260709 13:06:35.000128 19189 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:35.000490 19189 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.000856 19189 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.001055 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.874797 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:35.002074 14965 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.003140 15035 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
W20260709 13:06:35.004629 15035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2770) took 1327 ms (client timeout 1619 ms). Trace:
I20260709 13:06:35.004937 19090 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:35.005669 19090 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:35.006175 19090 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:34.855603 18893 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:35.008536 18893 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:35.008824 19130 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.009298 19125 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.009881 19130 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:35.009477 18893 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.979733 19286 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.805967 19277 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:34.882431 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:34.855366 19214 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:35.011790 15041 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:35.011974 19214 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:34.809298 19276 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.904981 15542 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:34.865563 19147 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.012887 19214 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.013700 19147 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.893555 14886 rpcz_store.cc:276] 0709 13:06:33.777508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.777638 (+   130us) service_pool.cc:224] Handling call
0709 13:06:33.800647 (+ 23009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.103706 (+303059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.870622 (+766916us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540024efd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:34.870847 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":692717440}
I20260709 13:06:34.969535 19292 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:34.894172 14793 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 10, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 10 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:35.016026 19292 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:34.810256 19274 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.945854 14963 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:35.017045 19292 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.016891 14793 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 13, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.017962 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:34.970187 15545 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:34.969658 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.018527 14963 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.972141 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.019855 15039 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 6.
I20260709 13:06:34.804575 19257 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.799707 19093 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:34.970445 19266 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.893131 19091 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:34.980597 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 289) took 10073 ms. Trace:
I20260709 13:06:34.889293 19213 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:34.893514 19139 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:34.982034 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.032557 14890 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:34.982132 19218 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:34.889844 19240 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:34.988560 19101 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:34.996236 19196 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:34.999701 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:34.991035 19283 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:34.977995 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:35.020071 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:34.979732 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:34.974229 19216 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.067795 14962 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:35.067972 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 1984) took 1385 ms. Trace:
I20260709 13:06:35.068514 14889 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:34.975135 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.068796 14961 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:34.972270 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.044200 15008 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:34.971612 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:35.070845 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.074882 14890 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:35.012854 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.075778 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:35.076049 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.076841 14890 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.077239 15041 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:35.022925 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.078418 15039 raft_consensus.cc:2368] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:35.018518 14793 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 7, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 7 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:35.015939 19147 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:35.023919 19233 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:35.004972 15035 rpcz_store.cc:269] 0709 13:06:33.677570 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.677678 (+   108us) service_pool.cc:224] Handling call
0709 13:06:35.004468 (+1326790us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540014a5d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:35.004561 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038791552}
I20260709 13:06:35.016081 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.026577 19199 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.062007 15546 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:35.060711 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.094903 14891 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:34.994988 19269 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.090183 19216 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.098399 19269 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.099109 15042 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:35.064960 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:35.036027 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.100641 14969 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:35.030892 14788 rpcz_store.cc:276] 0709 13:06:24.906763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:24.906938 (+   175us) service_pool.cc:224] Handling call
0709 13:06:34.980480 (+10073542us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:31.627516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:31.628080 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:31.628112 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:06:31.628129 (+    17us) tablet.cc:662] Decoding operations
0709 13:06:31.628632 (+   503us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:31.628686 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:31.628709 (+    23us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:06:31.629037 (+   328us) tablet.cc:701] Row locks acquired
0709 13:06:31.629056 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:06:31.629183 (+   127us) write_op.cc:270] Start()
0709 13:06:31.629293 (+   110us) write_op.cc:276] Timestamp: P: 1783602391629144 usec, L: 0
0709 13:06:31.629314 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:31.629995 (+   681us) log.cc:844] Serialized 1303 byte log entry
0709 13:06:32.084979 (+454984us) op_driver.cc:464] REPLICATION: finished
0709 13:06:32.485133 (+400154us) write_op.cc:301] APPLY: starting
0709 13:06:32.485213 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:32.526789 (+ 41576us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:32.526899 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:32.563397 (+ 36498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:32.563627 (+   230us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:06:32.563686 (+    59us) write_op.cc:312] APPLY: finished
0709 13:06:32.563929 (+   243us) log.cc:844] Serialized 41 byte log entry
0709 13:06:32.564104 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.564207 (+   103us) write_op.cc:454] Released schema lock
0709 13:06:32.564259 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:32.564643 (+   384us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:32.564677 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":621479,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":395296,"apply.run_cpu_time_us":9757,"apply.run_wall_time_us":79460,"cfile_cache_hit":10,"cfile_cache_hit_bytes":10450,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":1088,"lbm_reads_lt_1ms":12,"num_ops":3,"prepare.queue_time_us":112148,"prepare.run_cpu_time_us":2814,"prepare.run_wall_time_us":23790,"replication_time_us":401822,"thread_start_us":305178,"threads_started":2}]]}
I20260709 13:06:35.100914 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.102021 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.033630 14965 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:35.079324 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.088354 14968 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:35.102986 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.103655 14968 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.104954 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.088181 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.089409 14886 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:35.112139 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.112255 19216 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.112442 19262 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.113471 14886 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:35.011562 19228 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.090564 15036 raft_consensus.cc:2368] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10.
I20260709 13:06:35.068370 14970 rpcz_store.cc:276] 0709 13:06:33.683075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.683765 (+   690us) service_pool.cc:224] Handling call
0709 13:06:35.067808 (+1384043us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b54003e6f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:35.067921 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":549873024}
I20260709 13:06:35.064319 19275 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:35.111176 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:06:35.088088 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 43979.5us
I20260709 13:06:35.107170 14891 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:35.115792 14894 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.094084 14963 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:35.117462 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:35.118888 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.111174 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.123131 14890 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:35.124347 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.124455 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.124925 14886 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.034479 19139 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.126178 14891 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:35.126679 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:35.126488 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.128160 14891 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:35.036309 19240 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.064494 19213 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:35.007210 19090 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.167790 14890 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:35.092799 19233 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:35.178341 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 309788us
I20260709 13:06:35.171762 19143 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:35.161482 19139 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.164104 19212 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:35.131464 19198 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:35.125581 19269 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.194494 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:35.197705 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:35.115239 19275 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.115279 19262 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.161120 19101 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:35.191665 14893 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:35.132014 19263 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:35.132278 19228 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.186884 14894 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:35.161995 19300 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:35.167035 19240 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.117054 19204 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.199697 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:35.204167 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 359759us
I20260709 13:06:35.189919 19143 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:35.209612 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.194173 19198 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:35.274232 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 212814us
I20260709 13:06:35.272387 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.282522 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.290237 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.291493 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:35.197008 19216 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:35.307921 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:35.338933 14965 raft_consensus.cc:2368] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:06:35.308377 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:35.131743 19199 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.201506 19286 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:35.207554 19285 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:35.326982 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.372360 15041 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:35.373242 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.373750 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:35.374446 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:35.272023 19204 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.334544 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.352059 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:35.377709 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 178148us
I20260709 13:06:35.377895 15545 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.363652 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.378443 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:35.364146 14968 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:35.366627 18943 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:35.367048 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.326334 19198 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:35.367969 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 2404) took 1181 ms. Trace:
I20260709 13:06:35.362881 19286 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:35.362213 19262 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:35.369506 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 78154.8us
W20260709 13:06:35.389207 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 260906us
W20260709 13:06:35.390348 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.384505 14887 rpcz_store.cc:276] 0709 13:06:34.186583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.189372 (+  2789us) service_pool.cc:224] Handling call
0709 13:06:35.367800 (+1178428us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b540024e5d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:35.367895 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1130799872}
I20260709 13:06:35.391800 14859 leader_election.cc:400] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:06:35.392149 14859 leader_election.cc:403] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.361793 19257 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:35.354614 19309 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.361217 14886 raft_consensus.cc:2410] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:06:35.360430 19301 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 13:06:35.374882 15041 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.333825 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.374203 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:35.281471 19143 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.367681 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:35.383566 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 257195us
I20260709 13:06:35.383802 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:35.192366 19218 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.329171 19228 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:35.354892 19305 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.438654 19305 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.439200 19305 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.441732 15039 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:35.201138 19212 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:35.272526 19263 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.400353 19309 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.444895 19309 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.445608 19263 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.381647 19204 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.407629 19027 raft_consensus.cc:2764] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:35.410379 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.448215 19311 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:35.448937 19311 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:35.450011 19311 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.451674 19269 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:35.452343 19269 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:35.454360 18893 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:06:35.455338 18893 consensus_queue.cc:1243] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:06:35.456909 18893 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:35.456676 19228 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.457448 18893 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:35.458501 18893 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.275346 19300 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.501528 19300 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.403030 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.502591 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:35.503849 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:35.389600 19271 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.507536 19271 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.487003 15041 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:35.516680 19271 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:35.520820 19189 consensus_meta.cc:287] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
I20260709 13:06:35.521513 19189 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.388962 19286 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.385110 19285 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:06:34.994412 19115 ts_tablet_manager.cc:1469] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Trace:
0709 13:06:29.578877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.580141 (+  1264us) service_pool.cc:224] Handling call
0709 13:06:29.939750 (+359609us) ts_tablet_manager.cc:934] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
0709 13:06:32.294243 (+2354493us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:32.552889 (+258646us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:32.553021 (+   132us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:06:32.645117 (+ 92096us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:32.645417 (+   300us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:32.645774 (+   357us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:32.645839 (+    65us) inbound_call.cc:177] Queueing success response
0709 13:06:33.248854 (+603015us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:06:34.349953 (+1101099us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:06:34.426752 (+ 76799us) tablet_replica.cc:261] Starting instrumentation
0709 13:06:34.427448 (+   696us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":39634,"raft.queue_time_us":19096,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"tablet-copy.queue_time_us":325931,"tablet-download-pool.queue_time_us":135,"tablet-download-pool.run_cpu_time_us":1293,"tablet-download-pool.run_wall_time_us":274414,"thread_start_us":378501,"threads_started":2}
I20260709 13:06:35.422531 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.423573 19257 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.392397 18943 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.392180 19137 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:06:35.428193 19283 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:35.429760 19266 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:35.409962 18935 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:35.396268 19262 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.414217 19093 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.453387 19269 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.462776 14887 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:35.403478 19293 raft_consensus.cc:2764] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:06:35.399053 19091 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8.
I20260709 13:06:35.383919 19213 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.484246 19097 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:35.443354 15039 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:35.410585 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:35.488931 19153 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.494328 19233 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.495256 19212 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:35.522866 19281 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.331s	user 0.007s	sys 0.008s
I20260709 13:06:35.522678 15545 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:06:35.606148 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 195688us
I20260709 13:06:35.526906 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:35.607020 14970 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:35.414453 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:35.534483 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1988) took 1417 ms. Trace:
W20260709 13:06:35.608238 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 193914us
I20260709 13:06:35.399767 19214 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.129s
I20260709 13:06:35.533573 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.610345 14969 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:35.611001 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 2414) took 1099 ms. Trace:
I20260709 13:06:35.611230 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.611375 14895 rpcz_store.cc:276] 0709 13:06:34.512014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.512126 (+   112us) service_pool.cc:224] Handling call
0709 13:06:35.610859 (+1098733us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002ec2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:35.610949 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":383489280}
I20260709 13:06:35.612349 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.613456 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:35.544209 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 165859us
I20260709 13:06:35.614385 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:35.614840 19318 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:35.615568 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.616322 19283 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:35.616886 19283 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:35.617858 19189 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:35.617786 19283 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.618592 19189 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:35.618877 19287 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.172s	user 0.000s	sys 0.002s
I20260709 13:06:35.619539 19285 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.623332 19320 raft_consensus.cc:2764] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:06:35.624092 19320 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:35.624480 19320 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.624850 19320 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:35.626066 14888 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:35.626230 19199 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.626477 14888 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:35.627271 14888 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.627861 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1993) took 1273 ms. Trace:
I20260709 13:06:35.628285 14888 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:35.629081 19049 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:35.629623 19049 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.592224 15036 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
W20260709 13:06:35.600550 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.609369 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:35.590317 18935 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.499971 19228 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:35.634160 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 227051us
I20260709 13:06:35.641471 14970 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:35.607898 14964 rpcz_store.cc:276] 0709 13:06:34.117063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.134766 (+ 17703us) service_pool.cc:224] Handling call
0709 13:06:34.135071 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.507279 (+372208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.507309 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.507353 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:34.507385 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.534201 (+1026816us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54003ebf54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:35.534262 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.534414 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855712000}
I20260709 13:06:35.647809 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:35.648496 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.648656 19266 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:35.648823 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.649163 19266 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:35.649602 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:35.650152 14970 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:35.650081 19266 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.616887 19262 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:35.655352 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.653435 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:35.658953 14969 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:35.628306 14966 rpcz_store.cc:276] 0709 13:06:34.354735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.358084 (+  3349us) service_pool.cc:224] Handling call
0709 13:06:34.358382 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:34.686505 (+328123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.686549 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:34.686606 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:34.686650 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.627638 (+940988us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b5400097c54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:35.627681 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:35.627806 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":754215296}
I20260709 13:06:35.659339 14968 raft_consensus.cc:2368] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:35.657802 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:35.532967 19257 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.661070 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:35.603870 19316 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:35.667001 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.671451 15545 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:35.668771 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.673942 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.674625 15542 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:35.632467 19309 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.676218 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.605674 19322 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:35.655081 18935 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.703394 15043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:35.704376 15043 raft_consensus.cc:606] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:35.704855 15043 raft_consensus.cc:614] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:35.654522 19093 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:35.665848 19145 raft_consensus.cc:2764] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:06:35.605405 19097 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:35.720429 19233 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:35.664983 19228 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:35.723593 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 197171us
W20260709 13:06:35.748102 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.748139 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:35.725553 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:35.654260 19198 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.755831 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:35.756117 14888 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:35.757989 14888 pending_rounds.cc:85] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 8
W20260709 13:06:35.740414 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 142198us
I20260709 13:06:35.680833 19292 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:35.761341 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:35.679941 19049 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:35.751505 19228 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.772337 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.773221 15038 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:35.758299 14888 pending_rounds.cc:107] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:35.773860 14888 raft_consensus.cc:2889] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:35.774623 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2405) took 1587 ms. Trace:
I20260709 13:06:35.759279 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-13ff541fc966499ea2706d34cfb2c964 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:06:35.736485 19093 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:35.784319 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:35.789003 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 173517us
I20260709 13:06:35.775110 14888 rpcz_store.cc:276] 0709 13:06:34.186851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.190163 (+  3312us) service_pool.cc:224] Handling call
0709 13:06:34.190455 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:35.625976 (+1435521us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b5400039420. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d781c0 00007f5534d79231 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c
0709 13:06:35.774388 (+148412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:35.774567 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":306157440}
W20260709 13:06:35.768785 19314 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.345s	user 0.002s	sys 0.000s
I20260709 13:06:35.704396 19322 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.790069 15516 leader_election.cc:400] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:35.799816 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:35.822425 15516 leader_election.cc:403] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.824607 15037 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:06:35.821693 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:35.805330 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.827823 15039 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:06:35.828210 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 220968us
W20260709 13:06:35.829298 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76247.6us
I20260709 13:06:35.771293 19214 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:35.681499 19316 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:35.799575 19130 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.779s	user 0.013s	sys 0.000s
I20260709 13:06:35.832046 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:35.788655 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-13ff541fc966499ea2706d34cfb2c964 on tablet 13ff541fc966499ea2706d34cfb2c964 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:35.776443 19228 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:35.857574 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:35.861603 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:35.872742 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 82889.5us
I20260709 13:06:35.769667 19292 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.876118 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.829190 19233 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:35.883212 14888 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:35.777076 19145 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.875293 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.884531 14889 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:35.788784 19300 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:06:35.901517 15516 leader_election.cc:400] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10.
I20260709 13:06:35.835556 19214 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:35.902025 15516 leader_election.cc:403] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.896479 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.902969 15039 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:35.899173 15037 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:06:35.899888 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.833652 19137 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:35.911134 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:35.907053 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 159007us
I20260709 13:06:35.880569 19328 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.844123 19262 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:06:35.923002 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.923794 15037 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:35.925506 14888 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:06:35.926229 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.926577 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.927038 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.927682 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.927898 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.928243 14888 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:35.928007 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.928920 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.929009 14891 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.931646 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:35.932669 14886 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:35.933089 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:35.936916 19335 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.936789 19137 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:35.937641 19137 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:35.938184 19137 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:35.938524 19316 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.940527 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:35.944391 19313 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.356s	user 0.001s	sys 0.001s
I20260709 13:06:35.879290 19308 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 13:06:35.918929 19323 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:35.917239 19153 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:35.882861 19311 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:06:35.918396 19213 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:35.947707 15514 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:35.983150 15514 leader_election.cc:403] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.937511 19335 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.955475 14890 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:35.944600 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.960307 14891 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:35.944882 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:35.986646 14894 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
W20260709 13:06:35.974385 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73109.6us
I20260709 13:06:35.977191 14886 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:35.954494 19285 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:35.989603 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:35.989892 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:35.990198 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.990527 15547 raft_consensus.cc:2368] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:35.991245 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.991837 15547 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:35.992638 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.954686 19339 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:35.993935 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.997897 15545 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:06:35.990800 15550 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:35.993156 15547 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:35.996958 15544 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:35.979619 19323 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:36.002295 15044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2778) took 1861 ms (client timeout 2124 ms). Trace:
I20260709 13:06:36.003291 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:36.004431 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:36.005158 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57639.7us
I20260709 13:06:36.006450 14933 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
W20260709 13:06:36.002674 15044 rpcz_store.cc:269] 0709 13:06:34.140624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.314549 (+173925us) service_pool.cc:224] Handling call
0709 13:06:36.002098 (+1687549us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b540014aad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.002231 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226310016}
I20260709 13:06:36.006783 14933 leader_election.cc:403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:35.921113 19093 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.009697 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.009779 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.012488 15547 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 5.
I20260709 13:06:35.933678 19328 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.024206 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:35.997409 19213 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:36.025063 15547 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:36.025739 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:35.997339 19339 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:35.978318 19333 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:36.029085 19338 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.027522 15044 raft_consensus.cc:606] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:36.007519 19145 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:36.012554 19233 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:06:36.034075 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.005409 19323 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.010401 19252 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:36.051136 18821 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
W20260709 13:06:36.051223 19331 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 13:06:36.051508 19322 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.039906 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:36.051990 19286 consensus_meta.cc:287] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.520s	user 0.004s	sys 0.004s
I20260709 13:06:36.052191 15545 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:36.043109 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:36.028491 19204 consensus_meta.cc:287] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 13:06:36.053718 19204 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:36.055542 19312 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.608s	user 0.000s	sys 0.004s
I20260709 13:06:36.043813 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.007658 19153 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:06:36.047791 19334 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 13:06:36.048179 19305 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.608s	user 0.005s	sys 0.005s
I20260709 13:06:36.048463 19341 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.048098 19137 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:36.048853 19321 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.288s	user 0.001s	sys 0.000s
W20260709 13:06:36.049582 19324 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:06:36.049760 19325 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:36.050215 19189 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:06:36.050309 19332 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:06:36.052443 19286 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:35.999058 19285 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.045759 19342 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.057706 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:36.056335 19204 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.063880 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.032845 19335 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.034840 19339 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.076246 19322 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:06:36.078151 19307 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.864s	user 0.001s	sys 0.001s
W20260709 13:06:36.078433 19143 consensus_meta.cc:287] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 13:06:36.079176 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 2462) took 1567 ms. Trace:
I20260709 13:06:36.115280 14961 rpcz_store.cc:276] 0709 13:06:34.511877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.969364 (+457487us) service_pool.cc:224] Handling call
0709 13:06:36.079024 (+1109660us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54003e6a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.079124 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114425728}
W20260709 13:06:36.081655 19139 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.885s	user 0.006s	sys 0.004s
I20260709 13:06:36.081598 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:35.980947 19214 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:36.082612 19292 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:36.082803 18943 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.000s
W20260709 13:06:36.084007 19240 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.002s
W20260709 13:06:36.088922 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.092700 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.092919 19309 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.096688 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.097211 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:36.123785 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.108225 15041 raft_consensus.cc:606] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:06:36.056140 19340 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:36.116773 15549 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:36.122502 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.124147 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.125092 15545 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:36.116974 19143 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.125514 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.130713 15043 raft_consensus.cc:2368] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7.
I20260709 13:06:36.117264 19345 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:36.097862 19305 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.042790 19338 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.127966 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.128089 19348 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.127962 15041 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:36.119460 19139 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.133903 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:36.143594 14966 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:36.144340 15044 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:36.144296 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:36.127233 19290 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.667s	user 0.000s	sys 0.004s
I20260709 13:06:36.138435 19354 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:36.140861 19326 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:36.145331 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.123359 19240 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.141557 15516 leader_election.cc:400] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7.
I20260709 13:06:36.144672 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:06:36.145231 15550 raft_consensus.cc:2368] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:36.042883 19333 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.121893 19292 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.122517 18943 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:36.130589 19311 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:36.158382 15516 leader_election.cc:403] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.159626 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:36.143038 19137 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.141589 19355 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.148085 19204 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.111147 19213 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.168292 15544 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:36.160053 19320 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.534s	user 0.013s	sys 0.004s
I20260709 13:06:36.173777 15010 leader_election.cc:400] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:36.162568 19285 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:36.177713 15038 raft_consensus.cc:2368] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:36.179636 15010 leader_election.cc:403] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:36.163262 19189 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.184303 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.175643 19334 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.172123 19263 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.160063 19340 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:06:36.173906 19311 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:36.195950 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 1986) took 2149 ms. Trace:
I20260709 13:06:36.186652 19204 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12.
I20260709 13:06:36.188524 19268 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.165198 19292 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.205672 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 912) took 1802 ms. Trace:
I20260709 13:06:36.198093 14967 rpcz_store.cc:276] 0709 13:06:34.044733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.044856 (+   123us) service_pool.cc:224] Handling call
0709 13:06:34.086781 (+ 41925us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.087111 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.087140 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.087632 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:06:34.389249 (+301617us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:34.389303 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:34.389390 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.095276 (+1705886us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:36.188440 (+ 93164us) raft_consensus.cc:1685] finished
0709 13:06:36.188482 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.193827 (+  5345us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":85,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":13040000,"thread_start_us":274793,"threads_started":1,"wal-append.queue_time_us":347184}
I20260709 13:06:36.207072 15548 rpcz_store.cc:276] 0709 13:06:34.398478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.398632 (+   154us) service_pool.cc:224] Handling call
0709 13:06:34.398937 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:34.757836 (+358899us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:34.757864 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:34.758413 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 13:06:35.042875 (+284462us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:35.042927 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.200464 (+1157537us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54005d0f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:36.200518 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:36.200585 (+    67us) raft_consensus.cc:1685] finished
0709 13:06:36.200597 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:36.200778 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":777,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5429,"spinlock_wait_cycles":824711552,"thread_start_us":263576,"threads_started":1,"wal-append.queue_time_us":408209,"wal-append.run_cpu_time_us":1823,"wal-append.run_wall_time_us":1004757}
I20260709 13:06:36.203974 19139 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.216110 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.161484 19348 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.221187 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.165781 19354 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.224241 19354 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.224903 19348 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:36.224858 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.221328 19286 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.228188 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.228929 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.232723 15037 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:36.202711 19285 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:36.181782 19320 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.240795 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:36.227066 19289 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.710s	user 0.006s	sys 0.009s
I20260709 13:06:36.199190 19263 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.144249 19345 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.219543 19305 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:36.255934 19349 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:06:36.249845 19151 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.261476 15546 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:36.214102 19268 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.262221 19347 tablet_replica.cc:333] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:06:36.215068 18935 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.252831 19286 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:36.265496 15040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 2025) took 2328 ms (client timeout 2317 ms). Trace:
W20260709 13:06:36.265889 15040 rpcz_store.cc:269] 0709 13:06:33.936738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:33.936865 (+   127us) service_pool.cc:224] Handling call
0709 13:06:36.265274 (+2328409us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54001cd754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.265412 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055220608}
I20260709 13:06:36.266244 19345 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:36.267565 19351 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:36.264190 19151 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.269738 19263 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.258765 19348 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:36.270569 19292 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.271505 19151 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.274469 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.275128 14891 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:36.276225 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:36.276778 14891 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.277251 19257 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.278338 19338 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.279963 19341 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:36.281352 19342 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10.
I20260709 13:06:36.281608 19320 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.284430 14889 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:36.283643 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.286360 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.287225 15043 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.287268 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.291276 15548 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:36.286475 14891 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:36.294246 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:36.295599 15542 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:36.253291 19285 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.298177 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:36.300220 14889 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:36.301834 14888 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:06:36.304087 14891 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:36.303004 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:36.286931 19304 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.091s	user 0.003s	sys 0.000s
I20260709 13:06:36.308962 15547 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:36.310123 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.284677 19286 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.312109 19258 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:36.270571 19348 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:36.305332 19240 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:36.330425 19303 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.975s	user 0.000s	sys 0.006s
W20260709 13:06:36.333487 14962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 2475) took 1556 ms (client timeout 1812 ms). Trace:
W20260709 13:06:36.333988 14962 rpcz_store.cc:269] 0709 13:06:34.776849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.800940 (+ 24091us) service_pool.cc:224] Handling call
0709 13:06:36.333322 (+1532382us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b540010a4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.333428 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":506618624}
I20260709 13:06:36.336030 19024 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:36.336632 19024 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:36.348173 19097 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:36.348487 18893 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.283664 19328 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.349620 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.350531 15548 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:06:36.314960 19151 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:36.352773 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.353436 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.354367 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:36.355770 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:36.306838 19320 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:06:36.356400 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:36.356940 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.403317 19137 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.404933 14965 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:36.357515 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.319180 19258 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.403836 14961 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.261632 19311 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.370901 15043 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:36.406224 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.359396 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:36.364710 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:36.356220 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.305866 19257 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
W20260709 13:06:36.350411 19218 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.002s	sys 0.041s
W20260709 13:06:36.424805 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 68673.4us
I20260709 13:06:36.411302 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.425493 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:36.403558 19303 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:06:36.410194 14968 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:06:36.426698 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.337777 19024 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.426843 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:36.414048 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:36.427788 14965 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:06:36.428653 19090 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.008s	sys 0.006s
I20260709 13:06:36.428900 19204 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:36.432081 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.432600 14962 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:36.405535 19305 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:36.422003 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.422112 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.436807 15037 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:36.422880 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.414937 19258 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.425493 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.440295 14970 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:36.417125 19328 raft_consensus.cc:2764] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:06:36.428993 19090 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.008s	sys 0.006s
I20260709 13:06:36.433295 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:36.416090 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61833.8us
I20260709 13:06:36.434835 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.449342 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.419503 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:36.424861 19218 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.990s	user 0.002s	sys 0.041s
I20260709 13:06:36.435540 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.436040 19242 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:36.435839 19252 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:36.412674 19101 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.058s	user 0.008s	sys 0.004s
I20260709 13:06:36.349701 19251 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 13:06:36.353497 19140 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:06:36.444643 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.416865 19153 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:36.445719 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.446547 14936 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.424619 19151 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:36.464854 19268 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.427613 19276 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:36.464887 19352 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:06:36.465955 19276 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:36.459174 19101 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.008s	sys 0.004s
I20260709 13:06:36.467659 19101 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:36.468195 19276 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.404945 19137 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.468480 19101 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.470670 19137 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.442068 19305 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.464789 19153 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:36.474980 14970 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:36.475327 14967 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:36.476497 19305 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.476756 19153 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.465636 19151 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.479645 19299 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:36.480072 19299 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.480271 19334 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7.
I20260709 13:06:36.480422 19299 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:36.453787 15043 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:36.454968 14968 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:36.455482 14889 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:36.439294 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:36.486050 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50361.2us
I20260709 13:06:36.453459 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:36.459745 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 2038) took 2050 ms. Trace:
I20260709 13:06:36.461056 14894 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
W20260709 13:06:36.465500 19356 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:36.435029 19309 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:06:36.489377 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:36.490882 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.491878 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.456823 19242 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.494280 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.488091 15042 rpcz_store.cc:276] 0709 13:06:34.409375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:34.409532 (+   157us) service_pool.cc:224] Handling call
0709 13:06:36.459556 (+2050024us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b5400187254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.459678 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1497532288}
I20260709 13:06:36.514086 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:36.493335 19228 consensus_meta.cc:287] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.000s
I20260709 13:06:36.524999 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.527638 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.528225 15042 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.531626 19090 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:36.532004 19090 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:36.532346 19090 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:36.533129 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.445822 19348 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.534610 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.535636 19263 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:36.536482 19293 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:36.538563 19233 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:36.538759 19293 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:36.539234 19293 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:36.540243 19293 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.525846 19027 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:36.541754 19275 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.541849 19027 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:36.542361 19027 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.543869 19286 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:36.496953 19218 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:36.544653 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.453472 19323 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.546983 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.548075 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.495924 14961 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:36.497663 14889 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
W20260709 13:06:36.491747 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45289.6us
I20260709 13:06:36.496609 19137 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:36.539309 19285 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:36.550886 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:36.553431 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:36.495214 19268 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.571115 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.571197 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.561522 15550 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:36.556903 15543 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:36.567754 14963 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:06:36.569859 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.513670 19242 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:36.607969 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54657.9us
I20260709 13:06:36.651249 14890 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:36.614982 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45182.5us
W20260709 13:06:36.651887 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.655486 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.638424 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.592149 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.656814 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:36.639366 15042 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:36.571795 15043 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:36.657753 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.572620 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.514199 19145 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.096s
W20260709 13:06:36.561128 19266 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.000s	sys 0.012s
I20260709 13:06:36.668562 14965 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:36.688661 15037 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 13:06:36.689062 14965 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:36.689093 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:36.561190 19335 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.689999 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:36.690922 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.605358 18821 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:36.691092 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 140367us
I20260709 13:06:36.547129 18935 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.669040 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:36.572924 19092 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:36.689971 14965 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.636189 19285 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:36.635869 19093 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:36.691973 19266 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.031s
I20260709 13:06:36.563685 19328 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 13:06:36.669386 19268 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.562445 19228 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.668565 19334 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:36.708601 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 136101us
I20260709 13:06:36.650955 19137 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:36.610033 19311 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:06:36.710083 19153 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:36.697288 19277 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.559913 19339 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.694880 19286 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:36.696107 18821 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.610357 19343 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 13:06:36.697014 19267 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:36.702492 19092 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.705945 19218 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:36.822461 19199 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:36.821593 19263 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:06:36.824432 19322 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.011s
I20260709 13:06:36.824168 19286 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:36.781718 19292 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:36.794343 19334 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:36.809135 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.829533 19267 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:36.850831 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:36.835966 15548 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:36.803586 19268 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.707512 19093 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:36.846240 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73843.3us
I20260709 13:06:36.828823 18821 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:36.829408 19092 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:36.860402 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.861311 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.869664 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:36.870846 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.872411 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.873138 15043 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:36.823977 19277 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.848305 19286 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:36.907739 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:36.853693 19292 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.868920 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.862104 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:36.913548 15041 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:36.913779 19292 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.853369 19151 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:36.915652 19374 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:06:36.916944 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.918092 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.883020 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:36.842221 19199 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.883882 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2795) took 1502 ms. Trace:
I20260709 13:06:36.854331 19267 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:36.915239 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.887763 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:36.888208 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:36.876350 19153 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.923138 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:36.940714 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.888327 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.890196 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.929142 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 2048) took 1132 ms. Trace:
I20260709 13:06:36.942870 15550 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:36.897720 19323 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.919387 15548 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:36.921300 15545 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:36.900239 19266 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:36.855147 19260 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:36.925164 15036 rpcz_store.cc:276] 0709 13:06:35.381310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.422263 (+ 40953us) service_pool.cc:224] Handling call
0709 13:06:36.883653 (+1461390us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b54003336d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.883821 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22117632}
I20260709 13:06:36.899323 19143 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.902014 19339 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:36.853873 19334 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:36.927160 15041 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:36.899926 19268 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:36.924547 19370 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:06:36.978688 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.979393 15541 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:36.980747 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:36.983081 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:36.947976 15042 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:36.943032 15542 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 7: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:36.894531 19027 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.941083 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:36.907078 19092 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.890673 19090 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.921944 19326 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:36.937037 19153 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:36.925621 19228 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:36.943056 15038 rpcz_store.cc:276] 0709 13:06:35.796515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.796667 (+   152us) service_pool.cc:224] Handling call
0709 13:06:36.928987 (+1132320us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b540014afd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:36.929094 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804177792}
I20260709 13:06:36.971884 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.957296 19266 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:36.933188 19372 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 13:06:36.848685 19322 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:36.975834 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:36.976951 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:37.042351 15041 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:36.990916 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:37.043185 15542 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:37.044006 15035 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:37.044371 15041 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:36.992726 19260 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:36.993225 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:37.070581 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:36.924860 19199 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:36.970855 19258 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:06:36.957952 19337 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:36.996790 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:36.998257 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57269.7us
I20260709 13:06:36.996713 19308 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:36.923292 19204 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:06:36.987118 19299 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.033187 14886 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:37.034539 15550 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
W20260709 13:06:37.085457 19377 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:37.085565 19299 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.085851 15550 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:37.090801 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:37.091374 15542 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:37.036298 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:36.936273 19137 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:36.923771 19024 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:36.936038 19277 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:36.992125 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:37.068110 19326 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:37.071379 15548 raft_consensus.cc:2376] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13. Re-sending same reply.
I20260709 13:06:37.073217 14965 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:37.105013 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 68858.1us
I20260709 13:06:37.106563 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:37.076119 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:36.870522 19093 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:37.029685 19143 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:37.081776 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85068.6us
W20260709 13:06:37.094352 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.078104 19218 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:37.117883 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:37.123485 15542 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:37.118381 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:37.088714 19198 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.121461 14965 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:37.089056 19311 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:37.101445 19341 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:06:37.112511 19368 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.299s	user 0.000s	sys 0.003s
I20260709 13:06:37.089139 19258 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.129158 19308 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:37.134881 15550 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:37.115483 19216 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:37.154336 15542 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:37.153688 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:37.169953 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:37.131577 19371 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 13:06:37.133266 19139 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:37.172127 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:37.129904 19143 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:37.188874 14969 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:37.189585 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:37.191617 19308 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:37.192006 19378 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:06:37.194293 19366 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.365s	user 0.005s	sys 0.004s
I20260709 13:06:37.133041 19341 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:37.207722 19341 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.209048 19341 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:37.121495 19328 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:37.212724 19326 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.148720 19260 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.216761 19260 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.217064 19311 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.217662 19311 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.218223 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.218640 19260 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.219318 19275 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:37.219731 19139 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:37.219841 19275 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.220656 19139 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.222297 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.222965 14965 raft_consensus.cc:2368] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7.
I20260709 13:06:37.226888 19153 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.131326 19233 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.096s
I20260709 13:06:37.227332 19280 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:37.227838 19280 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.148547 19251 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 13:06:37.230379 19097 raft_consensus.cc:993] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:06:37.231088 19097 raft_consensus.cc:1081] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:06:37.231710 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.253995 14891 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:37.231853 19266 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.237010 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:37.168300 18893 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.819s	user 0.009s	sys 0.003s
W20260709 13:06:37.170284 19242 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.520s	user 0.010s	sys 0.001s
I20260709 13:06:37.259346 15039 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:06:37.259740 15039 pending_rounds.cc:85] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 4
I20260709 13:06:37.260003 15039 pending_rounds.cc:107] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:06:37.260285 15039 raft_consensus.cc:2889] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:37.263419 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 74092.1us
I20260709 13:06:37.264263 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.264777 14936 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:37.265270 14965 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12.
I20260709 13:06:37.267890 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.268189 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:37.271374 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:37.273108 14889 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:37.274101 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.275398 19027 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.277418 19333 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:37.279476 19383 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:06:37.281880 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.281678 19143 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.283399 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.277519 19280 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.285897 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.287350 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.288517 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.289778 19286 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.291224 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.291833 15543 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:37.272930 19218 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.287268 15541 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:37.293680 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:37.294493 14889 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:37.296217 15541 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:06:37.296634 14966 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:06:37.300115 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.300729 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.300767 14962 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:37.302560 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.285948 19258 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.304358 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.305644 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.298799 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:37.307113 14967 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:37.307857 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:37.307946 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.308401 14966 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.307899 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.309163 15516 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13.
I20260709 13:06:37.309341 14889 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:37.310189 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:37.311640 15549 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:37.311806 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.311980 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.312983 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.313182 19090 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.261570 19204 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.313946 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.313853 19204 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.297999 19092 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.314980 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:37.316650 14970 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:37.264575 19309 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:37.327241 14889 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:37.330128 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.251253 19267 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.274220 19146 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.337312 15514 leader_election.cc:400] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7.
I20260709 13:06:37.269084 19266 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:37.293372 19299 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:37.341488 14889 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:37.342182 15541 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:06:37.342291 14967 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:37.256278 19328 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:37.341378 15514 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12.
W20260709 13:06:37.336490 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 259664us
I20260709 13:06:37.355615 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:37.261677 19242 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.376406 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.380407 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:37.323307 19329 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:37.381970 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:37.320338 19339 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:37.320701 19310 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:37.383070 14892 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:37.385619 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:37.387542 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:37.373867 14966 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:37.305877 19262 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:06:37.434198 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 47711.2us
I20260709 13:06:37.439699 14965 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:37.323625 19228 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 13:06:37.500142 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:37.512290 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 51806.6us
I20260709 13:06:37.513675 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:37.521481 19268 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:37.390707 19216 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:37.384668 19299 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:37.527549 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 147261us
I20260709 13:06:37.531471 14892 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:06:37.531838 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:37.340077 19145 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.097s
I20260709 13:06:37.522282 19268 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:37.385980 19346 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:37.383490 19329 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:37.393940 19101 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:37.545888 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:37.506628 19292 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:37.356441 19146 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.376052 19266 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.517258 19339 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:37.520375 19311 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.539908 19299 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:37.553831 19334 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.564s	user 0.012s	sys 0.001s
I20260709 13:06:37.539727 19257 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:37.548420 19335 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.552608 19329 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:37.579432 14889 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:37.530795 19027 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
W20260709 13:06:37.586651 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 199245us
W20260709 13:06:37.613752 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.589788 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:37.621095 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:37.614395 19293 consensus_meta.cc:287] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.074s	user 0.009s	sys 0.006s
I20260709 13:06:37.567364 19275 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.586310 19346 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:06:37.621879 19293 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:37.612519 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 87617.4us
I20260709 13:06:37.627205 14890 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:37.567875 19277 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.591755 14887 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:37.651006 19387 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:06:37.651543 19214 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:37.641898 19339 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:37.653589 19093 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.518s	user 0.011s	sys 0.002s
I20260709 13:06:37.630748 19101 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:37.592504 19311 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:37.585599 19334 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.679713 14886 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:37.591156 19335 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.657896 19292 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:37.568864 19216 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.677518 19347 raft_consensus.cc:2243] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEARNER]: Raft consensus shutting down.
W20260709 13:06:37.697728 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 165985us
I20260709 13:06:37.722793 15545 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:37.683034 19310 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:37.731881 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.733007 14892 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:37.679226 19346 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:37.632737 19268 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.700037 19242 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.678979 19277 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:37.681612 19093 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.739718 14887 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
W20260709 13:06:37.742866 15549 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 1064) took 1539 ms (client timeout 1857 ms). Trace:
W20260709 13:06:37.771885 15549 rpcz_store.cc:269] 0709 13:06:36.203191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.228630 (+ 25439us) service_pool.cc:224] Handling call
0709 13:06:37.742678 (+1514048us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54003c91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:37.742786 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935448960}
I20260709 13:06:37.694962 19311 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.776717 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:06:37.741499 19024 consensus_meta.cc:287] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.638s	user 0.010s	sys 0.001s
W20260709 13:06:37.736532 19396 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 13:06:37.757580 19347 raft_consensus.cc:2272] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEARNER]: Raft consensus is shut down!
I20260709 13:06:37.786337 14968 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:37.742031 19334 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.790973 14961 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:37.742009 19146 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.755760 19346 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:37.755335 19277 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.698583 19402 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:06:37.776816 19101 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:37.812317 19395 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:06:37.813676 19402 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:37.814320 19402 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:37.813865 19310 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.822094 19402 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.823560 19402 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:37.824304 19347 ts_tablet_manager.cc:1916] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:06:37.775532 19262 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:06:37.735908 19258 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:06:37.787844 19242 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:37.782569 19145 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:06:37.808511 19027 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.813663 19397 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:06:37.825269 19346 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.815699 19266 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.839351 19027 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.842760 19299 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:37.833200 19242 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.821365 19101 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.848474 19311 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.849136 19293 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.855294 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2018) took 1500 ms. Trace:
I20260709 13:06:37.872310 14969 rpcz_store.cc:276] 0709 13:06:36.355205 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.405926 (+ 50721us) service_pool.cc:224] Handling call
0709 13:06:37.855070 (+1449144us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b540031ae54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:37.855229 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779566976}
I20260709 13:06:37.882385 14964 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:06:37.850739 19365 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.145s	user 0.010s	sys 0.002s
I20260709 13:06:37.885937 15036 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
W20260709 13:06:37.908258 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:37.911196 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.911288 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:37.884457 19403 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:37.895076 19399 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:06:37.924360 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.924983 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.928514 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:37.929420 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:37.942106 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 860) took 1668 ms. Trace:
I20260709 13:06:37.929598 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:37.932572 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:37.942597 15040 rpcz_store.cc:276] 0709 13:06:36.273676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.273818 (+   142us) service_pool.cc:224] Handling call
0709 13:06:36.299925 (+ 26107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.300237 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.300269 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.300703 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:06:36.450734 (+150031us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:36.450768 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:36.450826 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:37.811352 (+1360526us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:37.935238 (+123886us) raft_consensus.cc:1685] finished
0709 13:06:37.935265 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:37.942015 (+  6750us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4316,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":7836,"spinlock_wait_cycles":10099584,"thread_start_us":131602,"threads_started":1,"wal-append.queue_time_us":293464}
I20260709 13:06:37.932819 19262 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:37.949049 14890 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:37.954762 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:37.966794 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2070) took 1065 ms. Trace:
I20260709 13:06:37.967164 15035 rpcz_store.cc:276] 0709 13:06:36.901514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.912815 (+ 11301us) service_pool.cc:224] Handling call
0709 13:06:36.913074 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.044381 (+131307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.966599 (+922218us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54001b85d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:37.966743 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300790016}
I20260709 13:06:37.968688 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:37.969303 14964 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:37.968708 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:37.937763 19335 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:37.965497 19145 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:06:37.981320 14970 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34568
I20260709 13:06:37.981899 14970 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:37.982225 14970 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:37.983026 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2058) took 2070 ms. Trace:
I20260709 13:06:37.948361 19311 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:37.949944 19401 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:37.983428 15039 rpcz_store.cc:276] 0709 13:06:35.912342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.913125 (+   783us) service_pool.cc:224] Handling call
0709 13:06:35.913492 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.260791 (+1347299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.982776 (+721985us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54000c6f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:37.982958 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3094675712}
I20260709 13:06:37.941030 19403 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:37.976827 19093 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:37.978353 19140 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:37.976341 19218 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:37.963321 19262 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.012127 19263 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:38.023555 19410 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:38.023900 19263 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.025089 19262 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.016410 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 2478) took 1663 ms. Trace:
I20260709 13:06:37.988755 19311 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:38.026628 19311 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:37.999732 14970 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.026413 14963 rpcz_store.cc:276] 0709 13:06:36.352726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.356177 (+  3451us) service_pool.cc:224] Handling call
0709 13:06:38.016247 (+1660070us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b540010a4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:38.016349 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324322560}
I20260709 13:06:38.002487 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:37.990536 19137 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:38.005842 19420 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:38.026003 19405 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:37.992820 19400 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:38.037256 14964 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:38.013166 19292 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:37.996274 19408 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:38.006224 19140 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:38.076514 19403 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.056120 19420 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.035272 19240 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:38.087338 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:37.995460 19401 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.073659 19027 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.083151 19242 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.035611 19218 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.113170 19218 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.080868 19292 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:06:38.116171 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 393160us
I20260709 13:06:38.116297 19292 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.085503 19240 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:38.119681 19240 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.084218 19266 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:38.101389 19140 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.059995 19405 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.110543 19401 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:38.111285 19341 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.902s	user 0.008s	sys 0.003s
I20260709 13:06:38.067224 19392 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.034s
W20260709 13:06:38.130734 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 201415us
I20260709 13:06:38.060247 19400 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:38.095660 18821 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.141s	user 0.001s	sys 0.015s
I20260709 13:06:38.086400 19420 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.133423 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:38.083329 19408 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.134641 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.127067 19027 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:06:38.126956 19266 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.136011 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.136703 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:38.138211 15549 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:38.139010 19257 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:38.140249 19140 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.141116 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2811) took 1152 ms. Trace:
I20260709 13:06:38.142560 19405 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.149480 18821 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.157663 18821 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.158275 14888 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:38.159159 19286 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:38.161872 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1069) took 1167 ms. Trace:
I20260709 13:06:38.162245 15545 rpcz_store.cc:276] 0709 13:06:36.995004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.032748 (+ 37744us) service_pool.cc:224] Handling call
0709 13:06:37.033184 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.727560 (+694376us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.161664 (+434104us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54002e7a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:38.161817 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1585733504}
I20260709 13:06:38.163606 19402 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:38.153735 19257 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:38.165241 19267 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.165592 19263 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.165843 19257 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.157670 19204 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:38.144882 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.147410 15544 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:38.154206 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.154922 15036 rpcz_store.cc:276] 0709 13:06:36.988254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.070258 (+ 82004us) service_pool.cc:224] Handling call
0709 13:06:38.140943 (+1070685us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b540014a0d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:38.141047 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1827374464}
I20260709 13:06:38.154668 19341 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:38.171703 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:38.171104 15549 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:38.176297 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.177063 15544 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:38.177507 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.178517 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.179206 15544 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:38.107299 19329 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.153892 19420 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.181304 19240 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.181895 19329 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.183382 15541 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:38.183496 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.185804 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.186568 15545 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:38.186920 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:38.187561 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:38.189679 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:38.192116 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:38.196445 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:38.196602 19400 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.197341 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:38.198284 19266 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.198887 19266 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:38.199369 19418 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:38.199854 19418 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.200214 19418 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.203680 19408 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.194198 19271 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:38.198576 19415 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:38.185200 19267 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:38.205924 19415 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.192332 19420 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:38.206439 19415 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.206691 19420 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:38.207180 19420 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.212991 19240 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:38.182855 19308 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:38.214131 19308 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:38.214453 19308 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:38.216141 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:38.218097 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.199246 19266 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:38.222072 19266 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:38.229343 19299 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.219218 19347 ts_tablet_manager.cc:1929] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.8
I20260709 13:06:38.233580 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.234588 15544 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:38.235044 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:38.235581 14895 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:38.235981 14895 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.241218 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.243960 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.239574 14895 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.246615 14895 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.245574 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:38.238497 19347 log.cc:1199] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-3-root/wals/13ff541fc966499ea2706d34cfb2c964
I20260709 13:06:38.248813 19387 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:38.251822 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:38.252218 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.252343 19311 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.253314 19413 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:38.254602 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.236552 19280 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:06:38.242259 19267 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:38.259855 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.261638 19268 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.266716 19387 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:38.267202 19101 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.268025 14893 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:38.271117 14895 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 13:06:38.250213 19252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.018s	sys 0.022s
I20260709 13:06:38.275324 14895 pending_rounds.cc:85] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 7
I20260709 13:06:38.276970 14895 pending_rounds.cc:107] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:06:38.277230 14895 raft_consensus.cc:2889] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:38.276714 19268 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.279726 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.280336 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:38.280421 19268 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.280980 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 820) took 1666 ms. Trace:
I20260709 13:06:38.281131 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:38.281384 14888 rpcz_store.cc:276] 0709 13:06:36.615003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.650823 (+ 35820us) service_pool.cc:224] Handling call
0709 13:06:36.697659 (+ 46836us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.158656 (+1460997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.280796 (+122140us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540024ead4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:38.280927 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3359270656}
W20260709 13:06:38.278735 19367 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.456s	user 0.000s	sys 0.002s
I20260709 13:06:38.272104 19413 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:38.276702 19252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.019s	sys 0.022s
I20260709 13:06:38.267089 19266 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.285065 19413 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:38.290398 19308 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.275853 19387 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.284660 19292 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:06:38.292148 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:38.291247 19412 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
I20260709 13:06:38.294682 14968 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:38.295338 15546 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:06:38.295989 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.296681 19400 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:38.297344 19286 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:38.297976 14969 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:38.298171 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.298674 14968 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:38.298704 14961 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:38.283243 19101 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:06:38.294114 19347 ts_tablet_manager.cc:933] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.301224 14968 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:06:38.304422 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 959) took 1019 ms. Trace:
I20260709 13:06:38.316712 14965 rpcz_store.cc:276] 0709 13:06:37.285332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.287133 (+  1801us) service_pool.cc:224] Handling call
0709 13:06:38.304237 (+1017104us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54003e6a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:38.304371 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348336000}
I20260709 13:06:38.300586 19286 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:38.297425 19308 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.307807 19387 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.308934 19137 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:38.320343 19137 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.321483 19387 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.309703 19420 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.322896 19420 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.323741 19293 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 13:06:38.327194 19311 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.330789 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:38.331529 14968 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.298110 19418 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.308969 19101 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:38.341501 19286 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.344347 19286 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.338366 19101 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:38.359921 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:38.363937 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.364288 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.365054 15039 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:38.366844 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.369323 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.371711 15035 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:38.372063 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.372803 15040 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:06:38.380164 19389 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.863s	user 0.004s	sys 0.000s
I20260709 13:06:38.381466 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2068) took 1514 ms. Trace:
I20260709 13:06:38.381590 19347 tablet_copy_client.cc:323] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:06:38.379779 19413 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.381831 15043 rpcz_store.cc:276] 0709 13:06:36.867084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:36.949404 (+ 82320us) service_pool.cc:224] Handling call
0709 13:06:36.949750 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:36.949989 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:36.950024 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:36.950511 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:06:37.262208 (+311697us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:37.262255 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:37.262346 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:38.349329 (+1086983us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:38.381174 (+ 31845us) raft_consensus.cc:1685] finished
0709 13:06:38.381194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:38.381411 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33844480,"thread_start_us":173058,"threads_started":1,"wal-append.queue_time_us":278368}
I20260709 13:06:38.383611 19266 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.384354 19415 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.386868 19415 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.381314 19101 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.387566 19418 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.388124 19101 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.389712 19204 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:38.390340 19204 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.392802 19204 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.399840 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.400511 15036 raft_consensus.cc:2368] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:38.401456 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:38.402402 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.402519 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.399232 19137 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.404573 19137 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.405071 19415 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:38.406605 19280 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:06:38.410522 14936 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.3:46271 timed out after 1.548s (SENT) [suppressed 10 similar messages]
I20260709 13:06:38.406170 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:38.410445 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:38.418236 15544 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.418669 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.420105 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.421675 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.417240 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.425612 15544 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:38.426131 15549 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:38.427645 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:38.429332 15040 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:38.436381 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:38.437191 15550 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.444708 15549 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:38.446269 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:38.450081 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.456195 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3127) took 1186 ms. Trace:
I20260709 13:06:38.456595 14886 rpcz_store.cc:276] 0709 13:06:37.269961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.270109 (+   148us) service_pool.cc:224] Handling call
0709 13:06:37.270461 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:37.687944 (+417483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.455978 (+768034us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b540024f4d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:38.456144 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940827008}
I20260709 13:06:38.457650 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.458423 15044 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.464974 14968 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:38.467207 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:38.467753 15044 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:38.468650 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.469327 15040 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:38.469552 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:38.471542 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.472456 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.473166 15043 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:38.473760 19143 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:38.474553 19328 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:38.475236 19328 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:38.441418 19267 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:38.485389 15550 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:38.456903 19271 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:38.491482 19267 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.492616 19267 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.495689 19271 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.496783 19271 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.500526 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.501536 15041 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:38.499138 15042 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:38.503715 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.504961 14970 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.506971 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:38.508934 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.500774 19328 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.509743 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.468876 19204 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.516656 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.516897 19204 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:38.519717 19375 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 13:06:38.523275 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:38.523550 15544 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:38.523589 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.525863 15547 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
W20260709 13:06:38.524652 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 114171us
I20260709 13:06:38.527746 15044 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.528380 15042 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:06:38.530829 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:38.531188 15550 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:38.532801 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.534570 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.536141 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.536741 15043 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:38.537351 15043 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:38.538218 15043 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.539268 15043 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:38.540695 15550 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:38.551791 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.552610 15544 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:38.554993 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.555454 15044 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:38.556093 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:38.556598 15039 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.557623 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:38.558017 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.558681 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.565554 19143 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:38.566598 19143 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:38.566919 19143 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:38.567914 19143 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.569764 19240 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:06:38.553413 19204 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.570770 19343 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:38.571148 19343 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:38.571496 19388 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.411s	user 0.004s	sys 0.001s
I20260709 13:06:38.569427 19143 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.571990 19343 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.572647 18821 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:38.573143 18821 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.573248 19343 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:38.574115 18821 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.581822 19257 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.572070 19263 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.575325 18821 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:38.588671 19443 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:06:38.600353 19326 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:38.606065 19326 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:38.612262 19413 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.614952 19274 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:38.615337 19346 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.614861 19326 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.658200 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.658895 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:38.661553 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.662048 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:38.666644 14961 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:38.669374 14968 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:38.672791 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2504) took 1321 ms. Trace:
I20260709 13:06:38.673352 14969 rpcz_store.cc:276] 0709 13:06:37.351493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.881768 (+530275us) service_pool.cc:224] Handling call
0709 13:06:38.297820 (+416052us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:38.298356 (+   536us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:38.672341 (+373985us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b540025ba50. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:38.672594 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":956180864}
I20260709 13:06:38.678438 14966 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 12. Ops: []
I20260709 13:06:38.680473 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:38.686254 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:38.686283 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.688035 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:38.689705 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.608373 19092 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:38.690164 19214 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.690732 19092 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.691306 19214 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.692824 19092 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.694761 19092 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:38.695256 19214 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.696707 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.695010 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:38.707208 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.617249 19274 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.707717 19271 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.708578 19271 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.709522 19274 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.711951 19137 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:38.714201 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.648041 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:38.722214 19204 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:38.727385 19267 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:38.728067 19267 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:38.729158 19262 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:38.730176 19262 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:38.730816 19328 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.731832 19328 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:38.728515 19267 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:38.664240 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.738474 19328 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.741196 19343 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:38.742226 19343 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.733160 19271 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.744422 19101 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.745195 19101 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.741328 19274 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:38.754206 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.760162 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:38.737143 19266 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.762684 14888 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:38.773232 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.773368 19266 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:38.774883 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.775831 19275 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.776162 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.776533 19275 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.777719 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:38.777827 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:38.778549 19266 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.779273 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:38.783908 19140 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:38.784302 14887 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:38.784437 19214 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:38.784341 19140 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:38.786047 19214 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:38.785989 19218 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:38.786692 19214 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:38.786528 19140 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.788116 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:38.783577 19392 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:38.789482 19140 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.787910 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:38.799798 15040 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:38.799748 14890 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:38.812811 19258 consensus_queue.cc:1175] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 13 status { last_received { term: 13 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 11 } }
I20260709 13:06:38.814751 19271 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:38.815681 19271 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:38.819094 19271 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.794740 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:38.757606 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 71621.4us
I20260709 13:06:38.843753 19214 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.846796 19214 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:38.852797 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 188849us
I20260709 13:06:38.859261 19343 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:38.859947 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.860584 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.863489 14970 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:38.863794 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.864307 19276 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:06:38.865533 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:38.866071 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:38.866331 14963 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:38.866582 19240 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:38.867048 19240 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:38.832217 19275 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.838261 14969 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:06:38.876060 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 88232us
I20260709 13:06:38.877709 14890 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:38.860097 14861 leader_election.cc:400] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:38.883389 14861 leader_election.cc:403] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:38.887377 19240 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.889153 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 285) took 7690 ms. Trace:
I20260709 13:06:38.873001 19328 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.891778 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.892936 14961 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:38.889230 19240 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:38.899005 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.899864 15546 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
W20260709 13:06:38.904139 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 170729us
I20260709 13:06:38.907357 19024 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:38.920316 19101 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:38.909070 14970 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:38.912894 14967 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: [13.9-14.10]
I20260709 13:06:38.924922 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:38.908111 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.912771 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.908309 14969 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:38.930514 15543 raft_consensus.cc:2410] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:38.922433 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.931180 14966 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:38.931898 19218 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.932597 19218 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:38.935742 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.936120 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:38.937119 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.936501 19343 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:38.938607 19343 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.912220 19460 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:38.939934 19460 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:38.940328 19460 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:38.941291 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.945614 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:38.911317 15043 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:38.948416 14963 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:38.954007 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.957024 14969 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:38.958647 19266 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:38.958794 14968 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:38.960232 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52953.5us
I20260709 13:06:38.962061 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:38.963748 19311 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:38.909641 19257 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 13:06:38.964385 19311 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:38.964695 19153 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:38.965850 19311 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:38.971338 14962 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:38.889596 14793 rpcz_store.cc:276] 0709 13:06:31.212142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:31.250990 (+ 38848us) service_pool.cc:224] Handling call
0709 13:06:38.888873 (+7637883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:35.646769 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:35.915908 (+269139us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:35.918596 (+  2688us) write_op.cc:435] Acquired schema lock
0709 13:06:35.921565 (+  2969us) tablet.cc:662] Decoding operations
0709 13:06:36.119703 (+198138us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:36.121434 (+  1731us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:36.125124 (+  3690us) tablet.cc:685] Acquiring locks for 8 operations
0709 13:06:36.192783 (+ 67659us) tablet.cc:701] Row locks acquired
0709 13:06:36.192816 (+    33us) write_op.cc:260] PREPARE: finished
0709 13:06:36.193029 (+   213us) write_op.cc:270] Start()
0709 13:06:36.193142 (+   113us) write_op.cc:276] Timestamp: P: 1783602396192978 usec, L: 0
0709 13:06:36.193163 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:06:36.196349 (+  3186us) log.cc:844] Serialized 3348 byte log entry
0709 13:06:36.804069 (+607720us) op_driver.cc:464] REPLICATION: finished
0709 13:06:37.115897 (+311828us) write_op.cc:301] APPLY: starting
0709 13:06:37.125276 (+  9379us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:37.571229 (+445953us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:37.588663 (+ 17434us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:37.655497 (+ 66834us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:37.655755 (+   258us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 13:06:37.655833 (+    78us) write_op.cc:312] APPLY: finished
0709 13:06:37.656157 (+   324us) log.cc:844] Serialized 81 byte log entry
0709 13:06:37.791158 (+135001us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:37.809075 (+ 17917us) write_op.cc:454] Released schema lock
0709 13:06:37.819468 (+ 10393us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:37.840132 (+ 20664us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:37.840178 (+    46us) write_op.cc:454] Released schema lock
0709 13:06:38.290730 (+450552us) spinlock_profiling.cc:243] Waited 8.31 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
Metrics: {"mutex_wait_us":1654245,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":279683,"apply.run_cpu_time_us":32282,"apply.run_wall_time_us":725406,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37567,"num_ops":8,"prepare.queue_time_us":403049,"prepare.run_cpu_time_us":38644,"prepare.run_wall_time_us":633570,"raft.queue_time_us":374927,"raft.run_cpu_time_us":73462,"raft.run_wall_time_us":295721,"replication_time_us":517440,"spinlock_wait_cycles":19107712,"thread_start_us":719737,"threads_started":5,"wal-append.queue_time_us":305886,"wal-append.run_cpu_time_us":14593,"wal-append.run_wall_time_us":1315551}]]}
I20260709 13:06:38.972378 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:38.976402 14893 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:38.981769 15546 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:38.982838 14961 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:38.983954 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:38.950348 19458 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:38.947144 19218 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:38.992460 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.974673 19024 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:38.998792 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 140830us
W20260709 13:06:38.999207 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:38.999831 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.000981 18821 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.003571 19216 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:39.003662 19024 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.004594 19216 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.005570 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:39.007272 19266 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:39.007879 19266 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:39.008157 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:39.009019 19266 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.012425 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:39.012523 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:39.013911 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:39.014714 19275 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:38.999869 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.007105 19216 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:38.997365 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:39.015235 19275 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:38.988288 19458 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:39.007308 19024 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.037748 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:39.038770 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:39.040987 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:39.042714 19204 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:39.045773 19216 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:39.050949 19343 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:38.975739 19140 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:06:39.052312 19140 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:39.052688 19140 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:39.053548 19140 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.054978 19140 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.059620 19293 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:39.073199 14961 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:06:39.073729 14961 pending_rounds.cc:85] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 9
I20260709 13:06:38.992157 19328 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:06:39.060024 19293 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.060823 19458 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.077258 14961 pending_rounds.cc:107] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:06:39.084275 14970 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:39.019598 19392 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 13:06:39.076928 19024 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:39.085394 14961 raft_consensus.cc:2889] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:39.094856 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 79775.9us
I20260709 13:06:39.095582 19343 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:39.099642 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 136336us
W20260709 13:06:39.103052 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 173060us
I20260709 13:06:39.084954 19293 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:39.116396 14893 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
W20260709 13:06:39.141415 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 169312us
W20260709 13:06:39.145478 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.146131 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.158751 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.165290 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:39.165939 19153 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.166723 19153 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:39.167280 19153 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:39.167513 19257 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:39.168489 19153 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:39.170120 19463 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 13:06:39.170933 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:39.172349 19143 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.600s	user 0.013s	sys 0.005s
I20260709 13:06:39.172508 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:39.174094 19263 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.165541 15043 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:39.181155 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:39.184049 19346 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.184640 19346 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.185462 15040 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 13:06:39.187103 19461 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:06:39.195520 19343 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.196218 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 940) took 1285 ms. Trace:
I20260709 13:06:39.196720 15543 rpcz_store.cc:276] 0709 13:06:37.910936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:37.911069 (+   133us) service_pool.cc:224] Handling call
0709 13:06:39.195911 (+1284842us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b54000ec754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:39.196104 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2279708928}
I20260709 13:06:39.197840 19343 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:39.199360 19468 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:06:39.209748 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:39.212028 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54152.5us
I20260709 13:06:39.213374 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.214905 19276 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:39.203547 19293 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.187147 19346 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.221583 19263 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:39.222077 19263 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.222450 19263 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:39.203886 15039 consensus_meta.cc:287] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.601s	user 0.014s	sys 0.001s
I20260709 13:06:39.234942 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:39.242561 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 70195.7us
I20260709 13:06:39.236078 15039 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:39.229632 19276 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:39.249974 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 107697us
I20260709 13:06:39.255658 19276 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.259690 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:39.260383 15543 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.260630 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:39.263024 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.264194 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.264801 19346 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:39.265276 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.266034 15044 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:39.267426 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:39.268641 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.264758 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:39.271549 15546 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:39.271565 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.274212 15036 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:39.277031 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.277611 15042 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:39.278524 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:39.279358 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:39.279876 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.279814 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 13ff541fc966499ea2706d34cfb2c964 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:06:39.280534 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.280810 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 13ff541fc966499ea2706d34cfb2c964 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-13ff541fc966499ea2706d34cfb2c964
I20260709 13:06:39.281030 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.281352 15037 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:39.281806 15044 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 7: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:06:39.282295 19274 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 13:06:39.288774 15036 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:39.289942 15040 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:39.291066 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.293507 15040 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:06:39.293972 15040 pending_rounds.cc:85] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 9
I20260709 13:06:39.293460 19460 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.294220 15040 pending_rounds.cc:107] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 11.10
W20260709 13:06:39.295835 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 254964us
I20260709 13:06:39.297187 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:39.298303 19092 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.603s	user 0.016s	sys 0.001s
I20260709 13:06:39.295845 15042 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:39.294500 15040 raft_consensus.cc:2889] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.302135 15042 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:39.306384 15543 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:39.311067 15044 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:39.312762 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.315505 19293 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.317664 15054 tablet_copy_source_session.cc:215] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:06:39.327689 19242 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.332345 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:39.321111 19267 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.000s
I20260709 13:06:39.342206 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:39.349898 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.243153 19275 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.339003 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:39.365038 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67937us
I20260709 13:06:39.368888 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:39.369975 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:39.370946 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:39.372893 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.371848 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:39.334388 19328 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.380159 14968 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:39.381783 15041 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
W20260709 13:06:39.384172 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44833.2us
I20260709 13:06:39.386132 14970 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:39.328312 19242 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.361797 19460 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:39.321787 19311 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:39.389257 15547 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:06:39.389496 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89910.8us
I20260709 13:06:39.390185 15544 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:39.390507 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:39.390892 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 173) took 9872 ms. Trace:
W20260709 13:06:39.392382 19471 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
I20260709 13:06:39.395280 19326 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:06:39.396975 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:39.398589 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:39.405858 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:39.360423 19267 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:39.408851 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 158216us
I20260709 13:06:39.386648 19271 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:39.416309 19242 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.416891 14969 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:39.418421 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:39.418897 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.377413 19092 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:39.418366 14890 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:39.437901 19310 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:39.455525 14792 rpcz_store.cc:276] 0709 13:06:29.400346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.402944 (+  2598us) service_pool.cc:224] Handling call
0709 13:06:39.248692 (+9845748us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7593,"reported_tablets":20}
I20260709 13:06:39.464457 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.467432 15043 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
W20260709 13:06:39.469594 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 72739.5us
I20260709 13:06:39.479609 15550 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:39.479399 14886 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:39.476920 14893 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:39.482983 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:39.487365 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 68546.8us
I20260709 13:06:39.487068 19310 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.489802 19310 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.492269 15036 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:39.492565 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:39.496349 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:39.497684 18821 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:39.498477 18821 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.500538 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:39.501538 18821 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:39.502728 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:39.513424 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.475277 19257 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:39.514962 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 109213us
I20260709 13:06:39.517647 19228 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:39.519445 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 59154.3us
I20260709 13:06:39.524675 19276 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:39.508329 19101 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:39.514755 19092 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:06:39.532123 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.537894 19293 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:39.540740 19228 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.541370 19418 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:39.562290 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:39.547735 19328 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:39.549441 19267 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.531759 19257 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:39.522773 19214 consensus_meta.cc:287] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 13:06:39.462922 19311 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.562090 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:39.522455 19143 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:39.567364 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 87492.2us
I20260709 13:06:39.561874 19293 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.506304 19271 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.561959 19092 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.564158 19310 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:39.574507 19293 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:39.575630 15043 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:39.563513 19101 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.578575 15546 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:39.525555 19276 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:39.579552 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96687.4us
I20260709 13:06:39.732870 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:39.582203 19458 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.734006 19276 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.588213 15545 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:39.592653 19271 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:39.593482 19293 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:39.594347 19101 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.748226 19153 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:39.771993 19153 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:39.772421 19153 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:39.775817 19101 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:39.776366 19101 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.778419 19101 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:39.605240 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:39.780730 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.573037 19143 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:39.577116 19092 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:06:39.606865 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44659us
I20260709 13:06:39.577018 19310 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:39.807832 19310 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:39.808198 19474 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:39.808647 19474 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:39.809582 19474 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.810833 19474 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.604504 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.578999 19228 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.819653 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:39.614893 15550 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
W20260709 13:06:39.686132 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 166062us
I20260709 13:06:39.610214 19257 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:39.715940 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 213291us
I20260709 13:06:39.735991 19458 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:39.571007 19263 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:39.734863 15035 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:39.734195 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:39.765722 19476 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:06:39.767079 19293 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:39.592659 19311 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:39.743728 19214 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:39.781502 19143 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:39.836421 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:39.839576 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:39.849567 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:39.855664 19326 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:39.856083 19328 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:39.856709 19343 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:39.874440 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:39.875090 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 141030us
I20260709 13:06:39.899716 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.901623 15037 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:06:39.903818 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54343.1us
I20260709 13:06:39.904052 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:39.907452 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:39.911293 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:39.920785 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:39.873942 19271 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:39.848757 19204 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:06:39.928628 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:39.840040 19418 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 13:06:39.932457 15037 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:06:39.899852 19228 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:39.901197 19311 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:39.935072 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 60698.9us
I20260709 13:06:39.946781 15550 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:39.932046 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:39.945616 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 366843us
I20260709 13:06:39.932792 15037 pending_rounds.cc:85] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 10
I20260709 13:06:39.948544 15037 pending_rounds.cc:107] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:06:39.948783 15037 raft_consensus.cc:2889] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:39.865274 18821 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 13:06:39.950542 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49484us
I20260709 13:06:39.952003 14892 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:39.945210 19392 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:39.953817 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:39.910216 19140 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:39.898599 19293 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:06:39.924774 19326 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:39.945406 19460 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:39.979532 19460 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:39.980449 19460 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.981719 19460 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:39.984505 19493 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:39.967222 19458 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:06:39.988636 19490 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:06:39.967614 19392 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:39.991339 19392 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:39.994593 19266 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:39.971156 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:39.967922 19311 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:39.922714 19242 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 13:06:40.011857 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58532.6us
I20260709 13:06:40.013496 15548 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:39.979164 19143 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.020514 15041 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:40.028455 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 122818us
I20260709 13:06:40.032508 15041 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:39.983500 19274 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 13:06:40.016476 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:40.000795 19311 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.011744 19490 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.043231 19216 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:40.061283 19216 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:40.064023 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 92969.4us
I20260709 13:06:40.037925 19240 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:40.016263 19491 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.078444 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 124716us
I20260709 13:06:40.043541 19140 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:40.035109 19328 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:40.083976 15514 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:40.081032 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:40.062584 19216 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:40.091881 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.036796 19310 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.095824 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:40.100967 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.101802 14889 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:40.105492 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.106230 14893 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:40.107784 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.084976 19204 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:40.085698 18821 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:40.115653 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85917.2us
W20260709 13:06:40.118073 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 71814.2us
I20260709 13:06:40.060527 19504 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:06:40.092352 19263 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.059497 19501 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:06:40.119771 19392 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.111946 19240 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.124279 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:40.128988 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 65026.7us
I20260709 13:06:40.085377 19491 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.120396 19143 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:40.122146 19500 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:40.118036 18821 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:40.137526 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:40.139267 15044 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:40.093535 19490 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.120121 19204 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.149992 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:40.150683 14962 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:40.155675 14966 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:40.156670 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:40.121711 19328 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.142652 18821 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:40.162439 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:40.148237 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:40.163511 19488 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:06:40.164234 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.144070 19240 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:06:40.115530 19326 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.165076 19204 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.165658 14970 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:06:40.166517 14968 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:06:40.162436 19501 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:06:40.165110 14963 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:40.169239 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.171219 14969 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:40.173882 14970 pending_rounds.cc:85] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 10
I20260709 13:06:40.179018 14970 pending_rounds.cc:107] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:06:40.179315 14970 raft_consensus.cc:2889] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.162603 19263 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:40.177606 15035 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:40.183167 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.184151 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:40.184028 14968 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:40.185339 19512 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:40.185707 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:40.186097 19512 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.187121 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.189327 19512 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:40.189384 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.190336 19512 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.191265 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.192082 14968 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:40.190944 19512 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.196054 14965 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:40.180069 15514 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:40.197636 19487 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:06:40.171829 19257 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.196188 14933 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:40.205948 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:40.211941 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:40.193879 19242 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.224995 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:40.223982 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 159251us
I20260709 13:06:40.233477 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.234360 14965 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:40.173291 19508 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.141s
I20260709 13:06:40.172020 19140 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.250808 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.238343 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:40.239157 19491 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.222332 19458 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:40.239785 19474 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:40.240265 19310 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:40.210080 19257 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.223860 19505 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:40.198393 19418 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:06:40.255609 14888 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:40.263720 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 100565us
I20260709 13:06:40.223711 19214 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:06:40.269620 14894 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:40.233909 19242 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.236591 19507 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.144s
I20260709 13:06:40.271713 19474 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:40.261221 19143 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:06:40.291883 19092 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:40.292804 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:40.299130 14888 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:40.280484 19505 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:40.304504 19505 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.306077 19508 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:40.306507 19508 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:40.307344 19508 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.308513 19508 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:40.282128 19346 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.313161 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:40.314278 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.314633 19505 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.318780 14962 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:40.319532 19143 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:40.326344 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:40.327157 14888 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:40.290550 19458 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:40.339286 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46686us
I20260709 13:06:40.340260 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:06:40.348989 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.336005 14963 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
W20260709 13:06:40.337402 19511 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 13:06:40.301113 19474 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:40.295214 19513 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.292932 19490 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:40.364584 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 95030us
W20260709 13:06:40.361186 19496 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260709 13:06:40.383219 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 97330.4us
I20260709 13:06:40.339498 19458 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:40.408762 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147462us
I20260709 13:06:40.338141 19415 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.104s
I20260709 13:06:40.387141 19346 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:40.374012 19530 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:40.387485 19512 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.440752 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:40.442914 19514 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:40.443598 19528 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:40.444118 19528 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:40.444518 19528 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:40.451601 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 85010.8us
I20260709 13:06:40.456948 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:40.454176 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:40.458765 19271 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.004s
I20260709 13:06:40.459290 19271 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:40.459323 19532 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:40.460227 19532 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:40.431835 19310 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:06:40.461248 19532 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:40.462554 19153 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.690s	user 0.012s	sys 0.000s
I20260709 13:06:40.463050 19153 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:40.380731 19513 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:40.485014 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.371753 19518 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.218s
I20260709 13:06:40.434276 19346 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:06:40.496294 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.483875 19460 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.502s	user 0.018s	sys 0.002s
I20260709 13:06:40.436779 19530 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:06:40.499883 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 78652.3us
I20260709 13:06:40.497802 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:40.503544 14889 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.497498 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:40.440804 19539 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.494138 19500 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:40.506943 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:40.507773 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:40.494200 19490 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.511373 14888 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:40.537197 19513 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.519234 19539 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.545359 19524 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.546368 19343 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:40.546921 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:40.547477 15543 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 13:06:40.547314 19346 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.502357 19488 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:40.556541 15040 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:40.578857 15543 pending_rounds.cc:85] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 11
I20260709 13:06:40.625609 15543 pending_rounds.cc:107] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 13:06:40.546862 19276 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:06:40.624683 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 130947us
I20260709 13:06:40.626519 15543 raft_consensus.cc:2889] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:40.578291 19343 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:40.577901 19513 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:40.637404 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:40.637987 15040 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.643584 19530 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.643858 19343 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.645284 19343 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.577389 19490 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.625523 19488 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:40.688086 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:40.687283 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:40.697347 15549 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:40.698256 15546 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:40.697748 15549 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:40.583588 19524 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.654656 19153 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:40.713510 19550 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:40.686764 19311 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.691571 19488 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:40.709775 19275 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:06:40.715605 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:40.716302 19494 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.728s	user 0.005s	sys 0.000s
I20260709 13:06:40.717391 19524 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.709120 19527 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:40.705601 19547 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:40.743454 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:40.694481 19512 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:40.654457 19513 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.751000 15549 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.773073 19489 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:40.773489 19489 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:40.774297 19489 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.774699 15036 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:40.751966 19228 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.775786 19228 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.778277 19490 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:40.777851 19527 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:40.780025 19554 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:06:40.781191 19527 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:40.782138 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 548002us
I20260709 13:06:40.768970 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:40.783766 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:40.784322 15544 raft_consensus.cc:2410] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:06:40.793541 19228 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:40.798359 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55467.3us
I20260709 13:06:40.799369 14933 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:40.799762 14933 leader_election.cc:403] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:06:40.813218 15546 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:06:40.744925 19275 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:40.825839 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 70159.4us
I20260709 13:06:40.826738 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:40.775207 19489 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:40.827695 15040 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:06:40.816278 19263 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.620s	user 0.009s	sys 0.003s
I20260709 13:06:40.871620 19543 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
W20260709 13:06:40.917263 19474 consensus_meta.cc:287] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 13:06:40.877148 19544 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.877053 19506 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.108s
I20260709 13:06:40.747545 19311 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.877671 19520 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:40.878984 19562 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:40.823927 19153 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:40.825284 19490 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:06:40.837924 19508 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.812845 19512 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:40.947575 19528 consensus_meta.cc:287] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.503s	user 0.013s	sys 0.000s
I20260709 13:06:40.891346 19552 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:40.947324 19263 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:40.927776 19498 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.956s	user 0.002s	sys 0.002s
I20260709 13:06:40.928395 19513 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:40.929396 19539 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:40.876639 15542 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:40.829779 19524 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.102s
W20260709 13:06:40.935873 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 98873.5us
I20260709 13:06:40.943697 14889 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
W20260709 13:06:40.944089 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 143623us
W20260709 13:06:40.913470 18821 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.000s
W20260709 13:06:40.948257 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 151313us
I20260709 13:06:40.889587 19346 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:40.949640 19504 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:40.969457 19559 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.781756 19560 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.987866 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:40.957044 19343 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.946836 19474 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:40.967501 19552 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:40.998910 19552 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:40.991520 19543 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
W20260709 13:06:40.992966 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:40.965145 19520 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.994841 15036 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:40.995867 19474 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.016069 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.002103 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:41.013342 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.002767 19263 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:40.968665 19528 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.024760 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.025254 19140 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.026252 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:41.029804 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 253612us
I20260709 13:06:40.971968 19153 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.030539 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.031037 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:41.033587 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 206977us
I20260709 13:06:40.966848 19508 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.029886 14889 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:41.034332 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:40.993010 19524 consensus_queue.cc:1243] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:41.008565 19218 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:40.989141 19506 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 13:06:40.983741 18821 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.055362 14888 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:41.055523 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:40.989336 19346 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.058523 15543 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:41.063545 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:41.035058 19274 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:41.030529 19263 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:41.007616 19343 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.052211 19544 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:41.069777 14886 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:41.070930 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.074543 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:41.071527 19557 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:40.991055 19559 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:40.993696 19560 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.074168 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.059363 19539 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:41.067965 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.064689 19571 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:41.064991 19524 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:41.068320 19218 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.107645 19218 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.107815 19347 ts_tablet_manager.cc:1916] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Deleting tablet data with delete state TABLET_DATA_COPYING
I20260709 13:06:41.115916 19311 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:41.117414 19484 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.130s	user 0.003s	sys 0.000s
I20260709 13:06:41.117854 19346 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:41.119570 19492 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.150s	user 0.005s	sys 0.002s
W20260709 13:06:41.122248 19564 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:41.123087 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2097) took 1861 ms. Trace:
I20260709 13:06:41.123462 15038 rpcz_store.cc:276] 0709 13:06:39.261765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.277360 (+ 15595us) service_pool.cc:224] Handling call
0709 13:06:39.277669 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:39.318553 (+ 40884us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:39.318596 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:39.363919 (+ 45323us) log.cc:844] Serialized 26 byte log entry
0709 13:06:39.741668 (+377749us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:06:39.742020 (+   352us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:39.742116 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.116716 (+1374600us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:41.122784 (+  6068us) raft_consensus.cc:1685] finished
0709 13:06:41.122803 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.123003 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41970,"raft.queue_time_us":42752,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":4701,"spinlock_wait_cycles":36947840,"thread_start_us":351466,"threads_started":1,"wal-append.queue_time_us":523945}
I20260709 13:06:41.035857 19140 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:41.089475 15041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 2109) took 1584 ms (client timeout 2100 ms). Trace:
W20260709 13:06:41.092363 19570 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:06:41.093689 19573 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.092367 18821 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.094780 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.095590 19575 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:41.096020 19513 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:41.096860 19572 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:41.099906 19530 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:41.160996 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.103525 19539 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.125108 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.128153 15044 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:06:41.165498 15044 pending_rounds.cc:85] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 9
I20260709 13:06:41.165794 15044 pending_rounds.cc:107] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:06:41.130761 14893 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:41.130733 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.166241 15044 raft_consensus.cc:2889] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.167111 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.167182 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.167939 14893 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:41.168227 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.168802 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:41.129287 15041 rpcz_store.cc:269] 0709 13:06:39.491307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:39.496044 (+  4737us) service_pool.cc:224] Handling call
0709 13:06:41.076051 (+1580007us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b54004051d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:41.076154 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1204147072}
I20260709 13:06:41.131561 19557 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.136845 19556 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.131539 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:41.138289 14777 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e4938453819c469599f515b22d92fe27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:41.169696 14893 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:41.137723 19343 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.133589 19571 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:41.171118 19556 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:41.136356 19568 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:06:41.144096 14894 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:41.101467 19488 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.173127 19571 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.174160 15040 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:41.175241 19488 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.165620 14889 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:41.176259 15550 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.130481 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.177270 15036 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:41.129899 19392 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.177937 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 134964us
I20260709 13:06:41.169584 15038 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:41.142383 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.167317 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.129263 19500 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:41.178912 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:41.179347 19500 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.179911 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.138526 19575 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.144367 19489 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:41.161145 19572 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.160660 19257 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.181037 19520 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.181442 19500 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.138305 19501 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:06:41.228101 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.229465 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.178424 19218 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.181433 19576 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:41.143961 19573 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.183225 19267 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 13:06:41.236675 19489 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.236435 19491 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:41.244082 19572 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.183338 19392 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.219784 19488 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:41.236899 19575 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.247505 19501 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:41.336658 14891 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:41.280673 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.257002 19576 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:41.342036 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 61487.8us
I20260709 13:06:41.338960 19489 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:41.328841 19530 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:41.350737 15044 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:41.253257 19218 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.345683 19500 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:41.344583 19528 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:41.352068 19499 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 1.366s	user 0.000s	sys 0.004s
I20260709 13:06:41.363693 19585 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:41.364176 19574 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:06:41.364284 19585 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:41.366132 19577 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 13:06:41.366614 19585 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.368578 19346 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:41.369196 19346 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.371423 19271 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.371965 19271 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.372547 19346 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.373329 19346 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.359995 19532 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.373871 19346 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.374821 19532 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.261354 19552 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:41.359130 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 190674us
I20260709 13:06:41.382419 14891 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:06:41.382990 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:41.383432 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.384203 14887 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:41.253350 19263 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:41.385133 19346 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.386724 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:41.348608 19491 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.389640 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:41.387482 15542 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:41.394173 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.396111 15546 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:41.392432 19542 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.396888 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.397374 19514 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:41.397801 19514 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:41.397969 19491 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.398044 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.396381 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:41.400702 19500 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:41.401108 19500 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:41.401474 19500 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.406462 15549 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:41.402442 19275 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.407632 19560 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:41.410140 19580 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:06:41.410442 19573 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.413813 19572 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.415609 19539 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.416769 19542 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:41.418027 14887 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.420271 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.419983 19500 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.421051 14887 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:41.418587 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:41.422103 19545 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.865s	user 0.006s	sys 0.000s
I20260709 13:06:41.422551 19542 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:41.423548 19586 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.389175 19140 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.424953 19153 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:41.426164 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:41.442353 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.442622 14969 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:06:41.431921 19572 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:41.432417 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.464395 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.466899 14961 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:41.467564 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.474815 15039 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:41.475318 15039 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:41.458523 19140 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.483745 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.484391 15041 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:06:41.482213 15039 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.487744 15039 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:41.462198 19153 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:41.493263 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.493829 15036 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:41.430554 19576 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.474606 19474 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:41.479677 19311 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:41.498178 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.443526 19586 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.510803 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.507316 19552 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.490154 19140 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.531513 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:41.513456 19581 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 13:06:41.536248 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.539772 15039 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:41.467185 19530 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.494565 19153 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.545022 15041 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:41.543793 15042 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:41.551250 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.554809 15041 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:41.555853 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.556277 15039 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:41.557375 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.546957 19326 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:41.512717 19474 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.559911 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.513712 19311 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.551585 19216 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.568504 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.563442 19257 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:06:41.567068 19573 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.568058 19586 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.573720 14936 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14.
I20260709 13:06:41.576280 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:41.549237 19513 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:06:41.581626 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.583523 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:41.568677 19539 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:41.563268 19489 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.566191 19500 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.609576 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:41.610325 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 148224us
I20260709 13:06:41.611765 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:41.588398 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.613145 19553 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:41.616072 19311 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.616511 19204 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:41.582331 19458 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.590994 19474 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.559568 19575 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.575904 19216 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.595713 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 980) took 1099 ms. Trace:
I20260709 13:06:41.586161 19214 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:41.585971 19561 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:06:41.583137 19571 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:41.601745 15549 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:06:41.624358 14966 rpcz_store.cc:276] 0709 13:06:40.496638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.496749 (+   111us) service_pool.cc:224] Handling call
0709 13:06:40.496999 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.497214 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.497243 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.110799 (+613556us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b2c00010828. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:41.111345 (+   546us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.226812 (+115467us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:41.226860 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.226960 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.589040 (+362080us) raft_consensus.cc:1685] finished
0709 13:06:41.589058 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.595637 (+  6579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4157184,"thread_start_us":115023,"threads_started":1,"wal-append.queue_time_us":231714}
I20260709 13:06:41.596354 19140 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.566385 19326 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.600766 19153 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.634210 15549 pending_rounds.cc:85] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 9
I20260709 13:06:41.648890 15549 pending_rounds.cc:107] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:06:41.649165 15549 raft_consensus.cc:2889] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:41.650079 19603 raft_consensus.cc:2764] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:06:41.651683 19216 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.652292 19216 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:41.652948 19216 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:41.655973 19326 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.656582 19326 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:41.656951 19326 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:41.657335 19555 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.748s	user 0.007s	sys 0.000s
I20260709 13:06:41.657827 19326 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.659778 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.660324 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.660555 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.650183 14964 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:41.661960 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 987) took 1014 ms. Trace:
I20260709 13:06:41.674515 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.662389 15549 rpcz_store.cc:276] 0709 13:06:40.647865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.648005 (+   140us) service_pool.cc:224] Handling call
0709 13:06:40.686659 (+ 38654us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.141648 (+454989us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800a001d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cd20aa 00007f5534d54447 00007f5534d6cfe7 00007f5534d6e7de 00007f5534d78b49 00007f5534d79416 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4
0709 13:06:41.405853 (+264205us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5800a004d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cd20aa 00007f5534d54447 00007f5534d6cfe7 00007f5534d6e7de 00007f5534d78b49 00007f5534d79416 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4
0709 13:06:41.661651 (+255798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.661870 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":645170816}
I20260709 13:06:41.675259 15040 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:41.661964 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.677547 14966 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:41.647290 19458 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:41.678596 19101 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:41.702313 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.707854 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.708722 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:41.706764 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80816.8us
I20260709 13:06:41.701112 19542 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:06:41.712302 19597 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:06:41.713610 19508 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.716056 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.717541 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:41.718796 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.721510 19347 ts_tablet_manager.cc:1929] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 11.8
I20260709 13:06:41.722051 19392 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.722571 19347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13ff541fc966499ea2706d34cfb2c964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:06:41.723042 19092 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.728983 19489 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.729285 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.732172 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.738880 19514 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.746048 19514 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.749092 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.749625 14967 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:41.741438 14895 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:41.751893 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.752091 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:41.753424 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44538.6us
W20260709 13:06:41.753973 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 43865.7us
I20260709 13:06:41.755797 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:41.757301 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.758548 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.760700 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.757728 19415 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:41.769248 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:41.768791 14962 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:41.773324 19515 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:41.774791 19214 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:41.775031 19558 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.135s	user 0.001s	sys 0.013s
I20260709 13:06:41.775348 19214 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.776158 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.776365 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2120) took 1526 ms. Trace:
I20260709 13:06:41.753291 19514 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:41.771117 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:41.776741 15043 rpcz_store.cc:276] 0709 13:06:40.250189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.250326 (+   137us) service_pool.cc:224] Handling call
0709 13:06:40.270315 (+ 19989us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.365945 (+ 95630us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.366094 (+   149us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.367817 (+  1723us) log.cc:844] Serialized 26 byte log entry
0709 13:06:40.575880 (+208063us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:40.575925 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:40.576002 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.759602 (+1183600us) spinlock_profiling.cc:243] Waited 3.1 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:41.776092 (+ 16490us) raft_consensus.cc:1685] finished
0709 13:06:41.776114 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:41.776301 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2342,"raft.queue_time_us":30302,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":27163,"spinlock_wait_cycles":7128320,"thread_start_us":286213,"threads_started":2,"wal-append.queue_time_us":246349}
W20260709 13:06:41.781673 15035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 879) took 1625 ms (client timeout 2132 ms). Trace:
I20260709 13:06:41.758518 19573 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:41.782042 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.783505 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:41.786203 19530 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:41.782096 15035 rpcz_store.cc:269] 0709 13:06:40.156336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.156449 (+   113us) service_pool.cc:224] Handling call
0709 13:06:41.781496 (+1625047us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54003331d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:41.781615 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38159104}
I20260709 13:06:41.792687 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.795292 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:41.790441 19530 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:41.797755 19530 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.802186 19585 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.802654 19585 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.804908 19585 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.805617 19346 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:41.811709 19346 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:41.812146 19346 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:41.795534 19527 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:41.786734 19514 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.813233 19535 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:41.812567 19346 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:41.813699 15044 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:41.815448 15036 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:41.810868 19530 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.814224 15044 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:41.832577 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.830149 19535 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:41.834415 19535 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.840330 19510 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:41.840902 19510 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:41.782032 19500 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:41.787781 19415 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:41.841997 19510 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.854342 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:41.855237 14891 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:41.846060 15044 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.857021 19606 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:41.857717 19606 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:41.850097 19595 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:41.859905 19595 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.861744 19530 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.787952 19565 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:06:41.862504 19595 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.845993 19500 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:41.867182 14969 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:41.886804 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.850929 19214 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.885015 15044 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:41.885032 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.890041 14967 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:41.890162 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:41.886811 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.891654 15037 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:41.893465 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:41.894559 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.895090 15037 raft_consensus.cc:2410] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:06:41.896072 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.896894 14969 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:41.898844 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.887208 19510 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:41.914225 19514 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:41.888038 19500 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:41.925315 14968 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:41.925848 19606 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:41.849944 19527 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
W20260709 13:06:41.926658 19612 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:06:41.927951 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.925262 14966 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:41.950277 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:41.932835 19347 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:52838 (request call id 1040) took 5942 ms. Trace:
I20260709 13:06:41.934515 19559 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:41.937493 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.938607 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.939808 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:41.912957 19415 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:41.952306 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:41.952328 14891 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:41.941860 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:41.942535 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:41.954645 15549 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
W20260709 13:06:41.956553 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.945381 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:41.957577 14968 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:41.958537 15546 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:41.951071 14969 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:41.958818 15543 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:06:41.958720 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.964397 14891 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:41.965553 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.967624 15545 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:41.969806 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:41.966302 14891 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:41.971545 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.973537 14967 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:41.977108 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:41.977703 14889 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:41.979210 15039 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:06:41.959805 19514 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:41.983995 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:41.949429 19510 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:06:41.986685 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:41.990254 15041 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:41.979416 19573 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:42.002137 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.002381 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.002720 15549 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
W20260709 13:06:42.003104 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 60985us
W20260709 13:06:42.008425 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:41.984997 19514 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.018745 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 979) took 1510 ms. Trace:
I20260709 13:06:42.021611 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.019299 15548 rpcz_store.cc:276] 0709 13:06:40.502879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.502995 (+   116us) service_pool.cc:224] Handling call
0709 13:06:40.510018 (+  7023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.580132 (+ 70114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.580172 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.529825 (+949653us) spinlock_profiling.cc:243] Waited 44.1 ms on lock 0x7b2c00047618. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:41.530352 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.698065 (+167713us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:41.698099 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.698166 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:41.996509 (+298343us) raft_consensus.cc:1685] finished
0709 13:06:41.996539 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.012940 (+ 16401us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17079,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":40539,"spinlock_wait_cycles":101507456,"thread_start_us":167327,"threads_started":1,"wal-append.queue_time_us":231900}
I20260709 13:06:42.010089 19561 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:42.004768 19573 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.017266 19514 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:42.033077 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:42.035562 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.037396 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.037353 14889 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:42.049715 14889 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:42.030112 19573 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:42.028234 19527 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.053043 14961 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:42.062867 14889 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:42.063297 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.064443 14961 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:06:42.069231 15044 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:42.073613 14889 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:42.074733 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.030287 19561 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.078442 14889 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:42.079218 14961 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:42.081923 14889 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:06:42.083247 14889 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:06:42.084218 19328 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.088114 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 3169) took 1069 ms. Trace:
I20260709 13:06:42.088203 19242 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.088560 14886 rpcz_store.cc:276] 0709 13:06:41.018482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.018607 (+   125us) service_pool.cc:224] Handling call
0709 13:06:42.087937 (+1069330us) spinlock_profiling.cc:243] Waited 41.1 ms on lock 0x7b54000da554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:42.088024 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":94548864}
W20260709 13:06:42.089635 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:42.090337 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.090669 19242 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.091166 19242 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:42.092060 19603 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:06:42.091851 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.092808 19510 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:42.093240 19510 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:42.093756 19510 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:41.957285 19347 rpcz_store.cc:276] 0709 13:06:35.990129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:35.991000 (+   871us) service_pool.cc:224] Handling call
0709 13:06:38.128016 (+2137016us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:38.219053 (+ 91037us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:38.286167 (+ 67114us) ts_tablet_manager.cc:919] Shutdown and deleted data from running replica
0709 13:06:38.324295 (+ 38128us) ts_tablet_manager.cc:934] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
0709 13:06:41.036128 (+2711833us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:06:41.593843 (+557715us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.721358 (+127515us) tablet_metadata.cc:665] Metadata flushed
0709 13:06:41.722201 (+   843us) tablet_copy_client.cc:463] Replaced tombstoned tablet metadata.
0709 13:06:41.929307 (+207106us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:06:41.932197 (+  2890us) tablet_replica.cc:206] Creating consensus instance
0709 13:06:41.932613 (+   416us) ts_tablet_manager.cc:989] Replica registered.
0709 13:06:41.932735 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":33631,"mutex_wait_us":1256946,"tablet-copy.queue_time_us":131063,"thread_start_us":65539,"threads_started":2}
I20260709 13:06:42.096233 19347 tablet_copy_client.cc:806] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:06:42.096896 19347 tablet_copy_client.cc:670] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:06:42.093152 19242 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.098069 19532 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.106884 19561 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.107975 19561 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.108592 19561 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.110639 19561 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.117352 14967 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:42.118705 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.120743 15549 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:42.122421 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.122146 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.123601 15008 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.120177 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.125046 14967 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:42.125986 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.126773 14967 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:42.063628 19527 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.075280 19271 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.136562 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.075040 19346 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.128861 19606 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:42.127754 19392 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.148563 19510 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.150883 19510 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:42.152717 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.135524 19328 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:42.156775 14967 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:42.151500 19585 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.159238 19585 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.166683 19488 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.167306 19488 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.167562 19608 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:06:42.168694 19608 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:42.169073 19608 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:42.169720 19488 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.161733 19585 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:42.170007 19608 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.143433 19595 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:42.172610 14967 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:42.145537 19530 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.145885 19505 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.156715 19328 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.187739 14969 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:06:42.157660 19606 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:42.193348 15042 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:42.174680 19595 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.179065 19608 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:42.194885 19328 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.204603 19530 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.205035 19595 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.200490 19343 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:06:42.204424 19474 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:06:42.234210 14891 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:06:42.227857 19508 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.233381 19143 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:42.244225 19543 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.229394 19573 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.257606 19543 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.259859 19543 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.251621 19143 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:42.264437 19143 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.265543 19143 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:42.256780 19346 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.269223 19595 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.277012 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:42.277828 14891 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 7: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:42.280066 19575 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.249985 19508 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.255954 19527 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.271871 19595 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:42.287257 15044 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:42.287477 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.290745 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.290056 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:42.292300 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:42.293442 14859 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:42.294119 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.295687 19515 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:42.296096 19515 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.296439 19515 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.299078 19415 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:42.299772 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3171) took 1272 ms. Trace:
I20260709 13:06:42.300246 14894 rpcz_store.cc:276] 0709 13:06:41.027495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.027702 (+   207us) service_pool.cc:224] Handling call
0709 13:06:41.041179 (+ 13477us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:41.173731 (+132552us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.299535 (+1125804us) spinlock_profiling.cc:243] Waited 89 ms on lock 0x7b54000cc954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:42.299695 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":204677504}
I20260709 13:06:42.294097 19418 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:42.301551 19514 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.302512 14887 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:06:42.302966 14961 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:42.307906 15041 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:06:42.307976 19276 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:42.308604 19276 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:42.308991 19276 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.309635 19501 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.310247 19514 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.310681 19501 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.299674 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:42.314779 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.316495 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:42.248143 19606 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.315498 19271 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:42.318014 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:42.283182 19530 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:42.299250 19631 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.172s	user 0.003s	sys 0.000s
I20260709 13:06:42.319974 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.319883 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.321260 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.323949 15041 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:42.326978 19576 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:42.327931 19267 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:42.328330 19267 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.328662 19267 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.328936 19573 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.329020 19328 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.330832 19508 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.332060 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2541) took 1880 ms. Trace:
I20260709 13:06:42.332453 14965 rpcz_store.cc:276] 0709 13:06:40.451661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.456377 (+  4716us) service_pool.cc:224] Handling call
0709 13:06:40.456815 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:40.839818 (+383003us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:40.839862 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:40.872364 (+ 32502us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.030731 (+158367us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:41.210849 (+180118us) log.cc:844] Serialized 14 byte log entry
0709 13:06:41.212998 (+  2149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.331673 (+1118675us) spinlock_profiling.cc:243] Waited 51.8 ms on lock 0x7b540031bd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:42.331720 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.331768 (+    48us) raft_consensus.cc:1685] finished
0709 13:06:42.331878 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.332008 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15572,"prepare.queue_time_us":221160,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":132301,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":55000,"spinlock_wait_cycles":119160192,"thread_start_us":576980,"threads_started":3,"wal-append.queue_time_us":265121}
I20260709 13:06:42.319271 19500 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.319144 19527 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.335513 19346 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.336073 19346 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.335978 19527 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.338307 19346 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:42.338822 19346 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:42.338851 19527 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:42.339972 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 981) took 1296 ms. Trace:
I20260709 13:06:42.343032 14968 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 9. Ops: []
I20260709 13:06:42.342128 14963 rpcz_store.cc:276] 0709 13:06:41.043625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.044535 (+   910us) service_pool.cc:224] Handling call
0709 13:06:41.044957 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:41.065443 (+ 20486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:41.065471 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:41.085641 (+ 20170us) log.cc:844] Serialized 26 byte log entry
0709 13:06:41.221669 (+136028us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:41.221704 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:41.409400 (+187696us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:42.339677 (+930277us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54001ea354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:42.339732 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:42.339772 (+    40us) raft_consensus.cc:1685] finished
0709 13:06:42.339784 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:42.339919 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14927,"raft.queue_time_us":2416,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6649,"spinlock_wait_cycles":47755264,"thread_start_us":119240,"threads_started":1,"wal-append.queue_time_us":233593}
I20260709 13:06:42.339175 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.341301 19326 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.349633 19328 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.350129 19143 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:42.350479 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 11 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.352901 19512 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.356411 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.362238 14965 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.360520 14792 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 11 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:06:42.370626 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:42.372313 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49333.4us
I20260709 13:06:42.374066 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:42.364830 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.376252 15041 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.376989 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.366603 14792 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:42.378674 14967 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:42.379317 14792 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 6 to 8, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:42.341087 19500 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.386370 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.386732 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.388980 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.341600 19346 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:42.400635 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.403256 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.404160 15550 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:42.405575 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.388569 14792 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 5 to 7, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 7 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:42.407693 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 86513.8us
I20260709 13:06:42.408886 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.411649 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.412024 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.412534 15545 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:42.391993 19573 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:42.391696 19543 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.419184 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.409196 14792 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 10 to 12, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.422299 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.422992 15545 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:06:42.409766 19271 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:42.416675 19347 tablet_copy_client.cc:538] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:06:42.407325 19637 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:42.434897 19637 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:42.418797 19415 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.379546 19512 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:42.427361 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.384204 19508 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:42.424305 14792 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 8 to 11, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.406740 19528 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:06:42.439024 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:42.442209 15550 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.424053 19527 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.423801 19506 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:42.444774 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.426095 19293 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:06:42.435880 19637 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:42.448159 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.464716 15545 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:42.462303 15041 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:42.444207 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 9 to 10, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 10 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:42.466398 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.467885 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.469785 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.470875 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.471732 14962 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:42.474841 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.476145 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.477370 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.478089 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.479785 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.489688 14962 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:42.477716 14792 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 7 to 9, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 9 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.493240 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.491132 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.499271 15550 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:42.500933 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.475904 19474 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:42.501446 15546 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:42.488941 19143 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.489612 19616 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:06:42.479588 14777 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e4938453819c469599f515b22d92fe27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:42.494846 19415 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.469866 19556 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.504802 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.495961 14792 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:42.464069 19527 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.495337 19506 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.461939 19346 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.491598 19608 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
W20260709 13:06:42.509935 19639 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:06:42.505831 19143 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.505445 19474 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.513075 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.514298 14792 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:42.517547 19608 consensus_queue.cc:1243] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:42.518343 14887 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:42.519197 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.519457 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.496117 19606 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:06:42.500512 19559 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:06:42.503614 19595 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:06:42.509708 19532 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:06:42.514477 19415 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.514281 19504 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:06:42.526417 19474 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:42.523882 19143 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.574331 19557 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.593675 19347 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:06:42.546896 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:42.595717 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 192143us
I20260709 13:06:42.574589 19561 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 13:06:42.585040 19532 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:42.550661 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.565971 15545 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:42.605290 15547 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:42.564594 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2060) took 1092 ms. Trace:
I20260709 13:06:42.581303 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.526655 14792 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 9 to 11, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:42.572937 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.545025 15549 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:06:42.607197 14963 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:42.581972 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.533310 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.608013 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.607559 14792 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 7 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:42.528960 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.608765 14963 raft_consensus.cc:2410] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:42.590803 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.609485 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.607854 15541 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:42.609869 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.610456 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.610975 14963 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.546358 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:42.611785 15542 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:42.508462 19267 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.597086 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.509595 14895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "338c720b04aa4c14b53937055c254e24"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:42.599737 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:42.603682 14965 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:42.606026 14968 rpcz_store.cc:276] 0709 13:06:41.471811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.958308 (+486497us) service_pool.cc:224] Handling call
0709 13:06:42.342876 (+384568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:42.343350 (+   474us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.564351 (+221001us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54003ebf50. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:42.564526 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":873360640}
I20260709 13:06:42.613291 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.613696 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.619320 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:42.619596 14893 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:06:42.568841 19328 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:42.582592 19240 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:42.548571 19527 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.617699 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:42.629630 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:42.624567 14964 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:42.616772 19559 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.633435 19267 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.634719 19559 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:42.637190 19559 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:42.638971 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.639585 19505 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:42.640060 19505 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.640407 19505 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:42.643589 19514 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.644156 19514 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.644670 19514 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.604797 19532 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:42.651778 14889 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:42.655225 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.656183 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:42.615607 19530 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:42.615517 19557 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:42.577368 19515 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.624049 19556 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:42.622179 19488 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:42.625226 19328 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:42.677783 15548 raft_consensus.cc:2410] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:06:42.627206 19240 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:42.679051 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.685326 14963 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:06:42.661196 19527 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:42.695520 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:42.697542 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83918.2us
I20260709 13:06:42.698951 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:42.686841 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:42.665808 19508 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:42.700526 19508 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:42.700865 14963 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:42.700388 19328 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.701009 19508 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:42.701463 19328 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:06:42.703254 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.666337 19533 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:42.679853 19646 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:42.686473 19528 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.665373 19549 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:06:42.709796 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.711251 19501 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:42.707875 14963 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:42.689703 19218 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:42.711880 14894 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:42.713946 19501 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:42.714005 19143 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.715025 19530 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:42.715965 14893 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:06:42.718016 14963 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:06:42.722669 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.723459 15543 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:42.698163 19527 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:42.729018 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:42.730540 19533 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:42.732633 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2057) took 1261 ms. Trace:
I20260709 13:06:42.733026 14966 rpcz_store.cc:276] 0709 13:06:41.470926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.751611 (+280685us) service_pool.cc:224] Handling call
0709 13:06:42.732486 (+980875us) spinlock_profiling.cc:243] Waited 91.4 ms on lock 0x7b54003e7454. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:42.732581 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210123136}
I20260709 13:06:42.734511 14966 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:42.715396 19530 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:42.735535 19267 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:42.736090 19267 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.724208 19276 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.739470 19533 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.708628 19646 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:42.742537 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:42.743284 15541 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:42.743757 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.710889 19616 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.747231 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.756191 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.687641 19532 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.717161 19561 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:42.710171 19573 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:42.758499 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.716766 19543 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:42.761250 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.768421 19293 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:42.781556 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.797115 19542 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:06:42.804363 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.815927 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.817183 14962 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:06:42.817898 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:42.821385 19275 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:42.825635 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.837057 15548 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:42.758191 15035 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:06:42.843209 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.839946 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:42.845124 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.850653 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.851356 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.870715 14961 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
W20260709 13:06:42.877369 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.867527 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.877416 15041 raft_consensus.cc:2410] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 13:06:42.878805 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.717424 19528 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:42.884946 14893 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:42.887068 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.726935 19506 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.145s
I20260709 13:06:42.908700 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:42.903661 15037 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:42.888628 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:42.917464 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 77672.7us
I20260709 13:06:42.889819 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:42.922346 19559 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:42.922827 19559 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:42.923265 19559 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:42.930560 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.753176 19646 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:42.921295 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:42.938151 15040 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:42.756106 19328 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260709 13:06:42.942759 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:42.757951 19271 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.143s
I20260709 13:06:42.871065 19542 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:42.945451 15545 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:42.844646 19535 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:06:42.759595 19512 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.148s
I20260709 13:06:42.997351 19642 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:42.928167 19242 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:43.003974 19642 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.006079 19642 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:42.993319 19609 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:42.955386 19143 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:42.891666 19204 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.001041 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:42.949090 15541 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:06:42.853524 19561 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.041177 15038 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [10.11-12.12]
W20260709 13:06:43.008132 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:42.929713 19415 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:42.841742 19418 consensus_queue.cc:1175] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25b8f0cc46f748468395543b8b174bf4" responder_term: 12 status { last_received { term: 12 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:43.058761 15044 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:43.050830 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:43.046693 19645 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
I20260709 13:06:42.920542 19293 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.063081 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:43.062604 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:42.950659 19608 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.104s
I20260709 13:06:43.068812 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:43.075567 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:43.075811 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:43.077867 15548 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:43.050652 19328 consensus_queue.cc:1243] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:43.078941 15037 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:43.042052 19204 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:42.993696 19575 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
W20260709 13:06:43.088068 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.121654 15036 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:43.121645 15039 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:06:43.126703 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58017.1us
I20260709 13:06:43.127677 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:43.129451 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:43.130239 19346 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.139605 19267 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:43.189141 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 59782.5us
I20260709 13:06:43.171519 19575 consensus_queue.cc:1243] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:43.131173 19101 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.051092 19527 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.160543 19508 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.046072 19585 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
W20260709 13:06:43.168306 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 69640.7us
I20260709 13:06:43.084908 19542 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.075727 19515 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:43.075629 19276 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:43.058504 19606 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.109s
I20260709 13:06:43.172567 19242 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:43.172955 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.176690 19584 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.178530 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.179488 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.182546 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.190222 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:43.191145 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.150708 19293 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:43.188474 19505 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.000s
I20260709 13:06:43.165934 19506 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 13:06:43.189469 19514 consensus_meta.cc:287] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.544s	user 0.012s	sys 0.000s
W20260709 13:06:43.195713 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 247081us
I20260709 13:06:43.075347 19415 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:43.189772 19543 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:43.244416 14890 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
W20260709 13:06:43.246289 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56230.3us
I20260709 13:06:43.248917 14891 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:43.251504 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:43.260771 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:06:43.262714 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 328768us
I20260709 13:06:43.264777 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:43.245273 19595 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:43.266989 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:43.267673 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:43.268491 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:43.274598 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:43.273136 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:43.269517 19609 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:43.278431 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 533178us
I20260709 13:06:43.252842 19636 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:43.300519 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49123.2us
I20260709 13:06:43.301183 19293 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:43.301954 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.302320 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:43.302596 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:43.302932 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.303797 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.276667 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:43.396142 19557 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:43.262902 19415 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:43.402961 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 126420us
I20260709 13:06:43.270901 19595 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:43.257185 19505 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.277501 19616 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:43.297506 19608 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:43.280131 19607 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:43.480791 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:43.480955 15044 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:06:43.400753 19274 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.210s
I20260709 13:06:43.265681 19101 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.135s
I20260709 13:06:43.329824 19218 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:43.479314 19343 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:43.313640 19500 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:43.575464 19242 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.329953 19293 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:43.272578 19655 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:43.614883 14961 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:06:43.617246 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:43.653041 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:43.642210 19595 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:43.630355 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 318364us
I20260709 13:06:43.575129 19664 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.261684 19514 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.638720 14893 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:43.639503 14970 consensus_meta.cc:287] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.737s	user 0.010s	sys 0.000s
I20260709 13:06:43.578917 19575 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:43.626528 19608 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:43.645219 14964 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:06:43.646651 15044 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:06:43.649525 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 375052us
I20260709 13:06:43.606277 19543 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:43.621902 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:43.619351 19616 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:43.658610 14970 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:43.641247 19240 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.656404 19293 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:43.664104 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.646497 19504 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:43.645219 19506 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
W20260709 13:06:43.662736 19661 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.366s	user 0.001s	sys 0.000s
I20260709 13:06:43.675207 19608 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:43.636521 19328 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:06:43.687117 14967 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:43.658998 19660 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:43.679695 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57907.7us
I20260709 13:06:43.696410 14893 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:43.674023 19595 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:43.663693 14861 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:06:43.648777 19242 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.673421 19607 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:43.682052 19616 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:43.674690 19500 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:43.658149 19650 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:06:43.676487 19346 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:43.691973 19670 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.746630 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:43.755710 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 98650.7us
I20260709 13:06:43.768564 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:43.673137 19575 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:43.765720 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 94915.3us
I20260709 13:06:43.652436 19609 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.669947 19664 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.758416 19508 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:43.792246 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:43.798460 14888 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:43.797456 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2880) took 1052 ms. Trace:
I20260709 13:06:43.746884 19504 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:43.787083 19474 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.177s	user 0.011s	sys 0.002s
I20260709 13:06:43.799204 15042 rpcz_store.cc:276] 0709 13:06:42.745344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.745460 (+   116us) service_pool.cc:224] Handling call
0709 13:06:42.845626 (+100166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.846004 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.846042 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.872242 (+ 26200us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.191268 (+319026us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:43.191307 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.191369 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.797203 (+605834us) raft_consensus.cc:1685] finished
0709 13:06:43.797232 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.797385 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2192,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":23145,"thread_start_us":309207,"threads_started":1,"wal-append.queue_time_us":381816}
I20260709 13:06:43.784786 19418 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:43.858063 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:06:43.809773 19559 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.886s	user 0.008s	sys 0.004s
I20260709 13:06:43.858688 14893 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:43.840080 14933 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.585s (SENT) [suppressed 3 similar messages]
I20260709 13:06:43.760754 19660 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.770041 19500 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.875664 19500 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:43.876049 19681 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:06:43.877215 19672 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:06:43.879101 19662 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 13:06:43.880766 19275 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.974s	user 0.008s	sys 0.002s
I20260709 13:06:43.881726 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1012) took 1160 ms. Trace:
I20260709 13:06:43.882171 15542 rpcz_store.cc:276] 0709 13:06:42.721554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.721679 (+   125us) service_pool.cc:224] Handling call
0709 13:06:42.722015 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.738002 (+ 15987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.738040 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.738424 (+   384us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.191576 (+453152us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:43.648036 (+456460us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.648292 (+   256us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.648368 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.881492 (+233124us) raft_consensus.cc:1685] finished
0709 13:06:43.881518 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.881661 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2120,"prepare.queue_time_us":508590,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":8081,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":7100,"spinlock_wait_cycles":19311488,"thread_start_us":751935,"threads_started":2,"wal-append.queue_time_us":455560}
I20260709 13:06:43.888840 19664 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:43.782618 19346 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.892547 19575 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:43.897795 19663 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.318s	user 0.010s	sys 0.001s
I20260709 13:06:43.809099 19682 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:43.873050 19595 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:06:43.883915 14892 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:43.840235 19328 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:43.871075 19684 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:43.872462 19671 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:06:43.891147 19415 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:43.767488 19607 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.842059 19474 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.782462 19670 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.867165 19505 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:43.917879 14888 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:43.929850 14890 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:43.907301 19643 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:43.925823 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:43.929481 14893 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
W20260709 13:06:43.913403 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 143423us
I20260709 13:06:43.931259 14894 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:43.907509 19557 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:43.870275 19559 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.937947 15541 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:43.944777 15035 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:43.920892 19328 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:43.957245 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1011) took 1236 ms. Trace:
I20260709 13:06:43.957762 15546 rpcz_store.cc:276] 0709 13:06:42.721221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.721365 (+   144us) service_pool.cc:224] Handling call
0709 13:06:42.721625 (+   260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.723601 (+  1976us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.723645 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.738070 (+ 14425us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.174919 (+436849us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:43.174955 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.175026 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.795227 (+620201us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:43.937439 (+142212us) raft_consensus.cc:1685] finished
0709 13:06:43.937468 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.957169 (+ 19701us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1473,"raft.queue_time_us":5750,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":88999,"spinlock_wait_cycles":4653952,"thread_start_us":300173,"threads_started":1,"wal-append.queue_time_us":428857}
I20260709 13:06:43.967428 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2088) took 1309 ms. Trace:
I20260709 13:06:43.908080 19682 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.970798 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:43.973971 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:43.967880 14963 rpcz_store.cc:276] 0709 13:06:42.657842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.718976 (+ 61134us) service_pool.cc:224] Handling call
0709 13:06:42.719287 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.055973 (+336686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.056017 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.056536 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.588775 (+532239us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:43.741621 (+152846us) log.cc:844] Serialized 14 byte log entry
0709 13:06:43.935358 (+193737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.935473 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:43.967199 (+ 31726us) raft_consensus.cc:1685] finished
0709 13:06:43.967222 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:43.967355 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55663,"prepare.queue_time_us":45854,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":180694,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":6951,"thread_start_us":983680,"threads_started":4,"wal-append.queue_time_us":596380}
I20260709 13:06:43.935527 19514 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:43.942329 19637 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:43.963680 19646 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.961s	user 0.003s	sys 0.009s
I20260709 13:06:43.979935 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:43.918380 19684 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.986459 14890 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:43.990927 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50902.2us
I20260709 13:06:43.948159 19557 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:43.991720 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:43.943873 19643 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.983855 19683 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:44.003693 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.004393 15544 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:06:44.005919 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.006705 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.007671 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:44.005753 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:43.985692 19637 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:43.994195 19242 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.012331 19520 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:06:44.012630 19328 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.015826 19607 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.016185 19532 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.019544 19692 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:06:44.019743 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:43.997044 19346 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.023661 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.013449 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:44.020972 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.024855 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.031198 15042 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:43.985913 19646 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.034927 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:44.013732 19347 tablet_bootstrap.cc:700] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Time spent opening tablet: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:06:44.012984 19504 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.013136 19665 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:44.046468 19530 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.047606 19530 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.053171 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2889) took 1303 ms. Trace:
I20260709 13:06:44.053685 15035 rpcz_store.cc:276] 0709 13:06:42.749951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.901596 (+151645us) service_pool.cc:224] Handling call
0709 13:06:44.052934 (+1151338us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54001b80d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:44.053099 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2330640768}
I20260709 13:06:44.056619 19240 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.056871 19474 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.057900 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.058748 15042 raft_consensus.cc:2410] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:06:44.059609 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.059890 19660 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.060160 15042 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:06:44.009728 19683 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.061218 15042 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:44.061519 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.062587 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.031749 19688 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.065730 15545 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:44.065815 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.074924 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.078951 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.039215 19346 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:44.039390 19636 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:06:44.063302 19683 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.064724 19696 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:44.079286 19657 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:44.083796 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:44.097218 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.099702 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.101023 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.101292 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:44.102115 19685 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:06:44.104485 19658 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:44.106400 14894 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:44.087210 19698 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.112923 19293 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.117216 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.118278 19514 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.118983 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:44.119411 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.119719 14964 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:44.120478 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.120672 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.121150 14961 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:44.121727 19636 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:44.122427 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:44.122339 19636 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:44.123720 19655 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:44.124069 19700 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:06:44.124293 19655 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:44.124691 19655 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.090824 19559 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.125330 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1000) took 1077 ms. Trace:
I20260709 13:06:44.086460 19694 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:44.096491 19696 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.135740 15541 rpcz_store.cc:276] 0709 13:06:43.048319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.048485 (+   166us) service_pool.cc:224] Handling call
0709 13:06:43.937718 (+889233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.944840 (+  7122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.125158 (+180318us) spinlock_profiling.cc:243] Waited 889 ms on lock 0x7b54006a1150. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:44.125279 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2044589952}
I20260709 13:06:44.136442 19637 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.123754 19643 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:44.128532 14777 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e4938453819c469599f515b22d92fe27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:44.110956 19512 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:44.137917 19512 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:44.138382 19646 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.138828 19512 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.139547 19682 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.140229 19608 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.143850 19557 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.136178 19696 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.147264 19542 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:44.147434 19684 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.126204 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:44.089974 19346 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.115080 19293 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.147266 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:44.160573 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44219us
I20260709 13:06:44.110137 19658 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:44.067237 19665 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.110301 19670 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.140578 19655 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.125955 19698 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.170674 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:44.184542 14895 raft_consensus.cc:606] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:44.185056 14895 raft_consensus.cc:614] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:44.186045 14886 raft_consensus.cc:2410] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:06:44.177006 19608 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.187882 19616 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:44.194826 19698 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.180982 19670 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:06:44.200435 19693 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.201864 19528 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.202365 19346 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.204267 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.210289 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:44.204505 19651 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.015s	user 0.003s	sys 0.000s
I20260709 13:06:44.199759 19556 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:44.182976 19571 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:06:44.212563 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 220703us
I20260709 13:06:44.212939 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:44.215186 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.216194 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.219753 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.221792 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.214197 19571 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.240067 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.244036 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.214133 19556 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:44.238960 19571 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:44.308542 19655 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.316116 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.322942 19657 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:44.367549 19608 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.368161 19608 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.371264 19608 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.372213 19714 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.367385 19657 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.372767 19714 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.374970 19714 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.322830 19346 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:06:44.379745 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3170) took 3360 ms. Trace:
I20260709 13:06:44.380193 14892 rpcz_store.cc:276] 0709 13:06:41.018845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.019025 (+   180us) service_pool.cc:224] Handling call
0709 13:06:41.025943 (+  6918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.905167 (+2879224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.379468 (+474301us) spinlock_profiling.cc:243] Waited 2.86 s on lock 0x7b54000cba54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:44.379656 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6572708736}
W20260709 13:06:44.384708 19705 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:06:44.385221 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 2891) took 1542 ms. Trace:
I20260709 13:06:44.385656 15036 rpcz_store.cc:276] 0709 13:06:42.842977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.894434 (+ 51457us) service_pool.cc:224] Handling call
0709 13:06:44.385034 (+1490600us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001f4ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:44.385156 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409518848}
I20260709 13:06:44.387856 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2491) took 1799 ms. Trace:
I20260709 13:06:44.388170 19665 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.388335 14887 rpcz_store.cc:276] 0709 13:06:42.588828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.596828 (+  8000us) service_pool.cc:224] Handling call
0709 13:06:42.614794 (+ 17966us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.615167 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.615207 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.620451 (+  5244us) log.cc:844] Serialized 26 byte log entry
0709 13:06:42.919450 (+298999us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:42.919503 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:42.919584 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.203990 (+1284406us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:44.387491 (+183501us) raft_consensus.cc:1685] finished
0709 13:06:44.387522 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.387787 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":564,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":15292,"spinlock_wait_cycles":3094400,"thread_start_us":293240,"threads_started":1,"wal-append.queue_time_us":495922}
I20260709 13:06:44.212005 19658 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.393018 19658 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.311959 19670 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:44.212826 19693 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.424240 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.406636 19549 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:44.407049 19698 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:44.407335 19643 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.450529 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.427034 19665 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:44.482470 15038 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:06:44.413935 19688 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:44.464017 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.428429 19670 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.446094 19549 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.505192 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:44.509796 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.459242 19643 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.446377 19556 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.515797 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:44.520864 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.507259 19532 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.486039 19665 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.512892 19616 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.539144 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.540004 14969 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:44.540313 19515 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:44.540872 19515 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:44.541234 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.592195 14969 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:44.543067 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:44.545405 19675 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.796s	user 0.004s	sys 0.004s
I20260709 13:06:44.572451 15542 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:44.551292 19561 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:44.557669 19659 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.068s	user 0.000s	sys 0.016s
W20260709 13:06:44.557624 19711 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:06:44.561038 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.604182 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.586766 19674 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.742s	user 0.000s	sys 0.009s
I20260709 13:06:44.566664 19636 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:44.560794 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.567178 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55532 (request call id 0) took 2076 ms. Trace:
I20260709 13:06:44.568486 15039 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [10.11-12.12]
I20260709 13:06:44.570381 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:44.570937 19665 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.572427 19549 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.613660 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.573626 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:44.614485 19690 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.575083 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.574976 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.575755 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.612181 14895 rpcz_store.cc:276] 0709 13:06:42.496272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.502616 (+  6344us) service_pool.cc:224] Handling call
0709 13:06:44.566981 (+2064365us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002eb8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d70853 00007f5539d3e60a 00007f55332c47d4 00007f55332c4762 00007f55332c4691 00007f55332c460c 00007f55332c38c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:44.567099 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3608153984}
I20260709 13:06:44.576485 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:44.578251 15544 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:44.578948 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.616782 15548 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.579331 14894 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:06:44.580011 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.528337 19532 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:44.529827 19710 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.291s	user 0.001s	sys 0.000s
I20260709 13:06:44.580982 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.584357 19556 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.535280 19696 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.619232 14887 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:44.586772 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.588554 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.588964 18821 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:44.620257 18821 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:44.590591 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:44.620970 15546 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:44.575021 19670 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.625492 14889 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:44.601500 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.566239 19655 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.626503 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.606746 14963 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:44.605623 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.614540 15547 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:44.574286 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.614073 14961 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:44.577420 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.628436 15541 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 5.
I20260709 13:06:44.529207 19697 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:44.616075 14892 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
W20260709 13:06:44.600157 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57230.8us
I20260709 13:06:44.573627 19643 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.625813 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.605966 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.624110 18821 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.605468 19595 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:44.632539 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.634034 19655 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.624107 19667 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:44.638435 18821 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:44.631016 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.631341 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:44.638616 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.642115 15044 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:44.646409 15546 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:44.600554 19415 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:06:44.641636 19535 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:44.649647 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.653995 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.654656 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.654649 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:44.657047 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:44.640007 19595 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.662968 14891 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:44.662513 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:44.665954 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 894) took 2522 ms. Trace:
I20260709 13:06:44.666900 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2090) took 2008 ms. Trace:
I20260709 13:06:44.667187 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.639707 19697 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.668762 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2157) took 1632 ms. Trace:
I20260709 13:06:44.666319 15043 rpcz_store.cc:276] 0709 13:06:42.141113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.141242 (+   129us) service_pool.cc:224] Handling call
0709 13:06:42.147910 (+  6668us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:42.153566 (+  5656us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.153610 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:42.349132 (+195522us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b48002001d8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:06:42.800065 (+450933us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b180048ea40. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a
0709 13:06:42.801174 (+  1109us) spinlock_profiling.cc:243] Waited 962 us on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:06:42.801677 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:06:43.169767 (+368090us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:43.169829 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.169918 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.557104 (+1387186us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:44.663456 (+106352us) raft_consensus.cc:1685] finished
0709 13:06:44.663477 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.663611 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5236,"raft.queue_time_us":6026,"raft.run_cpu_time_us":2557,"raft.run_wall_time_us":193139,"spinlock_wait_cycles":66578816,"thread_start_us":367680,"threads_started":1,"wal-append.queue_time_us":462140}
I20260709 13:06:44.669145 15040 rpcz_store.cc:276] 0709 13:06:43.036101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.038324 (+  2223us) service_pool.cc:224] Handling call
0709 13:06:43.038726 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:43.051678 (+ 12952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.051723 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:43.052282 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:06:44.121865 (+1069583us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b180040e520. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:06:44.169302 (+ 47437us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:44.169345 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:44.169428 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.668460 (+499032us) raft_consensus.cc:1685] finished
0709 13:06:44.668482 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.668707 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12545,"raft.queue_time_us":30511,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":7969,"spinlock_wait_cycles":90152320,"thread_start_us":47223,"threads_started":1,"wal-append.queue_time_us":1122164}
I20260709 13:06:44.670413 19697 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.667479 14966 rpcz_store.cc:276] 0709 13:06:42.658181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.735175 (+ 76994us) service_pool.cc:224] Handling call
0709 13:06:42.741453 (+  6278us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:43.066585 (+325132us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:43.066620 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:43.196404 (+129784us) log.cc:844] Serialized 52 byte log entry
0709 13:06:43.655032 (+458628us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:43.655080 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.655159 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:44.586081 (+930922us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:44.666488 (+ 80407us) raft_consensus.cc:1685] finished
0709 13:06:44.666515 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:44.666818 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":44986,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":107,"spinlock_wait_cycles":9313536,"thread_start_us":725364,"threads_started":2,"wal-append.queue_time_us":515237}
I20260709 13:06:44.651834 19667 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.672392 14969 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:44.673631 19667 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.645259 19720 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:44.651320 19689 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:06:44.625453 19636 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.678304 19636 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:44.678433 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.679744 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:44.682973 19240 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.683409 19240 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.683943 19240 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.686149 19218 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:44.689934 19696 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.690589 19696 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:44.690961 19696 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:44.691813 19684 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:44.692186 19684 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:44.692368 19532 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.692425 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:44.692745 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:44.692966 19684 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.694000 19684 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:44.700275 15547 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:44.665241 19643 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:44.629882 19690 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:44.700795 15548 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:44.702945 15547 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:44.680940 19595 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:44.707044 19678 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.948s	user 0.003s	sys 0.006s
I20260709 13:06:44.662220 19722 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:44.714064 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.694944 19720 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:44.697362 19696 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:44.720036 15547 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:44.714927 19533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.023s	sys 0.040s
I20260709 13:06:44.724583 15547 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:44.722309 15548 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:44.727087 14968 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
W20260709 13:06:44.731709 14970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 986) took 2366 ms (client timeout 1925 ms). Trace:
I20260709 13:06:44.735366 14962 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:06:44.738308 14970 rpcz_store.cc:269] 0709 13:06:42.360272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.463984 (+103712us) service_pool.cc:224] Handling call
0709 13:06:44.726707 (+2262723us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540031bd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:44.726834 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981657472}
I20260709 13:06:44.765966 19665 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.766577 19665 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.744982 19667 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:44.772753 19667 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:44.776968 15547 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
W20260709 13:06:44.778811 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:44.736570 19533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.024s	sys 0.040s
I20260709 13:06:44.736677 19143 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.798337 19143 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.800403 19143 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.801257 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.802446 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:44.791468 19718 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:06:44.792455 19571 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.775233 19667 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.811517 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.812325 14892 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:44.839880 14961 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
W20260709 13:06:44.844988 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89745.1us
I20260709 13:06:44.845940 15546 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:06:44.808310 19143 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:44.808868 19690 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.851712 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 3193) took 1200 ms. Trace:
I20260709 13:06:44.852522 14886 rpcz_store.cc:276] 0709 13:06:43.651203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:43.651350 (+   147us) service_pool.cc:224] Handling call
0709 13:06:44.851575 (+1200225us) spinlock_profiling.cc:243] Waited 496 ms on lock 0x7b54002eb8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:44.851666 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1141067136}
W20260709 13:06:44.850850 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 193223us
I20260709 13:06:44.806437 19689 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 13:06:44.855662 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:44.825533 19655 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.725152 19720 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.887396 19326 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:44.856123 19143 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.900914 19326 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.902773 19143 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.902886 19326 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.887534 19276 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:06:44.904227 19276 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:44.904587 19276 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:44.905298 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.905424 19276 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:44.905964 14886 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:44.906802 19276 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:44.906991 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:44.908447 19240 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:44.910956 19240 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:44.911636 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:44.912177 14891 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:44.918174 19347 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:06:44.918597 14891 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:44.919252 19347 tablet_bootstrap.cc:492] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:06:44.920313 19571 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.924705 19720 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:44.926617 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:44.887962 19690 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:44.930289 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:44.936342 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.941314 19556 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:44.963514 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.969089 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:44.966001 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:44.973543 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:44.985777 15041 raft_consensus.cc:2410] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:44.956357 19326 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:44.957172 19240 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:44.962495 19347 ts_tablet_manager.cc:1403] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 2.369s	user 0.053s	sys 0.009s
I20260709 13:06:44.958083 19689 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:44.993040 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 66532.3us
I20260709 13:06:45.000669 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.000916 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.002218 15037 raft_consensus.cc:2410] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:06:44.963505 19665 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:44.986552 19556 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:44.970988 19276 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:45.002924 14890 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:44.969707 19204 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.006886 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.010689 15544 raft_consensus.cc:2410] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:06:44.991845 19240 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.011803 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.013659 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.013054 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.014343 14886 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:44.992398 19326 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.021317 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.022432 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.023034 14893 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:45.011229 19636 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.011781 19556 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.035017 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.036072 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.036119 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.037768 15039 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:45.030203 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2092) took 2371 ms. Trace:
I20260709 13:06:45.038676 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.039453 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1115) took 1036 ms. Trace:
I20260709 13:06:45.040001 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.038573 14967 rpcz_store.cc:276] 0709 13:06:42.658457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.765419 (+106962us) service_pool.cc:224] Handling call
0709 13:06:42.765733 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:43.747907 (+982174us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.029976 (+1282069us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b540016ce54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:45.030123 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2118709632}
I20260709 13:06:45.039842 15545 rpcz_store.cc:276] 0709 13:06:44.002995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.007066 (+  4071us) service_pool.cc:224] Handling call
0709 13:06:44.014319 (+  7253us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:44.076111 (+ 61792us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.039228 (+963117us) spinlock_profiling.cc:243] Waited 51.2 ms on lock 0x7b540059d3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:45.039375 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117704576}
I20260709 13:06:45.042030 18821 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:45.002238 19689 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.042418 18821 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.042773 18821 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.043448 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.044047 19689 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.044543 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:45.044831 15043 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:45.030303 19657 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.047389 19240 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.052203 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.041186 19520 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.044730 19347 raft_consensus.cc:359] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:45.056226 19347 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:06:45.056965 19347 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:06:45.057816 19653 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.876s	user 0.011s	sys 0.004s
I20260709 13:06:45.059190 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2567) took 2701 ms. Trace:
I20260709 13:06:45.059543 14965 rpcz_store.cc:276] 0709 13:06:42.357484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.616654 (+259170us) service_pool.cc:224] Handling call
0709 13:06:42.617000 (+   346us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:42.626156 (+  9156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:42.626185 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:42.651138 (+ 24953us) log.cc:844] Serialized 52 byte log entry
0709 13:06:43.061787 (+410649us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:43.061834 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:43.061915 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:45.057298 (+1995383us) spinlock_profiling.cc:243] Waited 2.43 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:45.058898 (+  1600us) raft_consensus.cc:1685] finished
0709 13:06:45.058918 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:45.059128 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1129,"raft.queue_time_us":3188,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6082,"spinlock_wait_cycles":5597952,"thread_start_us":369664,"threads_started":1,"wal-append.queue_time_us":502348}
I20260709 13:06:45.060680 19693 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.062291 18821 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.068418 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.069152 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.069156 15550 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:45.072072 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.041326 19532 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.076566 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.072438 18821 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.074348 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:45.071686 19347 ts_tablet_manager.cc:1434] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.001s
W20260709 13:06:45.084419 19732 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:06:45.084456 19643 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:06:45.085561 19643 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:45.085903 19643 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:45.093564 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.093994 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:45.096232 19733 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:06:45.051719 19595 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.098410 19595 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.098529 19326 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.080799 19655 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:45.038735 19636 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.099355 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.100016 14961 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:45.100051 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.100682 14967 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:45.101500 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.103767 15544 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:45.103605 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.104825 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:45.093190 19696 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.109470 19636 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.110889 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.111286 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.111912 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:45.114034 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.127375 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2569) took 2678 ms. Trace:
I20260709 13:06:45.127897 14968 rpcz_store.cc:276] 0709 13:06:42.448643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:42.649998 (+201355us) service_pool.cc:224] Handling call
0709 13:06:44.726847 (+2076849us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.737851 (+ 11004us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.127149 (+389298us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b540031bd50. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:45.127306 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4724416896}
I20260709 13:06:45.102490 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.106001 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.115831 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.129784 14965 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:45.130136 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.116525 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.130903 14967 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:45.118546 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:45.086731 19643 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.120299 14895 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:06:45.134034 18821 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.135864 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:45.134222 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57715.6us
I20260709 13:06:45.099292 19655 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.136699 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.146134 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.147502 15039 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:45.148612 14892 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:45.140403 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.150094 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.141197 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.150502 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:45.151228 15042 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:06:45.152324 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:45.141433 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.142091 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.143755 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.136957 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.155220 14887 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:45.142009 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.156432 14891 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:45.158479 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.159209 14965 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.146891 15542 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:45.160439 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.139688 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:45.167728 14895 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:06:45.168449 15038 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:06:45.156632 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.169917 18821 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.172448 15541 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:45.146749 19655 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.172920 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.174513 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.175297 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:45.176481 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73212.7us
W20260709 13:06:45.178961 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.132932 19528 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:45.137156 19240 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.181085 15043 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:45.177543 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:45.183557 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:45.186291 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:45.185700 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.186033 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.186861 14887 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:45.183964 14965 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:45.175264 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.189641 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.164718 19532 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.191164 14962 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:45.193892 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.170259 19101 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.174065 19657 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:06:45.136325 19691 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:06:45.219624 19657 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:45.220077 19691 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:45.183249 19415 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:06:45.220710 19691 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.187520 19690 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 13:06:45.222270 19690 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:45.221751 19691 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.222632 19690 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.165396 19693 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.192608 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.223783 19693 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.224169 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.187541 19504 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:06:45.225472 19504 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:45.225718 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.180361 19698 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:45.226197 19694 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:45.226540 19664 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:45.182305 19730 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:06:45.226935 19664 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.198819 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.227545 19616 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:45.197343 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:45.227962 19616 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:45.228277 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.223251 19691 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.227600 19326 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:45.228788 19616 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.227973 19595 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:45.229557 19326 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.229879 19595 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:45.230028 19326 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.230753 19595 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.231930 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.191475 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-13ff541fc966499ea2706d34cfb2c964 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:06:45.205921 19696 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.233146 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-13ff541fc966499ea2706d34cfb2c964 on tablet 13ff541fc966499ea2706d34cfb2c964 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.233220 19204 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:45.187772 19528 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.199355 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.236560 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.238298 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:45.184618 19512 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.181890 19688 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:45.214540 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.225903 19693 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.179965 19643 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.184687 19276 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:06:45.157120 19542 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:06:45.225850 19504 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.262013 14961 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:45.263144 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.263815 14961 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:45.264727 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.220134 19657 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.254096 19557 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:45.275967 19557 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:45.277109 19557 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.261049 19573 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:45.227356 19664 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.279306 19573 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.280067 19528 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.281266 19573 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.250622 19512 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.283533 19512 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.248219 19646 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:45.284126 19646 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:45.284536 19646 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.284232 19690 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.285969 19690 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.288430 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.289958 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.196636 19101 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:45.260399 19658 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:45.291592 19101 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.291985 19658 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.292801 19101 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.293031 19276 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:45.293366 19698 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.293815 19698 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.293979 19658 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.248567 19514 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:45.295188 19514 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:45.295962 14777 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e4938453819c469599f515b22d92fe27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:45.256196 14962 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:06:45.296090 19514 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:45.297539 19726 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 13:06:45.293387 19276 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.252898 19584 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.258631 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.299713 14966 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:45.210209 19655 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.300225 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.301770 19655 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:45.303189 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.249884 19688 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.303557 19687 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.303942 19688 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.304251 19687 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:45.237897 19694 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:45.304804 19698 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.305694 19694 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.306725 19698 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.307605 19696 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.275034 14968 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:06:45.283094 19515 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.257303 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.299274 19504 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.259182 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.229840 19616 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.321372 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.310304 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.314685 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.322669 14965 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:45.315712 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.325837 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:45.324173 14961 raft_consensus.cc:2376] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12. Re-sending same reply.
I20260709 13:06:45.339058 19658 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:45.340569 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.350351 14970 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:45.343148 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.350957 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.351423 14968 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.319348 19665 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.328307 19556 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.352141 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.363862 14894 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:45.373762 14964 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:45.337344 19204 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.374632 19556 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:45.374961 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 186095us
I20260709 13:06:45.303129 19326 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.375089 19204 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:06:45.372736 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 136249us
W20260709 13:06:45.370132 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.379724 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:45.380538 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.349252 19504 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.366974 19689 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.368526 19515 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.299283 19276 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.367522 19542 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:45.394271 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.394619 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:45.391295 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:45.394728 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:06:45.392117 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 152870us
I20260709 13:06:45.395880 14967 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.396204 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.396831 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:45.397522 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.399003 15036 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:06:45.401199 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:45.401419 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:45.404296 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.405298 15036 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:45.371837 19684 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:06:45.414698 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.392661 19689 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:45.394119 19240 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.416424 15543 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:06:45.381848 19655 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:45.399299 19512 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.399817 19326 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.413399 19573 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:06:45.419835 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67789.7us
I20260709 13:06:45.429083 14967 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:45.409183 19693 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:45.412835 19143 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.446282 19657 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:45.420827 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64690.3us
I20260709 13:06:45.466742 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 2898) took 1409 ms. Trace:
I20260709 13:06:45.435236 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.421847 19607 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.421608 19689 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.411585 19729 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:06:45.457799 19688 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.434540 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:45.459465 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57534.9us
I20260709 13:06:45.429355 19276 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.468079 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.495738 15036 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:45.468097 15044 rpcz_store.cc:276] 0709 13:06:44.056880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:44.061929 (+  5049us) service_pool.cc:224] Handling call
0709 13:06:44.062193 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:44.647191 (+584998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:45.466524 (+819333us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b54000889d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:45.466685 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333414272}
I20260709 13:06:45.434144 19573 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:45.478155 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.478472 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.510193 15546 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:45.511518 19514 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.479341 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.512034 19514 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.515398 19750 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.515987 19750 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.517864 19750 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.519687 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.520344 14968 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:45.520881 14965 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:45.482376 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.485088 18821 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.522960 19527 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.523083 18821 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.525265 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.520351 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.471992 19607 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:45.523252 19751 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:06:45.528090 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.522981 19646 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.529389 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.532455 14963 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:45.534181 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50362.8us
I20260709 13:06:45.525367 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.536144 14892 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.540071 19688 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.515286 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.527647 19418 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:06:45.542655 19346 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:45.543279 14964 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:45.543694 19346 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.544314 19657 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.545754 19346 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.546577 19418 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:45.547003 19418 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.471596 19693 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.547619 19693 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.547857 19418 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.549001 19418 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:45.549999 14886 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:06:45.550347 14886 pending_rounds.cc:85] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 11
I20260709 13:06:45.550580 14886 pending_rounds.cc:107] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:06:45.550802 14886 raft_consensus.cc:2889] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:45.552882 19691 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:45.554029 19565 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:45.554402 19565 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.554639 19616 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.555186 19565 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.553047 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.555210 19616 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.557890 19514 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.559151 19616 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:45.559561 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 125129us
I20260709 13:06:45.561314 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.561877 14970 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.562044 19506 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:45.562650 19533 raft_consensus.cc:2764] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:45.562531 19506 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.564539 19506 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.565059 19557 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:45.565701 19557 consensus_queue.cc:1243] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:45.514946 19756 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:06:45.566154 19512 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:45.566536 19512 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:45.567232 19512 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.569846 19512 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:45.568820 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.570885 15040 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:45.573570 19584 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:45.574196 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.531982 19573 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:45.577253 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.577539 15549 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:45.577857 15550 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
W20260709 13:06:45.578184 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 143572us
I20260709 13:06:45.578691 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:45.579042 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.580361 14892 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:45.579046 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:45.582774 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:45.583592 14963 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:45.481885 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:45.560092 19616 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:45.574052 19584 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.586943 14962 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 5. Current term is 6. Ops: []
I20260709 13:06:45.600008 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.597193 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:45.587805 14970 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:45.588224 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.589025 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.593019 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.605659 14886 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:06:45.593981 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 126020us
I20260709 13:06:45.595861 15039 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:45.605939 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.608626 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.612362 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.608458 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.609313 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.553329 19646 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:45.651242 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45411.4us
I20260709 13:06:45.512045 19556 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:45.665046 14892 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
W20260709 13:06:45.664009 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55469us
I20260709 13:06:45.584923 19688 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:45.586562 19664 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.670269 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:45.594082 19506 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.607422 19616 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:45.644698 19143 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:06:45.684624 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 100749us
W20260709 13:06:45.683343 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 71082.6us
I20260709 13:06:45.607275 19514 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:45.698727 15037 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:45.672732 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.664485 19240 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:45.659026 19747 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:45.663622 19698 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:45.666761 19667 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.644683 19655 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 13:06:45.684736 19729 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:45.665035 19595 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:06:45.729920 19595 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:45.730269 19595 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:45.731109 19595 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.732452 19595 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.690685 19646 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:45.734505 19646 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:45.720063 19240 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:45.736084 19240 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.733225 14894 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:45.711355 19514 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:45.704818 19714 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:45.691558 19143 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.700136 19757 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:06:45.711318 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.690644 19750 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.692620 19696 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:45.746948 14886 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
W20260709 13:06:45.758121 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:45.762908 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51711.6us
I20260709 13:06:45.767958 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.690428 19556 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:45.774180 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 177084us
W20260709 13:06:45.769155 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 78089.4us
I20260709 13:06:45.776371 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.759680 19143 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.759793 19714 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.764071 19750 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.782213 14962 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:45.780351 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:45.781316 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 169624us
I20260709 13:06:45.712054 19747 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.742862 19688 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:06:45.769178 19697 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:45.786754 14961 raft_consensus.cc:2410] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:06:45.788985 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.743641 19729 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.773904 19696 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:45.794037 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:45.795001 19267 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:45.784663 19714 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:45.739645 19646 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.786578 19750 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.787910 19692 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:45.807495 19756 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.791090 19720 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:45.815989 14890 raft_consensus.cc:606] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:45.816253 19556 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.816409 14890 raft_consensus.cc:614] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:45.816962 19571 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:45.816952 19692 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.818890 19692 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.777303 19616 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.819841 19757 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:45.820353 19757 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:06:45.821139 19758 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:06:45.821931 19664 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.822541 19664 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:06:45.824787 19689 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.826073 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.826880 19689 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.827129 19557 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.827621 15044 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:45.828876 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.829854 19557 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.831199 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.832955 19557 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.833453 19571 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:45.834156 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.839076 19584 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.800734 19527 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.835232 19557 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:45.841327 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.848883 19557 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.789412 19636 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:06:45.814474 19684 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:45.851331 19729 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:45.851805 18821 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.855824 19636 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:45.852182 19693 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.856230 19636 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:45.857209 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.849516 19747 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.807268 19514 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.857126 19636 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.858660 19636 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.861797 19750 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.863668 19665 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:45.863977 19684 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.865240 19293 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:06:45.865628 19293 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:45.866340 19293 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.864146 19665 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:45.868789 19565 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:45.890581 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.891377 14886 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:45.873520 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.874006 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.894500 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.895124 14890 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:45.895556 19771 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:45.896003 19771 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.867388 19293 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:06:45.898252 19684 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:45.841464 19607 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:45.899672 19607 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:45.899906 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.874183 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.900005 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:45.903264 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.874691 19696 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:45.905398 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.906219 14890 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:45.877640 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.907063 14894 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:45.880527 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.881479 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.908375 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:45.881814 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.909545 14891 raft_consensus.cc:2376] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9. Re-sending same reply.
I20260709 13:06:45.857729 19693 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:45.896515 19771 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:45.883850 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.885638 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.900005 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.880824 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:45.913007 14970 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:45.913578 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.844353 19689 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:45.916966 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.918143 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.919030 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:45.920918 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.889333 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:45.908779 15043 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:45.926561 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:45.927021 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 148054us
I20260709 13:06:45.927769 14888 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:45.928105 14895 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:45.955686 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.928774 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:45.925760 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 290) took 5866 ms. Trace:
I20260709 13:06:45.962707 14893 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:45.962793 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.963939 15044 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:45.970852 14859 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.972378 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:45.939795 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50522.7us
I20260709 13:06:45.928368 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:45.989100 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:45.992130 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:45.992759 15044 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:45.960645 14792 rpcz_store.cc:276] 0709 13:06:40.059366 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:40.059651 (+   285us) service_pool.cc:224] Handling call
0709 13:06:45.925678 (+5866027us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:43.644606 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:43.796094 (+151488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:43.844664 (+ 48570us) write_op.cc:435] Acquired schema lock
0709 13:06:43.844709 (+    45us) tablet.cc:662] Decoding operations
0709 13:06:43.874347 (+ 29638us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:43.874443 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:43.874475 (+    32us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:06:43.997613 (+123138us) tablet.cc:701] Row locks acquired
0709 13:06:44.003498 (+  5885us) write_op.cc:260] PREPARE: finished
0709 13:06:44.003673 (+   175us) write_op.cc:270] Start()
0709 13:06:44.003834 (+   161us) write_op.cc:276] Timestamp: P: 1783602404003609 usec, L: 0
0709 13:06:44.003872 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:06:44.004544 (+   672us) log.cc:844] Serialized 5629 byte log entry
0709 13:06:44.516862 (+512318us) op_driver.cc:464] REPLICATION: finished
0709 13:06:44.704769 (+187907us) write_op.cc:301] APPLY: starting
0709 13:06:44.704873 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:44.755972 (+ 51099us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:44.756116 (+   144us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:44.818559 (+ 62443us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:44.818970 (+   411us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:06:44.819038 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:44.819627 (+   589us) log.cc:844] Serialized 129 byte log entry
0709 13:06:44.849605 (+ 29978us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:44.865145 (+ 15540us) write_op.cc:454] Released schema lock
0709 13:06:44.888675 (+ 23530us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:44.901098 (+ 12423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:44.901128 (+    30us) write_op.cc:454] Released schema lock
0709 13:06:45.028271 (+127143us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b1800199d20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f5534cf3190 00007f5534cecae7 00007f5534cebdd9
Metrics: {"mutex_wait_us":1333,"reported_tablets":30,"child_traces":[["op",{"apply.queue_time_us":184931,"apply.run_cpu_time_us":21573,"apply.run_wall_time_us":196309,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":673002,"prepare.run_cpu_time_us":30574,"prepare.run_wall_time_us":696398,"raft.queue_time_us":267192,"raft.run_cpu_time_us":41217,"raft.run_wall_time_us":106719,"replication_time_us":503896,"spinlock_wait_cycles":6580096,"thread_start_us":857422,"threads_started":4,"wal-append.queue_time_us":212845}]]}
I20260709 13:06:46.003692 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.004302 19101 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:06:46.006580 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 78289.6us
I20260709 13:06:45.927528 19528 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:45.888598 19533 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:45.822552 19757 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:45.928429 19689 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:45.882745 19557 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.019285 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:46.018241 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:45.993498 19418 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:45.969754 19749 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.033438 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:46.033632 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.039496 14965 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:46.026211 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:45.989202 19764 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:45.994189 19690 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.038018 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:45.886145 19584 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260709 13:06:46.086228 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:45.992581 19655 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.039764 14895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:46.041020 14888 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:46.041985 19687 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:46.042358 19774 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:45.971092 19527 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:06:45.874365 19573 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.011746 19636 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:46.076701 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.094218 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:46.114580 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.115375 14893 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:06:46.084311 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 290361us
I20260709 13:06:46.095157 14933 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.083495 15044 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:45.988617 19571 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:06:46.102802 14895 raft_consensus.cc:606] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:46.122221 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:46.123488 14967 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:46.107899 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.036594 19689 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:46.108614 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 105008us
I20260709 13:06:46.044309 19750 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:46.032404 19533 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:45.992252 19714 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.111138 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:46.178668 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 67653.2us
I20260709 13:06:46.045514 19764 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.119305 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.120910 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.127492 14888 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
W20260709 13:06:46.182250 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61431.7us
I20260709 13:06:46.182793 14888 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:46.182924 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.184088 14933 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.129338 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:46.129987 19684 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.130406 15541 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:46.178988 14793 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 15, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:06:46.131490 19775 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:06:46.139782 19571 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:46.118078 19636 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.114305 19774 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.145123 19664 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:46.145387 19573 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:46.165849 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43705.1us
I20260709 13:06:46.171203 14894 raft_consensus.cc:2410] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:06:46.194238 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:46.195276 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:46.125097 19646 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:46.128157 14895 raft_consensus.cc:614] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:46.185401 19665 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.190552 19571 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:46.189137 14793 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 12, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:46.191664 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 72542.2us
I20260709 13:06:46.184166 14888 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:06:46.201030 19692 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:46.188371 19657 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:46.188450 19557 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:46.188585 19757 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:46.187099 19764 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.185527 19584 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:46.209199 19779 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:06:46.212886 19771 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.186020 19101 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:46.214043 18821 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.209785 19782 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:46.250342 18821 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.195505 19636 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.192422 19664 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:46.220594 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.221376 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.187638 14933 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.219094 19646 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:46.205974 19786 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:46.190994 19143 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.234714 14793 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 7 to 9, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:46.262806 14793 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:46.253602 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 66041.5us
I20260709 13:06:46.264631 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:46.185819 19514 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:46.254688 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:46.270253 19326 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 13:06:46.275632 19326 consensus_queue.cc:1243] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:46.276222 19326 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:46.276546 19326 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:46.277335 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:46.277462 19143 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:46.278033 15044 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.277537 19326 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.278318 15035 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:06:46.280689 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.259301 19646 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:46.281911 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:46.273813 19786 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.259479 19658 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.273267 19571 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.255343 18821 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.214002 19573 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 13:06:46.284371 19571 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.284979 19786 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.239324 19657 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:46.264779 14933 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.287564 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.288334 19774 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:46.218757 19533 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.289249 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:46.290573 19689 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.291229 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:46.292760 19689 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:46.273324 19101 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.294039 15043 raft_consensus.cc:2368] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13.
I20260709 13:06:46.261830 19769 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.247712 19584 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:46.286273 19657 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:46.288798 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.295720 19769 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:46.295270 19584 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.289354 19549 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.296679 19584 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.298601 19665 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:46.265398 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:46.300120 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.295105 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.300303 14894 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:46.274611 15544 raft_consensus.cc:2368] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:46.265132 14888 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:46.301259 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.260579 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:46.302991 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:46.303092 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.279072 19326 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:46.264879 14793 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.305295 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:46.305392 14968 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:46.306176 15541 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:46.306177 14793 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.307760 15037 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:46.308327 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:46.311455 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.308323 14793 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 14, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.313966 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.315243 14793 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.316563 15044 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:46.317294 14894 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:46.316790 14793 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 8 to 10, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.318035 14889 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:46.318212 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:46.318583 14889 raft_consensus.cc:606] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.319130 14889 raft_consensus.cc:614] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:46.319334 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.319932 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.320722 14894 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:46.321976 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:46.323570 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:46.324855 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.318619 14793 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 11, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.331030 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:46.333178 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:46.333786 14894 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.335005 14891 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 6.
I20260709 13:06:46.335623 14969 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.331291 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:46.326454 14793 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 14 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:46.346092 14793 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:46.348304 14793 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.350132 14793 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 11, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:46.352264 14793 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.359347 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.354278 14793 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 12, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:46.468603 14968 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:46.472537 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:46.312695 19658 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.315692 19549 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:46.275667 19771 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.282534 19514 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:46.319278 19772 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.314291 19689 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:46.325280 19774 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:46.274694 19714 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:46.325047 19607 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:06:46.482357 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.479231 19527 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:46.284863 19664 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.484864 14894 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:06:46.330850 19769 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:06:46.548413 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75975.1us
I20260709 13:06:46.344959 19750 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.219s
I20260709 13:06:46.343973 19782 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:46.344244 19143 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.476225 19757 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:46.481774 14888 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:46.570353 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:46.564023 19767 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:46.569356 19795 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:06:46.608918 14969 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
W20260709 13:06:46.481585 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 224354us
I20260709 13:06:46.623322 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:46.558496 19773 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:46.648747 15044 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:06:46.637909 19784 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:06:46.620584 19782 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:46.626256 19757 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:46.643033 19549 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:46.673534 14967 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 13:06:46.660403 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 301128us
I20260709 13:06:46.663061 19773 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:46.633697 19527 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:46.668843 19782 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:46.674592 19757 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:46.684558 19691 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.685710 19267 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:46.691300 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:46.655591 19542 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:46.693423 15010 leader_election.cc:400] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:46.696283 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.661196 19557 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:46.706424 15010 leader_election.cc:403] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:46.714249 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:46.715032 18821 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:46.715394 18821 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:46.715715 18821 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:46.718163 14888 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:46.650401 19799 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:06:46.716672 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:46.700060 19722 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.728922 14889 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:46.730353 14890 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:46.644003 19767 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.711730 19267 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.706068 19535 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.745231 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.752147 14890 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:46.728055 19774 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:46.733295 19542 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:46.765401 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 90055.8us
I20260709 13:06:46.665238 19514 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.729507 19565 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:46.771860 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 95425.6us
I20260709 13:06:46.711941 19691 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.732807 19786 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:06:46.790428 15514 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.778039 18821 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.723702 19557 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.803143 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:46.800989 14890 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:46.748687 19528 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:06:46.767480 19714 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.748288 19777 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:06:46.805040 18821 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.744170 19722 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.806399 18821 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:46.807523 18821 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.807945 14892 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:06:46.808305 14892 pending_rounds.cc:85] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 10
I20260709 13:06:46.808604 14892 pending_rounds.cc:107] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:06:46.808914 14892 raft_consensus.cc:2889] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:46.765240 19769 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:06:46.760836 19535 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.817770 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.755777 19802 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 13:06:46.821148 18821 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.782689 19607 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 13:06:46.829828 19764 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.001s
I20260709 13:06:46.791558 19565 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:46.827374 19571 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 13:06:46.805048 19727 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:06:46.896690 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.897262 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.898454 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.899314 14970 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:06:46.763768 19773 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.902073 19691 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.828631 19542 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:46.854733 19792 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:06:46.860153 19806 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:46.861321 19636 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.599s	user 0.008s	sys 0.001s
W20260709 13:06:46.867147 19646 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.586s	user 0.007s	sys 0.000s
I20260709 13:06:46.868341 19767 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:46.874040 15040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da044c14437c4be087d871f129926239"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:46.979357 15040 raft_consensus.cc:606] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:46.979923 15040 raft_consensus.cc:614] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:46.824468 19786 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:06:46.875633 19535 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:46.880712 19326 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 13:06:46.885922 19565 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:46.887434 19584 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.002s
I20260709 13:06:46.767783 19527 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.898454 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:46.923988 19595 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:46.908900 14891 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:46.848757 19722 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:46.910784 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:46.919495 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:46.924782 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.024837 14968 raft_consensus.cc:2410] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:47.024946 14963 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:46.973801 14965 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:06:46.976277 14970 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 13:06:46.980692 19684 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.000s
I20260709 13:06:46.987082 19646 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.039708 19684 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:47.041079 19657 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.746s	user 0.008s	sys 0.001s
W20260709 13:06:46.973030 19800 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.097s	user 0.000s	sys 0.004s
W20260709 13:06:46.972069 19807 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.088s	user 0.003s	sys 0.000s
I20260709 13:06:47.041489 19657 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:46.989207 14892 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:46.832116 19764 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.044173 19595 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.045598 19764 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:46.978834 19573 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:46.981874 19693 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:47.047325 19693 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:46.980096 19636 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.048208 19693 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.049250 19636 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.049371 19693 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.053421 19782 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:46.977824 19806 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.058501 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:06:47.067332 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.067998 15043 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:47.068821 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.069008 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:47.069607 15041 raft_consensus.cc:2410] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:06:47.060005 19557 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.070071 19774 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.060902 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:47.070372 19767 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:47.070727 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:47.070573 19774 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.071259 15040 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.058736 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3230) took 1136 ms. Trace:
I20260709 13:06:47.071940 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:47.072623 15036 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.059379 19749 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:47.067028 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.074029 15035 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:47.074923 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:47.059840 19657 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.075698 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:47.076426 15043 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:47.076996 19689 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:47.077389 19689 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:47.077706 14895 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:06:46.981388 19794 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.325s	user 0.002s	sys 0.001s
I20260709 13:06:47.078186 19749 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:46.982466 19616 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.078737 19749 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.079432 19616 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.080888 19749 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.077782 19689 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:06:47.059231 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 139854us
I20260709 13:06:47.081593 19774 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:47.081692 19727 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.081472 19616 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.082213 19727 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.071949 14886 rpcz_store.cc:276] 0709 13:06:45.922721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.032201 (+109480us) service_pool.cc:224] Handling call
0709 13:06:46.036718 (+  4517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:46.046096 (+  9378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:46.083360 (+ 37264us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:46.084130 (+   770us) log.cc:844] Serialized 26 byte log entry
0709 13:06:46.323296 (+239166us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:46.512659 (+189363us) log.cc:844] Serialized 14 byte log entry
0709 13:06:46.684149 (+171490us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b18002b8820. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f5534d6e060 00007f5534d80716 00007f5534d91287 00007f5534d91208
0709 13:06:46.684322 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:46.684402 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:47.058450 (+374048us) raft_consensus.cc:1685] finished
0709 13:06:47.058553 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:47.058680 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48382,"prepare.queue_time_us":226865,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":172516,"raft.run_cpu_time_us":218,"raft.run_wall_time_us":58228,"spinlock_wait_cycles":6924544,"thread_start_us":199870,"threads_started":1,"wal-append.queue_time_us":597539}
I20260709 13:06:47.069602 19607 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:06:47.086182 15040 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:47.087849 14887 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:47.066756 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:46.982160 14961 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:47.086560 19533 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.089929 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.103366 15039 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.106020 15043 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:47.095481 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:47.112506 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 60120.2us
I20260709 13:06:47.096557 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.099885 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:47.063032 19532 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.113500 14886 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:47.057825 19267 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.055388 19782 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.116823 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.062211 19806 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.117451 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:47.041405 19646 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.119753 14888 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.135866 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:47.136776 15040 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:47.121165 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:47.123463 19764 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.123449 19689 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.128515 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:47.152820 15549 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:47.129175 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.152904 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.153672 15543 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:47.129649 19782 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.134294 15039 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:06:47.134946 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.139679 15036 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:47.141198 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:47.146648 14888 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:47.113031 19326 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:47.157469 15044 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:47.155282 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:47.115386 19727 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.160027 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.159507 14936 leader_election.cc:400] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13.
I20260709 13:06:47.162171 15040 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:47.162418 14936 leader_election.cc:403] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:47.119102 19664 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:47.154187 19690 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:47.159685 19607 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.171303 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:47.163969 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 373671us
I20260709 13:06:47.178977 14967 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:06:47.163473 19616 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:47.180027 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.135008 19532 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.168393 19749 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.156492 19764 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.163589 19557 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:06:47.190186 14967 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:47.165364 19326 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:47.170939 19690 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.177783 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.172849 19607 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:47.199266 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.243873 15037 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:47.199779 19799 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.247995 14967 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:06:47.203568 19689 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:47.204156 19532 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:47.204432 14777 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e4938453819c469599f515b22d92fe27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:47.207734 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:47.214797 19811 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.170749 19658 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13.
I20260709 13:06:47.191780 14961 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.218600 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:47.160157 19782 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.178655 19571 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:06:47.226833 19801 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.457s	user 0.001s	sys 0.003s
W20260709 13:06:47.231338 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 109485us
I20260709 13:06:47.221194 14887 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:06:47.245997 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.280597 14965 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:47.218641 19616 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.281606 19616 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.189378 19691 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.178905 19688 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:06:47.215873 19747 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:47.262595 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 84933us
I20260709 13:06:47.275957 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.176985 19556 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 13:06:47.248703 19607 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.291905 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.243439 19690 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:47.284140 14777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79769.8us
I20260709 13:06:47.296221 19532 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.292317 14933 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:47.218283 19749 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.300105 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:47.304837 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.313156 15543 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:47.315088 19515 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:47.315533 19515 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.315912 19515 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.317523 19326 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.319615 19816 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:47.285183 19571 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:47.321280 19571 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.321399 19816 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:47.322042 19816 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:47.324694 19514 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:06:47.325191 19514 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:47.326913 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.327208 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.273130 19528 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:47.327497 14968 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.331494 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:47.326001 19514 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.328850 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.329274 14965 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:47.327942 14964 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.332901 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.345045 19520 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:47.345533 19520 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:47.345664 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.346319 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.346474 19267 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.347282 19267 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:47.351521 19689 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.351980 19689 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:47.353467 19757 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.641s	user 0.009s	sys 0.000s
I20260709 13:06:47.353968 19689 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.353900 19757 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:47.354971 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.355830 15542 raft_consensus.cc:2410] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:06:47.297714 19691 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.357992 19691 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.358143 19766 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:47.358511 19766 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:47.297940 19747 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.360010 19806 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:47.360431 19806 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:47.272868 19799 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.361377 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2530) took 1097 ms. Trace:
I20260709 13:06:47.361205 19806 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.361732 14887 rpcz_store.cc:276] 0709 13:06:46.263825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.341899 (+ 78074us) service_pool.cc:224] Handling call
0709 13:06:46.342161 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:47.280163 (+938002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.361171 (+ 81008us) spinlock_profiling.cc:243] Waited 746 ms on lock 0x7b54000ce254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:47.361327 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1714858880}
I20260709 13:06:47.362788 19799 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.359802 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.364516 15040 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:47.292815 19811 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.369267 15543 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:47.341836 15541 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:47.342473 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.284130 19767 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:06:47.329986 19532 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.363871 14966 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:47.376806 15549 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:47.336977 15546 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:47.389123 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.389935 15541 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:47.390480 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.391005 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.391359 15040 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:06:47.381841 14967 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:06:47.382603 14968 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:47.392448 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.393146 15541 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:47.393258 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.298425 19809 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:47.306056 14893 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:47.412729 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:47.413481 14893 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:47.414587 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.404093 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:47.312243 19771 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:47.415956 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67798.3us
I20260709 13:06:47.419100 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:47.443142 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.444336 15550 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:47.447913 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.448962 15550 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:06:47.323001 19816 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.394202 19727 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.454372 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.416882 19557 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:47.422173 19684 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:06:47.462170 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.463294 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:47.392951 19773 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:06:47.346346 19520 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.473389 14964 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:47.451586 19782 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.482928 19535 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.460994 19584 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:06:47.488854 19528 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:06:47.451224 19722 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.458098 19809 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.443382 19771 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.497056 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:47.461866 19557 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.467494 19813 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:47.359371 19766 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.490971 19816 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:47.542730 14888 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:47.560052 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:47.560847 14888 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:47.456037 19785 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:06:47.561867 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:47.472733 19527 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:06:47.471334 19802 consensus_queue.cc:1175] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e4938453819c469599f515b22d92fe27" responder_term: 13 status { last_received { term: 10 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:47.495424 19535 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.467891 19727 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:47.571631 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:47.584448 14892 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:06:47.569970 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:47.549202 19557 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:47.559116 19326 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.541658 19528 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:47.537498 19722 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.577622 19766 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.565940 19757 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:47.598289 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 144052us
I20260709 13:06:47.586993 19535 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.565390 19267 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.608516 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.621289 19528 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.623472 19532 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.624485 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.626385 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:47.629292 15040 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:47.639463 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.640164 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.631799 14888 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:47.640654 14961 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:47.641006 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.596565 19749 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:47.641788 15541 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:47.640300 15550 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
W20260709 13:06:47.646118 19826 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 13:06:47.646768 19817 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
W20260709 13:06:47.647874 19821 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 13:06:47.648142 19818 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.257s	user 0.001s	sys 0.000s
I20260709 13:06:47.648630 19520 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.650609 19788 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:47.670671 19727 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:47.671358 19824 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:06:47.741601 19520 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:47.677778 19664 consensus_meta.cc:287] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.003s
I20260709 13:06:47.671978 19607 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.744407 19520 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.745288 19607 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:47.652755 19722 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.653139 19595 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.655025 19771 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:47.656418 19822 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:06:47.747617 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.748385 14964 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:47.641494 19750 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.749704 19750 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.656033 19515 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.751291 14962 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:47.752930 19515 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.753362 19722 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:47.540097 19809 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.753877 19722 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.755774 19809 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.625140 19326 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:47.758271 19326 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:47.633198 19811 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.661535 19684 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:47.662209 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 171631us
I20260709 13:06:47.759025 19616 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.759549 19684 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.761106 19616 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.675858 19565 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.761978 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.761929 19565 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.762387 15514 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:47.763978 19565 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.765391 19782 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.765880 19782 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.766602 19771 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:47.767181 19771 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.767745 19771 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:47.745889 19607 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.763115 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.662339 19764 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.662711 19690 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:47.663508 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 151568us
I20260709 13:06:47.663646 19840 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.784309 19840 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.782838 19664 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:47.741602 19788 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.785739 19788 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.786489 19840 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.666849 19646 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:47.672618 14967 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:47.787860 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.788875 19690 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:47.789604 14894 raft_consensus.cc:2368] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17.
I20260709 13:06:47.682976 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.675153 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:47.791472 15044 raft_consensus.cc:2410] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:47.689838 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:47.791841 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 116769us
I20260709 13:06:47.690189 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.690838 15039 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:06:47.691797 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.699828 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.713649 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:47.792146 15037 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:47.727584 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.677211 19714 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 13:06:47.800099 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:47.801004 15044 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:47.802620 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:47.737613 19825 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:06:47.738993 19774 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.635161 19267 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.657590 19747 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.773730 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:47.776166 14933 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:47.780282 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.829335 15546 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:47.829761 14962 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:06:47.771288 19607 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.754938 19557 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.671190 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.793246 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:47.793318 14961 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:47.808053 14964 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:47.809576 15039 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:47.834259 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.838999 14970 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:47.839648 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.840947 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.843684 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:47.844751 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:47.839865 14962 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:47.846517 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.846896 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:47.850551 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 74624.7us
I20260709 13:06:47.854821 15546 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
W20260709 13:06:47.856195 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 63027us
I20260709 13:06:47.856097 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:47.876835 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:47.877714 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.878508 14961 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:47.862798 19785 consensus_queue.cc:1243] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:47.827970 19616 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.828109 19646 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:47.884567 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:47.830476 19813 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:47.834599 19803 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:47.887610 14966 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:47.886596 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:47.818699 19240 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:06:47.863651 19565 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:47.930913 14962 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:06:47.933048 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 363170us
W20260709 13:06:47.934463 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 47964.1us
I20260709 13:06:47.873390 19688 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:47.944734 19688 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:47.945149 19688 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:47.948247 19533 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:47.948899 19533 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.885260 19689 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:47.951862 19689 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:47.844128 19764 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:06:47.873806 19520 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:47.873946 19595 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:06:47.909301 19571 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.587s	user 0.011s	sys 0.000s
W20260709 13:06:47.937386 19828 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:06:47.906840 19769 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:47.913954 19616 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:47.943897 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.954207 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.955297 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.836153 19774 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.968644 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:47.969779 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:47.936721 14961 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:47.990360 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:47.913924 19749 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.062s
I20260709 13:06:48.002472 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:48.030534 14888 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.003513 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.004341 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.031728 14890 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:47.959246 19418 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:47.887279 19535 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.936820 19722 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.909631 19845 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 13:06:48.029217 15542 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:06:48.029584 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:48.033463 14889 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:06:47.959689 19782 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:47.958803 19533 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.036242 14893 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
W20260709 13:06:48.054236 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 167737us
I20260709 13:06:48.056733 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:48.037300 14886 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 6: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:47.970878 19848 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.052819 14888 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:47.995046 19595 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:47.937083 19803 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.029402 19769 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:48.038363 19418 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:47.952739 19689 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:47.989916 19571 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.137241 14962 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:06:48.058871 19779 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:48.070789 19845 consensus_queue.cc:1243] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:06:48.139424 14970 raft_consensus.cc:2410] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:06:48.077716 19418 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.136854 19802 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.143249 19839 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:48.172068 14969 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:48.172287 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:48.174108 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:48.247767 15039 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.174840 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:48.170075 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 292905us
I20260709 13:06:48.251812 15044 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:48.257176 19636 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.261071 19636 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.074702 19767 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 13:06:48.264511 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:48.054054 19813 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.269558 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:48.064695 19848 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:48.270967 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 216397us
I20260709 13:06:48.265779 15039 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:48.138443 19240 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 13:06:48.275291 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:48.279680 15044 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:48.231768 19839 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.282754 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:48.283382 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79274.9us
I20260709 13:06:48.285043 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:48.285739 15039 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:48.264374 19557 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.263453 19267 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.073750 19646 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.292307 15039 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:06:48.292559 15044 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:06:48.275269 19767 consensus_queue.cc:1243] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:48.267086 19802 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.321539 19802 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.323081 19571 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.324518 19774 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.325467 19803 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.326624 19535 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.288051 19769 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:48.270162 19595 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.285689 19839 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.290196 19528 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.336031 19528 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.339439 19688 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.341646 19688 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:48.335675 19859 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:06:48.350618 19861 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.002s
I20260709 13:06:48.351553 15550 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:48.359727 15550 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:48.360453 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:48.361881 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:48.360453 15550 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.378139 15550 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:48.394297 15550 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:06:48.394804 15550 pending_rounds.cc:85] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 10
I20260709 13:06:48.395100 15550 pending_rounds.cc:107] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:06:48.396093 15550 raft_consensus.cc:2889] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.359310 19664 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.380149 19849 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.387s	user 0.001s	sys 0.000s
I20260709 13:06:48.377528 19846 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:48.386049 19764 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:06:48.404111 19812 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 13:06:48.403694 19664 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.418774 19664 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:48.412035 19866 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:48.415328 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3248) took 1086 ms. Trace:
I20260709 13:06:48.421564 19616 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:48.421929 14887 rpcz_store.cc:276] 0709 13:06:47.328784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.362696 (+ 33912us) service_pool.cc:224] Handling call
0709 13:06:47.362973 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.363277 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:47.363302 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:47.370606 (+  7304us) log.cc:844] Serialized 26 byte log entry
0709 13:06:47.819123 (+448517us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:47.819177 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:47.819265 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.415114 (+595849us) raft_consensus.cc:1685] finished
0709 13:06:48.415138 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:48.415265 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3573,"raft.queue_time_us":25197,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":22031,"spinlock_wait_cycles":25472,"thread_start_us":448194,"threads_started":1,"wal-append.queue_time_us":561746}
I20260709 13:06:48.419283 19664 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.424196 19664 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.426102 19664 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:48.426534 19664 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:48.431427 19854 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 13:06:48.431563 19664 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:48.433810 19788 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 13:06:48.434252 19788 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.435374 15541 raft_consensus.cc:2368] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12.
I20260709 13:06:48.423617 19750 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.407732 19868 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:48.468384 14963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.001s	sys 0.006s
W20260709 13:06:48.472924 14963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.001s	sys 0.007s
I20260709 13:06:48.436168 19664 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:48.476527 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 180406us
W20260709 13:06:48.469904 19852 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260709 13:06:48.477685 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:48.478920 15545 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:48.479519 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:48.477483 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:48.478802 19595 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.480613 19809 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:48.481236 19809 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.481559 19809 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.482040 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:48.480751 19595 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.485814 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:48.480604 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:48.489398 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 434066us
I20260709 13:06:48.492009 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:48.491839 15007 leader_election.cc:400] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17.
I20260709 13:06:48.493047 15007 leader_election.cc:403] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.498026 19811 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:48.498569 19811 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:48.501672 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:48.502249 15039 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.540251 19595 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:48.540735 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:48.499396 19811 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.552099 19839 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.552119 15543 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.554272 19839 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.475621 19868 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.555261 15542 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:06:48.500015 19722 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:06:48.491060 19690 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:48.547891 19782 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17.
I20260709 13:06:48.562335 19868 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.566160 19690 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:48.562435 19809 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:48.567589 19870 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:06:48.568889 19809 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.563493 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:48.560781 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:48.573331 19872 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:48.574940 15543 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
W20260709 13:06:48.577019 19771 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.809s	user 0.006s	sys 0.004s
I20260709 13:06:48.578503 19782 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.581130 19520 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.582862 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.583856 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:48.601704 14892 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:48.585366 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:48.603765 14889 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:48.605010 14934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.005s	sys 0.004s
W20260709 13:06:48.605477 14934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.005s	sys 0.005s
I20260709 13:06:48.586006 15544 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:48.589007 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:48.606974 15040 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.584384 19607 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.567145 19690 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.593472 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:48.598263 15039 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:48.591380 19764 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:06:48.601788 14887 raft_consensus.cc:2368] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:48.590251 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:48.644512 15549 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:48.608500 15547 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.606762 15544 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:48.648635 14892 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:48.649711 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:48.646260 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:48.646384 15544 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.604765 19873 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.662467 15040 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:48.662439 15513 leader_election.cc:400] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:48.671077 15513 leader_election.cc:403] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:48.667851 14889 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:06:48.663035 15547 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:48.671568 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:48.607383 19636 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.671896 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:48.650609 19872 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.602006 19771 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.660073 19779 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:48.658492 19727 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.674177 19874 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:48.674525 19873 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.688390 19809 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:48.704629 19809 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:48.705637 19873 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.688827 19872 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.705834 19809 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.707894 19872 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.662040 19714 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.674101 19788 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.708631 19714 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.709688 19788 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.710158 19788 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.695463 19869 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:48.711812 19869 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:48.712495 19788 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:48.712682 19869 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.608510 19418 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.717015 19418 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.717555 19779 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.717976 19779 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:48.724164 19880 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:06:48.726281 14969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 2643) took 1481 ms (client timeout 1653 ms). Trace:
I20260709 13:06:48.727602 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:48.728971 19565 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.729568 19565 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.731006 19326 raft_consensus.cc:2764] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:06:48.711265 19714 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.732257 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:48.734833 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 465376us
I20260709 13:06:48.735059 19714 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.735627 19326 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:48.736172 19864 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:48.736565 19326 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.737221 19326 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.737987 19865 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:48.660239 19811 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:48.701233 19848 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.746291 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.603101 19782 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.736622 19864 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:48.605765 19520 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.696280 19693 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:48.726812 14969 rpcz_store.cc:269] 0709 13:06:47.245277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.245398 (+   121us) service_pool.cc:224] Handling call
0709 13:06:48.726051 (+1480653us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b54001969d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:48.726182 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2027350272}
I20260709 13:06:48.743325 14890 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:48.703367 19727 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:48.778855 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:48.746491 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.747788 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.774466 14892 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:48.746809 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:48.786765 14887 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:48.780747 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:48.790457 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 118982us
I20260709 13:06:48.791455 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:48.795188 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:48.796411 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:48.797098 15547 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:48.797724 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:48.796348 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:48.745733 19747 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.801245 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:48.802374 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:48.803346 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:48.808223 15547 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:48.748893 19326 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.810199 14892 pending_rounds.cc:85] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 7
I20260709 13:06:48.776250 19864 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:48.735639 19714 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.782737 19811 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:48.810477 14892 pending_rounds.cc:107] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 9.8
I20260709 13:06:48.775614 19557 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 13:06:48.778770 19757 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:06:48.780200 19693 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.848832 19848 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.849965 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:48.810070 19874 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:48.847478 14892 raft_consensus.cc:2917] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Aborting config change with OpId 9.8: Aborted: Op aborted by new leader
I20260709 13:06:48.874395 14892 raft_consensus.cc:2889] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:48.856968 19694 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:48.859817 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:48.876410 14962 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:48.859865 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.860867 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.878021 14970 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 8.
I20260709 13:06:48.862774 19727 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:48.864013 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.864169 19782 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.866251 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.824265 19881 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:48.867025 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.825152 19664 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:48.868314 19806 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:48.868433 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.868759 19714 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:48.811507 19868 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260709 13:06:48.867231 19870 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:48.823855 19595 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:48.811041 19747 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.879633 19767 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:48.849323 19811 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.890688 19874 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:48.900305 19595 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:48.879911 19848 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.886471 19694 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.893850 19664 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:48.905203 19764 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.907918 19646 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:48.939193 19779 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.939709 19874 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.936573 19764 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:48.975704 19771 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.073824 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.076064 14887 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:49.081527 14893 raft_consensus.cc:2410] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:06:49.082238 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:46280 (request call id 1) took 19510 ms. Trace:
W20260709 13:06:48.869482 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 131986us
I20260709 13:06:49.082799 14892 rpcz_store.cc:276] 0709 13:06:29.571766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:29.582622 (+ 10856us) service_pool.cc:224] Handling call
0709 13:06:29.894076 (+311454us) log.cc:844] Serialized 499 byte log entry
0709 13:06:30.202374 (+308298us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18004911a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f5534ccfb0b 00007f5534d54b63 00007f5534d7c752 00007f5539d3cd29
0709 13:06:49.082019 (+18879645us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58710,"raft.queue_time_us":246682,"raft.run_cpu_time_us":2340,"raft.run_wall_time_us":201872,"spinlock_wait_cycles":7658368,"thread_start_us":183283,"threads_started":1,"wal-append.queue_time_us":293874,"wal-append.run_cpu_time_us":8742,"wal-append.run_wall_time_us":1294812}
W20260709 13:06:49.090342 14841 auto_rebalancer.cc:629] Failed to schedule move for tablet 205008a787ca45349273b1e8daaebdf5: Aborted: Op aborted by new leader
W20260709 13:06:49.093849 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 796637us
I20260709 13:06:49.108815 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.109233 14895 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:49.110061 14894 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:48.887321 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:48.882460 14967 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:49.122524 14961 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:49.122819 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2649) took 1455 ms. Trace:
I20260709 13:06:49.122573 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.123286 14963 rpcz_store.cc:276] 0709 13:06:47.667245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.669405 (+  2160us) service_pool.cc:224] Handling call
0709 13:06:47.669753 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:47.670148 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:06:47.771577 (+101429us) log.cc:844] Serialized 14 byte log entry
0709 13:06:48.578551 (+806974us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b4800002dd8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:06:48.824750 (+246199us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:48.825289 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:06:48.825453 (+   164us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:48.825510 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:48.825590 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:48.965391 (+139801us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b1800463de0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5538c4a58f 00007f5531c89571 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd
0709 13:06:49.122255 (+156864us) raft_consensus.cc:1685] finished
0709 13:06:49.122299 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:49.122601 (+   302us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":830237,"prepare.queue_time_us":124001,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":362941,"raft.run_cpu_time_us":3979,"raft.run_wall_time_us":871734,"spinlock_wait_cycles":33257472,"thread_start_us":702715,"threads_started":1,"wal-append.queue_time_us":773296}
I20260709 13:06:49.131125 14965 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:06:49.132217 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 230854us
W20260709 13:06:49.137399 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.137279 19573 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:48.926846 19595 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:49.138360 15541 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1045) took 1446 ms (client timeout 1816 ms). Trace:
I20260709 13:06:49.141034 19693 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:49.144704 19520 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.144238 19646 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.145640 19694 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.146983 19747 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.148067 19757 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.148582 19533 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.149607 19764 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:49.150393 19714 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:49.242699 19714 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.243269 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.244028 15547 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:49.245421 19714 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.151801 19727 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.246430 19727 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.249221 19727 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.151885 19657 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.250146 19657 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.252179 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:49.252830 19657 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.161108 14969 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 13:06:49.254465 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.132274 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.256062 14968 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:49.257325 14968 raft_consensus.cc:1217] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 8.8->[10.9-11.10]   Dedup: 11.10->[]
I20260709 13:06:49.257810 14968 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: [10.9-11.10]
I20260709 13:06:49.162835 19664 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:49.163941 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 95842.1us
I20260709 13:06:49.260540 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:49.261009 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:49.262871 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:49.173066 19616 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:06:49.183135 15541 rpcz_store.cc:269] 0709 13:06:47.691451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.691579 (+   128us) service_pool.cc:224] Handling call
0709 13:06:49.137763 (+1446184us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b54002e7a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:49.138083 (+   320us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1477268224}
I20260709 13:06:49.201943 19848 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:49.202732 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.212184 19573 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.255230 14969 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:49.219378 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:49.311625 19616 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:49.312156 14965 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:06:49.223775 19533 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.313046 19528 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:49.312973 19616 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.314499 19616 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:49.314908 19533 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.230126 19767 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:06:49.231660 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.316335 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.317235 15040 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:49.317308 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.317894 19767 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:49.318143 15044 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:49.240180 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:49.240370 19809 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:49.319581 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:06:49.240530 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44120.8us
I20260709 13:06:49.320267 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.321372 15041 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 17 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:06:49.240587 19557 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:49.321763 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.322553 19557 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.252964 15547 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:49.166887 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.326750 14888 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:49.264081 19267 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:49.276854 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:49.267668 19757 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.327795 19267 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:49.329253 19267 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.329878 19757 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.291285 19803 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:49.294358 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.330876 19803 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.333587 19803 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.299008 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.300030 19532 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.311233 19573 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.335594 19693 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:49.325500 19557 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.337767 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 284) took 7904 ms. Trace:
I20260709 13:06:49.338197 14793 rpcz_store.cc:276] 0709 13:06:41.432996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:41.433178 (+   182us) service_pool.cc:224] Handling call
0709 13:06:49.337534 (+7904356us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:46.806731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:46.815718 (+  8987us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:46.818646 (+  2928us) write_op.cc:435] Acquired schema lock
0709 13:06:46.821843 (+  3197us) tablet.cc:662] Decoding operations
0709 13:06:47.036067 (+214224us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:47.036148 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:47.036188 (+    40us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:06:47.037782 (+  1594us) tablet.cc:701] Row locks acquired
0709 13:06:47.037807 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:06:47.037986 (+   179us) write_op.cc:270] Start()
0709 13:06:47.038123 (+   137us) write_op.cc:276] Timestamp: P: 1783602407037932 usec, L: 0
0709 13:06:47.038152 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 13:06:47.038954 (+   802us) log.cc:844] Serialized 6264 byte log entry
0709 13:06:47.664991 (+626037us) op_driver.cc:464] REPLICATION: finished
0709 13:06:48.077128 (+412137us) write_op.cc:301] APPLY: starting
0709 13:06:48.138488 (+ 61360us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:48.573637 (+435149us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:48.573722 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:48.716918 (+143196us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:48.717209 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:06:48.717253 (+    44us) write_op.cc:312] APPLY: finished
0709 13:06:48.717593 (+   340us) log.cc:844] Serialized 148 byte log entry
0709 13:06:48.717794 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.717955 (+   161us) write_op.cc:454] Released schema lock
0709 13:06:48.718014 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:48.791924 (+ 73910us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:48.793422 (+  1498us) write_op.cc:454] Released schema lock
0709 13:06:48.953475 (+160053us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b180035fa40. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
Metrics: {"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":378189,"apply.run_cpu_time_us":36389,"apply.run_wall_time_us":710199,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71007,"num_ops":16,"prepare.queue_time_us":188067,"prepare.run_cpu_time_us":11176,"prepare.run_wall_time_us":474770,"raft.queue_time_us":259898,"raft.run_cpu_time_us":38584,"raft.run_wall_time_us":330867,"replication_time_us":626686,"spinlock_wait_cycles":8158464,"thread_start_us":767368,"threads_started":4,"wal-append.queue_time_us":560576,"wal-append.run_cpu_time_us":18225,"wal-append.run_wall_time_us":1192552}]]}
I20260709 13:06:49.338443 14792 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:49.301764 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:49.302099 19779 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:49.305426 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.290696 19607 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:49.172518 14963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "599606a370ab4d629b9cac083be835da"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:39056
I20260709 13:06:49.318495 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:49.235324 19646 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.318965 19326 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:49.318663 19767 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.320292 19809 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.328045 15550 raft_consensus.cc:2368] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:49.280607 15544 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.294694 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.297010 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:06:49.336727 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 96804.2us
I20260709 13:06:49.300609 19881 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:49.349740 19657 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:49.353041 15545 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 7.
I20260709 13:06:49.351584 14963 raft_consensus.cc:606] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Received request to transfer leadership
I20260709 13:06:49.354395 15547 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:49.361064 15548 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.374073 14963 raft_consensus.cc:614] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:49.374439 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:49.375648 15545 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: [11.10-13.11]
W20260709 13:06:49.358402 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95693.9us
I20260709 13:06:49.370784 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:49.400846 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.367806 19557 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.411885 19557 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.370025 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:49.364841 14792 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 8, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 8 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:49.384310 19418 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:49.415675 19899 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:49.412132 19690 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:49.416294 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:49.417235 19899 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.419713 19533 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:49.419617 14792 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:49.420456 19533 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.370538 19573 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:06:49.421871 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
W20260709 13:06:49.412218 19806 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.504s	user 0.017s	sys 0.038s
I20260709 13:06:49.424404 19803 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.424345 14792 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:49.425107 19803 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.359318 19326 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.355394 19657 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.428020 14966 raft_consensus.cc:2410] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:06:49.426606 14792 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:49.429533 19326 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:49.357551 19767 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.429845 19657 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:49.371819 19565 consensus_meta.cc:287] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.012s
W20260709 13:06:49.436658 14962 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.007s
I20260709 13:06:49.436465 19565 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.437422 19595 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.370990 19607 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.429944 14792 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:49.439863 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69257.6us
I20260709 13:06:49.440894 19607 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.437165 14962 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:49.441388 19806 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:49.441772 19806 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.440992 14792 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 9, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.442010 14970 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:49.442139 19806 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.443766 19869 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:49.445678 15035 raft_consensus.cc:2368] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:49.438858 15544 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:49.447888 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1150) took 1843 ms. Trace:
I20260709 13:06:49.448222 15544 rpcz_store.cc:276] 0709 13:06:47.604768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:47.604946 (+   178us) service_pool.cc:224] Handling call
0709 13:06:47.605324 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:48.585901 (+980577us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b54005445a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d781c0 00007f5534d79231 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c
0709 13:06:49.279580 (+693679us) spinlock_profiling.cc:243] Waited 39.5 ms on lock 0x7b58001478d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534cd20aa 00007f5534d54447 00007f5534d6cfe7 00007f5534d6e7de 00007f5534d78b49 00007f5534d79416 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4
0709 13:06:49.447564 (+167984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.447817 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":708780544}
I20260709 13:06:49.433880 15036 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:49.449633 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:49.451608 19646 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:49.452004 19646 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.452486 19646 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:49.452845 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:49.452103 19584 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:06:49.456442 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:49.457360 19607 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:49.457736 19607 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.458091 19607 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.453012 19595 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:49.460192 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 158673us
I20260709 13:06:49.419185 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:49.439110 19565 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.475957 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.459048 19899 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
W20260709 13:06:49.466109 19864 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.547s	user 0.017s	sys 0.011s
I20260709 13:06:49.482484 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.487771 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.472858 19326 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.493472 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.497026 19326 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.499527 19326 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.499725 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.483429 19767 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:49.501001 19767 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.501394 19767 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:49.501780 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.503060 19528 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.503731 19528 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.481065 19809 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.505720 19557 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.506168 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.507279 19533 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.507513 15041 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:06:49.495723 19864 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.486287 19881 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:49.524154 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 105068us
I20260709 13:06:49.522449 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.536424 14964 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:49.537727 15044 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:06:49.539000 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 69164us
I20260709 13:06:49.535243 15036 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:49.540643 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:49.544205 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 112049us
I20260709 13:06:49.549690 19864 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.542472 19533 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:49.541378 14792 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:49.591771 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.550825 19881 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.599254 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.605325 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.609344 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:49.601804 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48820.2us
I20260709 13:06:49.611888 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:49.613161 19326 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:49.615792 19881 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:49.616034 15546 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:06:49.617686 15514 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:06:49.618005 15514 leader_election.cc:403] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.618953 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.619612 19869 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:06:49.620357 19869 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:49.621047 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:49.621251 19869 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:06:49.621994 19869 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:49.622977 14887 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:49.622989 19869 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.629372 19565 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:49.629851 19565 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.630069 19869 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.630314 19892 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.624475 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.630924 19892 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.631508 19533 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.632295 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.626736 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.627444 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.628873 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:49.628744 19864 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:49.634091 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.608071 14893 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:06:49.607313 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.651098 15547 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 6.
I20260709 13:06:49.656391 15548 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:49.657397 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.637908 19565 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.666657 14792 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 12, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:06:49.669305 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 182323us
I20260709 13:06:49.673085 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:49.674464 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.675933 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.677240 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.678574 19684 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.679371 19684 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.680029 19657 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:06:49.680620 19657 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.681082 19657 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:49.682103 19684 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.684067 14936 leader_election.cc:400] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:49.684455 14936 leader_election.cc:403] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.686100 19694 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:49.686748 19694 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:49.687121 19814 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:49.687983 19694 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:49.692776 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57228.5us
I20260709 13:06:49.669374 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:49.718027 19806 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.723959 19803 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.724663 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.725629 14963 raft_consensus.cc:2368] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:06:49.726487 14894 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:49.727851 14963 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:06:49.728291 14963 pending_rounds.cc:85] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 7
I20260709 13:06:49.728595 14963 pending_rounds.cc:107] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:06:49.728988 14963 raft_consensus.cc:2889] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:49.659123 19882 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.731812 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.732427 19882 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.732851 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:49.733330 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.734457 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:49.734601 19882 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.735579 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.736119 14968 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:49.736927 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.737459 14968 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:49.731388 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.738054 19658 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:49.738531 14969 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:49.738612 19658 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.739898 19882 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:49.740526 19882 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:49.741140 14969 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:06:49.715914 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 15, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:49.742576 19882 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:49.734285 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.748072 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:49.752950 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 81646.3us
I20260709 13:06:49.748868 14968 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:49.742995 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 12, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:49.758111 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.759207 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.734370 19542 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:49.748203 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:49.764261 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:49.764441 15035 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:49.765563 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:49.778010 19542 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:49.778211 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.779066 19542 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.781724 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:49.778335 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.783736 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.791388 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.772406 14792 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:49.793282 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.797381 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.803399 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.811149 14888 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:49.815348 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.811645 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.747920 14963 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:06:49.791304 19864 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:49.822722 19692 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:49.822979 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60886.1us
I20260709 13:06:49.826793 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.823134 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.823658 19747 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:49.831034 14890 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:49.792264 19803 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.834750 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 186614us
I20260709 13:06:49.830106 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.832818 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:49.824390 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.773614 19607 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:49.864624 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:49.839391 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:49.826100 19864 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:49.775107 19573 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 13:06:49.883505 14861 leader_election.cc:400] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12.
I20260709 13:06:49.844059 19533 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:49.898108 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.896802 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.885752 14861 leader_election.cc:403] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:49.899264 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:49.905408 19773 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:49.896184 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:49.923446 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:49.924949 15548 raft_consensus.cc:2368] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:49.884272 19864 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:49.933250 19515 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:49.933432 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:49.933884 19595 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:49.845602 19692 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:49.940681 19906 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 13:06:49.943392 14841 auto_rebalancer.cc:893] Removing replace marker failed: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 8 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:49.953343 14841 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 13:06:49.953732 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:06:49.888098 19803 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.002945 15541 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Advancing to term 15
I20260709 13:06:49.952323 19882 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:49.930970 19809 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:50.062539 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:50.059528 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 220214us
I20260709 13:06:50.036669 19882 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:50.075807 15036 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:50.075064 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.055837 19690 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12.
I20260709 13:06:50.024847 19773 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:50.027043 19657 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.090396 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:50.101387 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.104012 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.089013 19658 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.099154 19803 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.104763 19747 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:50.120827 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45443.5us
I20260709 13:06:50.073446 19515 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:06:50.128625 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 263201us
W20260709 13:06:50.119130 19646 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
I20260709 13:06:50.099449 19809 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.134446 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:50.136610 14894 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.139483 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:50.143740 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83957.1us
I20260709 13:06:50.128444 19607 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.153463 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:50.160624 14969 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:06:50.162266 19912 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 13:06:50.158468 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.143081 19694 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.169896 14893 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:50.140637 19646 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.165913 19532 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:06:50.174647 19532 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.175968 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.174996 19532 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.167938 19658 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:50.193995 14936 leader_election.cc:400] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:50.194886 14936 leader_election.cc:403] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.195990 15544 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:50.187851 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:50.189303 19694 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.157410 19267 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:06:50.208321 15035 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:50.211473 19874 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:06:50.213299 19657 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.217236 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:50.225282 19910 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:06:50.211005 19694 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.231992 15541 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:50.218005 19808 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.170838 19773 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.183012 19882 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.227460 19874 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.236085 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.238981 15037 raft_consensus.cc:2410] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 11 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 13:06:50.237095 19694 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:06:50.240226 19882 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:06:50.243786 19913 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
W20260709 13:06:50.243939 19915 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.144s	user 0.001s	sys 0.001s
I20260709 13:06:50.245332 19812 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.245843 19812 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.246958 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:50.247946 19917 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 13:06:50.248420 19905 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.375s	user 0.000s	sys 0.002s
I20260709 13:06:50.248842 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.249763 19809 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.247812 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.252035 15040 raft_consensus.cc:2368] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:06:50.263711 15043 raft_consensus.cc:2368] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:50.263883 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.267601 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.234483 19692 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.270321 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.274320 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.275368 15037 raft_consensus.cc:2368] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:50.279711 15039 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.288883 19812 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.267877 19528 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.295562 15039 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:50.298209 15042 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:06:50.302867 19907 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260709 13:06:50.290159 19692 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.310005 15044 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:06:50.312992 19814 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
I20260709 13:06:50.313457 19814 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:50.314575 19646 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:50.313126 19864 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.315461 14970 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:50.317082 19864 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.317238 15549 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 13:06:50.294950 19767 consensus_meta.cc:287] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.793s	user 0.011s	sys 0.002s
I20260709 13:06:50.322975 19542 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:50.320817 19767 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:50.333560 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67576.4us
I20260709 13:06:50.335397 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:50.336012 15541 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:06:50.337935 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 150206us
I20260709 13:06:50.338397 15036 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:06:50.343575 19646 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:50.345170 19779 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:50.345750 19779 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:50.346282 19869 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.716s	user 0.011s	sys 0.000s
I20260709 13:06:50.336992 19532 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.348666 19532 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.351089 19767 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.353219 19892 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.287604 19565 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.357247 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:50.360337 14894 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:50.364532 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.365106 14963 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.364555 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.364847 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.373776 14859 leader_election.cc:400] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:06:50.373952 15541 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:50.374109 14859 leader_election.cc:403] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.376029 14965 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:50.376746 14961 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:50.380066 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:50.383276 19747 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:50.383697 19747 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:50.384063 19747 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.384413 19809 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:50.385995 19809 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:50.390512 19848 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:50.392834 14963 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:50.401043 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.401404 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:50.402694 14968 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:50.394214 19418 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
W20260709 13:06:50.406942 15516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.3:46271 timed out after 1.712s (SENT) [suppressed 9 similar messages]
I20260709 13:06:50.410832 19869 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.440164 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:50.440979 14887 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.396452 19808 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:50.445655 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:50.413962 19916 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.308s	user 0.000s	sys 0.004s
W20260709 13:06:50.457067 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 205299us
I20260709 13:06:50.460158 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:50.462708 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 123749us
I20260709 13:06:50.462867 14888 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:06:50.465292 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.465898 15044 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
W20260709 13:06:50.466668 19930 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:06:50.466876 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:50.467486 15549 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:50.468732 14969 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:50.470826 14893 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:50.471343 15041 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9. Ops: []
I20260709 13:06:50.472923 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:50.472375 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:50.474898 19808 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.475931 14936 leader_election.cc:400] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:50.476155 14936 leader_election.cc:403] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.475598 19528 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:50.476595 19808 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:50.439895 19532 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:06:50.477955 19646 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:50.479578 19565 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.477607 15036 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:06:50.481618 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:50.482936 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:50.488152 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.490428 19646 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.467914 19779 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.495024 15516 leader_election.cc:400] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:06:50.498915 15516 leader_election.cc:400] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:50.499266 15516 leader_election.cc:403] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:50.500998 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.483759 19767 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:50.483798 19694 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:50.501590 15036 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:50.503701 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:50.530922 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.531903 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:50.533607 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.534045 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.534657 15043 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.536553 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:50.537161 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.537695 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:50.538998 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.539577 15042 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:50.502696 19267 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:50.551672 19267 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:50.552163 19267 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.551688 15044 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:06:50.554075 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.554703 15044 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:50.555532 19933 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:50.555615 19684 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:50.495097 19808 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:06:50.561237 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.562384 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.542021 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.601804 15543 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 9: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:06:50.602707 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 103934us
I20260709 13:06:50.603271 15548 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:50.608311 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.535703 19767 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:06:50.609808 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 67841.9us
I20260709 13:06:50.610822 19694 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:50.610752 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:50.628218 15542 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.631752 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.600651 19934 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:06:50.612466 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:50.556294 19816 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:06:50.627182 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.542177 19657 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:50.609709 19933 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:50.636260 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 96162.7us
I20260709 13:06:50.632377 14967 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:50.640969 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.641636 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.643442 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.644977 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.645563 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:50.647879 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.653259 19773 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:50.656859 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.644287 19803 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:50.661856 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.646956 19418 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:50.664018 19418 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:50.664472 19418 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:50.671239 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:50.671759 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.672581 14965 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 9: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:50.673386 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.676134 19658 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:50.660496 19657 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.656232 19922 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.679854 19922 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.682426 19922 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.688345 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.688856 19267 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.690080 19690 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:50.690515 19690 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:50.690593 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:50.691058 19690 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.692266 19937 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:06:50.663161 19882 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:50.694967 19811 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:50.695499 19811 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:50.695951 19811 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:50.699687 19767 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.710243 15042 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:50.712442 19267 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.717713 15542 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:50.723194 15549 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:06:50.724432 15547 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:06:50.725091 15043 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:50.719732 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.720563 14968 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:50.731890 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:50.728076 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:06:50.734254 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 43808us
I20260709 13:06:50.735282 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.736207 14887 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:50.715618 19657 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:50.746272 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 109053us
I20260709 13:06:50.738713 19934 raft_consensus.cc:2764] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:06:50.740952 19808 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:50.738873 19532 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:50.740634 19694 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:50.745791 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:50.723609 19747 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.758522 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.769845 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:50.756618 19694 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.786860 19806 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.778028 19767 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.787840 19767 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:06:50.789951 19767 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:50.757091 19528 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:06:50.804464 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:50.806198 19892 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:50.806666 19892 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:50.761168 19657 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:50.807152 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:50.807595 19657 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:50.808066 19573 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:50.808435 19941 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.158s	user 0.000s	sys 0.002s
I20260709 13:06:50.807541 19892 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:50.809937 19914 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.703s	user 0.004s	sys 0.020s
I20260709 13:06:50.809739 19573 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:50.768196 19812 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:06:50.774930 19692 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:06:50.819561 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66445us
I20260709 13:06:50.781955 19658 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:50.760565 19874 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:06:50.823768 19692 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:50.784130 19694 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:50.808117 19657 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.774684 19922 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 13:06:50.833642 19944 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:06:50.833777 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1063) took 1458 ms. Trace:
I20260709 13:06:50.834338 15550 rpcz_store.cc:276] 0709 13:06:49.375355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.378242 (+  2887us) service_pool.cc:224] Handling call
0709 13:06:49.394194 (+ 15952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:49.434766 (+ 40572us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:49.434799 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:49.435311 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 13:06:49.864264 (+428953us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:49.864316 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:49.864396 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:50.809347 (+944951us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:50.833510 (+ 24163us) raft_consensus.cc:1685] finished
0709 13:06:50.833532 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:50.833721 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":36327,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":114,"spinlock_wait_cycles":5019392,"thread_start_us":406449,"threads_started":1,"wal-append.queue_time_us":595351}
I20260709 13:06:50.836426 19684 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:50.838611 19684 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.839066 19418 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.827358 19658 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:50.842604 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84232.7us
I20260709 13:06:50.781348 19690 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.829895 19692 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:50.856673 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.861569 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:50.862159 19532 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:50.862739 19532 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.868832 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:50.869122 14965 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:50.869572 14965 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:50.870522 19532 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.870412 14965 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:50.871532 19909 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.918s	user 0.007s	sys 0.018s
I20260709 13:06:50.871755 14965 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:50.875226 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.846148 19658 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:50.876868 14887 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:06:50.880061 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:50.880014 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.884382 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:50.885848 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:50.886852 14887 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:50.886026 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.887956 15040 raft_consensus.cc:2368] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:50.891434 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.896999 14887 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:06:50.901333 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.901656 19528 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:50.902073 19528 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:50.897070 19533 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:50.897035 19616 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:50.903307 19616 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.904775 19515 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.905241 19616 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:50.905581 19690 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.907399 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.923012 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.923784 14968 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:06:50.929021 14966 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:50.902964 19528 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.913703 19747 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.935770 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:50.946435 15516 leader_election.cc:400] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 8. Current term is 9.
I20260709 13:06:50.953656 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:50.956619 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:50.937121 19657 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:50.955050 19418 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:50.970611 14968 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:50.978186 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:50.977979 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:50.979911 14895 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:50.987126 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:50.963605 19326 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:50.989127 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1060) took 1531 ms. Trace:
I20260709 13:06:50.991948 15544 rpcz_store.cc:276] 0709 13:06:49.457495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.467785 (+ 10290us) service_pool.cc:224] Handling call
0709 13:06:50.988946 (+1521161us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b54005f91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:50.989070 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1653440896}
I20260709 13:06:50.993703 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.994000 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:50.963798 19616 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:50.995042 19616 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:50.997257 19616 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:50.977955 19528 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.007120 15542 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:06:51.005825 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.011854 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.014410 14891 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:06:51.014463 14887 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:51.018244 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.018570 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.019033 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.020713 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.028934 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.059772 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.059433 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:51.072124 15043 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:51.062088 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.073002 14891 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:06:51.073565 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:51.074213 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.074944 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.076048 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.076154 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.076380 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.020867 19607 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:51.002871 19326 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.034669 19869 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:51.026778 19557 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:51.085968 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:51.073006 19767 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:51.118990 15542 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:06:51.083855 19959 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:51.132047 15038 pending_rounds.cc:85] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 10
I20260709 13:06:51.132444 15038 pending_rounds.cc:107] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:06:51.080883 19542 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:51.084900 19922 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.139075 15549 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:06:51.092161 19418 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:06:51.139569 15549 pending_rounds.cc:85] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 8
I20260709 13:06:51.140120 15549 pending_rounds.cc:107] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:06:51.140436 15549 raft_consensus.cc:2889] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.132774 15038 raft_consensus.cc:2889] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.116405 19773 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:51.143440 14965 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:51.152540 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1046) took 1008 ms. Trace:
I20260709 13:06:51.087963 19607 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.152961 14970 rpcz_store.cc:276] 0709 13:06:50.143798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.143955 (+   157us) service_pool.cc:224] Handling call
0709 13:06:50.159615 (+ 15660us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.315833 (+156218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.152346 (+836513us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54002175d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:51.152490 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357994368}
I20260709 13:06:51.106812 19869 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.137614 19882 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:06:51.140430 19542 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.134502 19767 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.135964 19557 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.153486 19960 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:51.176532 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100598us
I20260709 13:06:51.178413 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.142571 19959 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.160676 19657 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.162475 19694 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.172029 19882 consensus_queue.cc:1243] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:51.191572 19952 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:51.170090 19949 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.076s
W20260709 13:06:51.185077 19957 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
W20260709 13:06:51.200989 19963 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
W20260709 13:06:51.202708 19958 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 13:06:51.203454 19945 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.223s	user 0.001s	sys 0.000s
I20260709 13:06:51.204228 19767 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.205539 19869 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.205993 19658 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:51.206483 19925 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 13:06:51.203202 19692 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.207989 19658 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.208608 14893 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:06:51.208901 19557 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.192147 19952 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.210978 19952 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.211578 14962 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
W20260709 13:06:51.220686 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 191885us
I20260709 13:06:51.221652 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:51.222343 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163061us
I20260709 13:06:51.222910 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.181929 19960 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.196537 19937 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:51.219515 19694 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.235630 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.239794 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.226557 19934 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:51.239171 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.226303 19692 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.227208 19892 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.246094 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:51.226019 19658 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:06:51.247541 14895 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
W20260709 13:06:51.289113 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46001.2us
I20260709 13:06:51.242141 19816 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.241369 19326 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.293660 19960 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.288707 19607 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.294921 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 952) took 1119 ms. Trace:
I20260709 13:06:51.280319 19959 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.232761 19937 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.295276 15041 rpcz_store.cc:276] 0709 13:06:50.175451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:50.175598 (+   147us) service_pool.cc:224] Handling call
0709 13:06:50.194949 (+ 19351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:50.471727 (+276778us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:51.294692 (+822965us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54000893d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:51.294844 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630502272}
I20260709 13:06:51.297837 19937 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.277863 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.290566 19542 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.247722 14891 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:06:51.242300 19811 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.003s
I20260709 13:06:51.290144 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:51.287849 19979 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:06:51.319290 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.321520 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.322757 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.324295 19967 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:51.324376 19882 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.324898 19967 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:51.325778 19967 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.326352 19684 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.327200 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:51.322556 19892 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:51.316686 19811 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.320788 19808 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:51.332485 19808 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.332646 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:51.332966 19808 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:51.333565 19982 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:06:51.334089 19982 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:06:51.334923 19974 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:06:51.335052 19982 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.337832 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:51.339178 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.339857 19811 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.340267 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.340992 19811 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.341063 19937 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:51.342489 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.342916 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.343286 19937 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.345559 14965 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:51.344696 14891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d3b63f39d444317899acc30914f8801"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:51.346638 14891 raft_consensus.cc:606] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:51.347046 14891 raft_consensus.cc:614] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:51.303308 19953 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.325s	user 0.003s	sys 0.000s
I20260709 13:06:51.352396 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.364292 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.353538 14961 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:06:51.365792 14777 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e4938453819c469599f515b22d92fe27 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:51.367100 19976 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:51.367139 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 188858us
I20260709 13:06:51.371243 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.371737 19950 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:51.374287 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.374248 14964 raft_consensus.cc:2368] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:51.378101 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.380465 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:51.380304 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57588.6us
I20260709 13:06:51.384590 19816 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.386768 15039 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:06:51.414255 19977 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.239s	user 0.002s	sys 0.000s
I20260709 13:06:51.388599 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.393729 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.395071 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:51.395813 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.416131 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.416391 15035 raft_consensus.cc:606] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:51.416718 15035 raft_consensus.cc:614] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:51.418551 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:51.418457 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:51.419214 14895 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.419307 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.416728 14968 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:06:51.384505 19646 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:06:51.440467 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.443073 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.443256 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.447860 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.448726 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.450033 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.451941 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.441403 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:51.454540 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:51.452543 14886 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:06:51.442816 19949 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:51.457468 19949 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:51.457834 19949 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.459793 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.460475 14969 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:51.462536 19976 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:51.464099 19542 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:51.464862 19326 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.465507 19326 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:51.466187 19607 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:51.462546 14965 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:06:51.453393 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.468806 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.470118 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.467950 14895 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:51.439875 19814 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.479660 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.448019 19533 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:06:51.492031 19533 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:06:51.492179 19658 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.492471 19533 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:51.492808 19658 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.493440 19533 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.494653 19533 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:06:51.470966 19779 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.495561 19767 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:51.495663 19658 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.496613 19767 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:06:51.496979 19767 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:51.485327 19747 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:51.497617 19747 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.497833 19767 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.498929 19767 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.499634 19773 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.500270 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.499631 14967 raft_consensus.cc:2410] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 13 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:06:51.440070 19950 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.503890 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.505885 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.510175 14968 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
W20260709 13:06:51.503132 19882 consensus_queue.cc:1175] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "58ee9fe38eb8453098f6d964e7675e79" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:06:51.452415 19646 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:51.515561 19690 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:06:51.516108 19646 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.517751 14891 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:51.519315 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.519887 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.479671 19981 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:06:51.521512 19267 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.522895 19987 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.525301 15038 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:51.484810 19976 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.527189 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.533591 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.535853 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.560557 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.541651 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:51.525017 19779 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:51.570258 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 461126us
I20260709 13:06:51.570555 14859 leader_election.cc:400] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:51.570988 14859 leader_election.cc:403] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:06:51.573751 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.532697 19747 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.575968 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.576977 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.567020 19267 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
W20260709 13:06:51.570129 19972 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.378s	user 0.000s	sys 0.004s
I20260709 13:06:51.578158 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.519361 19773 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:06:51.608570 19773 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:51.608989 19773 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:51.609984 19773 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.612663 19950 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.587594 19779 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:51.588325 15543 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:06:51.588847 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:51.615046 19779 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.589463 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:51.589759 19808 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.617487 19779 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:51.617832 19808 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.620429 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.620883 14963 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:06:51.588054 19959 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:51.591291 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.534773 19607 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:06:51.572731 19803 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:06:51.570305 19684 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:06:51.612388 19949 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.591282 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:51.638903 15544 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:51.621940 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.622663 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.622776 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:51.625986 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.573086 19690 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:06:51.640867 19747 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:51.641510 19747 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.644444 19607 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:06:51.645964 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:51.646759 14894 raft_consensus.cc:606] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:51.647102 14894 raft_consensus.cc:614] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:06:51.611265 19773 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:51.649353 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 184688us
I20260709 13:06:51.662268 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.660234 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.673481 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.674132 15040 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:51.652674 15044 pending_rounds.cc:85] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 9
I20260709 13:06:51.675269 15044 pending_rounds.cc:107] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:06:51.675630 15044 raft_consensus.cc:2889] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:51.577204 19692 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11.
I20260709 13:06:51.670773 19684 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:51.673724 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.676414 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:51.681679 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.641505 19690 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:51.670668 19960 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.678723 19950 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:51.688699 15041 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:51.690814 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.644868 19607 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:51.697094 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.701833 14793 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.705968 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.710268 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.686223 19690 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:51.645748 19959 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.694273 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 286) took 5432 ms. Trace:
I20260709 13:06:51.679342 19882 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:06:51.676548 19747 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.636794 19952 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:06:51.684283 19542 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:51.714738 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.715726 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:51.683497 19869 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:06:51.727114 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.711856 14793 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 9 to 11, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:51.706503 19532 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.051s
I20260709 13:06:51.708739 19565 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.713110 19982 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:51.714257 19882 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:06:51.775820 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61164.9us
I20260709 13:06:51.754017 19960 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:51.760449 14793 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 11 to 12, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 12 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.713657 14792 rpcz_store.cc:276] 0709 13:06:46.271057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:46.271256 (+   199us) service_pool.cc:224] Handling call
0709 13:06:51.694188 (+5422932us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:50.322210 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:50.322860 (+   650us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:50.322908 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:06:50.322924 (+    16us) tablet.cc:662] Decoding operations
0709 13:06:50.324351 (+  1427us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:50.324461 (+   110us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:50.324495 (+    34us) tablet.cc:685] Acquiring locks for 14 operations
0709 13:06:50.394701 (+ 70206us) tablet.cc:701] Row locks acquired
0709 13:06:50.407282 (+ 12581us) write_op.cc:260] PREPARE: finished
0709 13:06:50.467185 (+ 59903us) write_op.cc:270] Start()
0709 13:06:50.467338 (+   153us) write_op.cc:276] Timestamp: P: 1783602410456578 usec, L: 0
0709 13:06:50.467372 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:06:50.469979 (+  2607us) log.cc:844] Serialized 5495 byte log entry
0709 13:06:50.939696 (+469717us) op_driver.cc:464] REPLICATION: finished
0709 13:06:51.074099 (+134403us) write_op.cc:301] APPLY: starting
0709 13:06:51.084067 (+  9968us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:51.311452 (+227385us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:51.311584 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:51.514562 (+202978us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:51.514896 (+   334us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0709 13:06:51.514964 (+    68us) write_op.cc:312] APPLY: finished
0709 13:06:51.515384 (+   420us) log.cc:844] Serialized 129 byte log entry
0709 13:06:51.521391 (+  6007us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.521536 (+   145us) write_op.cc:454] Released schema lock
0709 13:06:51.521609 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:51.566805 (+ 45196us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:51.569327 (+  2522us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1701,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":72610,"apply.run_cpu_time_us":20869,"apply.run_wall_time_us":491275,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62647,"num_ops":14,"prepare.queue_time_us":162428,"prepare.run_cpu_time_us":38767,"prepare.run_wall_time_us":282299,"raft.queue_time_us":107199,"raft.run_cpu_time_us":17910,"raft.run_wall_time_us":56090,"replication_time_us":459169,"thread_start_us":302755,"threads_started":4,"wal-append.queue_time_us":176691}]]}
I20260709 13:06:51.736156 19779 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 13:06:51.779623 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:06:51.767396 19980 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:06:51.796147 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 69136.6us
I20260709 13:06:51.779505 19933 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.799309 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:51.802340 14886 raft_consensus.cc:606] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:51.772635 19993 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.780260 19992 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:51.786656 19869 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:06:51.813387 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 131781us
I20260709 13:06:51.788442 14793 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 12 to 14, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:51.808390 19996 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260709 13:06:51.809398 19767 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.822291 14793 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 13 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:51.795074 19976 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:06:51.812140 19869 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:51.781634 19607 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.842252 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:06:51.850276 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 144388us
I20260709 13:06:51.853026 14793 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 13 to 16, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:51.782713 19684 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.875319 14793 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 6 to 7, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 7 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:51.828127 19950 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:51.879120 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:51.883695 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 86776.1us
I20260709 13:06:51.904878 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:51.807642 19933 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.881665 14793 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 11 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:06:51.916525 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 108483us
I20260709 13:06:51.920564 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:51.922693 14793 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 10 to 11, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 11 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:06:51.905817 19963 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:06:51.810784 19690 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.914167 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.937075 15544 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:51.931476 19607 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:51.919757 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:51.882823 19812 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:51.940080 19812 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:51.940616 15008 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:51.942454 19812 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:51.882820 19814 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:51.943136 19814 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:51.943624 19814 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:51.831990 19993 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 13:06:51.912762 19565 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:06:51.911096 19949 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:51.830036 19882 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.953680 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.945729 19267 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:06:51.951620 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.955643 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:51.949317 19990 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 13:06:51.956744 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.962440 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:51.974677 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:51.971262 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.972991 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:51.984642 14963 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:06:51.986869 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:51.954752 19533 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:51.989634 15040 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:51.974062 19565 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:51.998435 14968 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:51.983142 19922 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:52.004907 20014 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:51.912467 19542 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:51.986186 19803 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:06:51.986367 19690 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:51.992019 20005 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:52.024082 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44000.8us
I20260709 13:06:51.987363 19949 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
W20260709 13:06:52.044513 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 119484us
I20260709 13:06:51.994812 19882 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:52.014784 20014 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:52.049080 19694 raft_consensus.cc:1064] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:06:52.049297 19565 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:52.055823 20004 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:06:52.056159 19869 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.047115 19767 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:06:52.058004 20013 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:52.057804 19814 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:52.097774 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 121448us
I20260709 13:06:52.089830 19767 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:52.078217 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.083520 19532 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:52.084689 19694 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 10, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.105360 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:52.099411 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.079874 20014 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.146293 14962 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 13:06:52.146523 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47237.1us
I20260709 13:06:52.148609 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.149590 19533 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:52.150271 19533 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:52.150501 19892 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.067458 20005 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.107704 19418 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:52.103646 19767 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:52.108052 19933 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:52.236114 20003 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.238s	user 0.001s	sys 0.000s
I20260709 13:06:52.239486 20005 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.241636 20005 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:52.242336 20005 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:52.231706 20000 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:06:52.252526 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:52.259894 19767 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.261169 19767 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.305109 19814 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:52.307593 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:52.313524 20005 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:52.329861 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.332794 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.334692 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.338889 19933 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.341008 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.341439 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:52.347776 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 203975us
I20260709 13:06:52.332762 20008 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:52.343140 19773 consensus_meta.cc:287] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.002s
I20260709 13:06:52.347245 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:52.349881 14970 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:06:52.335153 20005 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.369488 15543 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:52.388931 15039 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:52.393450 19950 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:52.393608 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46483.1us
I20260709 13:06:52.394383 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:52.395821 20013 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:52.395939 19779 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:52.355003 19933 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 13:06:52.399377 20014 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.400556 15044 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:52.388477 20031 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:52.404253 20031 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.410936 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:52.412473 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.420023 20031 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.437868 20023 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:52.446424 20023 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.459617 20031 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:52.472543 20031 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.474927 20031 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:52.478261 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:52.488505 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.490053 20014 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:52.501689 20023 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:52.501710 19515 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:06:52.508761 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.512458 14966 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:06:52.513775 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:52.517539 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.503340 19515 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:52.518726 20012 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:52.518924 19515 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:52.519347 20012 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.519970 19515 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.521920 20012 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:52.523176 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:52.523792 15544 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:06:52.534330 15038 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:06:52.546820 20039 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:06:52.556010 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.561597 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:52.572894 19995 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.772s	user 0.006s	sys 0.004s
I20260709 13:06:52.579561 20005 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:52.580431 20005 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.583230 20018 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
W20260709 13:06:52.585210 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.572764 20007 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.595510 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.595500 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.596421 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.599263 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.570899 19528 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:52.592446 19869 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:52.607036 14887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:52.609683 14887 raft_consensus.cc:606] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:52.620993 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:52.630674 19994 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.700s	user 0.000s	sys 0.001s
I20260709 13:06:52.633412 14887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:52.634044 14887 raft_consensus.cc:606] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:52.634130 14963 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:06:52.603197 20006 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:52.636173 14968 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:52.604858 19528 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:52.651048 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.652810 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:52.662474 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58860.2us
I20260709 13:06:52.636685 20006 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.656522 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:52.674590 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.679695 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.684897 19959 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:52.686798 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.688112 15514 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.688578 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:06:52.689896 20032 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:52.690387 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:06:52.644411 19692 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:06:52.703444 15550 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:52.705332 20006 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.696151 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:06:52.698100 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.698770 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.699699 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:52.719681 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:06:52.722550 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44328.8us
I20260709 13:06:52.724696 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.729254 20032 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.729597 14887 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:06:52.729765 20032 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.730924 14887 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:52.731597 19892 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:52.731981 14895 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:52.732237 14891 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:52.716233 20023 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:52.731982 19892 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:52.741014 19892 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:52.678045 19528 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.744840 19528 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.745421 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.695294 19809 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.755919 19806 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:52.756947 19806 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:52.758364 19658 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:52.758752 19658 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:52.759626 19658 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.760753 19658 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:52.720852 19684 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 13:06:52.768338 19684 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:52.769616 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.770228 19976 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:52.773545 20025 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.554s	user 0.003s	sys 0.000s
I20260709 13:06:52.713281 19959 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.775440 20032 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:52.758843 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.778252 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.800611 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2215) took 1177 ms. Trace:
I20260709 13:06:52.808231 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.801048 14969 rpcz_store.cc:276] 0709 13:06:51.623502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:51.623687 (+   185us) service_pool.cc:224] Handling call
0709 13:06:51.650817 (+ 27130us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:51.686960 (+ 36143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:51.686989 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:51.687380 (+   391us) log.cc:844] Serialized 26 byte log entry
0709 13:06:52.062346 (+374966us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:52.062387 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:52.062458 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:52.773024 (+710566us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:52.784289 (+ 11265us) raft_consensus.cc:1685] finished
0709 13:06:52.784320 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:52.800545 (+ 16225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37148,"raft.queue_time_us":36530,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8049,"spinlock_wait_cycles":4376832,"thread_start_us":374630,"threads_started":1,"wal-append.queue_time_us":459295}
I20260709 13:06:52.770792 19976 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.831977 15550 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:06:52.833076 19542 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.833144 20006 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:52.827104 19814 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
W20260709 13:06:52.863560 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:52.872747 20005 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.847191 19542 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.867250 19976 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:52.880292 19542 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:52.881407 19892 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.891433 19657 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.892010 19657 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.894121 19657 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:52.894505 19814 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:52.895110 19814 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.897107 19814 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.894587 19657 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:52.898662 19657 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:52.901706 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.904929 15040 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:52.909276 19882 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:52.911562 19892 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:52.912226 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.912842 15040 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:52.914276 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:52.921226 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:52.921973 15040 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:52.931526 19892 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:52.931972 19892 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:52.932384 19892 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:52.908270 19657 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.941161 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.942292 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.943384 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.944118 14895 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:52.946260 19892 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:52.949898 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 225295us
I20260709 13:06:52.950417 19959 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:52.950872 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:52.951680 20024 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.952349 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.953671 20009 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.953953 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:52.954185 20009 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:52.956339 20009 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:52.957386 19952 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:52.960268 19692 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:52.962764 19892 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:52.965205 19869 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:52.966977 15542 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:52.969923 14888 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:52.971228 14890 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:06:52.971483 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.973186 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:52.973824 15549 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 7.
I20260709 13:06:52.976522 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:52.977018 15547 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:52.979226 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:52.980141 14894 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:52.980868 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:52.982098 19933 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:52.986454 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:52.989333 19987 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:06:52.991977 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:52.993038 19949 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:52.993979 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:52.996299 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.998240 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:52.998708 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:52.995708 19814 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 7 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:52.996991 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:52.999713 14966 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:06:53.007211 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:53.010937 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.011479 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.011616 14894 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:06:53.014415 14889 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:53.002518 19515 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:52.982707 19573 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:53.011009 15544 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 7 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:53.004272 19779 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:53.028652 20018 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:52.997512 19949 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:53.044247 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45617.9us
I20260709 13:06:53.044795 15549 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:06:53.028692 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:53.006623 19658 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:06:53.057116 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.054450 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:53.059192 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.060956 14962 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:06:53.062772 19892 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.051981 19922 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:53.048673 19616 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:06:53.051918 19998 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:06:53.081460 19998 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:53.081823 19998 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:53.082592 19998 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.050866 19658 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.083607 19658 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.088142 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.091565 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.092840 19949 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:53.093380 19949 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.093713 19949 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.094048 19949 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.094480 19767 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:53.095129 19767 consensus_queue.cc:1243] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:06:53.097463 14966 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:53.102020 19811 raft_consensus.cc:993] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:06:53.102515 19811 raft_consensus.cc:1081] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:06:53.044276 20018 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.073208 15041 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:06:53.105862 20018 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:53.036736 19573 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.109169 19573 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.109766 14961 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:06:53.113488 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:53.114430 19616 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:53.114910 19616 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.114995 19528 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:53.116273 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44795.5us
I20260709 13:06:53.116918 19616 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:53.117765 19779 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:53.119426 19779 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.119812 19779 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:53.123241 19998 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:06:53.124037 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56269.3us
I20260709 13:06:53.127230 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.127945 14888 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:53.128472 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.130676 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.131263 14966 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:53.063275 19892 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.065480 19418 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:53.055985 19694 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 13:06:53.065229 20026 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.163998 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:53.151306 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.152230 15044 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:53.159466 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:53.150461 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.170145 14961 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:53.175916 15544 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:06:53.180375 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50507.5us
I20260709 13:06:53.129987 14968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:06:53.182436 14968 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.182883 14968 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.187381 14966 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:53.203267 14968 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.173800 19982 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:53.174186 20018 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.169905 19692 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:53.213611 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.214238 14886 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:53.214527 14886 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:53.215248 14886 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.216454 14886 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.227455 14886 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:53.229077 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:53.229895 19882 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:53.230448 19882 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:53.231323 19882 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.233162 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:53.234268 14968 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.162873 19767 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:06:53.241180 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.237879 19692 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.248701 19779 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.250212 19692 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.238658 20018 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.260955 19658 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.262137 14964 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 8: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:53.264153 19816 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:53.264701 19816 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:53.264750 19892 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.265354 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:53.265759 14893 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:53.203994 19657 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:53.187093 20005 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:06:53.275162 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.275825 19657 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.278474 14886 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:06:53.282068 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:53.284026 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:53.290437 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:53.290979 15035 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.292470 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.178278 20026 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.281430 19684 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:06:53.277424 20014 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:53.234262 19982 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.311895 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:53.316740 19657 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.317449 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.294773 19892 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:53.318156 14886 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:53.295689 19692 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.327188 14969 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: []
I20260709 13:06:53.337124 14890 pending_rounds.cc:85] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 6
I20260709 13:06:53.337497 14890 pending_rounds.cc:107] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 13:06:53.337795 14890 raft_consensus.cc:2889] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:53.339912 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:53.265633 19816 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.308043 20014 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:53.318472 19779 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:53.310400 19684 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:53.321079 19892 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.348703 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:53.349725 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.352257 20031 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:53.359006 14966 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:53.341176 20018 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.351006 20014 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:53.371345 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.376953 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.377211 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:53.377664 14887 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:53.371397 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.378780 15044 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:53.348429 20024 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:53.338290 19692 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.360661 19892 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.374315 15037 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:06:53.387696 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 78515.3us
I20260709 13:06:53.361124 19934 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
W20260709 13:06:53.400559 20063 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:06:53.407205 20026 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:53.418223 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.418879 14964 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:53.420890 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.421532 15038 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:06:53.421597 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:53.423990 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:53.424855 20077 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:53.425376 20077 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:53.425729 20077 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:06:53.391745 20013 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:06:53.399737 19658 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:53.427867 20066 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:53.430981 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.424777 19809 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.432196 19809 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.434186 19809 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.434744 14895 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:53.437383 19987 raft_consensus.cc:993] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:06:53.437866 19987 raft_consensus.cc:1081] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:06:53.440431 15008 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.389380 19515 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:53.461458 19515 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.476666 19515 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:53.477144 19692 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.459286 20026 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:53.408864 19267 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:06:53.450960 19684 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.529397 19982 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:53.479737 20026 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:06:53.533914 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 147962us
W20260709 13:06:53.537483 20076 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 13:06:53.535140 20026 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:53.541668 20078 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:06:53.548352 15035 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:53.556612 19882 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.562479 20014 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.584511 15040 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
W20260709 13:06:53.592746 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49596.5us
I20260709 13:06:53.599659 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.600267 15035 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:53.601517 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.602233 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.603063 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.603229 19557 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.566820 19892 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.567516 20077 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.605305 15035 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:06:53.606392 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:53.607126 15550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52858
I20260709 13:06:53.615767 15550 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:06:53.616098 15550 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.609225 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.605187 19557 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.619618 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:53.619984 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.620220 15547 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:53.568892 19882 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:53.627102 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:53.614671 19967 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:06:53.621798 19982 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:53.626668 20032 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:53.651834 20032 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.652240 20032 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:53.656159 20014 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:53.659220 19892 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.659837 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.660514 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.660825 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:53.661226 14963 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:53.662720 19997 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:53.663326 19997 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:53.664222 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.664983 14970 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:53.666250 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.666980 14968 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:53.630155 19684 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.664974 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:53.674394 14966 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:53.647152 19557 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:53.660111 20074 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.285s	user 0.003s	sys 0.000s
I20260709 13:06:53.671773 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:53.672412 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.670289 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.683703 14887 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:53.681488 15007 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:53.681006 15550 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.683555 14894 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:06:53.686896 15542 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:53.633033 19967 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:53.688572 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:53.689042 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:53.682298 19684 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.631625 19692 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:06:53.640087 19982 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.694154 14970 raft_consensus.cc:2368] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:53.697834 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:53.698510 19882 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:53.704088 19949 consensus_meta.cc:287] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.610s	user 0.007s	sys 0.004s
I20260709 13:06:53.704532 19949 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.712456 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:53.713018 15040 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.716804 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.717000 15550 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.693917 19967 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.725414 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:53.726248 15544 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:06:53.697376 19982 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:53.714512 15035 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 7 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:53.705896 19542 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:06:53.749454 19684 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:53.749872 19542 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:53.750306 19542 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:06:53.751624 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:53.751080 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.705520 19747 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.752929 15039 raft_consensus.cc:2410] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:06:53.729456 15041 raft_consensus.cc:2368] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:53.761593 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.762118 14888 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:06:53.765875 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:53.762409 14888 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:53.726694 19528 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.779935 19528 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.664276 19997 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.777776 15040 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:53.791129 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.793690 15548 raft_consensus.cc:2410] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:06:53.726043 20079 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:53.789876 14888 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.798504 14888 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:06:53.796406 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 96622.5us
I20260709 13:06:53.805436 19542 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:53.798848 19418 consensus_queue.cc:1175] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 13:06:53.810141 15008 leader_election.cc:400] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:53.810606 15008 leader_election.cc:403] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:53.811785 19767 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:53.815686 19528 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.801690 19808 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:53.817968 19808 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:53.818979 19808 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.822151 15042 raft_consensus.cc:2410] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:06:53.797936 20079 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:53.724614 20080 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:06:53.827104 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:53.824393 20079 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.829870 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:53.831863 15040 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.829625 15039 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:06:53.834028 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.835860 19528 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:06:53.838331 19528 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.838738 19528 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:06:53.841840 20085 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 13:06:53.822639 19747 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:53.853386 15040 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:53.858088 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:53.863462 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.852671 20080 consensus_queue.cc:1243] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:06:53.861902 19747 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:53.871951 20088 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:53.868582 19981 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:53.888254 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:53.847316 20026 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.892637 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:53.882864 14792 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 15, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: HEALTHY } } }
I20260709 13:06:53.894286 14887 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:53.877024 20024 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:06:53.885058 19747 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:53.898176 14970 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:53.885828 19542 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:53.911691 19949 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:53.912192 20077 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.912740 15543 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 8.
I20260709 13:06:53.913491 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:53.897068 19981 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.937633 15040 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18.
I20260709 13:06:53.950850 19692 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:06:53.951334 19692 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:53.952355 19528 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.952237 19692 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:53.956393 15035 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:53.897411 20088 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:53.964627 19528 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:53.988108 14887 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:53.971438 19949 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.016129 19949 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:53.995383 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:54.035780 19542 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:54.044636 19542 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:54.045717 19542 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.057593 20088 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.061509 20026 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:54.065910 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:54.066500 14887 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.067569 19814 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:06:54.069151 14888 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:54.075698 19981 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.076264 14887 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:06:54.082052 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:54.080590 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.095903 14961 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.079216 20031 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:54.098219 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:54.099277 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 234061us
I20260709 13:06:54.099079 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.101046 14970 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:06:54.101999 19949 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:54.104087 19982 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:54.105136 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.105278 14894 raft_consensus.cc:2368] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:54.107589 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.108124 14964 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.112720 20079 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.115337 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.116034 14968 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:54.114848 20079 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:54.119125 14961 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:06:54.100652 20031 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.155295 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3029) took 1027 ms. Trace:
I20260709 13:06:54.125386 19967 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.155690 15041 rpcz_store.cc:276] 0709 13:06:53.128105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:53.128266 (+   161us) service_pool.cc:224] Handling call
0709 13:06:54.155095 (+1026829us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540014aad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:54.155219 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1375440128}
I20260709 13:06:54.156901 19747 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.096509 20032 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.158089 14887 raft_consensus.cc:2368] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13.
I20260709 13:06:54.159271 20032 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.101526 20013 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:54.161055 19747 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.161402 20013 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:06:54.162472 20013 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.135002 19982 leader_election.cc:290] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.166170 19967 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.141800 14964 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:06:54.161520 15007 leader_election.cc:400] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13.
I20260709 13:06:54.170373 15007 leader_election.cc:403] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.143234 14970 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:54.172091 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.172915 14892 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:06:54.173436 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:54.173949 14895 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.182174 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:54.189595 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:54.190541 15040 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.202283 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:54.202867 15041 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:54.208205 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:54.209965 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.211026 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:54.201462 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.216737 14969 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.222836 15040 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:06:54.224629 14890 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:54.227546 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:54.229758 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:54.230441 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.231222 14889 raft_consensus.cc:2410] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:06:54.232131 15035 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
W20260709 13:06:54.207783 20099 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 13:06:54.195647 20012 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.227258 14861 leader_election.cc:304] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:54.237988 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:54.241271 14888 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18.
I20260709 13:06:54.242909 14895 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:54.258540 15550 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:54.262275 20077 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:54.262806 20077 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.169296 20031 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.267889 19809 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:06:54.268440 19809 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:54.269253 19809 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.281957 15041 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:06:54.288386 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 78825.6us
I20260709 13:06:54.289754 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:54.294548 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 67383.9us
I20260709 13:06:54.271606 20077 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.302853 19658 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:54.294363 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:54.315495 19542 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:54.315864 20002 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.316102 19542 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.316416 20002 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.318364 20002 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:54.319343 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:54.321350 19528 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:54.321854 19528 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.326184 19528 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.327836 20031 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:54.329501 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:54.330087 15040 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:06:54.319139 19542 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:54.336359 20081 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:06:54.336784 20081 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:54.337543 20081 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.343777 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:54.344591 15035 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:54.350919 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.351716 14964 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:54.352196 15040 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:06:54.308235 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:06:54.357368 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49247.2us
I20260709 13:06:54.355235 20081 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:06:54.358317 19692 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.360162 19747 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:54.360714 19747 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:54.361662 19747 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.365257 19806 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:06:54.365432 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 71178.2us
I20260709 13:06:54.365829 19806 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:54.366191 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:54.366675 19806 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.376322 15550 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:06:54.371335 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:54.380962 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:06:54.149156 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:54.384522 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.384739 14969 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:06:54.386562 15007 leader_election.cc:400] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:54.386861 15007 leader_election.cc:403] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.388530 14962 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:54.389465 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:06:54.393329 14895 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:06:54.384112 14792 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:54.395567 14792 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 7 to 8, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.395582 20024 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:54.397192 20024 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:54.397586 20024 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:54.397650 14792 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 13, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.400806 14895 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:54.401229 20080 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.401777 20080 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.403527 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.404614 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.405221 14792 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.405798 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.408283 14792 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:54.410351 14792 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:54.413877 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 174) took 4978 ms. Trace:
I20260709 13:06:54.409245 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:54.420601 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.424355 14969 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:54.425196 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:54.432724 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:06:54.388098 19882 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:54.443473 14792 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 10 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.448288 14969 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:54.432322 19933 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:06:54.456911 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.423220 14793 rpcz_store.cc:276] 0709 13:06:49.435591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:49.469642 (+ 34051us) service_pool.cc:224] Handling call
0709 13:06:54.413814 (+4944172us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:52.348593 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:52.394403 (+ 45810us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:52.394445 (+    42us) write_op.cc:435] Acquired schema lock
0709 13:06:52.394466 (+    21us) tablet.cc:662] Decoding operations
0709 13:06:52.417314 (+ 22848us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:52.417399 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:52.417424 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:06:52.472493 (+ 55069us) tablet.cc:701] Row locks acquired
0709 13:06:52.472522 (+    29us) write_op.cc:260] PREPARE: finished
0709 13:06:52.472686 (+   164us) write_op.cc:270] Start()
0709 13:06:52.472808 (+   122us) write_op.cc:276] Timestamp: P: 1783602412472633 usec, L: 0
0709 13:06:52.472843 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 13:06:52.473557 (+   714us) log.cc:844] Serialized 3632 byte log entry
0709 13:06:52.573057 (+ 99500us) op_driver.cc:464] REPLICATION: finished
0709 13:06:52.723342 (+150285us) write_op.cc:301] APPLY: starting
0709 13:06:52.753045 (+ 29703us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:52.862831 (+109786us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:52.866502 (+  3671us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:52.871463 (+  4961us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:52.871731 (+   268us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:06:52.871787 (+    56us) write_op.cc:312] APPLY: finished
0709 13:06:52.872055 (+   268us) log.cc:844] Serialized 89 byte log entry
0709 13:06:52.879292 (+  7237us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.881142 (+  1850us) write_op.cc:454] Released schema lock
0709 13:06:52.881198 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:52.881754 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:52.881826 (+    72us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3230,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":127191,"apply.run_cpu_time_us":12742,"apply.run_wall_time_us":165738,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41747,"num_ops":9,"prepare.queue_time_us":261713,"prepare.run_cpu_time_us":5074,"prepare.run_wall_time_us":130969,"replication_time_us":100050,"spinlock_wait_cycles":1243392,"thread_start_us":267536,"threads_started":2}]]}
I20260709 13:06:54.412693 19993 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16.
I20260709 13:06:54.457656 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.458244 14969 raft_consensus.cc:2368] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13.
I20260709 13:06:54.439306 20012 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13.
I20260709 13:06:54.441419 19937 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:06:54.439435 20092 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:06:54.471329 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.450255 14792 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:54.473812 19933 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:54.473955 19959 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:06:54.425335 19607 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:06:54.470220 14933 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18.
I20260709 13:06:54.474792 19933 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.441169 20013 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:54.515816 14894 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 7 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:54.474980 19959 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:06:54.477303 14792 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 5 to 6, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 6 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:06:54.478405 14888 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:54.514276 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:54.538125 15008 leader_election.cc:400] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13.
I20260709 13:06:54.500010 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.502748 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:54.537488 14792 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 13 to 14, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:06:54.505220 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.510145 14933 leader_election.cc:403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.540163 14792 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 11 to 12, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:06:54.541689 15042 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:54.541841 14792 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:06:54.544438 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 74371.8us
I20260709 13:06:54.549247 14792 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:06:54.551079 14936 leader_election.cc:400] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:54.554812 14936 leader_election.cc:403] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:06:54.498035 20080 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:54.496749 20096 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.496456 20092 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:54.565765 14936 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18.
I20260709 13:06:54.571148 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:54.536755 19959 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:54.531059 19937 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:54.582185 15548 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:06:54.498716 19573 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 13:06:54.547581 20101 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:54.587980 19997 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:06:54.564119 20023 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18.
I20260709 13:06:54.588954 19959 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.590185 19937 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.592847 20013 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.598505 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:54.601715 20012 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.582679 19814 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12.
I20260709 13:06:54.603051 20002 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:54.613119 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:54.620314 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:54.583559 20096 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.636196 19809 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:06:54.669674 15035 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:54.690218 19809 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:06:54.671665 14859 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:54.691119 19809 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.636502 20002 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.696574 20002 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:54.667305 20092 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.637291 19692 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:06:54.701583 20096 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.702728 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.703729 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:54.703819 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.658627 19959 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:54.622511 20012 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.708936 14890 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:54.709301 20012 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:54.709901 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.711555 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.712100 20012 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:54.712870 20096 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:54.715269 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:54.621254 20013 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:54.716403 20024 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.717465 20013 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:54.717693 19950 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:54.718529 20024 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:54.722574 15514 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:54.724750 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:54.726253 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:54.728722 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:54.733230 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:54.736548 14890 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:06:54.740773 14886 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:06:54.739706 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 73851.7us
I20260709 13:06:54.743220 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:06:54.744647 14970 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:06:54.756227 20023 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:06:54.762383 15041 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:54.763533 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:54.764806 14890 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:54.767948 14970 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:06:54.769691 19949 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:54.776541 19692 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:54.738478 20096 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:06:54.793813 14961 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:54.794271 14969 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:54.752673 19607 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:54.857682 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:54.858923 15040 raft_consensus.cc:2410] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:06:54.865103 15042 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:54.792469 19997 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.868361 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:54.797487 20088 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:06:54.759559 19882 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.091s
I20260709 13:06:54.896775 14895 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:54.887820 15042 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:06:54.840329 20095 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.808935 19949 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.092s
I20260709 13:06:54.868193 20104 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:54.798491 20005 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:06:54.841763 19934 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:06:54.850060 19982 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:06:54.899823 20088 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:54.939996 15040 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:06:54.943346 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:54.943807 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:54.895561 19997 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.907109 20095 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:54.923954 19814 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 13:06:54.920745 20104 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:54.987107 20111 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 13:06:54.987908 20110 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 13:06:54.967027 20077 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:55.014552 19814 consensus_queue.cc:1243] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:06:55.078269 14890 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:06:55.085788 20023 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:06:55.086719 20023 consensus_queue.cc:1243] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 13:06:55.108915 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47383.4us
I20260709 13:06:55.125267 14936 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:55.134182 19808 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:06:55.163651 14966 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:06:55.166920 15041 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:55.136821 19806 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:55.058715 20088 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:55.177237 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66006.4us
W20260709 13:06:55.178336 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50844us
I20260709 13:06:55.180680 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:55.153496 20104 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:55.182029 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:55.186971 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:55.188308 19542 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:06:55.134398 20101 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:06:55.211059 14890 pending_rounds.cc:85] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 7
I20260709 13:06:55.211390 14890 pending_rounds.cc:107] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:06:55.211658 14890 raft_consensus.cc:2889] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:06:55.198581 19779 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:06:55.215951 19997 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:55.217528 20095 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:55.190040 20096 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
W20260709 13:06:55.229125 20117 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.210s	user 0.001s	sys 0.000s
I20260709 13:06:55.231086 19981 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:06:55.231554 19981 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:06:55.232416 19981 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:55.248469 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:55.252288 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:55.253106 15035 raft_consensus.cc:2410] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:06:55.257565 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 63655.4us
I20260709 13:06:55.260821 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:55.268043 14962 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:06:55.268131 20031 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.276333 20031 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:55.279127 20031 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:55.302019 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89530.9us
I20260709 13:06:55.286348 20096 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.015s
W20260709 13:06:55.342031 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147043us
I20260709 13:06:55.343103 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:55.343947 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 158831us
I20260709 13:06:55.348963 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:55.354203 15042 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:55.356734 15044 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:06:55.359790 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:55.362865 15041 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:06:55.367344 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:55.368165 15042 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:55.376937 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:55.377678 15541 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:06:55.375298 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:55.392127 20129 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:06:55.385079 19528 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:06:55.398289 19934 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:06:55.380815 19814 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:06:55.399559 20131 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:55.406060 20007 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:55.407431 19690 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:06:55.407851 20120 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.213s	user 0.003s	sys 0.000s
I20260709 13:06:55.378780 19779 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:06:55.413059 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 64199.2us
I20260709 13:06:55.439479 15549 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:06:55.444293 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:55.457531 20133 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:55.422037 19882 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:06:55.466212 15035 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:55.475536 14968 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:06:55.478343 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:55.478886 20128 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:06:55.468163 20133 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:55.482306 20133 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:55.483068 14968 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:06:55.483767 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:55.484817 14964 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:55.652632 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:06:55.484364 14892 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
W20260709 13:06:55.756031 20135 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.369s	user 0.000s	sys 0.000s
W20260709 13:06:55.866645 20137 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.322s	user 0.001s	sys 0.000s
W20260709 13:06:55.876099 20136 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
W20260709 13:06:55.895710 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 417861us
W20260709 13:06:55.816102 20144 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
W20260709 13:06:55.700700 20120 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:06:55.694005 19806 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.001s
W20260709 13:06:55.807101 20139 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.238s	user 0.000s	sys 0.000s
I20260709 13:06:55.927850 19806 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:06:55.941864 14961 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:06:55.891840 20096 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:55.961138 20012 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:55.962491 20012 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:56.041767 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 137520us
I20260709 13:06:56.043303 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3047) took 1246 ms. Trace:
I20260709 13:06:56.050894 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:56.051702 15042 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:56.048312 15039 rpcz_store.cc:276] 0709 13:06:54.796380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.850466 (+ 54086us) service_pool.cc:224] Handling call
0709 13:06:54.854866 (+  4400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:54.981807 (+126941us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:06:54.981836 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:54.992085 (+ 10249us) log.cc:844] Serialized 52 byte log entry
0709 13:06:55.282097 (+290012us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:55.282138 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:55.965999 (+683861us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b540003fcd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:55.966063 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:55.966121 (+    58us) raft_consensus.cc:1685] finished
0709 13:06:55.966142 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.043227 (+ 77085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8617,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":291149568,"thread_start_us":289537,"threads_started":1,"wal-append.queue_time_us":343094}
I20260709 13:06:55.953970 20096 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:56.075445 20130 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.665s	user 0.004s	sys 0.006s
W20260709 13:06:56.076961 20116 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.083s	user 0.002s	sys 0.001s
I20260709 13:06:56.079528 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3355) took 1467 ms. Trace:
W20260709 13:06:56.080070 20141 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:06:56.066583 20133 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.084435 20133 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.086529 20133 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:56.079910 14888 rpcz_store.cc:276] 0709 13:06:54.612285 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:54.612418 (+   133us) service_pool.cc:224] Handling call
0709 13:06:54.612715 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:54.613028 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:54.613057 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:54.618956 (+  5899us) log.cc:844] Serialized 26 byte log entry
0709 13:06:54.849733 (+230777us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:54.849776 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:54.849918 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.044116 (+1194198us) spinlock_profiling.cc:243] Waited 4.24 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:56.079190 (+ 35074us) raft_consensus.cc:1685] finished
0709 13:06:56.079213 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.079432 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31955,"raft.queue_time_us":4420,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":16441,"spinlock_wait_cycles":9743744,"thread_start_us":190784,"threads_started":1,"wal-append.queue_time_us":302347}
I20260709 13:06:56.105171 20012 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:56.064637 20155 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.043s
W20260709 13:06:56.111251 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.119563 20096 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:56.121475 20081 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.122177 20081 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.124455 20081 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:56.126214 19934 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:06:56.127820 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.137043 14895 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:06:56.131299 14888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "146ff3031af843e3a501710c2301a015"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:56.138679 14888 raft_consensus.cc:606] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:56.139158 14888 raft_consensus.cc:614] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:06:56.183152 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 66732.9us
I20260709 13:06:56.196655 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:56.208998 19515 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:56.209578 19515 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:56.213094 20152 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:06:56.187685 19992 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.217341 20146 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:06:56.127384 20081 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.122s
I20260709 13:06:56.278290 20012 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:56.292742 19515 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:56.347097 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 161772us
I20260709 13:06:56.292621 20005 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:56.292569 19992 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.368995 19992 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:56.369661 19992 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:56.370167 19992 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.371549 20005 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.373713 20005 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:56.304852 20012 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.390374 20012 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:56.447536 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 250338us
I20260709 13:06:56.449498 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.400591 20023 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.474325 14895 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:06:56.522801 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:56.523702 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.524300 14888 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:06:56.525547 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.525045 14962 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:06:56.531634 14965 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:56.539921 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.540095 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:56.540915 15036 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:06:56.541554 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.549521 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:56.553531 15514 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:06:56.551236 19515 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:06:56.572631 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:56.551599 20024 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:56.551779 19779 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.551362 20096 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.585566 20009 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:06:56.586167 20009 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.586656 20009 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:06:56.587471 20007 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:56.588116 20007 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.590646 20007 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:56.574004 19515 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.542528 20023 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.596036 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3064) took 1148 ms. Trace:
I20260709 13:06:56.597257 19981 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:56.568239 19982 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.571246 19992 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:56.614482 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:56.615254 15036 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:06:56.601403 15037 rpcz_store.cc:276] 0709 13:06:55.447229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.447357 (+   128us) service_pool.cc:224] Handling call
0709 13:06:55.447719 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:55.459857 (+ 12138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:55.459900 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:55.461393 (+  1493us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.215179 (+753786us) spinlock_profiling.cc:243] Waited 2.77 ms on lock 0x7b18004d3260. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9
0709 13:06:56.215793 (+   614us) spinlock_profiling.cc:243] Waited 2.59 ms on lock 0x7b18004d3260. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:06:56.496216 (+280423us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b48002001d8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:06:56.542626 (+ 46410us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:56.542914 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:06:56.591781 (+ 48867us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b18004d3260. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f5534d6e060 00007f5534d80716 00007f5534d91287 00007f5534d91208
0709 13:06:56.595717 (+  3936us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.595793 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:56.595836 (+    43us) raft_consensus.cc:1685] finished
0709 13:06:56.595851 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:56.595978 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80583,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":13236,"raft.run_cpu_time_us":19813,"raft.run_wall_time_us":1032547,"spinlock_wait_cycles":32646400,"thread_start_us":326652,"threads_started":1,"wal-append.queue_time_us":1126787}
I20260709 13:06:56.634110 20104 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.631289 20134 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.652086 20104 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.652787 20134 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.593441 20024 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.654290 20104 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:56.606428 20096 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.654506 20165 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.599658 19779 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.658782 20134 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:56.622133 19982 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.731817 19515 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:56.639714 19937 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:06:56.742916 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:56.748450 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:56.748799 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:56.750304 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 98398.7us
I20260709 13:06:56.750561 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 2780) took 1590 ms. Trace:
W20260709 13:06:56.748848 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 180182us
W20260709 13:06:56.759508 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 202366us
I20260709 13:06:56.760629 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:56.761814 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:56.764530 14961 rpcz_store.cc:276] 0709 13:06:55.160613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.160732 (+   119us) service_pool.cc:224] Handling call
0709 13:06:55.160951 (+   219us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:55.942203 (+781252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.750344 (+808141us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54003eba54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:56.750508 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1795383552}
W20260709 13:06:56.768932 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 320430us
I20260709 13:06:56.770053 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.809230 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:56.759342 20165 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.813786 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:56.815343 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:56.751950 20173 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:56.829720 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:56.807458 19933 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.805371 19952 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.804597 20013 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:56.817036 20160 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:56.824931 20137 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:06:56.815552 20077 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:56.829985 20170 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:06:56.896564 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 152352us
I20260709 13:06:56.835693 19565 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.922514 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:56.925634 19809 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:56.927255 19809 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.886775 20013 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:56.838912 20105 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:56.825655 20095 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:06:56.841266 20182 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.916581 19937 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:56.920754 20023 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:56.879132 19952 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.844671 19933 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.967278 15040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:06:57.053395 15040 raft_consensus.cc:606] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:06:56.968657 20182 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.974649 19937 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:56.961656 20013 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:56.964154 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 199068us
I20260709 13:06:56.896878 20160 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:56.833575 20173 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.052271 19992 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:56.918826 20077 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.066299 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:57.052955 20023 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:56.961961 20189 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.134s
I20260709 13:06:57.129594 19992 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.138167 19992 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:57.139329 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:57.138177 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:56.961344 19565 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.062250 20174 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.064646 20151 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:57.122254 20166 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
I20260709 13:06:57.170668 14970 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:06:57.124639 20180 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:56.965940 20105 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.253973 19982 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.130630 20096 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:57.251601 20179 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:06:57.386907 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:57.154726 20194 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:06:57.251595 20178 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.414s	user 0.001s	sys 0.000s
I20260709 13:06:57.169164 20024 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:57.170784 19607 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:57.458519 15513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.013s	sys 0.017s
I20260709 13:06:57.242293 19573 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:57.436020 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:57.309794 20185 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.490s	user 0.000s	sys 0.001s
I20260709 13:06:57.245637 20095 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:57.253614 19779 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:57.460546 15513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.013s	sys 0.017s
W20260709 13:06:57.475589 15008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.001s	sys 0.019s
W20260709 13:06:57.487771 15008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.001s	sys 0.020s
W20260709 13:06:57.488294 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:57.169886 20023 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.413475 20134 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.572772 15040 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.472481 19528 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:57.436225 20194 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:57.568173 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.008s	sys 0.021s
W20260709 13:06:57.582716 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.011s	sys 0.039s
W20260709 13:06:57.588183 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.012s	sys 0.027s
W20260709 13:06:57.616994 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.018s	sys 0.042s
W20260709 13:06:57.617092 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.012s	sys 0.027s
W20260709 13:06:57.617337 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 691383us
W20260709 13:06:57.617492 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 688837us
W20260709 13:06:57.475499 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.009s	sys 0.011s
I20260709 13:06:57.618278 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:06:57.618736 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.010s	sys 0.011s
I20260709 13:06:57.618829 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:57.476737 20192 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:57.568528 20179 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 13:06:57.609395 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.014s	sys 0.043s
W20260709 13:06:57.625792 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.014s	sys 0.043s
I20260709 13:06:57.222337 20174 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.561179 20184 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:57.599216 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.008s	sys 0.022s
I20260709 13:06:57.619570 15550 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
W20260709 13:06:57.581897 19684 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.032s	sys 0.065s
W20260709 13:06:57.620995 14962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.022s	sys 0.062s
W20260709 13:06:57.661949 14962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.022s	sys 0.063s
I20260709 13:06:57.583251 20096 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.620086 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2400) took 1115 ms. Trace:
I20260709 13:06:57.668969 15039 rpcz_store.cc:276] 0709 13:06:56.504868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.512692 (+  7824us) service_pool.cc:224] Handling call
0709 13:06:56.513059 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.551892 (+ 38833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.551922 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:56.552352 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:06:56.658778 (+106426us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:56.676779 (+ 18001us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:56.676889 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:57.619900 (+943011us) raft_consensus.cc:1685] finished
0709 13:06:57.619921 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:57.620033 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116283,"raft.queue_time_us":121056,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":13932,"thread_start_us":87855,"threads_started":1,"wal-append.queue_time_us":252991}
I20260709 13:06:57.479224 19607 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.351643 20180 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.689038 20180 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:57.604828 20194 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:06:57.689916 20165 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.691351 20105 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:57.692596 20202 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.693128 20105 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.693797 20105 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:57.661722 19684 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.032s	sys 0.065s
I20260709 13:06:57.695914 19684 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:06:57.696314 20198 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:06:57.697801 19933 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:57.343621 20151 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.621996 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:06:57.727442 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.958s	user 0.007s	sys 0.004s
W20260709 13:06:57.727779 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.007s	sys 0.004s
I20260709 13:06:57.553200 20095 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.613540 19692 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.687026 20173 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.628979 20192 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.699000 19809 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:57.729249 19981 consensus_meta.cc:287] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.112s	user 0.011s	sys 0.000s
I20260709 13:06:57.488948 19573 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.697182 20212 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.728775 20077 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:57.703861 20096 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.668044 20176 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:57.611815 19528 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.722249 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:57.644697 19882 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:57.567663 15010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.012s	sys 0.017s
W20260709 13:06:57.728142 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 971382us
I20260709 13:06:57.754132 19515 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:57.752573 20160 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:57.735767 15541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.024s	sys 0.041s
W20260709 13:06:57.788928 15541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.025s	sys 0.041s
I20260709 13:06:57.709580 20180 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.677824 20184 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.699167 20206 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:57.730075 20081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.005s	sys 0.003s
I20260709 13:06:57.755545 14967 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
W20260709 13:06:57.629880 20187 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.664s	user 0.000s	sys 0.001s
I20260709 13:06:57.730515 19937 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:57.730741 19952 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:57.768765 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:57.585335 20134 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.865163 20151 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.772143 20216 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.693145 20202 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.773769 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:57.866310 20216 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.866868 14893 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:57.867755 20202 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:57.740777 20182 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:57.728523 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:06:57.782743 15010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.952s	user 0.013s	sys 0.017s
W20260709 13:06:57.783320 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 162516us
W20260709 13:06:57.785295 14859 connection.cc:256] RPC call timeout handler was delayed by -1.0249387970000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1644s for a response
I20260709 13:06:57.759918 20165 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.771397 20189 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.749320 19692 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.857411 14967 pending_rounds.cc:85] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 9
I20260709 13:06:57.771869 20212 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.863350 20174 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.859468 20206 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.865695 20134 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.773396 15036 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:06:57.777348 19981 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.775393 19976 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:06:57.892740 15516 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.3:46271 timed out after 1.616s (SENT)
I20260709 13:06:57.781297 20217 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.903860 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:57.784641 19515 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.788240 19882 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:57.832093 20180 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:57.782421 20176 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.386736 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:57.857264 20081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.006s	sys 0.003s
I20260709 13:06:58.301383 20197 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:57.809022 20077 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.982705 20189 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.438122 20189 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.905776 19952 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:58.439918 19573 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.439815 19952 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.441185 20184 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.442205 19952 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:58.442394 20207 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.314s	user 0.000s	sys 0.000s
I20260709 13:06:58.444332 20192 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.394872 15038 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:06:58.445374 20222 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.446012 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:58.445865 20222 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.446605 15038 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:58.393002 19542 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:58.381222 20209 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:58.447891 19542 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.448305 20209 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.449033 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:58.449956 19542 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:58.450304 20209 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.450392 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:58.452540 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2306) took 1704 ms. Trace:
W20260709 13:06:58.358111 20194 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.668s	user 0.009s	sys 0.001s
I20260709 13:06:58.453112 14970 rpcz_store.cc:276] 0709 13:06:56.748112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.748217 (+   105us) service_pool.cc:224] Handling call
0709 13:06:58.452376 (+1704159us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400218ed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:58.452462 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":935602944}
I20260709 13:06:58.256481 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:58.391611 14967 pending_rounds.cc:107] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:06:58.250687 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:58.137133 15547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.015s	sys 0.016s
I20260709 13:06:58.461247 14967 raft_consensus.cc:2889] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:06:58.461464 15547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.027s	sys 0.025s
I20260709 13:06:57.969995 20220 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:58.293010 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:58.066233 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 143684us
I20260709 13:06:58.397337 15041 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:58.249568 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:06:58.414016 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:58.467798 14893 raft_consensus.cc:606] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:06:58.468478 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:58.469954 19573 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:06:57.852986 19809 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:58.472510 19809 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.473814 14890 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:58.417460 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:06:58.067375 19690 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.022s	sys 0.067s
W20260709 13:06:58.380316 20204 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.469s	user 0.000s	sys 0.000s
W20260709 13:06:58.477068 19690 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.300s	user 0.032s	sys 0.084s
I20260709 13:06:58.292733 20151 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:58.478422 19690 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:06:58.478240 20151 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.478948 19690 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:06:57.906499 20023 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.479423 19690 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:06:58.421885 20199 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:58.407971 20202 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:58.425014 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:58.424968 19692 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.429538 15545 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:06:58.382350 20211 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:58.484293 15043 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:06:58.484849 20211 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.431854 20096 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.392984 19976 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.490175 19976 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:06:58.432773 20009 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 1.846s	user 0.008s	sys 0.006s
I20260709 13:06:58.491041 20009 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:58.491693 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 74343.6us
I20260709 13:06:58.433001 19528 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.496223 15548 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:06:58.392792 20127 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:58.497172 20127 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.500743 20220 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.502584 20127 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:58.504235 20211 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:57.970403 20218 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:57.860093 20105 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:58.393069 20174 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:58.367516 20213 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:06:58.410722 19607 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:58.382231 20216 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:58.444928 20226 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:58.331123 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.012s	sys 0.034s
I20260709 13:06:58.476418 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:06:58.561753 15541 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.037s	sys 0.071s
W20260709 13:06:58.567519 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.013s	sys 0.035s
W20260709 13:06:58.567976 15541 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.039s	sys 0.071s
W20260709 13:06:58.568362 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 802220us
W20260709 13:06:58.568648 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 92375.3us
I20260709 13:06:58.475057 19809 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.347693 19937 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:57.927738 20165 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.433678 19515 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:57.975937 19565 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:58.062872 20112 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:58.507452 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2302) took 1739 ms. Trace:
I20260709 13:06:58.244642 20007 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:58.452457 20206 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:58.530164 19882 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.463291 19806 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:06:58.501118 20009 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:58.416661 19981 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.454797 20077 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.433552 20197 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.541663 20202 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.464463 20194 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.416328 20217 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:58.627660 14962 rpcz_store.cc:276] 0709 13:06:56.743848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.743976 (+   128us) service_pool.cc:224] Handling call
0709 13:06:56.744239 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:56.966006 (+221767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:56.967168 (+  1162us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.048995 (+ 81827us) log.cc:844] Serialized 26 byte log entry
0709 13:06:57.662368 (+613373us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:57.662409 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:57.662486 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:58.482115 (+819629us) raft_consensus.cc:1685] finished
0709 13:06:58.482190 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:58.483216 (+  1026us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51145,"raft.queue_time_us":65275,"spinlock_wait_cycles":9922816,"thread_start_us":778679,"threads_started":2,"wal-append.queue_time_us":730970}
W20260709 13:06:58.906862 15516 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.029s
I20260709 13:06:59.224856 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:58.669128 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 99826.8us
W20260709 13:06:59.226255 15516 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.008s	sys 0.040s
W20260709 13:06:59.226672 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 1.33397e+06us
I20260709 13:06:59.227465 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1231) took 1565 ms. Trace:
W20260709 13:06:59.227838 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.004s	sys 0.016s
W20260709 13:06:59.228334 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.004s	sys 0.016s
I20260709 13:06:59.070946 20165 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:59.228843 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 732415us
W20260709 13:06:59.064292 19690 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.584s	user 0.012s	sys 0.000s
I20260709 13:06:58.581554 20127 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.229766 19690 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.230147 20127 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:58.707958 14934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.086s	user 0.026s	sys 0.027s
W20260709 13:06:59.233593 14934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.611s	user 0.032s	sys 0.036s
I20260709 13:06:58.746762 20211 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.234639 20211 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:58.833853 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 264674us
W20260709 13:06:58.807817 20013 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.718s	user 0.011s	sys 0.001s
I20260709 13:06:59.240324 20013 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.241670 15037 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:06:58.647900 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:06:59.258104 14895 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:06:59.271150 19976 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:06:59.272439 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 642514us
I20260709 13:06:59.277854 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 3391) took 1540 ms. Trace:
I20260709 13:06:59.278287 14895 rpcz_store.cc:276] 0709 13:06:57.737147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.738187 (+  1040us) service_pool.cc:224] Handling call
0709 13:06:57.738527 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.270897 (+1532370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.277508 (+  6611us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540015bb54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.277669 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3494408448}
I20260709 13:06:59.292814 20013 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.294215 20222 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.294759 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1143) took 2157 ms. Trace:
I20260709 13:06:59.295132 15542 rpcz_store.cc:276] 0709 13:06:57.136955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.141722 (+  4767us) service_pool.cc:224] Handling call
0709 13:06:59.293997 (+2152275us) spinlock_profiling.cc:243] Waited 8.45 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:06:59.294189 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.294403 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.294430 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.294474 (+    44us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:06:59.294514 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.294566 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.294674 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19426560}
I20260709 13:06:59.296207 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1234) took 1607 ms. Trace:
I20260709 13:06:59.296792 15543 rpcz_store.cc:276] 0709 13:06:57.688324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:59.295504 (+1607180us) service_pool.cc:224] Handling call
0709 13:06:59.295760 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.295913 (+   153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.295940 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.295987 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:06:59.296021 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.296068 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.296149 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.303953 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1227) took 1677 ms. Trace:
I20260709 13:06:59.304395 15550 rpcz_store.cc:276] 0709 13:06:57.626386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.676743 (+ 50357us) service_pool.cc:224] Handling call
0709 13:06:57.677123 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.776467 (+ 99344us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.776511 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:57.776568 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:57.776616 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.303733 (+1527117us) spinlock_profiling.cc:243] Waited 99 ms on lock 0x7b54006a1dd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.303776 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.303902 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227778304}
I20260709 13:06:59.227937 15546 rpcz_store.cc:276] 0709 13:06:57.661635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.573643 (+912008us) service_pool.cc:224] Handling call
0709 13:06:59.226984 (+653341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.227151 (+   167us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.227176 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.227213 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:59.227248 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.227298 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.227396 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:06:59.259620 20194 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:06:58.708346 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 322612us
I20260709 13:06:59.306768 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1151) took 2167 ms. Trace:
I20260709 13:06:59.307201 15544 rpcz_store.cc:276] 0709 13:06:57.139376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.141104 (+  1728us) service_pool.cc:224] Handling call
0709 13:06:58.444966 (+1303862us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b58001c1498. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51f8c 00007f5531c51ef6 0000000000375939 00007f5539cc51e0 00007f5539d8e0c4 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:06:58.445095 (+   129us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.487935 (+ 42840us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:58.487978 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:58.488036 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:58.488081 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.306529 (+818448us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b5400692654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.306581 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.306716 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":452738944}
W20260709 13:06:59.309484 20235 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.462s	user 0.004s	sys 0.003s
I20260709 13:06:59.310119 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1230) took 1666 ms. Trace:
I20260709 13:06:59.310531 20151 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.310531 15547 rpcz_store.cc:276] 0709 13:06:57.643293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.543276 (+899983us) service_pool.cc:224] Handling call
0709 13:06:58.543693 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.247986 (+704293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.248028 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.248082 (+    54us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:06:59.248128 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.309887 (+ 61759us) spinlock_profiling.cc:243] Waited 704 ms on lock 0x7b54005546d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.309942 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.310069 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1619320704}
I20260709 13:06:59.312348 20211 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.266954 20217 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.269786 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.333567 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.333971 14962 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:59.334441 14968 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:06:58.605440 20189 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.312808 20194 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:59.313304 19976 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.313534 20195 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:06:59.313823 15545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1155) took 1692 ms (client timeout 1626 ms). Trace:
I20260709 13:06:58.699434 20220 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:06:59.230166 15516 connection.cc:256] RPC call timeout handler was delayed by -1.3104163649999236s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
I20260709 13:06:58.580776 20199 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.356292 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.358417 15038 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:59.360169 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.317402 20239 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:58.574453 20023 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:06:58.573463 20160 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:58.573268 19933 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.324250 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1139) took 2188 ms. Trace:
I20260709 13:06:59.326442 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:59.218485 20236 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
W20260709 13:06:58.811283 20229 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 13:06:58.813128 20232 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 13:06:58.812232 20228 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:06:59.328675 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:58.588132 20226 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.613770 20213 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.365154 15541 rpcz_store.cc:276] 0709 13:06:57.135853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.139519 (+  3666us) service_pool.cc:224] Handling call
0709 13:06:57.139938 (+   419us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:06:57.789386 (+649448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:57.789418 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:06:57.789993 (+   575us) log.cc:844] Serialized 52 byte log entry
0709 13:06:58.568787 (+778794us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:06:58.568834 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.568922 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.308659 (+739737us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:59.316246 (+  7587us) raft_consensus.cc:1685] finished
0709 13:06:59.316269 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.324193 (+  7924us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":360044,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":14931,"spinlock_wait_cycles":9285504,"thread_start_us":1305342,"threads_started":2,"wal-append.queue_time_us":913463}
I20260709 13:06:59.337702 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.338964 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:58.604439 19542 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:06:59.484447 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 252762us
I20260709 13:06:59.339874 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.339910 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:58.698328 20241 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.314071 20031 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:59.351774 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.498081 14968 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:06:59.499181 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.352533 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.314491 20222 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:06:59.315150 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:06:59.361232 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.522064 14963 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:06:58.604782 19937 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:06:59.353735 15545 rpcz_store.cc:269] 0709 13:06:57.621658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.621787 (+   129us) service_pool.cc:224] Handling call
0709 13:06:59.313597 (+1691810us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b5400501754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:59.313716 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615169792}
I20260709 13:06:59.362558 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:58.592567 20174 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.475679 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:06:59.536787 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.339243 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:58.668304 20007 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.477587 15040 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:06:59.485813 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.486799 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.471131 20180 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.488440 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.490473 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.544629 14961 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:06:59.545433 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.336199 19690 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.492535 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.493443 20077 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.467514 19933 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.320972 19806 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.494880 19542 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.467305 20160 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.495810 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.530989 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.353760 20225 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.362268 20217 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.578717 20217 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.580673 20217 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.580999 19542 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.582549 20226 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.582664 20007 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.362417 20005 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.536226 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.353936 20243 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.539737 15038 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:06:58.592404 20218 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:58.649362 20112 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.474255 20202 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.589553 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.590181 15541 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:06:59.590976 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.545964 14961 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:06:59.357352 19976 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.549584 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.350885 20189 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.594713 14962 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:59.355463 20194 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.564802 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.532074 20031 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.577793 20225 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:06:59.586082 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 229832us
I20260709 13:06:59.361737 20195 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.607781 20195 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.610642 20197 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.612818 20213 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.613054 20031 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.614396 20211 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:06:59.614437 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:59.615285 20225 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.615968 20211 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:06:59.592661 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.616358 20211 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.616760 20211 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:06:59.593994 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.619814 15541 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:06:59.538064 20222 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.421550 20239 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.626227 20239 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.593561 20005 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.627450 20211 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.596493 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.602497 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1024) took 1815 ms. Trace:
I20260709 13:06:59.630784 15037 rpcz_store.cc:276] 0709 13:06:57.786774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.787000 (+   226us) service_pool.cc:224] Handling call
0709 13:06:57.787344 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.242102 (+1454758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.602289 (+360187us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001f40d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.602447 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3344362368}
I20260709 13:06:59.594211 20243 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.521129 20241 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.605427 19937 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.615798 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:59.588995 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.634303 15545 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:06:59.636103 20218 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.636283 20112 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.637933 20189 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.624042 20222 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.629349 20005 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.638937 20191 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.639117 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1138) took 2566 ms. Trace:
I20260709 13:06:59.639564 20191 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.641368 20199 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.641873 20199 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.642465 20191 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.642324 20199 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.643858 20224 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.645002 19976 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.645519 19976 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.645960 19976 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.648723 20194 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.649808 19933 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.649994 20174 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.650997 15035 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:06:59.644775 20224 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:06:59.629406 20211 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.660554 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.661005 20160 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.664068 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1029) took 1240 ms. Trace:
I20260709 13:06:59.639662 15549 rpcz_store.cc:276] 0709 13:06:57.072282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.072486 (+   204us) service_pool.cc:224] Handling call
0709 13:06:57.072763 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:57.072977 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:57.086694 (+ 13717us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.176743 (+ 90049us) log.cc:844] Serialized 14 byte log entry
0709 13:06:57.177077 (+   334us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.638607 (+2461530us) spinlock_profiling.cc:243] Waited 5.72 ms on lock 0x7b180043b580. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f5534d6e060 00007f5534d80716 00007f5534d91287
0709 13:06:59.638706 (+    99us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.638757 (+    51us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:06:59.638807 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.638884 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.639064 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21131,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":100,"raft.queue_time_us":323174,"spinlock_wait_cycles":45382272,"thread_start_us":451150,"threads_started":2,"wal-append.queue_time_us":767624,"wal-append.run_cpu_time_us":2706,"wal-append.run_wall_time_us":1599107}
I20260709 13:06:59.664418 15036 rpcz_store.cc:276] 0709 13:06:58.423886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.438732 (+ 14846us) service_pool.cc:224] Handling call
0709 13:06:58.439026 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.556150 (+1117124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.556194 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.556253 (+    59us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:06:59.556306 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.663909 (+107603us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540014bed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.663943 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.664025 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2568803200}
I20260709 13:06:59.667624 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:59.668040 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52344.9us
I20260709 13:06:59.668159 15036 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:06:59.668686 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:06:59.668869 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.670087 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.673904 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.665942 20174 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:59.676048 20191 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:59.676487 20191 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.676399 20174 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.676923 20191 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:06:59.677150 20234 log.cc:927] Time spent T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.930s	user 0.004s	sys 0.005s
I20260709 13:06:59.678270 20241 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.679596 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2411) took 1867 ms. Trace:
I20260709 13:06:59.677130 20160 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:06:59.680231 20199 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.676867 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:59.667994 20222 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:59.684909 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:59.688282 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:06:59.688939 20160 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:59.684104 20174 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.690603 20211 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:06:59.691511 20211 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:06:59.691298 20160 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:06:59.691849 20211 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.691995 20160 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.698047 20211 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.689604 20088 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:06:59.540400 14892 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:06:59.545994 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.592133 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.860488 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.863330 20160 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.672784 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.870636 15038 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:06:59.766245 14894 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:59.780716 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.872463 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.767000 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.764006 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.764014 14886 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:59.885591 15547 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:06:59.897819 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:59.899103 14890 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 3396) took 2130 ms (client timeout 1524 ms). Trace:
I20260709 13:06:59.899582 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:06:59.899652 14890 rpcz_store.cc:269] 0709 13:06:57.768401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.768533 (+   132us) service_pool.cc:224] Handling call
0709 13:06:59.898655 (+2130122us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54000cd354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:59.898881 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401582336}
I20260709 13:06:59.900434 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.901336 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.902878 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.884187 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.888096 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.887061 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.886358 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.912750 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.913553 15544 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:06:59.878844 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:06:59.914482 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.916560 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2294) took 4439 ms. Trace:
I20260709 13:06:59.917104 14967 rpcz_store.cc:276] 0709 13:06:55.477154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:55.477256 (+   102us) service_pool.cc:224] Handling call
0709 13:06:55.477464 (+   208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:58.461867 (+2984403us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.915945 (+1454078us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54003e7954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:06:59.916318 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5238741376}
I20260709 13:06:59.918666 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.920639 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:06:59.920745 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.883845 19933 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:06:59.922044 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:06:59.879380 14936 connection.cc:256] RPC call timeout handler was delayed by -1.6600271859999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260709 13:06:59.923457 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.925454 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.925755 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:06:59.884843 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:06:59.928382 15549 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
W20260709 13:06:59.928440 15548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 1135) took 2862 ms (client timeout 2054 ms). Trace:
W20260709 13:06:59.929071 15548 rpcz_store.cc:269] 0709 13:06:57.065762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.065940 (+   178us) service_pool.cc:224] Handling call
0709 13:06:59.927873 (+2861933us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400b4f354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:06:59.928202 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3155204992}
I20260709 13:06:59.930177 19557 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:06:59.930750 19557 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:06:59.931237 19557 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:06:59.923251 19933 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:06:59.940913 14890 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:06:59.690887 20224 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.971860 19981 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:06:59.853392 19976 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:06:59.977412 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.978951 14891 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:06:59.700162 20211 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:06:59.690016 20222 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.980479 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.982311 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:06:59.716223 20191 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:06:59.986133 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.987185 14964 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:06:59.990973 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:06:59.759238 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 409154us
I20260709 13:06:59.936486 19933 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:06:59.998808 14887 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:06:59.706272 20176 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.003933 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.018250 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.020064 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.019167 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.025177 15548 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:00.026979 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.027889 20095 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.030318 19933 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.031903 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.032436 19933 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:00.033455 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.035462 20088 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:00.036484 20088 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:00.039099 20193 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 2.418s	user 0.010s	sys 0.044s
W20260709 13:07:00.040383 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 114935us
I20260709 13:07:00.023586 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.045910 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.048750 14891 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:00.054544 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.053336 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.059684 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:00.063558 20261 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:00.053112 20222 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.063732 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:00.065676 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.067976 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:06:59.679962 15044 rpcz_store.cc:276] 0709 13:06:57.812477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.812597 (+   120us) service_pool.cc:224] Handling call
0709 13:06:57.812964 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:06:57.813366 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:06:57.813401 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:06:57.845727 (+ 32326us) log.cc:844] Serialized 26 byte log entry
0709 13:06:58.411462 (+565735us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:06:58.411569 (+   107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:58.411707 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:06:59.661869 (+1250162us) spinlock_profiling.cc:243] Waited 5.09 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:06:59.679314 (+ 17445us) raft_consensus.cc:1685] finished
0709 13:06:59.679336 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:06:59.679542 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":89814,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":155372,"spinlock_wait_cycles":11706240,"thread_start_us":499431,"threads_started":1,"wal-append.queue_time_us":770833}
I20260709 13:07:00.069859 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:00.071141 20221 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.071620 20221 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:00.071991 20221 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:00.068167 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73897.1us
W20260709 13:07:00.081064 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 153801us
I20260709 13:07:00.075234 19806 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.082427 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.085578 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.089902 20095 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.090550 20095 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.095943 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.098913 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.102077 20220 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:00.104418 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.104642 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.105083 14887 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:00.106082 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.106256 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.100387 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.098035 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.107331 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.112071 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.102072 14891 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:00.130998 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.136453 20127 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.103346 20220 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.125931 19987 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:00.134477 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:00.140583 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.140584 19987 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.147156 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.146799 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.149482 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.154987 14890 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:00.146528 14970 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:00.164127 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.164463 15549 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:07:00.166982 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.151546 19987 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.175942 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.180064 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.190187 20241 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.192531 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:00.194160 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53417us
I20260709 13:07:00.195746 20131 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:07:00.196074 20263 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:00.196269 20131 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:00.196671 20131 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.202116 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:00.205116 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.194402 20212 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.208868 20243 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.211190 20095 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.212796 20088 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.214267 15544 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:00.215525 19987 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.217809 19573 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:00.217993 19987 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.218294 19573 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.218297 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.218954 19573 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.193801 20220 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.228147 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.229875 14962 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:07:00.233062 14894 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:00.237151 15549 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:00.241961 15548 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:00.243100 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.243983 14966 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.244683 19557 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:00.250566 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83917.4us
I20260709 13:07:00.252418 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.255015 14894 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:00.255563 14961 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:00.251863 19557 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.263789 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.238718 19987 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:00.269774 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.270949 19607 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:07:00.272698 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:00.275738 20267 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.139s	user 0.005s	sys 0.000s
I20260709 13:07:00.276219 20088 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.272428 19987 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.282747 20160 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.283986 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.284644 15544 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:00.283980 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.291234 20216 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.291911 20216 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.292474 20191 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.294152 20216 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.297122 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.298760 14966 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:07:00.298817 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1027) took 1924 ms. Trace:
I20260709 13:07:00.299082 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.300750 15039 rpcz_store.cc:276] 0709 13:06:58.374853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.375359 (+   506us) service_pool.cc:224] Handling call
0709 13:06:58.375696 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.622179 (+1246483us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:06:59.870301 (+248122us) log.cc:844] Serialized 14 byte log entry
0709 13:06:59.999636 (+129335us) log.cc:844] Serialized 14 byte log entry
0709 13:07:00.002554 (+  2918us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:00.003611 (+  1057us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:00.004667 (+  1056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:00.195534 (+190867us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b1800498d00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:07:00.196486 (+   952us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b1800498d00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:07:00.298491 (+102005us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54003331d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:00.298534 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.298658 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6271,"prepare.queue_time_us":292457,"prepare.run_cpu_time_us":121,"prepare.run_wall_time_us":122,"raft.queue_time_us":40155,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":12461,"spinlock_wait_cycles":2877476608,"thread_start_us":328564,"threads_started":2,"wal-append.queue_time_us":211377}
I20260709 13:07:00.303803 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2649) took 2054 ms. Trace:
I20260709 13:07:00.304375 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:00.304215 14888 rpcz_store.cc:276] 0709 13:06:58.249812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:58.249975 (+   163us) service_pool.cc:224] Handling call
0709 13:06:59.905292 (+1655317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:06:59.905836 (+   544us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:06:59.905874 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:06:59.905940 (+    66us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:06:59.905998 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:06:59.906089 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:00.303472 (+397383us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b54000cd350. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:00.303607 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3806096640}
I20260709 13:07:00.305774 20216 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:00.306202 20216 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:00.306548 20216 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:00.310317 20265 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:07:00.311838 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:00.314854 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.320940 14895 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:00.316551 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.317330 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.321767 19607 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:00.322216 19607 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:00.322674 19607 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.318651 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.319375 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.320142 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.330597 20220 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:00.330927 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47142.5us
I20260709 13:07:00.332780 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.332813 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.334157 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.327970 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:00.300203 19987 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.347812 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.348165 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.349076 14793 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 7 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:00.278708 20221 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.358410 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.358718 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.361114 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.361788 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.362247 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.363272 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.364362 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:00.367527 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 97068.9us
I20260709 13:07:00.318634 20216 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.361208 19573 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.401618 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.385061 14895 raft_consensus.cc:2368] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11.
I20260709 13:07:00.384196 15541 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:00.376273 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 63786.7us
I20260709 13:07:00.401255 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.395630 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.386986 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.391213 14936 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:00.419159 14893 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:00.386240 14887 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:00.422401 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.420030 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.384514 14793 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:00.424155 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.384429 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.389056 20221 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.428256 14966 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:00.433948 14963 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:00.375934 20088 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.397583 19573 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.393110 20216 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:00.436549 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52369us
I20260709 13:07:00.383961 20215 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:07:00.440519 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.440933 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.441215 20215 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:00.441648 20215 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:00.442737 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.382225 19607 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.447526 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.447710 20172 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:00.448170 20172 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:00.448529 20172 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:00.437662 20170 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.450441 14793 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:00.437902 19806 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:00.454085 14793 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.371361 20131 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.460210 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.461263 19806 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:00.461645 19806 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:00.461988 19806 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.461889 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.463757 20165 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:00.445314 20220 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:00.465766 20220 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.469484 20220 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.472165 19806 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.482218 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.487984 20215 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.489054 20215 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:00.501173 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 150850us
I20260709 13:07:00.475688 20172 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:00.503831 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 102671us
I20260709 13:07:00.508239 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.508381 20216 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:00.509730 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.478343 19607 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.510464 20216 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:00.511564 14890 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 9: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:00.510644 20170 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.479938 19806 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.518662 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:00.519515 14889 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:00.520813 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.524171 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:00.527885 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 136878us
I20260709 13:07:00.528973 20170 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.529395 20170 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.529762 20170 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.529995 20172 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.524999 20131 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.530793 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 291) took 7981 ms. Trace:
I20260709 13:07:00.512226 14793 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:00.538655 20181 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:00.538849 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.548305 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.549044 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.548367 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.549218 14889 raft_consensus.cc:2368] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:00.551608 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.551184 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.555182 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.553535 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.556484 14966 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:00.558136 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.558633 14964 raft_consensus.cc:2376] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10. Re-sending same reply.
I20260709 13:07:00.559062 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.559293 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.561412 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:00.562523 20181 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:00.567539 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.569135 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.569443 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.569912 20181 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.570044 14895 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.570855 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.576153 14887 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:00.577586 14895 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:07:00.578991 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:00.581482 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:00.582320 20088 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:00.582705 20088 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.583065 20088 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.583972 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:00.584880 19607 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:00.531163 14792 rpcz_store.cc:276] 0709 13:06:52.549564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.549800 (+   236us) service_pool.cc:224] Handling call
0709 13:07:00.530568 (+7980768us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:06:54.993340 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:06:55.109380 (+116040us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:06:55.112624 (+  3244us) write_op.cc:435] Acquired schema lock
0709 13:06:55.112650 (+    26us) tablet.cc:662] Decoding operations
0709 13:06:55.143338 (+ 30688us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:06:55.143402 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 13:06:55.143455 (+    53us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:06:55.144767 (+  1312us) tablet.cc:701] Row locks acquired
0709 13:06:55.144790 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:06:55.151210 (+  6420us) write_op.cc:270] Start()
0709 13:06:55.172401 (+ 21191us) write_op.cc:276] Timestamp: P: 1783602415144928 usec, L: 0
0709 13:06:55.172459 (+    58us) op_driver.cc:348] REPLICATION: starting
0709 13:06:55.226449 (+ 53990us) log.cc:844] Serialized 5961 byte log entry
0709 13:06:56.046600 (+820151us) op_driver.cc:464] REPLICATION: finished
0709 13:06:56.769635 (+723035us) write_op.cc:301] APPLY: starting
0709 13:06:56.805609 (+ 35974us) tablet.cc:1367] starting BulkCheckPresence
0709 13:06:58.788483 (+1982874us) tablet.cc:1370] finished BulkCheckPresence
0709 13:06:58.788614 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:06:59.706717 (+918103us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:06:59.707124 (+   407us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:06:59.707187 (+    63us) write_op.cc:312] APPLY: finished
0709 13:06:59.707704 (+   517us) log.cc:844] Serialized 139 byte log entry
0709 13:06:59.720670 (+ 12966us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:59.720884 (+   214us) write_op.cc:454] Released schema lock
0709 13:06:59.720964 (+    80us) write_op.cc:341] FINISH: Updating metrics
0709 13:06:59.721474 (+   510us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:06:59.721513 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1129980,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":713008,"apply.run_cpu_time_us":32067,"apply.run_wall_time_us":2959958,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":335214,"prepare.run_cpu_time_us":13917,"prepare.run_wall_time_us":372673,"raft.queue_time_us":106467,"raft.run_cpu_time_us":43773,"raft.run_wall_time_us":304178,"replication_time_us":868347,"thread_start_us":612731,"threads_started":5,"wal-append.queue_time_us":525900,"wal-append.run_cpu_time_us":6930,"wal-append.run_wall_time_us":1502874}]]}
I20260709 13:07:00.587529 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:00.590770 19607 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:00.591212 19607 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.579038 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:00.577837 20181 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:00.591699 19607 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.590885 20088 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.604179 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.606158 14793 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.607686 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:00.615608 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.616760 20131 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:00.617374 20131 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:00.617859 20131 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.608942 20220 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:00.620774 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.621354 20220 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.621928 20220 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:00.605677 20172 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:07:00.625094 20172 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:00.625475 20172 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:00.626425 20172 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.627635 20172 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:00.609660 20160 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:00.627697 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48762.7us
I20260709 13:07:00.628512 19987 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.641881 15548 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:00.629431 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.632144 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.632819 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.646755 15044 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:00.646561 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.647253 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.647517 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.647982 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:00.666738 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:00.648445 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50350.7us
I20260709 13:07:00.641942 20160 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:00.649544 20170 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.649770 20246 raft_consensus.cc:2764] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:00.642099 19987 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:00.647557 15041 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:00.652456 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.657990 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:00.659456 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:00.660365 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:00.666740 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:00.673498 14933 leader_election.cc:400] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:00.674219 15037 raft_consensus.cc:2410] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:07:00.675477 14933 leader_election.cc:403] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:00.676200 20223 raft_consensus.cc:2764] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:00.676543 15040 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:00.677030 15546 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.677698 15541 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:00.667522 14793 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 16 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:00.687661 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.692461 15039 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:07:00.693212 15547 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.669765 20160 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:00.694880 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51560.3us
I20260709 13:07:00.695343 20221 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.679313 19987 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.698334 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:00.703819 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58022.4us
I20260709 13:07:00.696671 14793 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 11, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:00.706450 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.707028 14961 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.710531 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.715597 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.709446 20155 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:00.719337 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.719784 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:00.718533 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:00.736013 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 136419us
I20260709 13:07:00.710579 19607 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.738845 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.742954 19933 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:00.743532 19933 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.723352 20155 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:00.752454 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.755131 20170 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.742924 14793 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 16, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:00.758417 14793 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 11 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:00.751945 19933 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:00.765798 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.769659 20221 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:00.743957 20191 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:00.771600 20191 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.772004 20191 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.773861 20155 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.779965 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.780920 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.784471 20191 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.785962 19933 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.787670 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.782171 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.792054 20191 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.792755 15043 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:00.794546 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.793588 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.796742 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.797307 15036 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:00.793509 14793 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.798417 14793 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.803182 20088 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:00.804181 20273 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:00.803815 19987 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.804842 19933 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.747560 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:00.821357 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:00.736099 20220 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:00.826323 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 88238.2us
I20260709 13:07:00.811829 19607 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:00.823827 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:00.830165 20216 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.829666 14793 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 16, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 16 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:07:00.831015 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75917.8us
I20260709 13:07:00.832612 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.834329 15044 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:00.837179 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:00.837749 20220 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.837899 14962 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:00.841300 15546 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:00.831614 20131 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:00.840646 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 105902us
I20260709 13:07:00.844787 14961 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
W20260709 13:07:00.847263 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 95377.2us
I20260709 13:07:00.831312 20223 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:00.850498 20220 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:00.850726 20223 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:00.851110 20220 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:00.851208 20223 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:00.852183 20220 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.852840 14793 catalog_manager.cc:5697] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 12, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.854610 15042 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:00.838624 20221 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.855743 20221 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.857797 20221 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.859355 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:00.859807 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.864830 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.865921 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.868021 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:00.869414 19987 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.870688 20181 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:00.871507 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:00.873936 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:00.874513 15042 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.874625 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:00.876085 19607 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:00.876212 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:00.876502 19607 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.876881 19607 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:00.877506 20216 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:00.877866 20216 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.878203 20216 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:00.879908 15547 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:00.849938 14967 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:00.854741 14793 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:00.886098 15044 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:00.877059 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:00.890507 15042 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:00.900759 20220 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:00.901242 20220 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.901733 20220 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:00.909184 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.909869 15035 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:00.911525 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.912135 15035 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:00.913050 14793 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 13, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:00.914629 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.915614 20131 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:00.916277 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:00.916482 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67418.3us
I20260709 13:07:00.917215 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:00.917994 19933 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.922384 20181 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:00.924238 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:00.925676 20215 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:00.926092 20215 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:00.926227 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:00.926505 20215 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:00.927549 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 78889.6us
I20260709 13:07:00.930332 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.930902 14967 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:00.932291 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.932612 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.933643 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.933439 20220 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.915220 14793 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:00.886065 20088 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:00.934033 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57067.9us
I20260709 13:07:00.934752 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.934945 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:00.935792 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:00.937376 15550 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:00.937498 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.938987 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:00.948994 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:00.975301 14967 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:00.976361 15042 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:00.936795 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.952854 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:00.957010 20221 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:00.974474 15549 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:00.957139 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:00.962145 15542 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:00.935698 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.982398 15541 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:00.980320 15547 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:00.985401 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.937836 20220 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:00.987313 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:00.991153 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:00.991549 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:00.994735 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66071.6us
I20260709 13:07:00.994756 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:00.992280 20155 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:00.998116 15544 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:00.959496 20246 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:07:00.939662 20160 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:00.963074 19607 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.011487 20220 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.013319 19607 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:01.019869 20160 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:01.003696 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.004133 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:00.994196 20181 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:01.030447 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77781.4us
I20260709 13:07:01.030733 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:00.938160 20223 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:00.993939 20191 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:01.001894 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.023833 15549 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:01.024966 15543 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:01.025449 15545 raft_consensus.cc:2368] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:01.028221 20215 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.029160 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:01.032220 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 93429.3us
I20260709 13:07:01.034448 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:01.000711 20155 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:01.047580 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 52954.2us
I20260709 13:07:01.047613 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.055087 15513 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.058496 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:01.059122 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.050645 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.051331 14895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:01.059870 20223 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.046520 20155 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.060374 14895 raft_consensus.cc:606] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.060542 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.063477 19607 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.046295 19933 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:01.044262 20191 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:01.048532 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:01.066097 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:01.065635 20170 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:01.067656 20277 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.068332 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.067327 20170 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:01.068975 20170 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.069623 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.071689 20277 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:01.072541 20277 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:01.072582 19933 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:01.073829 19933 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.082000 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.071300 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.084108 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:01.084849 14969 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:01.085640 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.086830 20160 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.065809 20191 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.089116 14966 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:01.090257 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.090495 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.090732 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.091164 14961 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:01.091495 15043 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:01.091328 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:01.091812 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.092353 20160 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:01.092787 20160 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:01.093077 14968 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.093181 20160 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:01.094370 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.094854 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.095162 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.095669 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:01.096328 14962 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:01.092469 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.097921 14969 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:01.099841 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.100548 15513 leader_election.cc:400] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11.
I20260709 13:07:01.101336 15513 leader_election.cc:403] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:07:01.101274 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52453.2us
I20260709 13:07:01.103240 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:01.109416 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44006us
I20260709 13:07:01.104310 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.091131 15041 raft_consensus.cc:2368] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11.
I20260709 13:07:01.113029 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.116044 14963 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:01.106632 20160 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.119805 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.120711 14861 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.118681 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:01.124210 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.124912 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:01.126293 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:01.127614 15549 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:01.130060 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.131572 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:01.129315 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.107229 20286 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11.
I20260709 13:07:01.134295 15544 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:01.103055 20216 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.137032 14936 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.139518 20221 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.140905 20215 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.141319 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.141482 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.142192 14894 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:01.142784 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.144173 14891 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:01.144318 20155 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.144799 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.145298 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.147006 20286 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:01.122983 20277 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.147469 15545 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:01.145311 19607 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:01.148064 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.149179 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.149259 20170 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.149504 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:01.182925 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 64309us
I20260709 13:07:01.153820 14969 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:01.174201 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57518.4us
I20260709 13:07:01.173328 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:01.180675 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43716.5us
I20260709 13:07:01.180877 14889 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:01.180712 20286 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:01.181407 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.181520 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.184073 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:01.181929 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48033.8us
I20260709 13:07:01.184892 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.150821 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.188478 15039 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:01.150687 19987 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.191361 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.192747 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.194509 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.195698 15037 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:01.182453 20172 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:01.197893 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.201090 14893 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:01.202689 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.203194 15042 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:01.208679 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.209278 20216 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:01.198927 19933 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:01.209925 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.178149 20191 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.219043 20191 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.219770 15541 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:01.222007 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.222368 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.224126 20155 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.203891 20215 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.225284 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.197270 20247 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 13:07:01.192610 20127 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:07:01.226166 20277 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.226449 20247 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:01.226873 20247 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.226960 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:01.228354 20291 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:07:01.228694 19987 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:01.224128 20160 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:01.230192 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.230791 14966 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.230988 20170 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:01.227830 20247 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.232184 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.232733 20247 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.230348 20160 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.231011 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.233626 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.234241 14892 raft_consensus.cc:2376] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13. Re-sending same reply.
I20260709 13:07:01.227810 20286 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.239383 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.235963 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.240154 20220 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.240629 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:01.222182 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.236166 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:01.241310 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 51188us
I20260709 13:07:01.241202 14894 raft_consensus.cc:606] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:01.242149 14894 raft_consensus.cc:614] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:01.247493 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.247841 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.248278 19607 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:01.250602 14966 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:01.256978 19987 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:01.258695 20223 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:01.259088 20223 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.259939 20223 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.261113 20223 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:01.262269 15041 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:01.263571 19982 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:01.264062 19982 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:01.264483 19982 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.266072 15008 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.267760 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.256691 20181 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:01.272972 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63115.1us
I20260709 13:07:01.269488 20216 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:07:01.273859 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.275808 20290 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:01.275990 14893 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:01.277000 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.280236 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b9511e929bc448349baf940df42e2a22"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:01.280747 15040 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:01.278164 20170 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:01.283277 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.280838 14893 raft_consensus.cc:606] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:01.283427 20155 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:07:01.296638 20191 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.297622 20278 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:01.298010 20278 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.272341 19987 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:07:01.304592 19987 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:01.304931 19987 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.305785 19987 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.306393 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:01.307003 19987 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.309094 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:01.309224 19933 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:01.310534 20127 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:01.310959 20127 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.311896 20127 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.313119 20127 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:01.286156 20220 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:01.281932 20290 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:01.286492 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.320071 20215 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.320760 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.321668 20215 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.325870 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.326864 20284 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:01.327374 20284 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.328284 20284 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:01.330935 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.298869 20278 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.339645 20220 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:01.340368 20278 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.341017 19607 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:01.341650 19607 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.343806 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.344771 20246 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:01.344907 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.345224 20246 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:01.345721 20246 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.346406 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.347250 20274 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:01.348209 20274 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:01.349833 20274 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:01.355943 20246 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.342746 19607 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.359738 20246 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:01.360313 19607 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.369601 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:01.347790 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 64583.9us
W20260709 13:07:01.372169 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 94199.7us
I20260709 13:07:01.373291 15516 leader_election.cc:400] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11.
I20260709 13:07:01.372903 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.369086 20223 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:01.387559 20223 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:01.388068 20223 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.375326 20127 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:01.394835 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46075.7us
I20260709 13:07:01.391759 15008 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:01.379801 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.396063 20131 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:01.383504 20220 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:01.396847 20246 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:01.397254 20246 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.397574 20220 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:01.398001 20220 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.398062 20246 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.398976 20220 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.400406 20220 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.402158 20223 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.377346 20215 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.372156 20155 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:01.405877 20155 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:01.406240 20155 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:01.407684 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:01.385300 19982 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.396627 20172 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:01.419091 19557 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:01.419533 19557 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:01.419811 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.419919 19557 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.420136 19982 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:01.421286 19607 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:01.421759 19607 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:01.423364 19607 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.425069 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:01.426692 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55569.6us
I20260709 13:07:01.427395 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.422132 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.429629 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.433023 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:01.434914 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.433836 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.437187 15042 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:01.438560 15043 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:01.407132 20155 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.441370 15037 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:01.446332 19607 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.443487 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:01.430897 20294 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:01.454535 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 82826.5us
I20260709 13:07:01.454974 19607 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:01.458438 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.470729 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:01.472532 20155 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.468847 20181 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:01.475046 20292 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
I20260709 13:07:01.475749 20223 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:01.486213 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:01.489120 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58157.8us
I20260709 13:07:01.480296 19933 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.494120 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.493635 20215 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:01.498375 20215 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:01.498724 20215 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:01.495875 20290 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.503415 20296 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:01.504304 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.497829 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.511715 14969 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.514421 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:01.516271 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.522708 15543 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:01.489811 20246 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.525236 14969 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
W20260709 13:07:01.525938 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 98616.5us
I20260709 13:07:01.532552 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.533226 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.533617 19607 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:01.534134 19607 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.532729 15007 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.537508 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.509071 20296 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.539114 20296 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.536092 20172 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.555529 20127 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.496313 20216 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:07:01.556572 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:01.557183 20191 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:01.568326 20191 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:01.568663 20191 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:01.569535 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:01.569501 20191 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.557521 20277 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.548688 19557 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.570779 20191 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:01.560352 20170 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:01.560876 20215 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.571619 20290 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:01.571787 19933 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:01.572185 20290 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:01.572342 19933 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:01.572460 19557 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.573087 20290 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.573201 19933 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.562865 20274 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.572836 20215 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.573288 14966 raft_consensus.cc:2393] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:01.576817 20274 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:01.564283 19607 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.578778 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.579806 15040 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:01.581248 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:01.582336 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49679us
W20260709 13:07:01.583069 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.583014 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:01.584465 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 90439.5us
I20260709 13:07:01.594166 15550 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:01.595209 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.595762 20216 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:01.599170 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.600006 15039 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:07:01.600682 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.601147 15036 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:01.602741 19557 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:01.603596 15035 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:01.603261 19557 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.605325 19557 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:01.605496 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.605430 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.607322 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:01.609254 20181 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:01.609654 20181 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:01.613969 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 90759.7us
I20260709 13:07:01.610430 20181 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.617565 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.618165 20172 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:07:01.622506 20181 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.626417 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.627436 20303 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.627571 20301 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.627584 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.633126 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.636531 14966 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:01.640105 20294 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:01.624544 20305 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.641577 20306 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:01.641973 20306 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:01.642776 20306 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.644135 20310 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:01.645686 14894 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.645738 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.646620 14892 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:01.638559 20220 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:01.647485 14893 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:01.648612 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.650168 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.653191 14893 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:01.657505 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.659291 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.660320 14888 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:01.659519 14893 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:01.665568 14893 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.666379 14893 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.667234 14893 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:01.672184 20306 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:01.675611 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 58529us
W20260709 13:07:01.679224 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.679603 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.689102 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.689996 20303 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.691278 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.692550 19607 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.693423 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.693905 14893 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:01.700783 14859 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.688369 20220 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:01.702376 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.692011 20296 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:01.692589 20246 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.675546 20301 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:01.714217 20301 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:01.714593 20301 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:01.715319 20301 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.716646 20301 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:01.719728 20305 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:01.720305 20305 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.721243 20305 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.726990 20246 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:01.727530 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.728097 20246 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:01.728324 20274 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:01.728477 20246 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.729228 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.729350 20246 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.730015 20274 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:01.730422 20274 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:01.730628 20246 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:01.730814 20274 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.731727 20315 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.731575 19987 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:01.732118 20298 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:01.732936 19987 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:01.733181 20298 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:01.733323 19987 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.733680 20298 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.734292 19987 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.734566 20298 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.736455 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:01.737375 20172 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.746662 14888 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:01.746006 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:01.761245 15007 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.735400 19987 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.770522 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:01.747325 20298 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:01.777081 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.763888 20220 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:07:01.783174 19557 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:01.792498 15040 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:01.794834 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.795145 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.798401 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.744643 20310 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:07:01.763972 20303 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:01.790066 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:01.791564 15036 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:01.791776 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:01.808199 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.786741 14936 leader_election.cc:400] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:01.791810 20172 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:01.772204 20274 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.820210 20172 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:01.821152 20172 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.821869 20274 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:01.799804 19557 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:01.824077 19557 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.818171 20160 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:07:01.828655 20160 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:01.828975 20160 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:01.829777 20160 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:01.830967 20160 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:01.812326 20302 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:07:01.801076 20284 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:01.817188 15549 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:01.800014 19982 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:01.836410 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.841281 15035 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.841933 14966 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:01.836941 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:01.838111 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:01.843551 14967 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:01.802850 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.844805 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.818591 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:01.840183 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.839480 20215 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:01.847666 20314 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:01.850860 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48100.1us
I20260709 13:07:01.851825 14961 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.851900 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:01.850916 14968 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.862412 20284 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:01.849665 20215 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:01.870569 14961 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:01.877166 20305 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:01.878844 20310 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:01.879429 20310 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:01.881124 20310 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:01.883069 20310 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.886852 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:01.887674 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.887852 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.802807 19933 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:07:01.868429 20277 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:01.849736 20314 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:01.857194 20223 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:01.902184 20286 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:01.899762 14961 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:07:01.904368 14966 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:01.903695 20215 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:01.910228 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.910444 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:01.924929 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.869992 20191 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:07:01.863590 20290 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:01.971042 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.940412 14968 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:01.939342 14969 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:07:01.947289 15035 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:01.975394 15549 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:01.976573 14966 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:01.936340 20314 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:01.980284 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:01.981720 14970 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:01.982661 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:01.983794 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:01.984328 14962 raft_consensus.cc:2376] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12. Re-sending same reply.
I20260709 13:07:01.985960 15541 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:01.988394 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.930214 20284 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:07:01.994602 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 84452.3us
I20260709 13:07:01.995458 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:01.997391 20321 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:02.001672 19987 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:02.002228 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:02.002722 20322 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.003350 20322 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:02.003386 14859 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:02.004591 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:01.938310 20223 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.012451 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:01.994952 20221 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:02.019791 20221 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.021797 20221 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.025156 20274 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:02.025550 20274 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.026397 20274 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.016238 20321 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:02.029451 20274 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:02.031905 20325 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:02.032303 20325 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:02.033130 20325 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.034474 20325 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.035916 20247 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:02.036295 20247 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.037052 20247 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.038380 20247 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.040122 15035 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:01.994134 20284 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.019151 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:02.006646 20290 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:07:02.050948 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.053021 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:02.061312 14963 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:02.062796 14888 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:02.066174 14888 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:02.067370 20303 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:02.067636 20191 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:02.013172 19987 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:02.070979 20305 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:02.072925 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.075747 20215 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.073297 19933 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:02.076970 20215 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:02.077142 19933 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:02.078090 19933 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.079684 20327 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:02.085114 14969 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:02.088193 15035 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:07:02.091173 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 97868.8us
I20260709 13:07:02.072853 20284 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.093031 20290 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:02.094075 20284 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.059895 20246 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:02.092145 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.079355 19933 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.082793 19982 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:02.019523 20302 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:02.100907 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.108604 14966 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:02.088747 20305 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.115792 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.088688 19987 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:07:02.088963 20303 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 13:07:02.110030 20221 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:02.121239 20331 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:02.075742 20223 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.149138 14891 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:02.155851 20303 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:02.157029 20314 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.158205 14967 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:02.159087 20314 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.161684 20298 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:02.116451 19982 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.175164 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:02.116933 20172 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.179780 14968 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:02.194775 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 287) took 5982 ms. Trace:
I20260709 13:07:02.116451 20306 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:07:02.131212 20305 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.195377 14793 rpcz_store.cc:276] 0709 13:06:56.212738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:56.212906 (+   168us) service_pool.cc:224] Handling call
0709 13:06:56.508409 (+295503us) spinlock_profiling.cc:243] Waited 58.3 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:07:02.194702 (+5686293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:01.063142 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:01.063849 (+   707us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:01.066110 (+  2261us) write_op.cc:435] Acquired schema lock
0709 13:07:01.073477 (+  7367us) tablet.cc:662] Decoding operations
0709 13:07:01.075222 (+  1745us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:01.075308 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:01.075337 (+    29us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:07:01.076888 (+  1551us) tablet.cc:701] Row locks acquired
0709 13:07:01.076943 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:07:01.077123 (+   180us) write_op.cc:270] Start()
0709 13:07:01.133278 (+ 56155us) write_op.cc:276] Timestamp: P: 1783602421077043 usec, L: 0
0709 13:07:01.135480 (+  2202us) op_driver.cc:348] REPLICATION: starting
0709 13:07:01.144457 (+  8977us) log.cc:844] Serialized 6726 byte log entry
0709 13:07:01.587654 (+443197us) op_driver.cc:464] REPLICATION: finished
0709 13:07:01.669404 (+ 81750us) write_op.cc:301] APPLY: starting
0709 13:07:01.669500 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:01.710592 (+ 41092us) spinlock_profiling.cc:243] Waited 2.78 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7332a 00007f5534cf8f14 00007f5534cf8ec3 00007f5534cf8e38 00007f5534cf8df3 00007f5534cf80dc 00007f5534d21e16 00007f5534d09cbb 00007f5534cf439d 00007f5534cf7d75
0709 13:07:01.891896 (+181304us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:01.891951 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:02.034416 (+142465us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:02.034800 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 13:07:02.034848 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:02.035304 (+   456us) log.cc:844] Serialized 156 byte log entry
0709 13:07:02.071151 (+ 35847us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.090823 (+ 19672us) write_op.cc:454] Released schema lock
0709 13:07:02.107499 (+ 16676us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:02.154167 (+ 46668us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:02.154195 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1132,"reported_tablets":37,"spinlock_wait_cycles":134088960,"child_traces":[["op",{"apply.queue_time_us":79782,"apply.run_cpu_time_us":24720,"apply.run_wall_time_us":470414,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75187,"num_ops":17,"prepare.queue_time_us":68386,"prepare.run_cpu_time_us":33280,"prepare.run_wall_time_us":179505,"raft.queue_time_us":52790,"raft.run_cpu_time_us":7024,"raft.run_wall_time_us":179314,"replication_time_us":400863,"spinlock_wait_cycles":6401280,"thread_start_us":177109,"threads_started":4,"wal-append.queue_time_us":122950}]]}
W20260709 13:07:02.217653 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 101939us
I20260709 13:07:02.189946 20298 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:02.230334 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 158974us
I20260709 13:07:02.231011 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:02.234921 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.241122 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:02.254439 20336 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:07:02.273121 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.269181 20306 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:02.283638 20301 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 13:07:02.299106 20328 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.065s
W20260709 13:07:02.508879 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 204336us
I20260709 13:07:02.511433 19607 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.532716 19607 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.534899 19607 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.512569 20303 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.535851 20303 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.538336 20303 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.517030 20127 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.301398 20307 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.539300 20127 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.540858 20215 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.262904 19982 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.541816 20127 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.543583 15036 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:02.529033 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:02.398649 20298 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.552166 20337 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:02.555004 20155 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:02.555562 20155 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.562469 14890 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
W20260709 13:07:02.571652 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 252244us
I20260709 13:07:02.573273 20298 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.574183 20172 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:02.577642 20160 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.578130 20160 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.580268 20160 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.580977 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:02.581575 15543 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:02.584213 15543 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:02.584797 14893 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:02.586334 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.586488 20322 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.586946 20322 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.587563 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.588142 14894 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:02.587435 20337 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:07:02.588208 20191 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:02.592792 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.595708 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.596441 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:02.601063 20155 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.601383 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:02.603385 19557 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:02.607653 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:02.638836 15036 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:02.640208 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:02.608997 20247 consensus_meta.cc:287] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.003s
I20260709 13:07:02.615262 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.588881 20322 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.628815 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:02.645445 20246 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:02.645946 20246 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:02.646317 20246 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.648550 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:02.650065 20303 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:02.650458 20303 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.650765 20303 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.659029 20305 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.659596 20305 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.660545 20215 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:02.660955 20215 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:02.661671 20305 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.661798 20215 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.662979 20215 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:02.663203 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:02.664024 15039 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:07:02.665076 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:02.665903 20305 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:02.666294 20305 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.666647 20305 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.667382 20246 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.674871 14892 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:02.678157 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:02.678184 20277 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:02.678804 20246 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.678891 15039 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.679088 20277 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:02.642875 19557 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:02.679600 20277 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:02.679912 19557 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:02.680466 20277 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.681612 20277 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:02.668051 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:02.670537 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.684432 14966 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:02.670743 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.686519 15039 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:02.671396 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.689415 20305 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.691569 20305 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.691979 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:02.693038 20305 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:02.693536 20305 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.693578 20127 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:02.694103 20127 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.694474 20127 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.694489 20305 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.693658 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:02.700513 15039 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.705022 20246 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:02.705595 20246 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.705051 15036 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:02.709038 20246 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:02.710625 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:02.711606 15036 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:02.712540 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:02.700363 20303 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.701313 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:02.701354 14788 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.727167 15039 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:02.734392 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:02.735536 20277 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:02.745575 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:02.746532 19607 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:02.747054 19607 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:02.747579 19607 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:02.748227 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 475232us
I20260709 13:07:02.749708 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.763492 20351 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:02.764190 20351 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.765938 14966 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:02.766762 20351 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:02.768121 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.768766 14892 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:02.771341 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:02.738651 20160 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.775465 20325 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:02.775843 20160 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.776074 20325 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.777907 20160 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:02.778196 20325 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.738600 20246 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:02.774034 19982 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:07:02.780349 14788 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 12, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:02.770344 20298 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:02.782562 20303 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:02.782089 14788 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.788203 15035 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:02.789637 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.788594 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.793152 14892 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:02.798866 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:02.800431 19987 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:02.802659 19933 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:02.803188 19933 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:02.804550 19933 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:02.805063 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48146.5us
I20260709 13:07:02.811267 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:02.811359 20328 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:02.812139 14962 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:02.813866 20155 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:02.814313 20155 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:02.820402 14788 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:02.824536 14788 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:02.838461 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:02.791581 20351 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:07:02.839286 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 94919.4us
I20260709 13:07:02.839628 15541 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:07:02.839751 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.843354 14969 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:02.843708 19607 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.844686 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:02.795769 20246 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.850656 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:02.851365 15543 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:02.856508 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:02.819710 20305 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:07:02.861536 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:02.862874 20337 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:02.836264 20160 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:02.841677 20351 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:02.863230 20337 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:02.863749 20351 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.864066 20337 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:02.865867 20127 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.841427 20274 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 13:07:02.839294 20322 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:07:02.872225 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:02.875844 20307 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.876904 14968 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:02.876471 20307 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.878795 20305 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:02.879220 20305 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:02.863688 20160 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.879832 20246 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.880074 20337 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.880125 20305 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:02.881249 20160 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.881745 20305 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:02.884526 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:02.885293 15039 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:02.886507 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.890161 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:02.890666 15543 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:02.894799 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:02.895589 14894 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.906610 19607 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.947149 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:02.947095 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.909686 15039 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:02.820361 19982 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:02.838265 20155 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.955741 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:02.964421 15550 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:02.956414 15543 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 13:07:02.957310 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:02.963049 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:02.966303 20369 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.966926 20369 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.904927 20298 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:07:02.973549 20328 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:02.973834 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:02.975564 20331 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:02.969391 20369 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.957872 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.955896 20310 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:02.961082 15549 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:02.986651 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:02.962067 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:02.883049 19933 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.988983 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.989559 14964 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:02.989784 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:02.990124 19933 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:02.991371 15036 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
W20260709 13:07:02.948202 20367 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:07:02.966643 15547 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:02.981560 14963 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:02.970788 19557 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:02.957476 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:02.987306 15545 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:02.976225 20331 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:02.992455 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:02.905961 20337 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:02.994217 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:02.995311 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.019528 15036 raft_consensus.cc:1813] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Handling vote request from an unknown peer 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:03.019618 15037 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:02.996834 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.000670 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:03.020502 15036 raft_consensus.cc:2410] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 13:07:03.004830 20221 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:03.024955 15043 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:03.006541 20351 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.008750 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:03.012580 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:02.986456 20127 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:02.987519 20307 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.020408 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:03.029090 15541 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:07:03.030910 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46643.8us
I20260709 13:07:03.034261 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:03.036397 20160 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:03.036805 20160 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.037134 20160 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:02.998948 20155 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.040614 15036 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:03.042680 15037 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:03.044118 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.044593 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:03.044785 14890 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.047075 20170 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:03.028728 19933 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:03.044236 20353 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:07:03.053084 19982 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:03.053190 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44527.2us
I20260709 13:07:03.053715 19982 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.054643 19982 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.043993 20346 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:03.057175 19987 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:03.059029 20351 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:02.996459 20310 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.059916 20364 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.055351 14894 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:03.072399 15036 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:03.077006 15550 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:03.075727 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.083256 20364 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.085546 20364 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.074087 20290 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:03.088476 20160 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.089607 15549 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:03.092046 20310 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.099753 14890 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:03.104298 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:03.105176 15549 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:03.109395 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.110996 20346 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:03.109762 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.114156 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.115428 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.120203 19933 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:03.113977 20223 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:07:03.121539 20215 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:03.121958 20215 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:07:03.121985 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 92632.3us
I20260709 13:07:03.116986 20246 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:03.123523 20246 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.123960 20246 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.124033 20352 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:03.125217 20352 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:03.125463 19557 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.125595 20352 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:03.126552 20352 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.116524 20346 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.128846 19933 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:03.129132 20346 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.107861 20310 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:07:03.129725 19933 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.130445 20310 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:03.130843 20310 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.131668 20310 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.133035 20310 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.132913 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:03.134253 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.134824 14966 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:03.135706 20307 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:03.136507 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.094659 20220 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:03.140105 20220 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:03.141114 20352 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.146608 20274 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:03.141001 20220 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.147027 20274 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.147818 20274 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.142028 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.119211 15043 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:03.135650 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.149752 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:03.163228 14894 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:03.148981 20274 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.165629 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.174739 15036 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:03.179698 14890 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:03.182134 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.184983 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:03.185804 15547 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:03.184425 20221 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:03.193670 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.197975 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.166460 20290 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.194487 14966 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.122951 20215 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.202788 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:03.116093 20322 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:07:03.188951 20221 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.207876 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.220098 20322 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:03.220562 20322 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.221508 20322 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.222826 20322 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.226271 20221 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.213997 20290 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.236198 20290 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.210690 20246 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.244740 14966 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:03.250473 15036 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:03.204928 20172 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:07:03.263157 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44302.4us
I20260709 13:07:03.240968 20301 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:03.269970 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 68454.2us
I20260709 13:07:03.275348 19607 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:03.251204 20346 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:03.276058 19607 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:03.279388 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 90883.5us
I20260709 13:07:03.280092 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:03.240912 19987 consensus_queue.cc:1175] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25b8f0cc46f748468395543b8b174bf4" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 9 index: 9 } }
I20260709 13:07:03.282176 20353 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:03.282720 20353 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:03.265009 20332 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 13:07:03.283890 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.283728 20353 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.284642 14890 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.285557 20346 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.265359 20160 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.268085 20172 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:03.312419 19607 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.312527 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.313388 14890 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.313475 20246 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.314240 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.314826 15036 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.316784 20305 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Committing config change with OpId 14.11: config changed from index 5 to 11, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:03.318678 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 135514us
I20260709 13:07:03.342545 15043 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 5 to 11, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:03.351747 20172 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.356439 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.357431 15036 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:03.341457 20284 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.360451 20274 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.390373 20284 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.390499 20274 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.392040 20215 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.392454 20284 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.393126 20274 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.360649 20277 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.394008 20277 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.361423 14892 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.397414 20277 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.366170 19607 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.399925 19607 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.402009 19607 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.375627 20369 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.358498 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:03.404042 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45635.5us
I20260709 13:07:03.404141 20274 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:03.404799 20274 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.403337 20369 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.405730 20274 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.406814 20369 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.411458 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.412029 15035 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:03.375842 20346 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.386415 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:03.387130 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:03.387130 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.415392 15547 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:03.415750 15036 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:03.415441 15541 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:03.413894 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:03.416903 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.417394 15545 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.414187 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:03.408010 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.418227 15543 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:03.419350 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.417402 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.420074 15036 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:03.420477 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:03.409185 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.420790 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.415215 20220 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.421653 20220 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.422005 15550 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:03.421051 15041 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:03.423692 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.424268 14962 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:03.425262 14890 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:03.426973 20170 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.427524 20170 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.418289 14892 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:03.429219 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.428565 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.429874 14890 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:03.432233 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:03.433252 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.434615 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.435837 19607 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:03.436261 19607 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.436609 19607 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.436959 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.440861 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:03.441694 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.442533 14970 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:03.444106 20088 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.444499 20088 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.445608 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:03.446655 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:03.444950 20298 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.448102 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.448351 20298 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.448688 14962 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:07:03.448843 20303 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:03.449199 20303 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:03.449573 20303 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.451704 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:03.452044 20383 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:03.452692 20383 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:03.453007 20383 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.453383 20383 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.454757 15545 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:03.379151 20290 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.455684 20344 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:03.483826 20344 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:03.484256 20344 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:03.487756 15547 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:03.444841 20088 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.489118 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:56542 (request call id 0) took 6077 ms. Trace:
I20260709 13:07:03.489524 15043 rpcz_store.cc:276] 0709 13:06:57.411677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:57.411947 (+   270us) service_pool.cc:224] Handling call
0709 13:06:57.601551 (+189604us) log.cc:844] Serialized 494 byte log entry
0709 13:07:03.489008 (+5887457us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98646,"raft.queue_time_us":387115,"raft.run_cpu_time_us":5837,"raft.run_wall_time_us":248138,"thread_start_us":799103,"threads_started":2,"wal-append.queue_time_us":927034,"wal-append.run_cpu_time_us":21527,"wal-append.run_wall_time_us":1990894}
I20260709 13:07:03.490317 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.490958 14969 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:03.456826 19982 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:03.491371 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 13:07:03.491843 19982 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.492331 19982 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.448693 20298 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.457767 20337 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:03.459513 20365 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:03.496778 20365 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:03.497146 20365 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.499691 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.500305 14969 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:03.502848 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.460321 20388 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:03.509155 20388 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.509529 20388 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.510105 20366 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:03.510545 20366 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.510895 20366 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.518602 20366 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.519667 20301 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:03.467386 20170 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.469965 15035 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:03.476917 20220 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.482602 20346 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:03.536538 20346 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.538679 20346 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.531586 20337 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:03.520203 20301 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:03.521921 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60130.6us
I20260709 13:07:03.549778 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.550329 14970 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.562041 20301 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.564044 20088 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.533095 20298 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.567438 20298 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.569268 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:03.570251 15545 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.575742 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.576493 14892 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.576635 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:03.577447 15545 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.581643 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:03.582587 15541 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:03.581632 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.581775 15010 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.583874 15010 leader_election.cc:403] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.583871 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.571678 15549 raft_consensus.cc:2955] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 5 to 11, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:03.584765 14894 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.576686 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.587276 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.525295 20303 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.598624 15545 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:03.578688 19607 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.600488 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.573122 20088 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.567152 20322 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:07:03.591468 20346 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.612700 19607 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.618162 14970 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:03.591385 20127 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:03.622689 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.623328 14894 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.625653 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:03.626418 20337 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:03.625715 20383 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.633975 20383 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.635758 19933 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:03.636322 19933 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:03.637221 19933 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.637850 20303 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.605970 20344 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.640647 20344 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.628363 20127 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:03.642270 20127 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.644572 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.645035 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:03.645238 14890 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.651079 20366 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.653291 19982 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.657779 20365 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.656791 20290 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.660027 20365 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.661300 20388 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.662407 15035 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.669759 15549 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:03.673013 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:03.673679 15547 raft_consensus.cc:2368] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.675026 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.628051 20337 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.675611 14969 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.676249 20337 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.676865 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.678331 20366 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:03.678870 20366 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:03.679960 20366 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.685348 20277 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.685948 20277 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.689284 15010 leader_election.cc:400] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.689673 15010 leader_election.cc:403] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.690361 14894 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:03.691738 14890 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:07:03.692201 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 170667us
I20260709 13:07:03.694809 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.695533 14966 raft_consensus.cc:2368] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.696715 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.697304 14962 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:03.697063 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.698415 15043 raft_consensus.cc:2368] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:07:03.701663 14892 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:03.701862 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.694675 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.702421 14961 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:03.702898 14890 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:03.705246 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.706084 14966 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.706292 14970 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:03.709698 19607 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.711182 19607 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.708915 14969 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:03.713524 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.714717 15039 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:03.717197 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.690618 20388 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.718482 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.735252 19607 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.718354 15036 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:03.733577 14936 leader_election.cc:400] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:07:03.736372 14936 leader_election.cc:403] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:07:03.734027 15008 leader_election.cc:400] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.743557 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.744854 19607 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:03.745639 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:03.746166 14964 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.748730 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.749065 14961 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:03.749279 15040 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:03.715606 20277 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.750288 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.750725 14894 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:03.750898 14970 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:03.754318 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.717957 19982 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:03.704847 20290 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 13:07:03.760217 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:03.734802 20369 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:03.773880 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.774621 14894 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.767699 15040 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:03.768500 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:03.770313 15039 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:03.770787 15035 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:03.772023 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.772562 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.772775 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.780328 14889 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:03.774642 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.776408 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.757606 20088 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.761765 20305 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:07:03.784260 20369 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.808388 20383 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:03.783716 20365 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.834129 14893 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:03.840929 19557 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:03.824652 19982 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:03.823953 20170 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:03.832791 20369 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:03.830953 20191 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 13:07:03.842273 20383 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:03.829487 20088 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.863699 14966 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:03.884555 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:03.887131 14889 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:03.894604 19607 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:03.852090 19982 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:03.898451 14962 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:03.900390 19933 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:03.876603 20220 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.852164 20170 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.905356 19607 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:03.910895 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 165782us
I20260709 13:07:03.878541 20328 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:07:03.919840 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:03.911017 19933 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:03.898133 20366 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
W20260709 13:07:03.931010 20394 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:07:03.927079 20383 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.934738 20170 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.935523 19982 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.912359 20220 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:03.939831 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.942279 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:03.945906 14893 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:03.947741 20088 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.957499 15039 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:03.957823 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:03.926792 20127 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.964999 20127 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:03.969028 20346 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:03.970517 19933 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.975698 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:03.975945 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:03.976338 14963 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:03.976596 14888 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:03.977368 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:03.977895 20401 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:03.978286 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:03.979632 20220 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:03.980041 20088 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:03.955811 20322 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:03.980919 15035 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:03.978320 20401 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.982167 20401 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:03.980947 20322 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.985636 20332 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:03.980417 20088 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:03.992002 20088 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:03.994675 20369 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:03.997514 15545 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:04.001845 20331 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:07:04.003571 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45859.1us
I20260709 13:07:04.004097 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:04.004289 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:04.004726 14895 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:04.005048 20170 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:04.006291 14889 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:07:03.959827 14964 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:04.005600 20170 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:04.008380 20365 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:04.008924 20365 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:04.009775 20365 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.011372 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:04.017442 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:04.018443 14963 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:04.020159 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:04.026080 15549 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:04.027343 14964 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:04.028658 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:04.030553 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.037075 15541 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:04.038287 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:04.043620 20301 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:04.031083 20322 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.044273 20332 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:04.048128 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:04.009020 20170 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.048056 20332 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.031271 20307 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 13:07:04.020188 15043 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:04.112278 19982 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.112808 19982 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.114815 19982 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.117475 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.118093 15550 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:04.088167 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:04.061690 20332 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.062228 20346 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:04.125092 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 87194us
I20260709 13:07:04.081173 20223 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:04.086895 20353 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.132640 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:04.143010 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 94947.7us
I20260709 13:07:04.146763 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:04.147794 19607 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:04.148226 19607 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:04.148568 19607 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:04.125895 20346 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.159195 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:04.163087 20346 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.134652 20384 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:07:04.161563 20400 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.142390 20127 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:07:04.137519 20223 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.146799 20353 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:04.179867 20395 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.248s	user 0.004s	sys 0.000s
I20260709 13:07:04.182644 20353 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:04.186955 20403 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 13:07:04.189672 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:04.190392 14890 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:04.172091 20369 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.198617 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:04.187989 20400 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.195252 19607 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:04.207647 20337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.008s	sys 0.003s
I20260709 13:07:04.261248 19607 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.218828 20314 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:04.269042 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 116202us
W20260709 13:07:04.266512 20337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.008s	sys 0.004s
I20260709 13:07:04.272670 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:04.273880 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:04.274508 14890 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:04.276757 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:04.277773 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 127966us
I20260709 13:07:04.286204 19607 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:04.286682 19607 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.286787 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:04.267161 20301 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:04.287106 19607 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:04.268247 20314 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.296010 20314 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:04.324167 20415 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 13:07:04.326799 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:04.337801 20410 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:07:04.346979 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:04.348579 20274 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:04.349035 20274 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.349436 20274 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.317377 20353 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.355744 20353 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.357748 20353 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:04.362337 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:04.362955 14890 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:04.379061 19607 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.386209 19607 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.410138 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:04.412834 14964 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:07:04.413887 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 118474us
I20260709 13:07:04.423668 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:04.424431 14964 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:04.424908 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:04.433764 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:04.427646 20223 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.453329 20088 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.454332 20352 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:04.454783 20352 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.455150 20352 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.464597 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.415877 20301 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.459784 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:04.473987 14895 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.461021 15550 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:04.465332 15549 raft_consensus.cc:2368] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
W20260709 13:07:04.457916 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 68221.9us
W20260709 13:07:04.468003 20422 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:07:04.469559 20401 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.483737 15036 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:04.484745 20401 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.472397 20088 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.476033 14861 leader_election.cc:400] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:07:04.494274 14861 leader_election.cc:403] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:04.477149 20429 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:07:04.477747 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:04.479620 15039 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:04.495814 19933 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:04.481159 15037 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:04.508469 20307 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.508988 20307 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:04.522099 20397 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.600s	user 0.001s	sys 0.007s
I20260709 13:07:04.529796 15039 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.531067 20277 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:04.534277 20352 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.534969 20290 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:04.537182 20328 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:07:04.539490 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61820.7us
I20260709 13:07:04.542841 15547 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 13:07:04.551246 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:04.551620 14895 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:04.551877 14966 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.628850 15039 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:04.642922 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 89141us
I20260709 13:07:04.643703 15035 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:07:04.650406 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 100748us
I20260709 13:07:04.653004 14888 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:04.656739 14966 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:04.653716 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:04.661616 19557 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.663108 19557 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.540386 20328 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:07:04.673146 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 235967us
I20260709 13:07:04.629096 20305 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:07:04.651319 20221 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.674455 20223 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.696871 19557 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.697209 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:04.699965 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 153652us
I20260709 13:07:04.702507 15038 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:04.703902 20402 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:04.704468 20402 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.712090 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:04.713182 15044 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:04.667176 20337 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:04.717316 14964 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:04.719645 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:04.723793 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:04.724426 14895 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
W20260709 13:07:04.722960 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73700us
I20260709 13:07:04.694811 20383 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.679260 20346 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.688751 19933 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 13:07:04.731546 20088 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:07:04.737306 15040 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:04.714617 20223 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.740154 20223 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.741334 20307 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:04.742250 20332 consensus_meta.cc:287] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.002s
I20260709 13:07:04.722267 20328 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.742646 20332 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.743202 20328 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:04.744586 20332 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.691505 20221 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.746762 20383 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:04.747592 20221 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.747706 20383 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.748320 14888 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:04.748925 19933 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.749389 19933 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.735002 15547 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:04.723624 20388 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:04.758683 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 105050us
W20260709 13:07:04.765368 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62827.7us
I20260709 13:07:04.767736 20274 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.769285 20400 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.769809 20274 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.758826 20352 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:04.751739 20314 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.772497 20314 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:04.751242 19933 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:04.773025 20388 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.783092 20332 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:04.804714 20274 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:07:04.813366 20388 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:04.816923 20421 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.405s	user 0.002s	sys 0.009s
I20260709 13:07:04.801052 20332 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:04.822176 20332 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.828065 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:04.830042 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:04.834934 20402 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:04.835045 20443 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 13:07:04.841781 20400 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:04.855737 20446 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:04.856345 20446 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.858664 20446 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:04.868731 14895 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:04.869459 14890 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:04.869690 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:04.871084 14888 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:04.874513 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:04.874753 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.875164 15549 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:04.875607 15550 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:07:04.878654 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:04.882220 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:04.882905 14890 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:04.883757 15549 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:04.884300 14890 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:04.884608 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:04.886078 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:04.888309 15549 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:04.892050 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:04.845701 20301 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:07:04.899289 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 74323.8us
I20260709 13:07:04.901432 14967 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:04.902400 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:04.903101 14964 raft_consensus.cc:2368] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15.
I20260709 13:07:04.910952 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:04.914424 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:04.919041 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:04.919850 14964 raft_consensus.cc:2410] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:04.922272 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.926666 15549 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:04.927428 14890 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:04.928884 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:04.928905 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:04.930830 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:04.931577 14967 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:04.935362 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.936074 15541 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:04.936930 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:04.929941 20337 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:04.937875 20337 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:04.937155 19933 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:04.938898 20446 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:04.942420 19933 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:04.969764 20446 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:04.969887 19933 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:04.970177 20446 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:07:04.972939 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 144962us
I20260709 13:07:04.964339 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:04.936981 20322 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:04.981118 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:04.979161 14893 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:04.999169 20455 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:05.002274 20088 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:05.002429 20424 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.552s	user 0.001s	sys 0.000s
I20260709 13:07:05.002838 20088 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.003384 20337 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:04.993909 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:04.976301 20301 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 13:07:05.012609 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:05.013500 20088 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:05.014921 20246 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:05.015453 20246 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:05.016328 20246 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.024324 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:05.009688 20303 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:05.029845 20450 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:05.003983 20322 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:05.037536 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:05.045336 20393 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:05.045881 20393 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:05.048545 20322 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.028746 20301 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:05.050767 20439 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:07:05.055688 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:05.039081 20303 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.060889 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:05.070554 15549 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:05.061687 15550 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 10: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:05.062052 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.074649 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.075109 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.075861 14963 raft_consensus.cc:2368] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
W20260709 13:07:05.050954 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61358.2us
I20260709 13:07:05.052785 20450 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:05.025983 20365 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:07:05.069649 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:05.083989 15543 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:05.095191 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:05.095434 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 369440us
I20260709 13:07:05.084800 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:05.094676 15545 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 13:07:05.102805 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.103619 14969 raft_consensus.cc:2368] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:05.075371 14968 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:07:05.105717 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:05.111713 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:05.112095 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:05.112437 15044 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:05.116376 20450 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.117432 20453 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:05.117937 20453 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.119939 20453 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:05.120398 20453 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:05.120744 20453 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:05.121438 20453 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.122356 20453 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:05.127336 20352 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:07:05.130771 20456 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:05.131635 20456 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:05.131933 20456 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:05.132704 20456 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.135054 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:05.135592 14894 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:05.139555 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:05.148036 14965 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:05.133837 20456 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:05.158304 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:05.158329 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 145786us
I20260709 13:07:05.159097 14969 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:05.159463 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:05.160418 20274 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:05.169937 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.093981 20303 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:05.113049 20215 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:05.171845 20215 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.172220 20215 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:05.173269 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:05.177057 14962 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:05.171178 14894 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:05.188580 14859 leader_election.cc:400] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13.
I20260709 13:07:05.157893 20328 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:05.200770 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:05.210258 20328 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.240638 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:05.206547 19933 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.243554 14859 leader_election.cc:400] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:05.244029 14859 leader_election.cc:403] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:05.246291 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45648.7us
I20260709 13:07:05.046777 20393 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.257714 14961 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:05.271479 19933 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:05.253065 20352 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:05.255668 20310 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:05.338601 20446 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.341351 20435 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.341918 20435 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:05.344079 20405 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 13:07:05.345203 20462 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:07:05.345494 20444 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:07:05.347424 20328 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:05.348280 14888 raft_consensus.cc:2368] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:07:05.328510 20436 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 13:07:05.352413 20422 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:05.354344 20346 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:05.340917 20446 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:05.424167 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:05.426160 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 165286us
I20260709 13:07:05.410214 20284 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:05.445811 14893 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:05.445694 20352 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:07:05.455848 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.437665 20215 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.439311 20284 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.469388 20215 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:05.471563 20284 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:05.473184 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:05.481914 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:05.485219 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2510) took 1495 ms. Trace:
I20260709 13:07:05.485594 15036 rpcz_store.cc:276] 0709 13:07:03.989861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:03.990410 (+   549us) service_pool.cc:224] Handling call
0709 13:07:03.990653 (+   243us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:04.484107 (+493454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:05.485024 (+1000917us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54001f45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:05.485165 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1133604736}
I20260709 13:07:05.486218 14890 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:05.492169 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:05.493083 14968 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:05.501987 14886 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:05.519562 19933 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:05.514015 20447 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:07:05.519693 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:05.532850 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:05.533437 15550 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.535970 20443 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:05.552762 14964 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:05.592914 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:05.517652 20352 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.576017 20443 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:05.597705 20215 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:05.597858 20303 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.616809 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:05.599303 20441 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:07:05.649421 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:05.650084 14892 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:05.651724 15040 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:05.652356 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:05.652917 14892 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:05.653802 14933 leader_election.cc:400] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:07:05.654134 14933 leader_election.cc:403] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:05.654690 20476 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:05.655227 20476 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:05.656106 20221 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:05.656208 20476 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.659479 15008 leader_election.cc:400] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15.
I20260709 13:07:05.660554 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:05.661295 20393 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:05.661921 20459 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.330s	user 0.003s	sys 0.000s
I20260709 13:07:05.661795 20393 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.619966 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.623046 14967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:07:05.665120 14967 raft_consensus.cc:606] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:05.665593 14967 raft_consensus.cc:614] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:05.633122 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:05.633602 15044 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:05.637033 15550 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:05.670248 15541 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:05.672693 14892 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:05.639935 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:05.643607 19987 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:05.644465 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:05.647639 20215 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.683916 15043 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 13:07:05.684286 15043 pending_rounds.cc:85] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 11
I20260709 13:07:05.678960 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:05.684512 15043 pending_rounds.cc:107] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 13:07:05.693648 15043 raft_consensus.cc:2889] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.694844 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:05.695642 15546 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:05.696501 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:05.697105 14887 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:05.684105 20307 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:05.709282 15546 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:05.691285 20321 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:05.688750 20455 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:07:05.713517 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:05.715485 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:05.716352 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.708534 20307 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:05.717283 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:05.721254 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:05.719372 20383 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:05.726109 20438 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:05.697865 19987 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
W20260709 13:07:05.732131 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 43758.3us
I20260709 13:07:05.734161 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:05.736876 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:05.738122 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:05.743463 20488 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:05.744010 20488 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:05.744493 20488 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:05.747987 20479 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
I20260709 13:07:05.729491 20307 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:05.715085 20321 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:05.717964 20393 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:05.762600 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:05.766026 14887 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:05.763005 20338 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:05.755098 20223 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:05.770262 20455 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:05.795841 15036 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 13:07:05.796399 15036 pending_rounds.cc:85] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 12
I20260709 13:07:05.796667 15036 pending_rounds.cc:107] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:07:05.796953 15036 raft_consensus.cc:2889] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:05.717756 20443 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.791968 20338 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:05.794030 20455 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:05.823361 20486 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 13:07:05.842478 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:05.843357 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44435.7us
I20260709 13:07:05.844223 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:05.854378 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.839921 20455 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:05.813465 20488 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:05.833632 20310 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 13:07:05.876636 20220 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:05.915953 15043 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:07:05.813719 20321 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:05.926084 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 209523us
I20260709 13:07:05.916309 20305 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:05.966663 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:05.978155 20307 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.979693 14962 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:05.980655 20307 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:05.916662 20489 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 13:07:05.941397 20220 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:05.943456 20215 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:05.949981 20305 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.011870 20331 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:06.012410 20331 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:06.012557 20305 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.013432 20331 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.015501 20220 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:05.941921 20338 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.033093 20221 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 10. Current term is 11.
I20260709 13:07:06.027376 20488 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:06.051169 14967 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:06.014984 20331 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:06.089236 14886 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:06.090108 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 155411us
I20260709 13:07:06.076969 20450 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:06.095077 20450 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.100236 20450 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.108075 20365 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.108987 20365 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:06.109342 20365 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:06.085368 20455 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.110167 20365 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.118417 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:06.118918 14888 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:06.117151 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:06.123976 14887 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.126189 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:06.111399 20365 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.135099 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:06.151655 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:06.144452 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:06.153100 15549 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:06.154162 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:06.154773 14968 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:06.134575 14888 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:06.136646 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:06.159539 14936 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:06.113476 20455 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:06.162782 14859 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:06.163395 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:06.132963 20303 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.115063 20284 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:06.212764 20247 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:06.215934 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:06.219677 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:06.157191 20419 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 13:07:06.164808 20344 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:06.240154 14888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:06.215167 20284 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:06.240793 14888 raft_consensus.cc:606] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:06.243192 14888 raft_consensus.cc:614] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:06.235797 20508 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:06.244737 20455 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:06.245313 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.245059 20284 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.247179 14793 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 11, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.251688 20435 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:06.254138 20509 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.180s	user 0.004s	sys 0.000s
I20260709 13:07:06.241357 20456 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:06.259661 15040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3156) took 1175 ms (client timeout 1546 ms). Trace:
I20260709 13:07:06.264341 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:06.267369 15040 rpcz_store.cc:269] 0709 13:07:05.084412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.084532 (+   120us) service_pool.cc:224] Handling call
0709 13:07:06.259450 (+1174918us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540029d1d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:06.259577 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1271108480}
I20260709 13:07:06.261821 20508 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:06.266611 20455 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:06.272552 20284 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.280864 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:06.283493 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:06.286480 14887 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.286595 14894 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:06.285830 20352 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.288010 20352 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.296056 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:06.296196 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:06.296797 15549 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:06.293820 14887 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:06.273703 20508 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:06.307590 15546 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:06.289950 20352 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:06.303747 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:06.311179 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:06.315657 20455 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.323390 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:06.328987 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:06.333223 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2396) took 1208 ms. Trace:
I20260709 13:07:06.333907 14965 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.347793 14793 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 18, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:06.359853 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:06.361300 14961 rpcz_store.cc:276] 0709 13:07:05.124714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.138906 (+ 14192us) service_pool.cc:224] Handling call
0709 13:07:06.333024 (+1194118us) spinlock_profiling.cc:243] Waited 87.1 ms on lock 0x7b540031ae54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:06.333141 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":200320768}
I20260709 13:07:06.326166 20352 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:06.352094 20305 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:06.366113 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:06.382607 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:06.383445 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 60111.9us
I20260709 13:07:06.368904 20352 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:06.382326 20488 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.386468 20435 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:06.384473 20427 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:06.392655 20352 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.410212 20435 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:06.411199 20435 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.422273 14963 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:07:06.425032 14888 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:07:06.423602 20221 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:06.440953 20221 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.441474 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 2763) took 1394 ms. Trace:
I20260709 13:07:06.446853 14893 rpcz_store.cc:276] 0709 13:07:05.047294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:05.048187 (+   893us) service_pool.cc:224] Handling call
0709 13:07:05.048487 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:05.446298 (+397811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:06.441196 (+994898us) spinlock_profiling.cc:243] Waited 397 ms on lock 0x7b540024ead4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:06.441406 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":913308544}
W20260709 13:07:06.476367 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 88552.9us
I20260709 13:07:06.449895 20221 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.461352 20417 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:07:06.497406 20508 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.491196 20352 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.524436 20352 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.527259 20303 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:06.527745 20303 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:06.528607 20303 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.483790 20427 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:06.529876 20303 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.530040 20427 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.533062 20427 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.538300 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:06.557199 14888 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:06.540588 20456 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:06.564767 20456 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.581854 20508 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.573045 20523 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:07:06.610801 14967 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:06.611292 14967 pending_rounds.cc:85] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 9
I20260709 13:07:06.611574 14967 pending_rounds.cc:107] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:07:06.611824 14967 raft_consensus.cc:2889] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:06.612419 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 241503us
I20260709 13:07:06.613759 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:06.585039 20402 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:07:06.618449 20476 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.617470 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:06.621215 15549 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:06.629529 20402 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:06.629976 20402 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:06.630285 20474 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:06.630769 20402 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.632052 20402 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:06.637024 14893 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:06.637660 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:06.638226 14886 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.643908 15037 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:07:06.645834 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:06.645764 15037 pending_rounds.cc:85] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 8
I20260709 13:07:06.646638 15037 pending_rounds.cc:107] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:07:06.646799 15037 raft_consensus.cc:2889] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.648126 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:06.650209 14886 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:06.651309 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:06.654451 20337 raft_consensus.cc:2764] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:07:06.657564 14961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:07:06.658172 14961 raft_consensus.cc:606] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:06.658483 14961 raft_consensus.cc:614] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:06.660034 14963 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:06.666085 20456 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.666942 20474 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:06.671633 20474 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:06.672612 20474 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.673352 20221 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:06.673841 20221 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.668519 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:06.675765 20221 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:06.677302 14893 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:06.678242 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:06.676496 20454 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:06.681272 14891 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:06.683907 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:06.691012 14893 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:06.684950 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:06.685500 15546 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:07:06.689430 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75558.1us
I20260709 13:07:06.694526 14891 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:06.696741 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:06.706037 14793 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.707219 14886 raft_consensus.cc:606] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:06.708482 14886 raft_consensus.cc:614] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:06.708724 14793 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:06.711288 14793 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:06.719036 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:06.713476 14793 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 11, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 11 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:06.720621 15042 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:06.716710 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:06.660320 20337 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:06.729781 14966 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:06.739486 15038 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:06.739850 15038 pending_rounds.cc:85] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 7
I20260709 13:07:06.740072 15038 pending_rounds.cc:107] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:06.740294 15038 raft_consensus.cc:2889] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:06.740458 20520 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:06.741358 20520 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:06.741714 20520 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:06.742578 20520 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.715955 20344 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:07:06.690305 20490 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:06.748590 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:06.750787 15042 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:06.768566 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:06.705255 20423 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:07:06.778962 20247 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:06.752738 20476 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:06.749053 20127 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:06.788898 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da044c14437c4be087d871f129926239"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:06.728516 20328 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:07:06.790601 14886 raft_consensus.cc:606] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:06.733305 20337 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.761226 20447 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:07:06.759421 20353 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:07:06.760887 20490 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:06.788950 20476 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:06.823603 20476 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:06.796868 20520 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:06.789522 14970 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:06.816141 20456 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.818331 20490 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:06.822624 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:06.831317 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:06.837872 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:06.796084 20127 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:06.847472 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 67194.2us
W20260709 13:07:06.882773 20529 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.248s	user 0.004s	sys 0.000s
W20260709 13:07:06.888851 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 120422us
I20260709 13:07:06.871353 20456 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:06.870816 20303 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:06.926671 20344 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
I20260709 13:07:06.901181 20303 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:06.991690 20538 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:07:07.000087 20303 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:07.036129 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 13:07:07.072557 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125072us
I20260709 13:07:07.073783 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:07.084599 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:07.085417 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:07.086755 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:07.087353 14965 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:07.087700 15042 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:07.079977 20337 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:07.096324 20446 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:07.108501 20446 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:07.109593 20446 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:07.120718 20127 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:07.127969 15550 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:07.129369 20501 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:07.130035 20501 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:07.132462 20501 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:07.090952 20353 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:07.142525 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:07.157330 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:07.171741 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:07.172670 20476 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.178601 14965 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:07.179004 14965 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:07.179728 14965 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.180795 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:07.181384 14967 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
W20260709 13:07:07.184077 20533 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:07:07.209794 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:07.210430 14886 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:07.210583 14893 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:07.211162 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:07.216320 15550 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:07.216861 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:07.217746 20366 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:07.218163 20366 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:07.218489 20366 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.222286 15037 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:07.225535 20366 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.229779 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:07.230522 14894 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.232709 20127 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:07.233289 20441 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:07.236724 20127 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:07.237269 20383 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:07.237543 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:07.237896 20383 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:07.238782 20365 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:07.239217 20383 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:07.240641 20383 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:07.242146 14965 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:07.259865 20476 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:07.271533 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:07.271756 14793 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:07.273044 14793 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:07.272298 14965 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:07:07.274117 14965 pending_rounds.cc:85] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 9
I20260709 13:07:07.275918 14965 pending_rounds.cc:107] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:07:07.276238 14965 raft_consensus.cc:2889] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.277076 14793 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 13, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:07.280274 14793 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:07.281440 14793 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 12 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:07.283061 14793 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 15, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1), now has a pending config: VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1), VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:07.285122 14793 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
W20260709 13:07:07.287856 20498 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260709 13:07:07.293565 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 102041us
I20260709 13:07:07.299949 14793 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:07.300460 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:07.302028 14887 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:07.313298 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 67423.2us
W20260709 13:07:07.314455 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 224847us
I20260709 13:07:07.316733 14888 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:07:07.318909 14780 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica eb4a5ac9f0c5425b92051187b939860f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:07.321265 14793 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:07.303622 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 57247.2us
I20260709 13:07:07.329154 14894 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:07.331295 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:07.332098 20127 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:07.333150 20431 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:07.333616 20127 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:07.334612 20127 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:07.358410 14788 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 285) took 14318 ms (client timeout 15000 ms). Trace:
I20260709 13:07:07.385047 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:07.392495 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:07.403383 20366 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:07.359019 14788 rpcz_store.cc:269] 0709 13:06:52.992811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:06:52.994639 (+  1828us) service_pool.cc:224] Handling call
0709 13:07:07.311321 (+14316682us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:03.100880 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:03.101697 (+   817us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:03.101729 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:07:03.101747 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:03.102700 (+   953us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:03.102814 (+   114us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:03.102855 (+    41us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:07:03.165826 (+ 62971us) tablet.cc:701] Row locks acquired
0709 13:07:03.167427 (+  1601us) write_op.cc:260] PREPARE: finished
0709 13:07:03.189564 (+ 22137us) write_op.cc:270] Start()
0709 13:07:03.209567 (+ 20003us) write_op.cc:276] Timestamp: P: 1783602423185598 usec, L: 0
0709 13:07:03.213796 (+  4229us) op_driver.cc:348] REPLICATION: starting
0709 13:07:03.240292 (+ 26496us) log.cc:844] Serialized 2054 byte log entry
0709 13:07:03.713684 (+473392us) op_driver.cc:464] REPLICATION: finished
0709 13:07:03.951675 (+237991us) write_op.cc:301] APPLY: starting
0709 13:07:03.951777 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:03.998081 (+ 46304us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:03.998170 (+    89us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:04.001201 (+  3031us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:04.001416 (+   215us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:07:04.001458 (+    42us) write_op.cc:312] APPLY: finished
0709 13:07:04.002761 (+  1303us) log.cc:844] Serialized 57 byte log entry
0709 13:07:04.028024 (+ 25263us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.037546 (+  9522us) write_op.cc:454] Released schema lock
0709 13:07:04.040083 (+  2537us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:04.058557 (+ 18474us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:04.059946 (+  1389us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":315397,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":234691,"apply.run_cpu_time_us":8410,"apply.run_wall_time_us":98958,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":112213,"prepare.run_cpu_time_us":14074,"prepare.run_wall_time_us":256134,"raft.queue_time_us":260615,"raft.run_cpu_time_us":80815,"raft.run_wall_time_us":162838,"replication_time_us":482358,"thread_start_us":456189,"threads_started":4,"wal-append.queue_time_us":167058,"wal-append.run_cpu_time_us":13047,"wal-append.run_wall_time_us":1596013}]]}
I20260709 13:07:07.427609 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:07.428208 14961 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:07.407354 20328 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:07.443503 14961 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:07.425714 20353 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:07.399065 20221 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
W20260709 13:07:07.463368 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 70972.3us
I20260709 13:07:07.476491 14892 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:07.462502 20328 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:07.480257 20328 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.490895 20344 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:07.491006 20510 raft_consensus.cc:993] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:07:07.492719 20510 raft_consensus.cc:1081] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:07:07.495023 15549 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:07:07.496224 15040 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:07.494805 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:07.495399 15549 pending_rounds.cc:85] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 11
I20260709 13:07:07.497781 15549 pending_rounds.cc:107] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:07:07.497992 15549 raft_consensus.cc:2889] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:07.501150 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:07.501755 15040 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:07.502987 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:07.503501 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:07.504207 15040 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:07.506229 19987 raft_consensus.cc:2764] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:07:07.521582 20501 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:07:07.580688 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:07.592043 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da044c14437c4be087d871f129926239"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34584
I20260709 13:07:07.592702 14962 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:07.593075 14962 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:07.595708 20474 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:07.624190 14962 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.645469 14962 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:07.642729 20560 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 13:07:07.631915 20352 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:07.671454 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:07.675691 15040 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:07.678422 20562 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:07.679656 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:07.680203 14894 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:07.680514 14894 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:07.681258 14894 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.692396 15040 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:07.693900 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:07.673465 20523 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.702842 14894 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:07.704289 20433 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:07.799780 14894 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
W20260709 13:07:07.800290 20561 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:07:07.818725 14890 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:07.705194 20523 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:07.813993 20433 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:07.850790 15549 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:07:07.868886 20433 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.874339 14962 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:07.876627 20402 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:07.877117 20402 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:07.879034 20402 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:07.884894 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:07.893967 20523 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:07.900211 20564 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 13:07:07.905418 20366 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:07.930238 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:07.933012 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:07.933841 14887 raft_consensus.cc:2410] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:07.933609 20402 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:07.937427 14962 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:07:07.939396 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:07.940817 20127 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:07.952206 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:07.953454 14961 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 13:07:07.955611 20274 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:07.960892 14894 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:07.975286 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:07.976150 20383 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:08.000553 20338 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:07.996204 20503 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
W20260709 13:07:08.071216 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49658.3us
W20260709 13:07:08.213199 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50069.6us
W20260709 13:07:08.216773 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 83054.6us
I20260709 13:07:08.254770 14791 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 14 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 18 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.256825 14791 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 16 to 17, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.258126 14791 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 9 to 10, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 10 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.260448 14791 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 11 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 12 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.265715 15040 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:08.265944 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 288) took 5445 ms. Trace:
I20260709 13:07:08.272558 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:08.289315 20328 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:08.272472 14793 rpcz_store.cc:276] 0709 13:07:02.838738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:02.844413 (+  5675us) service_pool.cc:224] Handling call
0709 13:07:08.265888 (+5421475us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:07.390955 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:07.391329 (+   374us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:07.391349 (+    20us) write_op.cc:435] Acquired schema lock
0709 13:07:07.391359 (+    10us) tablet.cc:662] Decoding operations
0709 13:07:07.408215 (+ 16856us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:07.408308 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:07.408346 (+    38us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:07:07.511745 (+103399us) tablet.cc:701] Row locks acquired
0709 13:07:07.511769 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:07:07.511906 (+   137us) write_op.cc:270] Start()
0709 13:07:07.512031 (+   125us) write_op.cc:276] Timestamp: P: 1783602427511861 usec, L: 0
0709 13:07:07.512059 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:07:07.512704 (+   645us) log.cc:844] Serialized 6189 byte log entry
0709 13:07:08.035869 (+523165us) op_driver.cc:464] REPLICATION: finished
0709 13:07:08.106681 (+ 70812us) write_op.cc:301] APPLY: starting
0709 13:07:08.108615 (+  1934us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:08.116257 (+  7642us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:08.116335 (+    78us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:08.147941 (+ 31606us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7332a 00007f5534cf8f14 00007f5534cf8ec3 00007f5534cf8e38 00007f5534cf8df3 00007f5534cf80dc 00007f5534d21e16 00007f5534d09cbb 00007f5534cf439d 00007f5534cf7d75
0709 13:07:08.181848 (+ 33907us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:08.220680 (+ 38832us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:07:08.220728 (+    48us) write_op.cc:312] APPLY: finished
0709 13:07:08.221057 (+   329us) log.cc:844] Serialized 139 byte log entry
0709 13:07:08.221200 (+   143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:08.221336 (+   136us) write_op.cc:454] Released schema lock
0709 13:07:08.221404 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:08.221773 (+   369us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:08.221796 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2090211,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":69250,"apply.run_cpu_time_us":20767,"apply.run_wall_time_us":115100,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":57853,"prepare.run_cpu_time_us":7105,"prepare.run_wall_time_us":135116,"raft.queue_time_us":236331,"raft.run_cpu_time_us":31198,"raft.run_wall_time_us":132687,"replication_time_us":522753,"spinlock_wait_cycles":26227968,"thread_start_us":268637,"threads_started":4,"wal-append.queue_time_us":43391}]]}
I20260709 13:07:08.332913 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 175) took 8261 ms. Trace:
I20260709 13:07:08.338454 14892 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:08.343189 20328 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:08.345052 14791 rpcz_store.cc:276] 0709 13:07:00.072293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:00.072808 (+   515us) service_pool.cc:224] Handling call
0709 13:07:08.332848 (+8260040us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:08.272280 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:08.272790 (+   510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:08.272823 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:07:08.272840 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:08.273390 (+   550us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:08.273464 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:08.273488 (+    24us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:07:08.273839 (+   351us) tablet.cc:701] Row locks acquired
0709 13:07:08.273856 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:07:08.273980 (+   124us) write_op.cc:270] Start()
0709 13:07:08.274099 (+   119us) write_op.cc:276] Timestamp: P: 1783602428273939 usec, L: 0
0709 13:07:08.274140 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 13:07:08.274842 (+   702us) log.cc:844] Serialized 1674 byte log entry
0709 13:07:08.276544 (+  1702us) op_driver.cc:464] REPLICATION: finished
0709 13:07:08.276946 (+   402us) write_op.cc:301] APPLY: starting
0709 13:07:08.277012 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:08.279034 (+  2022us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:08.279121 (+    87us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:08.281350 (+  2229us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:08.281503 (+   153us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:07:08.281554 (+    51us) write_op.cc:312] APPLY: finished
0709 13:07:08.281769 (+   215us) log.cc:844] Serialized 49 byte log entry
0709 13:07:08.285658 (+  3889us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:08.285748 (+    90us) write_op.cc:454] Released schema lock
0709 13:07:08.285792 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:08.308695 (+ 22903us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:08.308725 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":149016,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":231,"apply.run_cpu_time_us":5412,"apply.run_wall_time_us":9137,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":8049,"prepare.run_cpu_time_us":2734,"prepare.run_wall_time_us":36369,"replication_time_us":2275,"thread_start_us":10185,"threads_started":1}]]}
I20260709 13:07:08.364650 20383 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:08.459386 20383 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:08.461741 20383 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:08.463042 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:08.463707 15042 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:08.464973 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:08.468248 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:08.469046 14961 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:08.476467 15042 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:08.478307 20501 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:07:08.534776 20581 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:07:08.537020 20506 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:08.537566 20506 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:08.537961 20506 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:08.566406 20582 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.003s
W20260709 13:07:08.583498 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 118643us
W20260709 13:07:08.677263 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 86363.4us
I20260709 13:07:08.680243 20506 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:08.726219 20506 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:08.738489 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44272us
I20260709 13:07:08.740064 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:08.740653 15044 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:08.742383 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:08.743081 14961 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:07:08.741933 14777 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 6eec3351a3e94e158c79a8784e2c6574 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 5 but the committed config has opid_index of 11
I20260709 13:07:08.750342 14788 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.751853 14788 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.756767 15044 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:08.756721 14788 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.763906 14968 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:08.773075 14961 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:08.771004 14788 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 15, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.779017 14788 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:08.780998 14788 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.782279 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:08.765600 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 292) took 7462 ms. Trace:
I20260709 13:07:08.783352 14792 rpcz_store.cc:276] 0709 13:07:01.303132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:01.303326 (+   194us) service_pool.cc:224] Handling call
0709 13:07:08.765534 (+7462208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":66147,"reported_tablets":29}
I20260709 13:07:08.783754 14788 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 14, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.795221 14788 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 14, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.809698 20523 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:08.822917 20523 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:08.823890 20523 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:08.804502 14788 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.853102 15545 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:08.854172 15037 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:08.851915 14788 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.873564 14788 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:08.891783 14788 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:08.893149 14788 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 14, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 14 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.896493 20556 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:08.900154 20476 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:08.894649 14788 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 14, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 14 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.908031 14788 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.909308 14788 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.921224 14788 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 5 to 11, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted, no longer has a pending config: VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1), VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.923983 14788 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.925629 14788 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.927551 14788 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 9 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:08.929275 14788 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:08.964135 20344 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.976673 15545 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.985553 15042 raft_consensus.cc:2955] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:08.990227 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 13ff541fc966499ea2706d34cfb2c964 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:09.235297 15042 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:09.238322 20523 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:09.318993 14962 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:09.325280 20592 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:07:09.325981 14791 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:09.349161 14791 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 11 to 13, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:09.351176 14791 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 16 to 17, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:09.353339 14791 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 13 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:09.365249 14791 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:09.373842 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eec3351a3e94e158c79a8784e2c6574 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:39056
I20260709 13:07:09.394203 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 286) took 1349 ms. Trace:
I20260709 13:07:09.396687 14788 rpcz_store.cc:276] 0709 13:07:08.023839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.031772 (+  7933us) service_pool.cc:224] Handling call
0709 13:07:08.124327 (+ 92555us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:07:09.373398 (+1249071us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:09.029453 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:09.030009 (+   556us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:09.030045 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:07:09.030064 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:09.031851 (+  1787us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:09.031919 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:09.031954 (+    35us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:07:09.033703 (+  1749us) tablet.cc:701] Row locks acquired
0709 13:07:09.033723 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:07:09.033855 (+   132us) write_op.cc:270] Start()
0709 13:07:09.033967 (+   112us) write_op.cc:276] Timestamp: P: 1783602429033807 usec, L: 0
0709 13:07:09.033994 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:09.034749 (+   755us) log.cc:844] Serialized 8180 byte log entry
0709 13:07:09.052627 (+ 17878us) op_driver.cc:464] REPLICATION: finished
0709 13:07:09.063835 (+ 11208us) write_op.cc:301] APPLY: starting
0709 13:07:09.063914 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:09.101225 (+ 37311us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:09.101353 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:09.241454 (+140101us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:09.254570 (+ 13116us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:07:09.254613 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:09.254994 (+   381us) log.cc:844] Serialized 188 byte log entry
0709 13:07:09.264394 (+  9400us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.270597 (+  6203us) write_op.cc:454] Released schema lock
0709 13:07:09.270654 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:09.286711 (+ 16057us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:09.286740 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":194825,"reported_tablets":39,"spinlock_wait_cycles":101806464,"child_traces":[["op",{"apply.queue_time_us":10959,"apply.run_cpu_time_us":27320,"apply.run_wall_time_us":222836,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91907,"num_ops":21,"prepare.queue_time_us":90780,"prepare.run_cpu_time_us":5681,"prepare.run_wall_time_us":8705,"replication_time_us":18470,"thread_start_us":78764,"threads_started":2}]]}
I20260709 13:07:09.395702 14791 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:09.452967 20606 tablet_replica.cc:333] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:07:09.460181 20606 raft_consensus.cc:2243] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:09.472975 20606 raft_consensus.cc:2272] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:09.477288 14790 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 12 to 13, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:09.479291 14790 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:09.478713 20606 ts_tablet_manager.cc:1916] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:09.720320 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:09.785279 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 289) took 1458 ms. Trace:
I20260709 13:07:09.785737 14793 rpcz_store.cc:276] 0709 13:07:08.326832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:08.326969 (+   137us) service_pool.cc:224] Handling call
0709 13:07:08.357046 (+ 30077us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:07:09.785215 (+1428169us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":28,"spinlock_wait_cycles":60345216}
W20260709 13:07:09.796504 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50455.7us
I20260709 13:07:09.829913 20606 ts_tablet_manager.cc:1929] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.10
I20260709 13:07:09.879138 20606 log.cc:1199] T 6eec3351a3e94e158c79a8784e2c6574 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/6eec3351a3e94e158c79a8784e2c6574
I20260709 13:07:09.921295 14966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:07:09.922199 14966 raft_consensus.cc:606] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
W20260709 13:07:09.925683 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58558.8us
W20260709 13:07:09.942850 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62388us
W20260709 13:07:09.984128 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65471.7us
I20260709 13:07:09.999382 20476 raft_consensus.cc:993] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:07:09.999905 20476 raft_consensus.cc:1081] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Signalling peer e4938453819c469599f515b22d92fe27 to start an election
I20260709 13:07:10.036358 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 6eec3351a3e94e158c79a8784e2c6574 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
W20260709 13:07:10.040966 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 167811us
W20260709 13:07:10.049892 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 185958us
W20260709 13:07:09.982909 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 101139us
W20260709 13:07:10.067056 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 181690us
I20260709 13:07:10.091101 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:10.092940 15044 raft_consensus.cc:606] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:10.123818 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
W20260709 13:07:10.137205 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 93970us
I20260709 13:07:10.153944 14887 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993"
dest_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:38796
I20260709 13:07:10.154786 14887 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:10.155314 14887 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.159057 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet 13ff541fc966499ea2706d34cfb2c964 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:34356
I20260709 13:07:10.170272 14891 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:10.189983 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:10.193686 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 71727.4us
I20260709 13:07:10.215943 20631 tablet_replica.cc:333] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:07:10.217736 20631 raft_consensus.cc:2243] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:07:10.218562 20617 raft_consensus.cc:670] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:07:10.241856 14887 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:10.276420 20621 raft_consensus.cc:993] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:07:10.305215 14887 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:10.305459 20621 raft_consensus.cc:1081] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:07:10.313019 14962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34568
I20260709 13:07:10.313651 14962 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:10.314015 14962 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.283749 20631 raft_consensus.cc:2272] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.319037 14891 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:10.333310 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:10.334003 15044 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.342712 20631 ts_tablet_manager.cc:1916] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:10.350514 15549 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:10.351061 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:10.351831 14969 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:10.352151 14969 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:10.353082 14969 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:10.354292 14969 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:10.356339 15042 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:10.359344 14962 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:10.362155 14962 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:10.380230 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:10.380895 15042 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:10.381260 15042 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:10.382211 15042 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:10.383891 15042 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.384624 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:10.386739 20617 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:10.385344 14891 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:10.391765 15044 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:10.401473 15042 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:10.403004 20625 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:10.406741 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:10.421522 20626 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:10.422055 20626 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:10.404500 14969 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:10.423027 20626 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:10.427508 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:10.428507 20344 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:10.434628 20344 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:10.439872 20344 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:10.436533 14891 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:10.479689 14790 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 15, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.480459 14793 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:10.487141 20625 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:10.508266 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 599606a370ab4d629b9cac083be835da with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:10.512169 20631 ts_tablet_manager.cc:1929] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:07:10.512974 20631 log.cc:1199] T 13ff541fc966499ea2706d34cfb2c964 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/13ff541fc966499ea2706d34cfb2c964
I20260709 13:07:10.517500 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet 13ff541fc966499ea2706d34cfb2c964 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:07:10.522070 15547 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:10.517769 15038 raft_consensus.cc:2955] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 6 to 10, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:10.574635 14791 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 6 to 10, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 11 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:10.698948 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 599606a370ab4d629b9cac083be835da with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:39056
I20260709 13:07:10.708222 20642 tablet_replica.cc:333] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:07:10.734709 20642 raft_consensus.cc:2243] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:10.735535 20642 raft_consensus.cc:2272] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:10.739728 20642 ts_tablet_manager.cc:1916] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:10.781185 20642 ts_tablet_manager.cc:1929] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 13:07:10.781682 20642 log.cc:1199] T 599606a370ab4d629b9cac083be835da P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/599606a370ab4d629b9cac083be835da
I20260709 13:07:10.783478 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 599606a370ab4d629b9cac083be835da (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:07:10.835467 15038 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:10.840412 15042 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:10.847746 20627 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:10.874291 14969 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:10.882599 20630 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:10.885967 14962 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:10.888756 14895 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:10.891714 20625 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:10.895342 20623 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:10.941994 15042 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:10.942983 20630 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:10.944674 14891 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:10.950330 20344 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:10.945664 14969 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:10.954712 14895 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index -1 to 14, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:07:10.963950 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 86937.7us
W20260709 13:07:10.967585 15010 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f7a1be4a55754b9baba160c70df7dc21. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:10.976588 20625 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
W20260709 13:07:11.042129 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57973.7us
W20260709 13:07:11.105926 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 90006.3us
I20260709 13:07:11.114171 14895 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:11.120761 14793 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 14, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.184794 15038 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:11.185055 14969 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:11.186745 20626 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:07:11.187867 14861 consensus_peers.cc:597] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5af46e976c54b8ba2b6e09ce06690af. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.188517 20616 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:11.193658 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:11.250088 20626 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.255272 15038 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.263213 14969 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.344210 14792 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 11, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.357055 20665 ts_tablet_manager.cc:933] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:11.363344 15038 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:11.396059 14968 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:11.397518 20630 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:11.398519 15010 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d87ff4cfb034c7eb5e9fdb522974b90. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.398675 20665 tablet_copy_client.cc:323] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:07:11.400768 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet f7a1be4a55754b9baba160c70df7dc21 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:07:11.401319 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet f7a1be4a55754b9baba160c70df7dc21 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-f7a1be4a55754b9baba160c70df7dc21
I20260709 13:07:11.411646 14895 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:11.413148 20657 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:11.439648 15054 tablet_copy_source_session.cc:215] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:11.448766 14895 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.451853 20665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7a1be4a55754b9baba160c70df7dc21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:11.446818 20655 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.498786 14968 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.570268 14793 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.573274 14968 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:07:11.855474 14936 consensus_peers.cc:597] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: da044c14437c4be087d871f129926239. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:11.869740 14888 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:11.877662 20338 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:11.917112 20338 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:11.945106 14887 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:12.030562 15037 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:12.107577 20671 ts_tablet_manager.cc:933] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
W20260709 13:07:12.149932 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 87008.4us
W20260709 13:07:12.161764 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46710.4us
I20260709 13:07:12.167763 20338 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 13:07:12.189177 20665 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.672s	user 0.010s	sys 0.000s
I20260709 13:07:12.202733 20665 tablet_copy_client.cc:806] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:12.203532 20665 tablet_copy_client.cc:670] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
W20260709 13:07:12.204463 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100866us
W20260709 13:07:12.288565 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 87392.9us
I20260709 13:07:12.290144 15038 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:07:12.351354 15547 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.044s	sys 0.046s
W20260709 13:07:12.351800 15547 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.044s	sys 0.046s
W20260709 13:07:12.352739 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 66306.8us
I20260709 13:07:12.358853 20671 tablet_copy_client.cc:323] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
W20260709 13:07:12.367368 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 110785us
W20260709 13:07:12.397812 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 149853us
W20260709 13:07:12.402423 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147324us
I20260709 13:07:12.438524 14793 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:12.462751 20701 ts_tablet_manager.cc:933] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:12.470959 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 92610.9us
I20260709 13:07:12.492265 20703 ts_tablet_manager.cc:933] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:12.510255 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet c5af46e976c54b8ba2b6e09ce06690af from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:07:12.510917 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet c5af46e976c54b8ba2b6e09ce06690af from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-c5af46e976c54b8ba2b6e09ce06690af
I20260709 13:07:12.513713 20665 tablet_copy_client.cc:538] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:12.538198 14905 tablet_copy_source_session.cc:215] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:12.558926 20703 tablet_copy_client.cc:323] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:07:12.570215 20671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5af46e976c54b8ba2b6e09ce06690af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:12.583312 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:12.583966 20701 tablet_copy_client.cc:323] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.3:46271
I20260709 13:07:12.585822 15054 tablet_copy_service.cc:140] P eb4a5ac9f0c5425b92051187b939860f: Received BeginTabletCopySession request for tablet 7d87ff4cfb034c7eb5e9fdb522974b90 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:44388)
I20260709 13:07:12.586329 15054 tablet_copy_service.cc:161] P eb4a5ac9f0c5425b92051187b939860f: Beginning new tablet copy session on tablet 7d87ff4cfb034c7eb5e9fdb522974b90 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:44388: session id = 58ee9fe38eb8453098f6d964e7675e79-7d87ff4cfb034c7eb5e9fdb522974b90
I20260709 13:07:12.595549 15054 tablet_copy_source_session.cc:215] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:12.604235 20701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d87ff4cfb034c7eb5e9fdb522974b90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:12.595854 20671 tablet_copy_client.cc:806] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:12.596316 20665 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:12.605917 20671 tablet_copy_client.cc:670] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:12.609331 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet da044c14437c4be087d871f129926239 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:07:12.615669 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet da044c14437c4be087d871f129926239 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-da044c14437c4be087d871f129926239
I20260709 13:07:12.626390 20671 tablet_copy_client.cc:538] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:12.631067 14979 tablet_copy_source_session.cc:215] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:12.634945 20703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da044c14437c4be087d871f129926239. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:12.660542 20671 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:12.735538 20703 tablet_copy_client.cc:806] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:12.738934 20703 tablet_copy_client.cc:670] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:12.747742 14894 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:12.748375 14894 raft_consensus.cc:606] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:12.751734 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:07:12.752271 14962 raft_consensus.cc:606] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:12.755396 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:12.756943 20703 tablet_copy_client.cc:538] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:12.757653 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:12.764814 20701 tablet_copy_client.cc:806] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:12.787724 20701 tablet_copy_client.cc:670] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:12.801646 20701 tablet_copy_client.cc:538] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:12.815712 20703 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:12.853999 20701 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:12.859051 20671 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:12.871867 20671 tablet_bootstrap.cc:492] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:12.872713 20671 ts_tablet_manager.cc:1403] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.212s	user 0.051s	sys 0.038s
I20260709 13:07:12.886688 20671 raft_consensus.cc:359] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:12.895005 20671 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:12.895691 20671 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:12.913990 20671 ts_tablet_manager.cc:1434] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 13:07:12.916863 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-c5af46e976c54b8ba2b6e09ce06690af received from {username='slave'} at 127.0.0.1:51176
I20260709 13:07:12.917284 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-c5af46e976c54b8ba2b6e09ce06690af on tablet c5af46e976c54b8ba2b6e09ce06690af with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:12.919834 20616 raft_consensus.cc:993] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:07:12.920279 20616 raft_consensus.cc:1081] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:07:12.934053 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45060
I20260709 13:07:12.934567 15044 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:12.934892 15044 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.950773 15044 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:12.952982 15044 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:12.954922 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:12.995734 14894 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:12.996093 14894 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:12.996878 14894 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:12.998091 14894 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:12.954939 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:12.958146 20665 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:12.999734 15547 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:13.000735 20665 tablet_bootstrap.cc:492] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:13.001482 20665 ts_tablet_manager.cc:1403] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.405s	user 0.044s	sys 0.020s
I20260709 13:07:13.002523 20701 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:13.003391 20701 tablet_bootstrap.cc:492] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:13.004541 20701 ts_tablet_manager.cc:1403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.151s	user 0.035s	sys 0.015s
I20260709 13:07:13.009183 20701 raft_consensus.cc:359] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:13.010072 20701 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:13.010753 20701 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:13.014029 14894 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:13.018224 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:13.019049 20674 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:13.019564 20674 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:13.020265 20665 raft_consensus.cc:359] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:13.020373 20674 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:13.021368 20665 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:13.022092 20665 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:13.025172 20665 ts_tablet_manager.cc:1434] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:07:13.014285 20701 ts_tablet_manager.cc:1434] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:07:13.015568 15547 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:13.031430 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-f7a1be4a55754b9baba160c70df7dc21 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:07:13.031869 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-f7a1be4a55754b9baba160c70df7dc21 on tablet f7a1be4a55754b9baba160c70df7dc21 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:13.036556 15054 tablet_copy_service.cc:342] P eb4a5ac9f0c5425b92051187b939860f: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7d87ff4cfb034c7eb5e9fdb522974b90 received from {username='slave'} at 127.0.0.1:44388
I20260709 13:07:13.036945 15054 tablet_copy_service.cc:434] P eb4a5ac9f0c5425b92051187b939860f: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-7d87ff4cfb034c7eb5e9fdb522974b90 on tablet 7d87ff4cfb034c7eb5e9fdb522974b90 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:13.105691 20680 raft_consensus.cc:993] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:07:13.106199 20680 raft_consensus.cc:1081] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:07:13.109256 15044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:07:13.109745 15044 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:13.110064 15044 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.113788 14791 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 12, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 12 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:13.116334 15044 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:13.119035 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:13.119089 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:13.119663 14966 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:13.119681 15547 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.120117 14966 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:13.120879 14966 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:13.122810 14966 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:13.126235 15547 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:13.127566 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:13.129060 20674 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:13.132876 20674 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:13.133761 15044 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:13.133977 20674 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:13.136037 15547 raft_consensus.cc:1217] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.10->[15.11-15.11]   Dedup: 15.11->[]
I20260709 13:07:13.142038 14966 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:13.145112 20703 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:13.147185 20703 tablet_bootstrap.cc:492] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:13.148630 20703 ts_tablet_manager.cc:1403] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.350s	user 0.041s	sys 0.038s
I20260709 13:07:13.155319 20703 raft_consensus.cc:359] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:13.157282 20703 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:13.158385 20703 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:13.161815 20703 ts_tablet_manager.cc:1434] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:07:13.164510 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-da044c14437c4be087d871f129926239 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:07:13.165019 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-da044c14437c4be087d871f129926239 on tablet da044c14437c4be087d871f129926239 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:13.234686 15547 raft_consensus.cc:1217] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.13->[18.14-18.14]   Dedup: 18.14->[]
I20260709 13:07:13.272541 14791 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:13.334861 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002bac60 after lost signal to thread 13795
W20260709 13:07:13.336275 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002d65c0 after lost signal to thread 14827
W20260709 13:07:13.337680 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800135140 after lost signal to thread 14919
W20260709 13:07:13.338896 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800155660 after lost signal to thread 14994
W20260709 13:07:13.340346 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800339000 after lost signal to thread 15068
W20260709 13:07:13.347081 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9a60 after lost signal to thread 15574
I20260709 13:07:13.436058 15547 raft_consensus.cc:1217] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Deduplicated request from leader. Original: 18.11->[18.12-18.12]   Dedup: 18.12->[]
I20260709 13:07:13.519307 14966 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:13.520916 20674 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:13.525681 15547 raft_consensus.cc:1217] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.11->[17.12-17.12]   Dedup: 17.12->[]
I20260709 13:07:13.533437 15547 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:13.535081 20676 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:13.554209 14891 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:07:13.561596 20674 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:13.602332 20686 raft_consensus.cc:1064] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:13.606197 20686 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 9, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:13.639657 15550 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:13.647809 20674 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
W20260709 13:07:13.728377 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58127.3us
I20260709 13:07:13.758739 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:13.794951 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46503.1us
W20260709 13:07:13.840257 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 104282us
W20260709 13:07:13.847286 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55943.4us
W20260709 13:07:13.876951 20719 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:07:13.914331 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 72326.6us
W20260709 13:07:13.932972 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 155455us
W20260709 13:07:13.947567 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 98338.6us
W20260709 13:07:13.950059 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52456.4us
W20260709 13:07:13.997575 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 60271.6us
W20260709 13:07:14.004880 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83285.4us
W20260709 13:07:14.079540 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 140934us
W20260709 13:07:14.203187 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 121894us
I20260709 13:07:14.218603 20687 raft_consensus.cc:1064] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:14.221989 20687 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:14.238256 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 142734us
W20260709 13:07:14.242900 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 134546us
I20260709 13:07:14.251734 15044 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:14.253762 15550 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:14.296469 20764 raft_consensus.cc:1064] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
W20260709 13:07:14.317320 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54125.6us
I20260709 13:07:14.320096 14968 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:14.333626 20743 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:14.365456 20761 raft_consensus.cc:1064] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:14.360129 20764 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:14.371006 20761 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 10, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:14.383354 20768 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:14.398958 15547 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:14.403110 20760 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:14.403450 14894 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:14.403846 14968 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:14.405021 20687 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:14.416988 15550 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:14.418618 20687 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:14.431342 14966 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:14.433499 20687 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:14.435501 20725 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:14.438380 14887 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:14.446085 20687 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:14.473213 20760 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
W20260709 13:07:14.500389 20775 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.119s	user 0.004s	sys 0.000s
I20260709 13:07:14.515885 20757 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:14.535660 20776 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:14.627552 14962 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:14.884981 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 215664us
W20260709 13:07:14.913681 20781 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:07:14.979704 20783 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:07:14.937342 20766 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.002744 15038 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.036701 15550 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:15.096261 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 121124us
I20260709 13:07:15.103652 14961 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:15.135135 20779 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:07:15.156147 14791 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 11 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.176573 14793 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 14 to 15, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:15.184170 14962 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.12: config changed from index 11 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.188771 20799 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.148108 14891 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.162504 14895 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.206852 15550 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:07:15.214661 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 164087us
I20260709 13:07:15.242313 20338 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:15.261384 14894 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:15.277468 15037 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:15.286357 15545 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Committing config change with OpId 18.15: config changed from index 14 to 15, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.286958 15546 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.312620 20800 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:15.357872 20800 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:15.436165 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:15.452881 20811 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.455080 15040 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.483507 14790 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } attrs { replace: true } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.471535 14887 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:15.496884 14891 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.504515 15547 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:15.509935 20702 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:15.512814 14961 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:15.515499 20743 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:15.527047 20759 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.532661 14961 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.553515 15546 raft_consensus.cc:2955] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Committing config change with OpId 15.13: config changed from index 12 to 13, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.620841 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5af46e976c54b8ba2b6e09ce06690af with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:15.626149 14793 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.670141 15546 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Committing config change with OpId 17.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.713281 15044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:15.713924 15044 raft_consensus.cc:606] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:15.704761 14788 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 12 to 13, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.722839 15037 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:15.733084 15044 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:15.756884 15040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:15.757722 15040 raft_consensus.cc:606] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:15.769297 15546 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:15.778892 14791 catalog_manager.cc:5244] ChangeConfig:REMOVE_PEER RPC for tablet c5af46e976c54b8ba2b6e09ce06690af with cas_config_opid_index 12: aborting the task: latest config opid_index 13; task opid_index 12
I20260709 13:07:15.778985 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet c5af46e976c54b8ba2b6e09ce06690af with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 13) from {username='slave'} at 127.0.0.1:56542
I20260709 13:07:15.785732 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:07:15.788383 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:15.784204 14887 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:15.791316 20716 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:07:15.811000 20760 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:15.820235 15550 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.870695 14887 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.871956 20825 tablet_replica.cc:333] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:07:15.873150 20825 raft_consensus.cc:2243] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:15.873896 20825 raft_consensus.cc:2272] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:15.876433 15546 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:07:15.876499 14968 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:15.840083 20822 raft_consensus.cc:2955] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 13 to 14, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.896378 15546 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:15.896824 15040 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:15.881284 20716 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 13:07:15.901484 20750 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:15.903321 20750 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:15.904088 14788 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 13 to 14, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.912824 20758 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.914813 20760 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.918955 15546 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.920667 20825 ts_tablet_manager.cc:1916] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:15.923141 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d87ff4cfb034c7eb5e9fdb522974b90 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:39056
I20260709 13:07:15.946519 14887 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:07:15.955107 20716 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:15.923641 15547 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.979614 14887 raft_consensus.cc:2955] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Committing config change with OpId 18.16: config changed from index 15 to 16, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:15.991783 15040 raft_consensus.cc:2955] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 13 to 14, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:16.040784 14788 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 15 to 16, VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) evicted. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:16.045728 20825 ts_tablet_manager.cc:1929] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.12
I20260709 13:07:16.046211 20825 log.cc:1199] T c5af46e976c54b8ba2b6e09ce06690af P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/c5af46e976c54b8ba2b6e09ce06690af
I20260709 13:07:16.053607 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet da044c14437c4be087d871f129926239 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:16.066355 14953 tablet_service.cc:1558] Processing DeleteTablet for tablet f7a1be4a55754b9baba160c70df7dc21 with delete_type TABLET_DATA_TOMBSTONED (TS 25b8f0cc46f748468395543b8b174bf4 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:39056
I20260709 13:07:16.067986 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d87ff4cfb034c7eb5e9fdb522974b90 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:16.077368 14792 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 13 to 14, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:16.088577 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet c5af46e976c54b8ba2b6e09ce06690af (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:07:16.098824 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f7a1be4a55754b9baba160c70df7dc21 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:16.107839 20826 tablet_replica.cc:333] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:07:16.108944 20826 raft_consensus.cc:2243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:16.109535 20799 raft_consensus.cc:993] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:16.109709 20826 raft_consensus.cc:2272] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:16.110049 20799 raft_consensus.cc:1081] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:16.112422 15546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52838
I20260709 13:07:16.113008 15546 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.113319 15546 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.127101 14885 tablet_service.cc:1558] Processing DeleteTablet for tablet da044c14437c4be087d871f129926239 with delete_type TABLET_DATA_TOMBSTONED (TS e4938453819c469599f515b22d92fe27 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:34356
I20260709 13:07:16.119410 15546 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:16.132579 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:16.133340 14968 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.140511 14968 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:16.141489 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:16.143339 20826 ts_tablet_manager.cc:1916] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:16.146067 20729 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:16.148205 20827 tablet_replica.cc:333] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:07:16.152102 20827 raft_consensus.cc:2243] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:16.153116 20827 raft_consensus.cc:2272] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:16.148264 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:16.157146 15040 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:16.157228 20827 ts_tablet_manager.cc:1916] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:16.157543 15040 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:16.148838 15546 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:16.149436 20729 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:16.158419 15040 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:16.162640 15040 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.168396 20824 raft_consensus.cc:993] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:07:16.160372 20729 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:16.168928 20824 raft_consensus.cc:1081] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Signalling peer 25b8f0cc46f748468395543b8b174bf4 to start an election
I20260709 13:07:16.172730 14961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:34568
I20260709 13:07:16.173300 14961 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:16.173642 14961 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.174110 15040 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:16.177152 20827 ts_tablet_manager.cc:1929] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 17.13
I20260709 13:07:16.177809 20827 log.cc:1199] T da044c14437c4be087d871f129926239 P e4938453819c469599f515b22d92fe27: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/wals/da044c14437c4be087d871f129926239
I20260709 13:07:16.181553 14961 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:16.184717 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:16.185335 14887 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.191529 14887 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:16.193084 14961 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:16.193280 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:16.193924 15040 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:16.194232 15040 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:16.194989 15040 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:16.195652 14933 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:16.196211 15040 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:16.196449 20758 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:16.197007 20758 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:16.197886 20758 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:16.200910 14777 catalog_manager.cc:5028] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): tablet da044c14437c4be087d871f129926239 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:07:16.202979 15040 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:16.220144 14792 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:16.284360 14792 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:16.300141 20826 ts_tablet_manager.cc:1929] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260709 13:07:16.300608 20826 log.cc:1199] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/7d87ff4cfb034c7eb5e9fdb522974b90
I20260709 13:07:16.302260 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet 7d87ff4cfb034c7eb5e9fdb522974b90 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:07:16.312597 20826 tablet_replica.cc:333] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:07:16.313737 20826 raft_consensus.cc:2243] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:07:16.314519 20826 raft_consensus.cc:2272] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:07:16.326525 20826 ts_tablet_manager.cc:1916] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:07:16.372385 20826 ts_tablet_manager.cc:1929] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.15
I20260709 13:07:16.372819 20826 log.cc:1199] T f7a1be4a55754b9baba160c70df7dc21 P 25b8f0cc46f748468395543b8b174bf4: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/wals/f7a1be4a55754b9baba160c70df7dc21
I20260709 13:07:16.379135 14778 catalog_manager.cc:5028] TS 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): tablet f7a1be4a55754b9baba160c70df7dc21 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:07:16.605580 15038 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:16.607538 20689 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:16.638126 14961 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:16.639894 20810 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:16.662266 14891 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:16.664125 20753 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:16.730914 15044 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:16.751986 20753 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:16.819638 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:07:16.842267 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 94608.1us
I20260709 13:07:17.398350 14961 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:17.439253 15038 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:07:17.443379 14936 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f85c193fa13b46d9bceea2295f514c29. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.479279 20753 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:17.491061 14894 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:17.492720 20811 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:17.545533 20811 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.548892 15038 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.549229 14894 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.598263 14887 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:17.611896 14792 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 10, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.649747 15038 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:17.651535 20832 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:07:17.652696 14861 consensus_peers.cc:597] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8fa9dae6116418f8b520fc591ae5757. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:17.652922 14962 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:07:17.655123 20832 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:07:17.709286 20766 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.715224 15038 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.859563 14788 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index -1 to 6, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:17.875765 14962 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:17.875500 14961 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:17.988286 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:18.140304 20854 ts_tablet_manager.cc:933] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:18.177330 15044 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:18.179000 20753 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:18.181242 14895 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:18.183816 20753 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:18.189374 20854 tablet_copy_client.cc:323] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:07:18.217818 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet f85c193fa13b46d9bceea2295f514c29 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:07:18.218369 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet f85c193fa13b46d9bceea2295f514c29 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-f85c193fa13b46d9bceea2295f514c29
I20260709 13:07:18.225971 14979 tablet_copy_source_session.cc:215] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:18.232685 14962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da044c14437c4be087d871f129926239"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:07:18.233385 14962 raft_consensus.cc:606] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:18.235018 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 13:07:18.237121 14936 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 754b0ca0f8c0459c8b6f122a5ff76b39. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:18.243131 20854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85c193fa13b46d9bceea2295f514c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:18.280061 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:18.298828 20854 tablet_copy_client.cc:806] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:18.299751 20854 tablet_copy_client.cc:670] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:18.306948 20758 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:18.326710 14962 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:18.338353 15037 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:18.343109 20753 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:07:18.351100 14936 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 770c4e1c2abb48cba0a9b362f6be74f5. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:07:18.362798 20857 ts_tablet_manager.cc:933] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755)
I20260709 13:07:18.375164 15044 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:18.377743 20811 raft_consensus.cc:993] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: : Instructing follower eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:07:18.378283 20758 raft_consensus.cc:1081] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Signalling peer eb4a5ac9f0c5425b92051187b939860f to start an election
I20260709 13:07:18.380107 15038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da044c14437c4be087d871f129926239"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:45052
I20260709 13:07:18.380856 15038 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:18.381237 15038 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.387516 15038 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:18.396723 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:18.397354 14962 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:18.397740 14962 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:18.398365 14887 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:18.399217 14895 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:18.401422 15038 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:18.404002 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:18.404546 15546 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.398483 14962 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:18.407470 14962 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:18.405560 20758 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:07:18.404469 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 9, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 12 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.442278 15546 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:18.459314 15010 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:18.467495 14962 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:18.460817 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 107427us
I20260709 13:07:18.437939 20854 tablet_copy_client.cc:538] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:18.484169 20822 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:18.530452 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61380.2us
W20260709 13:07:18.523787 20862 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.071s	user 0.002s	sys 0.000s
W20260709 13:07:18.527112 20858 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:07:18.550045 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77354us
W20260709 13:07:18.569593 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65832.1us
I20260709 13:07:18.591953 20857 tablet_copy_client.cc:323] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.1:46755
I20260709 13:07:18.630293 14905 tablet_copy_service.cc:140] P e4938453819c469599f515b22d92fe27: Received BeginTabletCopySession request for tablet c8fa9dae6116418f8b520fc591ae5757 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:51176)
I20260709 13:07:18.631044 14905 tablet_copy_service.cc:161] P e4938453819c469599f515b22d92fe27: Beginning new tablet copy session on tablet c8fa9dae6116418f8b520fc591ae5757 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:51176: session id = 58ee9fe38eb8453098f6d964e7675e79-c8fa9dae6116418f8b520fc591ae5757
I20260709 13:07:18.614496 20869 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:18.650101 14905 tablet_copy_source_session.cc:215] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:18.660229 20857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8fa9dae6116418f8b520fc591ae5757. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:07:18.630347 20863 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:07:18.676669 15037 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:18.685619 20854 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:18.697691 20857 tablet_copy_client.cc:806] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:18.698439 20857 tablet_copy_client.cc:670] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:18.702481 20857 tablet_copy_client.cc:538] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:07:18.731483 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 182618us
I20260709 13:07:18.624432 20822 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:18.733994 20822 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:18.740345 20857 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
W20260709 13:07:18.740077 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 158725us
I20260709 13:07:18.786832 14890 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:07:18.810182 14791 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index -1 to 12, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:18.822363 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46644.1us
W20260709 13:07:18.823473 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47844.1us
I20260709 13:07:18.849762 20895 ts_tablet_manager.cc:933] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:18.874677 14788 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:18.886229 20895 tablet_copy_client.cc:323] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:07:18.895773 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 754b0ca0f8c0459c8b6f122a5ff76b39 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:07:18.896513 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 754b0ca0f8c0459c8b6f122a5ff76b39 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-754b0ca0f8c0459c8b6f122a5ff76b39
I20260709 13:07:18.913161 20897 ts_tablet_manager.cc:933] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:18.942355 14979 tablet_copy_source_session.cc:215] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:18.946084 20895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 754b0ca0f8c0459c8b6f122a5ff76b39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:18.969415 20897 tablet_copy_client.cc:323] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:07:18.975297 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 770c4e1c2abb48cba0a9b362f6be74f5 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:07:18.976015 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 770c4e1c2abb48cba0a9b362f6be74f5 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-770c4e1c2abb48cba0a9b362f6be74f5
I20260709 13:07:18.984067 14979 tablet_copy_source_session.cc:215] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:07:18.990731 20897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 770c4e1c2abb48cba0a9b362f6be74f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:07:18.998061 20854 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:18.999183 20854 tablet_bootstrap.cc:492] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:19.000023 20854 ts_tablet_manager.cc:1403] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.315s	user 0.042s	sys 0.014s
I20260709 13:07:19.005105 20854 raft_consensus.cc:359] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:19.006057 20854 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:19.006776 20854 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:19.009656 20854 ts_tablet_manager.cc:1434] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:07:19.012925 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-f85c193fa13b46d9bceea2295f514c29 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:07:19.013338 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-f85c193fa13b46d9bceea2295f514c29 on tablet f85c193fa13b46d9bceea2295f514c29 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:19.039213 20857 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:19.040192 20857 tablet_bootstrap.cc:492] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:19.040908 20857 ts_tablet_manager.cc:1403] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.301s	user 0.021s	sys 0.015s
I20260709 13:07:19.043481 20895 tablet_copy_client.cc:806] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:19.044104 20895 tablet_copy_client.cc:670] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:19.043788 20857 raft_consensus.cc:359] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:19.044814 20857 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:19.045593 20857 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:19.049695 20857 ts_tablet_manager.cc:1434] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:07:19.056195 14905 tablet_copy_service.cc:342] P e4938453819c469599f515b22d92fe27: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-c8fa9dae6116418f8b520fc591ae5757 received from {username='slave'} at 127.0.0.1:51176
I20260709 13:07:19.056586 14905 tablet_copy_service.cc:434] P e4938453819c469599f515b22d92fe27: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-c8fa9dae6116418f8b520fc591ae5757 on tablet c8fa9dae6116418f8b520fc591ae5757 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:19.059636 20895 tablet_copy_client.cc:538] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:19.070413 20897 tablet_copy_client.cc:806] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:07:19.070989 20897 tablet_copy_client.cc:670] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:07:19.080943 20895 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:19.095269 20897 tablet_copy_client.cc:538] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:07:19.121748 20897 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:07:19.169039 20895 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:19.171347 20895 tablet_bootstrap.cc:492] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:19.174695 20895 ts_tablet_manager.cc:1403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.094s	user 0.045s	sys 0.005s
I20260709 13:07:19.186342 14966 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:19.190037 20893 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:19.215701 20895 raft_consensus.cc:359] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:19.216672 20895 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:19.217378 20895 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:19.222512 15550 raft_consensus.cc:1217] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 13:07:19.230995 20895 ts_tablet_manager.cc:1434] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:07:19.239032 15550 raft_consensus.cc:1217] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:07:19.245352 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-754b0ca0f8c0459c8b6f122a5ff76b39 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:07:19.245813 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-754b0ca0f8c0459c8b6f122a5ff76b39 on tablet 754b0ca0f8c0459c8b6f122a5ff76b39 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:19.305048 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:20.294538 20904 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:20.295522 20904 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:20.298861 20904 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:20.366041 14916 debug-util.cc:398] Leaking SignalData structure 0x7b0800377660 after lost signal to thread 13795
W20260709 13:07:20.591153 13797 debug-util.cc:398] Leaking SignalData structure 0x7b080000fd00 after lost signal to thread 14966
W20260709 13:07:20.603210 13797 kernel_stack_watchdog.cc:198] Thread 14966 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 396ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 13:07:20.603783 14916 debug-util.cc:398] Leaking SignalData structure 0x7b0800096180 after lost signal to thread 14827
I20260709 13:07:20.605333 20904 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:20.606005 20904 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:20.608274 20904 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:20.610086 20904 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:20.610806 20904 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:20.614440 20904 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:20.614976 20904 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:20.615561 20904 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:20.618394 20904 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:21.418910 20860 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:21.420717 20860 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:21.489876 20860 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:21.549667 20904 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:21.573693 20904 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:21.577069 20904 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:21.577643 20904 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:21.578631 20904 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:21.587359 20904 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:21.803565 20860 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:21.804713 20860 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:21.807621 20860 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:21.809177 13797 debug-util.cc:398] Leaking SignalData structure 0x7b080000f760 after lost signal to thread 14966
W20260709 13:07:21.904136 13797 kernel_stack_watchdog.cc:198] Thread 14966 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 1614ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:07:21.922397 20860 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:21.930176 20860 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:21.933399 20860 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:21.935839 20860 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:21.936919 20860 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:21.939706 20860 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:21.940267 20860 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:21.941102 20860 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:21.943787 20860 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:21.956729 20832 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:21.964596 20890 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:21.965679 20890 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:21.969451 20890 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:21.974013 20842 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:21.975808 20832 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:21.985730 20766 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:21.975098 20842 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:21.996920 20842 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:21.997713 20842 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.000160 20876 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.001014 20876 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.003517 20766 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.010675 20906 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.012589 20907 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.012969 20906 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.013906 20907 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.017248 20907 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:21.998667 20842 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.025651 20884 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.011329 20832 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:22.036124 14966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.842s	user 0.004s	sys 0.051s
I20260709 13:07:22.035676 20884 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.027599 20876 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.007355 20766 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:22.041431 14966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.848s	user 0.005s	sys 0.051s
I20260709 13:07:22.045023 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3311) took 2852 ms. Trace:
I20260709 13:07:22.045089 20904 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.045884 20904 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.030205 20907 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.031011 20860 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.050549 20906 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.040634 20884 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.047158 14966 rpcz_store.cc:276] 0709 13:07:19.192084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.192481 (+   397us) service_pool.cc:224] Handling call
0709 13:07:19.192744 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:19.193020 (+   276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:19.193046 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:19.193445 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 13:07:22.044385 (+2850940us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:22.044460 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.044631 (+   171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:22.044707 (+    76us) raft_consensus.cc:1685] finished
0709 13:07:22.044722 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:22.044903 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":881,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"thread_start_us":2850386,"threads_started":1,"wal-append.queue_time_us":298201,"wal-append.run_cpu_time_us":1732,"wal-append.run_wall_time_us":1001740}
I20260709 13:07:22.061522 20904 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.062610 20860 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.066872 20860 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.067505 20842 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.067720 20907 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:22.073328 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4520 after lost signal to thread 14919
W20260709 13:07:22.073721 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08001e4500 after lost signal to thread 14920
I20260709 13:07:22.076660 20907 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.101120 20878 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.101962 20878 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.103739 20910 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.104938 20910 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.105571 15550 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:22.106662 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1528) took 2783 ms. Trace:
I20260709 13:07:22.083163 20909 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.113030 20909 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.113855 20878 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.107112 15550 rpcz_store.cc:276] 0709 13:07:19.323094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.323342 (+   248us) service_pool.cc:224] Handling call
0709 13:07:22.104650 (+2781308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:22.106220 (+  1570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:22.106552 (+   332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:22.122617 20842 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.123332 20842 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.125408 20842 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.125878 20842 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.126469 20842 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.127751 20832 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.128575 20910 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.128511 20832 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.130887 20832 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.132004 20876 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.133188 20897 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=13 overwritten=1 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:07:22.132936 20876 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.134573 20897 tablet_bootstrap.cc:492] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:07:22.135596 20911 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.135994 20842 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.136371 20911 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.138751 20911 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.140843 20908 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.141614 20908 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.146030 20876 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.162763 20887 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.164283 20910 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.160133 20876 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.173596 20904 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.174422 20904 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.176854 20904 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.177513 20887 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.177855 20910 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.179949 20887 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.180154 20910 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.180701 20909 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.182283 20860 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.182852 20906 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.183141 20860 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.183769 20906 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.185634 20860 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.186055 20906 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.187597 20908 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.190652 20881 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.191817 20876 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.194314 20876 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.199523 20869 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.200640 20869 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.204499 20915 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.205211 20907 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.205389 20915 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.206391 20907 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.207903 20750 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.208777 20904 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.208628 20750 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.209575 20904 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.210997 20750 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.211539 20906 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.212158 20906 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.212548 20869 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.214349 20906 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.215111 20907 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.216570 20904 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.227681 20881 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.230368 20881 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.237282 20893 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.238209 20893 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.240108 20878 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.240712 20893 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.240900 20878 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.242323 20893 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.237340 20913 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.243178 20878 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.242970 20893 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.243815 20913 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.252682 20897 ts_tablet_manager.cc:1403] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 3.136s	user 0.046s	sys 0.073s
I20260709 13:07:22.288516 20912 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.289827 20912 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.269884 20750 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.291656 20882 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.292678 20882 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.292815 20750 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.296068 20750 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.296312 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 212) took 3037 ms. Trace:
I20260709 13:07:22.296703 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.298082 14962 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:22.298768 20860 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.299670 20860 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.300263 20915 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:22.301105 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08000f8560 after lost signal to thread 14994
I20260709 13:07:22.257218 20881 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.296761 14788 rpcz_store.cc:276] 0709 13:07:19.258713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.258845 (+   132us) service_pool.cc:224] Handling call
0709 13:07:22.296061 (+3037216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16025,"reported_tablets":2}
I20260709 13:07:22.275197 20878 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:22.316135 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08003813e0 after lost signal to thread 15068
I20260709 13:07:22.315796 20911 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.319023 20911 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.322487 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:22.325083 14916 debug-util.cc:398] Leaking SignalData structure 0x7b08002e52a0 after lost signal to thread 15574
W20260709 13:07:22.325470 14916 debug-util.cc:398] Leaking SignalData structure 0x7b0800315c40 after lost signal to thread 15575
I20260709 13:07:22.315743 20908 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.311645 20750 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.329280 20916 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.329731 20911 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.340301 20876 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.340507 20908 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.341245 20766 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.341084 20876 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.341943 20766 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.342911 20908 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.343379 20876 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.345992 20884 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.346625 20884 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.347497 20890 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.347693 20870 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.348117 20890 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.348408 20870 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.350396 20766 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.350993 20870 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.352099 20926 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.351874 20878 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.352882 20926 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.354329 20878 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.331215 20917 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.336714 20909 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.352856 20870 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.355723 20909 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.356771 20870 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.357805 20891 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.358156 20909 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.358428 20891 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.358990 20926 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.338927 20832 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.355252 20917 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.359975 20926 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.360101 20832 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.358871 20916 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.361547 20884 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.362350 20832 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.362833 20913 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.362919 20914 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.343146 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 318) took 3064 ms. Trace:
W20260709 13:07:22.364766 14916 debug-util.cc:398] Leaking SignalData structure 0x7b0800056520 after lost signal to thread 20861
I20260709 13:07:22.364212 14791 rpcz_store.cc:276] 0709 13:07:19.315573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:19.318087 (+  2514us) service_pool.cc:224] Handling call
0709 13:07:22.342956 (+3024869us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2962479,"reported_tablets":1}
I20260709 13:07:22.350421 20890 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.351652 20750 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.351578 20875 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.363075 20916 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.380143 20875 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.372068 20881 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.386215 20750 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.388518 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.401175 14966 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:22.401420 20870 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.388989 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.401618 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.390259 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.402748 20875 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.402876 14969 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:22.403296 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.404211 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.404788 14967 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:22.404891 20881 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.405236 20917 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.406803 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.364624 20882 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.391264 20893 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.391517 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.407685 20912 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.408005 14968 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:22.408499 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.392925 20891 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.394135 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.371997 20914 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.396483 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.397159 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.409660 14962 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:22.409885 14890 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:22.397619 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.360832 20926 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.397977 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.398483 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.398802 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.399070 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.390338 20860 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.424324 20914 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.424786 14888 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:22.425436 20923 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.425673 20926 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.426311 20923 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.427418 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.428318 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.429023 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.429739 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.429893 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.411060 14894 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:07:22.411561 14963 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:22.432560 14970 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:22.434659 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.437609 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.446563 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.444137 14966 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:22.448802 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.450181 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.451120 20908 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.451748 20908 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.454017 20908 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.456120 20897 raft_consensus.cc:359] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.457158 20897 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:07:22.457938 20897 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:22.461091 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.461674 14890 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:22.462702 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.463261 14890 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:22.463665 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.464408 20924 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.464730 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.465093 20924 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.468631 20914 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.468936 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.469615 14886 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:22.469340 20914 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.470640 20932 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.470801 20881 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.471580 20912 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.471338 20932 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.472239 20912 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.473738 20932 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.474288 20932 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.474838 20878 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.475227 20875 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.475490 20890 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:22.475670 20913 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.476047 20890 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.476547 20890 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:22.476423 20913 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.478616 20913 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.478812 20914 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.474364 20912 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.479549 20925 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.475704 20875 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.480268 20925 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.475519 20878 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.485764 20878 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.475718 20922 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.486017 20925 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.486452 20922 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.481669 20881 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.489183 20881 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.489681 20881 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.490340 20881 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.490589 20914 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.490716 20882 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.491717 20928 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.491434 20882 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.492728 20922 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.492393 20928 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.480355 20875 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.493719 20882 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.491482 20920 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.494779 20920 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.496964 20920 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.494788 20928 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.476720 20923 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.499831 20923 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.500655 20912 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.501281 20912 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.502856 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.505399 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.506035 15042 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:22.506410 20923 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.507385 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.474910 20932 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.508114 15042 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 7.
I20260709 13:07:22.468112 20924 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.503314 20912 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.474879 20918 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:22.515736 20932 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.515878 20918 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.516364 20918 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:22.516433 20881 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.491307 20914 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.508730 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.508911 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.508523 20923 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.521700 20932 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:22.522619 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.523272 14893 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:22.525013 20914 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.525771 20875 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.526443 20926 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.527010 20926 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.527454 20729 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.527961 20875 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.528074 20729 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.528666 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.529099 20926 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.529232 14888 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:22.530471 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.534932 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.535298 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.536281 20897 ts_tablet_manager.cc:1434] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.252s	user 0.005s	sys 0.004s
I20260709 13:07:22.533092 20875 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:22.537429 20875 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.537838 20875 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:22.540162 20729 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:22.531695 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 63553.9us
I20260709 13:07:22.541844 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.542862 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.544646 20870 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.545385 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.545204 20870 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.547724 20871 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.547797 20930 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.548374 20871 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.548557 20930 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.552213 20927 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.552799 20927 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.556018 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.556093 20888 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.556725 20926 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.557119 20888 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.557410 20926 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.559350 20926 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.556768 20689 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.559916 20936 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.574256 20689 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.574656 20936 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.576403 20689 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.560184 20930 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.563879 20871 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.580740 20930 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:22.581216 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.554935 20927 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.547264 20870 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.559372 20888 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.565930 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.566691 20928 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.567390 20923 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:22.567806 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 60968.4us
I20260709 13:07:22.568068 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.568750 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.570219 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.570300 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.570917 20934 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:22.571977 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.573519 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.576685 20936 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.588822 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.589567 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.588317 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.591066 15042 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:22.591825 20871 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.592264 20689 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.592674 20930 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.587812 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.594180 15044 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:22.595389 15038 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:22.599292 20934 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.600176 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.600054 20923 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.600837 20928 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.602967 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.618371 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.611649 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.601074 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:22.667026 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 96887.5us
I20260709 13:07:22.622722 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.618042 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.732540 14967 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:22.602401 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.731869 14969 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:22.742981 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.744460 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.608754 20888 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.743681 14962 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:22.746850 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.749294 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.751459 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.752468 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.667250 20935 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.669667 20870 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:22.669935 20926 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.610848 20927 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.755211 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.751497 15037 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:22.757851 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.761643 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.761569 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.762392 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.763044 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.763686 15038 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:22.760123 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.764703 14967 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:22.765537 20923 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.766083 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.767125 20928 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.769404 20875 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.731834 20934 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:22.771384 20875 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.772710 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.774936 20860 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:22.775064 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.775367 20860 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.776496 20860 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:22.776641 20890 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.778751 20890 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.774055 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.780474 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.781481 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.782006 15041 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:22.782739 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.772787 20689 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.784166 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.785532 20934 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.763777 20908 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:22.800787 20908 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.801214 20908 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:22.785892 20689 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.775707 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.775874 15038 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:22.762133 14970 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:22.785254 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.773527 20870 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.668730 20936 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:22.669147 20933 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.791769 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.828135 15044 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:22.666599 20918 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.793648 20927 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.780467 20930 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.775399 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.756579 20935 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.845851 20935 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:22.847654 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 72355.5us
I20260709 13:07:22.848628 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.849429 20919 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.849937 20919 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.850302 20919 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.851958 20750 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:22.852397 20750 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.852768 20750 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.845605 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.855216 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.856323 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.857012 15042 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:22.857553 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.857815 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.858666 20919 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.858956 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.860059 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.860786 20870 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.861021 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.823225 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.823971 20934 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.824610 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.861856 15036 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:22.816335 15035 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:22.862756 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:22.830013 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 68458.6us
I20260709 13:07:22.831583 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.863248 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.864257 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.864404 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.865314 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:22.861864 20936 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.832374 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.783612 20926 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.867734 14894 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:22.867944 20936 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.833303 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.833772 14886 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:22.834445 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.835577 20890 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:22.836764 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.837648 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.839459 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.865332 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.869838 15548 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:22.839716 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.840399 14891 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:22.840728 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.871148 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.841321 20933 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.841717 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.843560 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.844125 20927 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.829624 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.843588 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:22.860899 20919 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.816273 20888 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.783263 15041 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:22.869294 15544 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:22.863339 15036 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:22.892524 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:22.883813 15037 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:22.602547 20871 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.887882 20933 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.890097 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.894804 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.897944 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.894874 20926 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:22.898506 20934 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:22.900770 20934 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:22.901172 20934 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:22.880225 20890 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:22.901876 14892 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:22.904178 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.840760 20918 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:22.905056 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:22.901878 20890 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:22.922425 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:22.931847 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.953032 14891 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:22.953758 20888 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:22.951853 14892 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:22.955618 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.961289 15545 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:22.962288 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.962493 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.962920 15544 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 8.
I20260709 13:07:22.963117 15549 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:22.963160 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.963719 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.965692 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.966262 15546 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:22.969810 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.970327 15546 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:22.970498 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.972172 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.973097 14892 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:22.974117 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.974783 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.975288 20750 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.975718 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.973323 20935 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:22.974548 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.976822 14890 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:22.977535 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.978410 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.959026 20860 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:22.978585 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.980314 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.028501 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.974242 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.979475 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.032938 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.035099 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.974278 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.977622 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.038559 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.040776 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.041043 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.041774 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.043195 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.044675 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:22.991781 20919 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:23.045300 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 140346us
I20260709 13:07:23.046165 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.049116 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.049937 15543 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:23.049103 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.051093 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:22.985944 20942 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.056283 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.056773 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.057866 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.059307 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.048069 20919 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.069048 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.069953 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.077389 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.080287 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.055722 20942 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.084846 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.061028 20919 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.087996 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.089221 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.089242 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.047768 20908 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.090665 20942 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.091708 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.107507 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.105985 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.108283 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.108552 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.109126 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.091728 15545 raft_consensus.cc:1217] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEARNER]: Deduplicated request from leader. Original: 16.11->[16.12-16.12]   Dedup: 16.12->[]
I20260709 13:07:23.109474 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.092446 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.110554 14890 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:23.110838 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.109409 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.112218 15547 raft_consensus.cc:1217] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
I20260709 13:07:23.113560 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.115650 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.110550 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.099757 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.100277 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.102538 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.118490 14887 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:23.105177 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.110603 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.105967 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.106235 20914 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:23.106668 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.119163 15544 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:23.119246 15545 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:23.107116 20908 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.127929 20914 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.128510 20912 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:23.128924 20912 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.079561 20928 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:07:23.129905 20928 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.130079 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.124642 20871 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.130959 20881 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:23.131197 20890 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.131645 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.132004 20881 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.133252 20881 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.133687 20881 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.133934 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.134145 20937 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.134899 20937 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.124867 20860 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.126094 15513 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:23.120995 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:23.123977 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.130368 20928 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.129794 20912 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.142175 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.137881 20750 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.150202 20912 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:23.159660 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 111309us
I20260709 13:07:23.161798 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.134712 20881 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.161989 20871 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.166174 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:23.174860 20928 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.176509 20928 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.176752 20860 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:23.177024 20890 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.177194 20860 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.177708 20860 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.165267 20926 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:07:23.180379 20926 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:23.180763 20926 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.181670 20926 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.183004 20926 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.183651 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:23.185489 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 152745us
I20260709 13:07:23.186726 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.187969 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.188674 20888 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:23.165477 20937 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:07:23.189896 20946 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.192016 20935 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.192662 20888 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.193105 20888 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.190128 20945 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.194116 20888 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.195091 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.195483 20888 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.195787 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.196099 20937 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:23.196481 20937 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.197315 20937 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.198612 20937 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.174437 20871 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.199713 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.199949 20871 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.200758 20942 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.202914 20942 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.173928 15008 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.203544 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:23.203945 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 151804us
I20260709 13:07:23.204705 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.205206 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.205433 20923 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.205541 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.205964 20923 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.206043 20945 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.206518 20923 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.206856 20914 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.172168 20934 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.208436 14894 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.206568 20945 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.206367 20924 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:23.211889 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.214989 20924 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.212468 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.215502 20924 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.210618 20944 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.218595 20919 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.219753 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.211488 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.189047 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:23.213284 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.219779 15010 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.213881 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.203981 20881 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.209408 20934 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.220625 20919 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.223369 15549 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:23.223551 20926 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.250443 20926 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.250844 20926 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.221454 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.254914 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.221657 20914 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.256201 20914 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.256763 20914 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.256959 20881 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.258356 20881 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:23.258755 20881 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.222612 20945 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.259142 20881 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.224888 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.224013 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.253240 20860 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.225036 20942 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:23.265836 20942 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:23.266047 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 104722us
I20260709 13:07:23.266462 20942 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.266835 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.267539 20860 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.268208 20860 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:23.268599 20860 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.268982 20860 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.265898 20934 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.270128 20934 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.270530 20934 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:23.234808 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.272598 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.243048 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:23.221184 20928 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.221454 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:23.274950 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53584.6us
I20260709 13:07:23.244057 20912 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:07:23.276685 20928 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.277071 20928 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:23.277437 20928 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.273912 20919 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:23.229343 20923 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.280017 20919 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.280555 20919 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.281836 20923 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.282521 20923 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:23.282902 20923 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:23.243934 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77876.5us
I20260709 13:07:23.286072 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.286849 20944 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.287207 20944 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.287269 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.287622 20944 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.288501 20935 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:07:23.288959 20935 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.289057 20946 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.289397 20935 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:23.289515 20946 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.290306 20946 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.290419 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.291216 20947 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:23.299501 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 67841.7us
I20260709 13:07:23.300518 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.309634 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.300374 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.311880 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.312842 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.313515 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:23.314872 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.314538 20943 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.316895 20943 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.317297 20943 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.319591 20908 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.319885 20750 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.321605 20926 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.309340 20924 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.325663 20871 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.326941 20875 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.327389 20875 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.327860 20875 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.328953 20928 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.329444 20871 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.331079 20928 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.316002 20917 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:23.344640 20917 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.345139 20917 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.345850 20935 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.331493 20923 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.325665 20924 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.335858 20934 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.351265 20923 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.351652 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.352404 20934 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.353036 20935 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.307529 20942 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.353750 20918 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:23.354250 20918 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.353852 20946 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.354672 20918 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.354887 20942 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.337388 20860 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:23.339517 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.344666 20926 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.356603 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.357340 20860 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.342382 20881 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.311442 20945 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.314744 20890 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.358214 20890 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.358604 20890 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.362313 20918 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.363722 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.365792 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.366150 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.365584 15541 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:23.367923 14969 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:23.300137 20947 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:23.370383 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89929.2us
I20260709 13:07:23.370492 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.372618 15549 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:23.335248 20943 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.369745 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.374121 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.376402 14963 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:23.377506 14964 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:23.377476 20908 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.381609 20908 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.381841 20881 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.382166 20908 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.384150 20943 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.384657 20919 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.386830 20919 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.379976 20875 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.388409 14964 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:23.388621 20946 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.369390 20947 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.390667 14963 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:23.392416 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-770c4e1c2abb48cba0a9b362f6be74f5 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:07:23.392246 20908 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.393059 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-770c4e1c2abb48cba0a9b362f6be74f5 on tablet 770c4e1c2abb48cba0a9b362f6be74f5 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:23.379145 20935 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:23.393728 20935 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.394219 20935 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.394562 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.395153 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.398468 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:23.399770 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 144985us
I20260709 13:07:23.379659 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.400839 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.400993 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.401970 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.405351 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.402957 20881 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.403867 20924 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.406858 20881 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:23.407554 20881 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.407662 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.408521 20924 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.409677 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:23.409791 20875 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.410490 20924 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:23.410851 20924 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.411185 20924 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.412005 20908 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.415387 20935 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.416520 20945 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.403153 20928 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.418222 20924 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.420202 20924 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.429571 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.429023 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.435660 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.439920 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.380323 20917 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:07:23.441843 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 67792.5us
W20260709 13:07:23.441994 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 141722us
I20260709 13:07:23.436476 20923 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.443666 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.437497 20928 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.445801 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.448623 20875 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.449054 20875 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.449401 20875 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.446462 20912 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:07:23.442140 20952 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.436343 20914 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.452842 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.454418 20914 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.458104 20890 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:23.460372 20890 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.462182 20908 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.462814 20908 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.465090 20908 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.468515 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.468881 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.461952 20917 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.469252 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.469261 15546 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.442530 20944 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.471809 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.472077 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.472390 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.472841 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.472973 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.474537 20944 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.475577 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.475907 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.477347 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.478703 20918 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.478835 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.480568 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.482249 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.482990 20935 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.483218 20914 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.490391 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.492390 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.493348 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.493901 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.494007 20935 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.500394 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.501273 14888 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.498008 14894 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:23.495309 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.499035 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:23.506788 15035 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:23.507457 15039 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:23.507849 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.508008 20954 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.508222 20928 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:23.508706 20928 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.509081 20928 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.495616 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.495275 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.510455 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.512688 20912 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.510761 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.511397 20935 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:23.514314 20935 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.514719 20935 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.515251 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.517032 15042 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.518560 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.520067 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.521682 15039 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:23.522482 20935 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.523293 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.510074 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.526345 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.526989 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.528671 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.528620 20926 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:23.530615 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.531749 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.531973 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.532507 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.532898 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.533883 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.534426 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.533885 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.535209 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.535583 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.536680 20954 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.536957 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.537678 20926 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:23.538045 20926 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.538093 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.539077 20954 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.539726 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.539079 20926 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.541244 20926 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.541456 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.543489 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.544302 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.543547 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.550654 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.552924 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.554795 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.555644 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:23.556334 15035 raft_consensus.cc:606] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:07:23.556646 15035 raft_consensus.cc:614] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:23.557209 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.481221 20875 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.557823 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:07:23.557894 20954 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:23.558596 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 76405.9us
I20260709 13:07:23.559315 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.560057 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:23.557950 14964 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:23.561249 20947 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.561681 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.561899 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.562389 14969 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:23.563630 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.565696 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.565884 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.559311 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.568004 20928 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.568836 20914 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.559952 20935 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.570005 20928 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.572377 15042 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:23.574424 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.576308 14894 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.576637 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.576328 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.577198 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.577889 14891 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.577889 14888 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.580838 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.581000 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.581699 14893 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.581667 20933 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:23.582672 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.582860 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.583000 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.584385 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:23.582870 14886 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:23.585726 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.586107 15038 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:23.586584 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.586884 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.588306 20954 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:23.588745 20954 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.584652 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.589239 20954 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.589625 14889 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.590818 14891 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.591890 20875 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:23.592321 14888 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.592775 20947 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.593788 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.594519 20933 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.595537 20933 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:23.596650 20933 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:23.597028 20933 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.596865 20954 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.598044 20933 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.598939 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.599359 20933 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:23.600647 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.604776 20888 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:23.605856 20888 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:23.606189 20888 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.606352 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.607144 14888 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.608608 14890 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 7. Current term is 8. Ops: []
I20260709 13:07:23.574627 15039 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:23.610658 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.570106 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.612974 14889 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:07:23.613929 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 43908.5us
I20260709 13:07:23.616672 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.615010 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:23.618920 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.607105 20888 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.619537 20943 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.620272 20888 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:23.622190 20942 raft_consensus.cc:1064] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:23.623485 20871 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:23.616039 20944 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.624462 20944 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.624886 20944 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.625241 14892 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:23.624698 20942 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.626427 14891 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.627559 14888 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:23.630151 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.614040 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.631558 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.633350 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.616283 20947 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.624558 20871 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:23.636750 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.641873 20871 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.634500 20914 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.632212 20943 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.656497 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.657668 14888 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:23.616129 20928 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.659799 14892 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:23.631543 20926 consensus_queue.cc:1175] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 10 status { last_received { term: 10 index: 10 } last_committed_idx: 10 last_received_current_leader { term: 10 index: 10 } }
I20260709 13:07:23.662626 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.662864 14969 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.658442 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:23.663533 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49577.7us
I20260709 13:07:23.664675 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.665670 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.661355 20918 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.659627 20935 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.701956 20935 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.702376 20935 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.704162 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.704923 15039 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.705013 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.705196 20945 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.705816 15041 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:23.706174 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 43637.3us
I20260709 13:07:23.707463 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.659456 20750 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:23.667325 20956 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.668537 20947 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:23.642867 20871 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.712641 20947 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:23.713105 20947 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.713147 20871 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.672353 20954 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.715942 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:23.716861 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52273.7us
I20260709 13:07:23.718685 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.719995 20956 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.720702 20956 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:23.721681 20871 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.722035 20871 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.674909 20926 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.722958 20871 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.682344 20944 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.732714 14963 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:23.733620 20944 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.660621 20933 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.697636 14964 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.697690 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.722069 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.724581 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.735176 14969 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:07:23.726238 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 93041.3us
I20260709 13:07:23.726850 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.736248 20933 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.680199 20888 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.729447 20750 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:23.728886 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.737147 15041 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:23.737211 20750 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:23.737668 20750 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:23.738013 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.737214 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.738536 20750 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.730121 20943 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:23.729839 20949 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:23.736501 15042 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:23.746749 20750 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:23.740021 20933 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.747399 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.743119 20926 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:07:23.749490 20926 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:23.749863 20926 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.750109 20949 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.750480 20949 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:23.750917 20926 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.751230 20949 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:23.752858 20926 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:23.753289 20949 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.755051 15039 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:23.742852 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.756593 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.739563 20958 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.757921 20956 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.758597 20956 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:23.758613 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.739322 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.760540 20923 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:23.762936 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.761530 20871 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.771309 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.763525 20928 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:23.775609 20918 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:23.775831 20928 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:23.776067 20918 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.776314 20928 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.776612 20918 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.777179 20928 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.778357 20928 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.764458 20923 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.779609 20923 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.780454 20923 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.781559 20923 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.784744 20918 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:23.787479 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 121923us
I20260709 13:07:23.731977 20935 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.790170 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.761056 15516 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.791862 20935 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.792210 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.793056 20957 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.793370 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.794067 20957 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.794452 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.767189 20958 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:07:23.731729 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.795315 20958 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.793782 20926 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:23.796012 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64367.7us
I20260709 13:07:23.763229 20888 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:23.796825 20947 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.799082 20947 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.799257 20944 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:23.835597 20944 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:23.836014 20944 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:23.836869 20944 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.838091 20944 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:23.796895 20943 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.800274 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:23.802644 20888 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.802723 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.806388 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.806638 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.807214 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.807874 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.841944 20945 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.816428 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.842984 20888 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.843431 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.844157 20888 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:23.844538 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.845265 20888 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:23.845631 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.846340 20888 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.819428 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.762694 15035 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:23.842072 14969 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:23.800288 20918 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.847819 20875 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:23.848265 20875 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:23.848628 20875 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.849370 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.850029 20871 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:23.852275 20946 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:23.853623 20946 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:23.855372 20954 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:23.856089 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:23.856479 20919 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.856889 20919 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:23.857062 20918 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:23.857738 20919 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.858865 20919 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.854905 20946 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:07:23.882175 14969 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:23.888280 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.878814 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:23.893939 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.897902 14966 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:23.871475 20750 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:23.898974 20750 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:23.885658 14964 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.900051 20750 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.860318 20946 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:23.901317 20946 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:23.901376 20750 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:23.902226 20946 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:23.860741 20943 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:23.903419 20946 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:23.911248 15543 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:23.912060 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.878603 14892 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:23.904937 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.877425 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:23.874907 20875 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.913746 14888 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.906996 20871 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:23.920022 20871 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:23.920434 20871 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.920475 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.921432 20871 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.907521 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.907888 20888 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:23.925387 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.925931 20888 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:23.926308 20888 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:23.927352 15543 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:23.927143 20888 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.929168 20923 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:23.930255 20923 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:23.909264 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.932066 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.932600 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.935701 20888 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.939306 14964 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:23.940392 14962 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:23.860394 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:23.910305 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.910745 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.911366 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.943910 15541 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:23.930621 20923 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:23.944334 20871 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.911754 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.966205 20923 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.948028 15542 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:23.948544 20918 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:23.967595 20918 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:23.968070 20918 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:23.977646 20923 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:23.981088 20918 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:23.949223 20928 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:23.950560 15010 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:23.950636 15549 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:23.953004 14963 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:23.988094 20928 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:23.953841 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.955374 20875 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:23.956642 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.956897 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:23.989269 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.957962 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.958591 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.959225 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:23.992902 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:23.986969 15547 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:23.993695 15041 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:23.995035 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.000221 20924 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:24.000702 20924 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:24.001713 20924 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.003155 20924 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:24.005503 15547 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:24.008675 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:23.952512 20946 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:24.015950 20946 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:24.016347 20946 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.017210 20946 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.018653 20946 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:23.903625 20943 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.018862 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:23.949136 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 88838.7us
I20260709 13:07:24.027105 15547 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:23.990177 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:24.028302 15010 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.028513 15549 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:24.009428 15035 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:23.959692 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:24.010797 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.030550 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.012404 20918 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:24.020455 20943 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.021452 14966 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
W20260709 13:07:24.022013 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:23.964588 15545 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:24.029408 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.042212 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:07:24.034897 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.043645 20928 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:24.044150 20928 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:24.040271 20914 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:24.044880 20914 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:24.044997 20928 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.045986 20914 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.039525 20923 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.048704 20943 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.049185 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.050120 14962 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:24.050895 20912 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:24.051904 20952 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:24.056988 14892 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:24.058270 14888 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:07:24.062110 15043 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:24.058499 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:24.069895 15037 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:24.071991 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:24.076892 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.076084 20955 raft_consensus.cc:1064] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
W20260709 13:07:24.083909 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54212.4us
I20260709 13:07:24.089701 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.090641 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.084952 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.055495 20912 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:24.070668 20935 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:24.096900 20962 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:24.095734 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.122509 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.077668 20952 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:24.098867 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.099056 20944 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:24.111488 15040 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:24.083254 20947 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:24.123775 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:24.115864 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.093398 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 66033.2us
I20260709 13:07:24.096434 20935 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:24.127436 20935 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:24.130169 20947 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:07:24.130590 20947 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.083539 20919 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:07:24.133769 20919 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:24.134111 20919 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.134378 20912 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.134924 20919 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.135489 20947 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.136148 20919 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:24.136653 20947 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:24.137151 15042 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:24.102507 20955 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 4, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.141003 14965 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:24.125996 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.124207 20918 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:24.124665 20923 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.146122 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.146379 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.149196 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.150151 20943 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:24.150418 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.142186 20942 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:24.152711 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.152876 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.145249 20875 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:24.153796 20875 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:24.154210 20875 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.171221 20935 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.176445 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:24.144861 20962 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:24.179111 20750 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:24.178318 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.181541 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:24.178843 20942 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:24.183501 20944 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:24.184018 20944 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.184970 20944 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:24.187572 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.181833 20917 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.180188 20918 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:24.182163 20946 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:24.177656 20943 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:24.193281 20750 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.195747 20750 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.192133 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:24.178221 20923 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:24.177462 20961 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:24.202040 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:24.191478 20952 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.208470 20923 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:24.213711 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:24.212782 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66481.6us
I20260709 13:07:24.200790 20917 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.218532 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.212352 20962 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.205289 20918 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.212831 20945 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:24.224901 14788 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 15, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.237462 14788 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 10 to 11, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 11 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.266011 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:24.267867 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:24.270249 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89576.9us
I20260709 13:07:24.226301 20946 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 13:07:24.273671 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:24.235852 20945 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.272610 20942 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:24.264887 20935 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:24.285115 20918 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.285712 20917 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.284060 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.267753 20962 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.289695 14965 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:07:24.294262 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:24.234943 20961 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.298584 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:24.299603 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:24.272162 20947 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:24.306520 20945 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.307919 15513 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.309114 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.307945 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.309775 20957 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:24.313376 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.314989 20962 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.315578 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.316113 20957 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:24.316658 20871 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:24.317597 20962 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.318504 20871 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:07:24.318882 20871 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:24.319676 20871 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.321185 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:24.331058 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:24.297145 20942 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.333837 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.334820 20942 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.338874 20947 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.300698 20935 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:24.303391 20919 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:07:24.379742 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57517.2us
I20260709 13:07:24.385674 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.386222 15042 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:24.386287 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:24.385610 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:24.387497 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77354.9us
I20260709 13:07:24.392768 15037 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:24.421756 15040 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:07:24.410969 20935 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:24.431764 20980 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:24.431881 20947 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.391430 20875 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:24.436339 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.441284 20961 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.443909 20943 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:24.445822 20943 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.447065 20943 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.449301 20943 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:24.451020 20968 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.167s	user 0.001s	sys 0.006s
I20260709 13:07:24.438877 20935 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.457577 20935 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.460826 20875 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:24.471729 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163889us
W20260709 13:07:24.478739 20970 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.200s	user 0.003s	sys 0.000s
W20260709 13:07:24.481247 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 95411.1us
I20260709 13:07:24.482784 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:24.484897 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.484861 20945 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:24.489539 20978 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260709 13:07:24.493666 20860 raft_consensus.cc:1064] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:24.496157 20860 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.504500 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.505383 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.506876 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:24.506412 20972 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:24.511354 20972 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.512256 20972 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.521138 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:24.522480 14888 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:24.529618 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 120668us
I20260709 13:07:24.509722 20975 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.510334 20976 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:24.532148 14970 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:24.506239 20983 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.590641 15546 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:07:24.619772 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 90543.2us
I20260709 13:07:24.579996 20957 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:24.649382 15547 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:07:24.636363 20973 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.324s	user 0.000s	sys 0.006s
W20260709 13:07:24.653175 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:24.656566 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:24.657264 20983 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.658195 20983 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:24.627025 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:24.666553 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45140.4us
I20260709 13:07:24.667236 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.663957 20964 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 13:07:24.668743 20961 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:07:24.669946 20975 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.670874 20975 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.675051 20972 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:24.675644 14791 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.684034 15035 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:24.648696 20976 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.648304 20957 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:24.650883 20871 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:07:24.688805 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.689426 14970 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:24.679033 20971 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:07:24.691915 20935 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:24.692997 14962 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:24.700102 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.706447 14965 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:24.709754 14888 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:24.707839 20961 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:24.712960 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.719713 20954 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:24.720080 20875 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:24.729688 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:24.712667 20935 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:24.731869 20875 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.731653 20976 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.732762 20972 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:24.733230 20972 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.733430 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.734073 20972 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.734862 20962 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.734315 14792 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:24.731560 20943 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:24.732088 20935 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.691094 20928 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260709 13:07:24.746837 20875 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:24.747807 14888 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:24.718402 20969 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:24.756031 20971 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:07:24.757880 15035 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:24.759601 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:24.760377 20992 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:24.760960 20976 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:24.761860 20976 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.763047 20976 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.764361 15035 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:24.760481 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:24.769057 15037 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.772212 20918 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:24.772799 20918 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:24.742025 20943 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:24.773746 20918 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.774884 20943 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.776031 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:24.776415 20943 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.777598 15547 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:07:24.779776 14969 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:07:24.785930 14891 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:24.786394 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:24.789832 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:24.797209 20957 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.800393 20957 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:24.789361 20917 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:24.807802 14969 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:24.782536 20996 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:07:24.790257 20962 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:07:24.796458 20955 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:24.819120 15542 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:24.820505 20888 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:24.824373 20888 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.829811 15035 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:24.834830 20947 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:24.827551 21000 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:07:24.854954 14891 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:24.855937 20946 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:24.855069 14966 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:24.858858 20919 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:24.794235 20935 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:24.866310 15549 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:24.860321 20919 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:24.866698 20935 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:24.816368 20952 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:07:24.873272 15546 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:24.820794 20923 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 13:07:24.807332 20995 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.056s
I20260709 13:07:24.897656 15547 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:07:24.895327 14888 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:24.900219 20750 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:24.874076 20942 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:07:24.874305 20945 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260709 13:07:24.900673 20992 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:07:24.926049 20924 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 13:07:24.984107 20947 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:07:25.006060 15547 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:25.012331 21011 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:25.024145 15547 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:07:25.032126 20888 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:25.040246 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 139103us
W20260709 13:07:25.056452 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 160851us
I20260709 13:07:25.061290 20914 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 13:07:25.069114 20914 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:25.069633 20914 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:25.072999 21004 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:25.074429 20992 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:25.075096 20992 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.080052 20992 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.055629 20954 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
I20260709 13:07:25.082280 14969 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:07:25.087261 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 290631us
I20260709 13:07:25.095388 15035 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:25.096784 15040 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:07:25.099823 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:25.102041 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.080672 20995 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:25.105064 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:25.112924 20995 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:25.152292 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 52700.9us
I20260709 13:07:25.154342 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:25.153254 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 48279.6us
W20260709 13:07:25.195322 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:25.154692 20871 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.191699 20969 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 13:07:25.228777 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46022.9us
I20260709 13:07:25.193840 20964 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:25.204936 21018 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 13:07:25.241449 20914 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.195577 20954 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 13:07:25.154783 20955 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:07:25.246369 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:25.247059 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75103.6us
I20260709 13:07:25.199330 20942 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
I20260709 13:07:25.237460 20860 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.195806 20952 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:25.254909 14964 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:25.227571 20871 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.262038 20947 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.244567 20961 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:07:25.279309 21020 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.287377 20947 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.300603 20947 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.301792 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.246476 20964 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.302592 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:25.306020 21023 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:07:25.307381 21017 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:07:25.313015 20964 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.314471 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.268047 20860 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.317180 21020 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.327302 20957 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.310793 14791 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 17 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:25.370949 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 68468.3us
I20260709 13:07:25.338701 20995 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:25.374094 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 128840us
I20260709 13:07:25.348101 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.352880 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.373445 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.341212 20871 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.375638 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:25.375655 14966 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:25.374014 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.384995 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:25.387485 21030 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 13:07:25.388067 20965 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:25.388473 20965 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:25.389328 20965 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:25.390679 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 153954us
I20260709 13:07:25.391587 15541 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:25.393393 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.395555 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:25.396476 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:25.380267 20996 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:25.421130 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.423564 15041 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.423946 15035 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:25.428180 15039 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.398141 20965 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:25.432528 15547 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:25.424942 15043 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.390843 20964 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:25.435739 15548 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:07:25.436437 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:25.402387 20888 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:25.383258 20957 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.442540 15543 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:25.428742 21024 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.445308 20955 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:07:25.462633 20928 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:25.438164 20912 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:25.434980 20964 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.484407 15041 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:25.438591 20888 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:25.495028 21037 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:25.497450 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77671.3us
I20260709 13:07:25.482643 20871 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:25.527832 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.488736 20888 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.530200 14970 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:25.534250 20750 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.534852 20750 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.488024 20912 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.548077 15035 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:25.524091 20871 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.565104 15043 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:25.579772 15543 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:25.581221 20750 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:25.581915 20750 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.586614 20750 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.482656 21024 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.594566 15039 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:25.573012 20871 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:25.595542 20750 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.583421 20964 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.587307 20928 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.607577 21020 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.609053 20912 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.588512 20995 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:25.591142 20923 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.616719 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.588549 21051 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:25.598143 20996 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.630810 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.634371 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.635324 14970 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:25.633236 15546 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:25.651237 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.646386 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.702512 14966 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
W20260709 13:07:25.636755 21032 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:07:25.639910 21055 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.710157 20993 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.641269 21024 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.623095 20860 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:25.634217 20946 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.636384 21025 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:25.698401 20945 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.646008 20952 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.637230 21053 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:25.717541 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73585.1us
I20260709 13:07:25.620664 20928 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.642122 20957 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.636202 21049 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:25.622149 21020 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:25.698300 20964 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:25.638337 20923 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.638098 20995 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:25.735117 21060 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:25.735234 20928 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.736353 21044 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:25.637842 21051 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.739567 21042 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.731129 21025 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.743227 21053 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.762549 21025 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.762851 20923 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.763284 21053 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.763547 21042 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.764094 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.765261 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.765863 14964 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:25.767218 21051 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:25.764758 14968 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:25.767611 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.768661 15546 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:25.775599 21042 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.742903 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.759986 21060 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.778036 21060 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.729068 20946 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.781065 20946 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.781561 20946 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.782099 20946 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.741994 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.784037 14966 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:25.739925 21057 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:25.784521 20888 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.784849 21057 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.786517 20888 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.786221 20871 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.725927 20993 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.787810 15550 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:25.749562 21049 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.638239 20996 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:25.793707 15548 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:25.724772 21055 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.794819 21049 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.751638 20964 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.764410 20972 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:07:25.731829 20945 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:25.815829 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.815856 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.816011 15041 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:25.792845 20993 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.797274 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.820778 14894 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:25.800168 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:25.803290 20750 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:25.805897 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.806458 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:25.822638 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.807435 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.822999 14968 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:25.807737 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.808079 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.824026 14966 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:25.809319 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.811730 15549 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEARNER]: Advancing to term 14
I20260709 13:07:25.814502 15035 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:25.814765 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.816457 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:25.808580 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.817301 14962 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:25.817610 15043 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:25.816481 15545 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:25.798491 20946 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.743055 20952 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.833962 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.834329 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.834548 14961 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:25.834745 15039 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 7.
I20260709 13:07:25.834913 14892 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:25.834760 14967 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:07:25.830000 15035 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:07:25.830737 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:25.751839 21020 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.831705 14886 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:25.839082 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.832204 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.843612 14888 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 8.
I20260709 13:07:25.824153 14890 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:25.825529 15544 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:25.836220 14887 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.837594 14895 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:25.806483 21055 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:25.830940 15036 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:25.850087 20945 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:25.837559 21042 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:25.793980 21064 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:07:25.856297 21062 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:07:25.816718 20976 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:07:25.858677 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.860276 20990 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:25.860841 21050 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.861352 21050 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.862293 20995 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.868759 15041 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:25.869102 15549 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:25.846226 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:25.872413 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.877143 14889 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:25.887168 14887 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:25.853842 20964 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.894477 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:25.866849 20952 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.900482 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:25.906221 21066 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:25.910311 20964 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:25.917085 21020 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:25.917232 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:25.918233 20972 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:25.918375 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:25.885777 21049 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:25.920172 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.931491 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.926004 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.932046 14888 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:25.932474 14894 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:25.927129 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:25.927601 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:25.903827 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.936635 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.938920 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.941290 14964 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:25.942018 15543 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
W20260709 13:07:25.943135 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 127866us
I20260709 13:07:25.943606 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.944164 14964 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:25.944329 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.911000 21006 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 13:07:25.944976 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:25.946552 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:25.947559 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47167.5us
I20260709 13:07:25.947547 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.947759 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.948472 14962 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:25.948674 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:25.948480 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:25.949090 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:25.945508 14895 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:25.949278 15043 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:25.950430 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:25.951122 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:25.951715 15038 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:25.953369 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:25.980120 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.931169 20945 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.983943 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.984174 14893 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:07:25.952219 15043 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:25.944459 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:25.937000 21055 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:07:25.982652 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:25.895525 21062 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:07:25.939592 20984 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.984561 14961 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:25.986588 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:25.987136 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:25.987192 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:26.002539 14965 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:25.863387 21050 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:25.996140 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:25.949416 20888 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:25.992813 14887 raft_consensus.cc:2393] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 8: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:25.981001 20928 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:25.981530 20957 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:25.939069 20971 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 13:07:25.986383 20946 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:25.982919 20924 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:26.006321 15550 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:25.937772 21049 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:25.986260 20919 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:25.988390 21055 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.982623 20969 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
W20260709 13:07:26.035447 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46317.2us
I20260709 13:07:25.994517 20980 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.001816 20984 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.015667 20957 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:25.980831 20976 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:07:26.012527 20928 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.041880 21024 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.053920 21024 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.056299 21024 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.040521 20957 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:26.059640 20947 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.060312 20947 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.062950 20947 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.064280 21057 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.064770 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.065052 21056 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.065508 21056 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.065845 21056 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.066298 20912 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.066812 20912 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.037732 20919 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.068867 20912 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.070043 20919 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.070824 14967 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:26.032647 20924 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:26.072345 20924 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:26.033035 20888 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:26.074301 20888 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.035270 21055 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.073560 20928 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.084806 21049 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:25.995083 20945 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.040997 20984 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.086781 20871 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.087625 14966 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:26.005522 20935 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:26.040846 20980 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.069988 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.086830 20996 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:26.092640 21070 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:26.093559 20980 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.098249 20984 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.100736 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.101954 15546 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:26.102039 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.018405 20946 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.103047 20946 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.103467 21057 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:26.103869 21057 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:26.104220 21057 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.104799 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.105420 15541 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:26.095108 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:26.107565 20980 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:26.107991 20980 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.108304 20980 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.017156 21050 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:26.108754 21050 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.109138 21050 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:26.109148 20942 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.109663 20942 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.110006 20942 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.111752 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.111757 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.114744 20954 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:26.115810 21067 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.093s	user 0.000s	sys 0.002s
I20260709 13:07:26.116273 20860 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.116830 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1590) took 1058 ms. Trace:
I20260709 13:07:26.116776 20860 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.117906 20871 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:26.118479 20871 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:26.118719 20860 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.118866 20871 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.119679 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:26.117245 15542 rpcz_store.cc:276] 0709 13:07:25.058720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.058838 (+   118us) service_pool.cc:224] Handling call
0709 13:07:25.059157 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.059559 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.059597 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.061158 (+  1561us) log.cc:844] Serialized 26 byte log entry
0709 13:07:25.734125 (+672967us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b180011a8e0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:07:25.871579 (+137454us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:25.871611 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:25.871666 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.063018 (+191352us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:26.116626 (+ 53608us) raft_consensus.cc:1685] finished
0709 13:07:26.116660 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.116759 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2749,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":9494,"spinlock_wait_cycles":24498688,"thread_start_us":137241,"threads_started":1,"wal-append.queue_time_us":900687}
I20260709 13:07:26.122932 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 218) took 1017 ms. Trace:
I20260709 13:07:26.117933 20980 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.126394 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:26.126977 14961 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:26.126616 14792 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 18 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.128433 15514 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:26.129581 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.132829 21049 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:26.087092 20945 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.133296 21049 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:26.131130 15010 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:26.133714 21049 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.134807 20993 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:26.135208 20993 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.135576 20993 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.132560 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:26.135903 20946 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.136461 21020 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:26.136806 21020 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.137164 21020 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.137961 20946 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.132489 14792 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.139914 14792 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 16 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.141806 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.141487 14792 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.143301 14792 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.142474 14887 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:26.145792 14965 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
W20260709 13:07:26.039933 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91549.4us
I20260709 13:07:26.152179 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.160424 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.161106 14891 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.164129 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.164364 14792 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.165849 14792 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 16, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 16 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.175500 14792 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:26.177331 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 199923us
I20260709 13:07:26.179343 14792 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 8 to 9, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.180971 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 18 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 19 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.182487 14792 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 13 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.183947 14792 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 12, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 12 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:26.202610 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.202975 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.203507 14961 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:26.185361 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 18 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:26.203229 14893 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:26.155646 14894 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:26.210382 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:26.211104 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:26.141219 20928 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.213747 20928 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.214725 20957 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.144639 20871 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.215214 21071 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:26.126422 20980 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.123289 14791 rpcz_store.cc:276] 0709 13:07:25.105805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.105964 (+   159us) service_pool.cc:224] Handling call
0709 13:07:26.122878 (+1016914us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:25.385262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:25.385750 (+   488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:25.385778 (+    28us) write_op.cc:435] Acquired schema lock
0709 13:07:25.385795 (+    17us) tablet.cc:662] Decoding operations
0709 13:07:25.386120 (+   325us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:25.386172 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:25.386197 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:25.386372 (+   175us) tablet.cc:701] Row locks acquired
0709 13:07:25.386391 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:07:25.386528 (+   137us) write_op.cc:270] Start()
0709 13:07:25.386645 (+   117us) write_op.cc:276] Timestamp: P: 1783602445386477 usec, L: 0
0709 13:07:25.386669 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:07:25.387312 (+   643us) log.cc:844] Serialized 533 byte log entry
0709 13:07:25.430324 (+ 43012us) op_driver.cc:464] REPLICATION: finished
0709 13:07:25.458143 (+ 27819us) write_op.cc:301] APPLY: starting
0709 13:07:25.458234 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:25.459318 (+  1084us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:25.459461 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:25.460161 (+   700us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:25.460338 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:25.460382 (+    44us) write_op.cc:312] APPLY: finished
0709 13:07:25.460556 (+   174us) log.cc:844] Serialized 25 byte log entry
0709 13:07:25.460707 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.460784 (+    77us) write_op.cc:454] Released schema lock
0709 13:07:25.460823 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:25.461190 (+   367us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:25.461215 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"spinlock_wait_cycles":1664896,"child_traces":[["op",{"apply.queue_time_us":5824,"apply.run_cpu_time_us":3044,"apply.run_wall_time_us":3044,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":7231,"prepare.run_cpu_time_us":2398,"prepare.run_wall_time_us":16483,"replication_time_us":17135}]]}
I20260709 13:07:26.222668 20957 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.223136 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.222091 21071 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.223903 21071 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.224918 20871 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.216007 21038 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.227942 21038 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.228144 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.230075 21038 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.231815 21069 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:26.232230 21069 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:26.232576 21069 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.233255 14891 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:26.236433 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.237083 15546 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:26.238696 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:26.239135 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:26.240135 20946 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:26.240458 20964 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.240692 20946 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:26.241918 20946 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.242874 20923 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:26.243299 20923 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.243662 20923 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.207479 21060 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.244556 21060 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.246604 21060 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.247860 21020 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.249940 21020 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:26.255726 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 103650us
I20260709 13:07:26.240898 20964 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.256045 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.256407 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.234720 20924 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.257431 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.273944 14967 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:26.274919 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.282428 14961 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:07:26.283717 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:26.269804 20964 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.289496 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:26.292485 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 114371us
I20260709 13:07:26.269413 20943 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.296592 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:26.206650 20993 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.298749 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:26.300827 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:26.304416 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:26.310371 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:26.311121 14964 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:26.312281 15544 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:26.281577 20860 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.281159 20928 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.316846 15546 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:26.287748 21051 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:26.317894 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:26.318516 14962 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:26.287638 21020 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.321182 15043 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 13:07:26.323153 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:26.273999 20942 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.273495 21050 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.307965 21060 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:26.335839 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.315078 21053 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.251230 20923 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.351776 15040 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:07:26.341540 14963 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:26.307771 20992 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:26.321808 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 334793us
I20260709 13:07:26.296708 21049 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.273777 21056 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.293989 21057 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.374482 14969 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:26.335439 21051 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:26.298130 21069 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.382679 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.383229 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:26.385851 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.386884 15040 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:26.308262 20943 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.388273 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.389837 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.390115 20943 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.390650 15544 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:07:26.392009 21073 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:26.392190 21055 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.393858 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.394479 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.394896 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.395043 15043 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:26.395172 15545 raft_consensus.cc:2368] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:07:26.395609 15037 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:26.392010 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.395884 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.396390 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.396867 21048 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.397076 15037 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:26.397331 21048 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.397683 21048 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.397832 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.398435 15037 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:26.396509 15043 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:26.322337 20928 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.381970 15543 raft_consensus.cc:2955] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Committing config change with OpId 16.13: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:26.419819 14967 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
W20260709 13:07:26.421600 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44743.6us
I20260709 13:07:26.423198 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:26.427346 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.427940 15546 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:26.428799 14961 raft_consensus.cc:2368] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:26.359939 20995 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:26.412170 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.425721 15548 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:26.335229 21020 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:26.399756 21030 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:07:26.458035 20750 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:26.459650 20750 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.460001 20750 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:26.457684 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45600us
I20260709 13:07:26.461000 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:26.461756 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:26.457103 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.468065 15549 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:26.469254 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 86122.5us
I20260709 13:07:26.322779 20860 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.470468 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.480881 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.481819 14891 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:26.482120 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.482656 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.481833 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.483244 14894 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:26.381686 20954 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.487883 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.431675 21053 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:26.494050 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.494936 14891 raft_consensus.cc:2393] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:26.489660 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:26.382288 20945 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260709 13:07:26.496191 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.503736 14890 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.504954 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.495872 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:26.426370 21062 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 13:07:26.509073 20919 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:26.510341 20928 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.420274 21006 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:07:26.514468 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.520514 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.433796 20961 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260709 13:07:26.421479 20971 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:07:26.486487 21055 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:26.515524 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45139.7us
I20260709 13:07:26.346745 20952 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:26.558108 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46313.1us
I20260709 13:07:26.598832 20919 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.607393 14963 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:26.611944 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:26.557144 20888 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:26.587322 21053 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:26.609658 20919 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:26.504323 20954 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.611088 20924 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.495471 21081 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:26.518910 20972 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
I20260709 13:07:26.678546 20750 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.511314 21043 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.117s
I20260709 13:07:26.624735 20888 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:26.691823 21082 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 13:07:26.692240 21065 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.692536 20984 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:26.693480 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 203930us
I20260709 13:07:26.710951 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:26.706414 20750 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.672936 20993 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.736450 14967 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:26.736883 14963 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:26.618709 20975 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260709 13:07:26.715942 20952 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.724406 20995 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.732215 21050 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.697599 20871 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:26.751386 14969 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:26.748036 20917 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:26.692667 21022 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.237s
I20260709 13:07:26.764133 14963 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:26.756800 21083 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:07:26.756877 21069 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.776504 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:26.752023 20923 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.607039 21051 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.748993 20943 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:26.751576 20952 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:26.771873 14963 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:07:26.738890 20942 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.751292 20995 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:26.775624 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 155093us
I20260709 13:07:26.748397 21065 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.707901 20888 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:26.828953 21090 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:07:26.830348 21098 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:26.778589 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.834527 20995 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.836513 20995 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.775321 21076 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.347s
I20260709 13:07:26.794059 20984 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:26.842645 21065 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:26.844247 21089 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 13:07:26.845603 21078 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.356s	user 0.000s	sys 0.001s
I20260709 13:07:26.846195 21052 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.846923 21052 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.849475 21052 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.763522 20871 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.760757 20917 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:26.804950 14967 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:07:26.769480 21049 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.760802 21079 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:26.765058 21057 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:26.810313 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:26.856225 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46038.7us
I20260709 13:07:26.858461 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:26.859275 21104 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:26.820783 14968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e"
dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:57192
I20260709 13:07:26.868958 14968 raft_consensus.cc:606] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
I20260709 13:07:26.869374 14968 raft_consensus.cc:614] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:07:26.824541 21075 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.412s	user 0.001s	sys 0.000s
W20260709 13:07:26.824916 21086 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:07:26.824724 21106 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:26.825603 20954 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.826474 20860 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:26.847523 21094 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
I20260709 13:07:26.853736 20871 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.814975 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:26.892313 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.892696 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.854749 21079 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.861821 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:26.863056 14890 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:26.812448 20943 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:26.881028 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:26.884476 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.886439 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:26.859616 21020 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:26.890686 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:26.899839 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 253217us
I20260709 13:07:26.892866 15549 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.815994 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:26.890435 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.915107 14886 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.915197 15546 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:26.894212 15010 leader_election.cc:400] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:07:26.894767 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:26.895503 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.915988 15010 leader_election.cc:403] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:26.896410 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:26.900110 15548 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:26.916911 14890 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:26.897120 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.898144 14964 raft_consensus.cc:2368] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:26.898512 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:26.823972 21044 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 13:07:26.876888 20942 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:26.899273 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:26.921548 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53484.6us
I20260709 13:07:26.925786 14890 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:26.868911 20935 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:07:26.800031 21053 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:26.893409 21043 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.893213 21106 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:26.913506 20943 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:26.940596 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:26.934180 21056 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.961560 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:26.955606 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:27.013650 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58178us
I20260709 13:07:26.943861 21020 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:26.969107 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2944) took 1049 ms. Trace:
I20260709 13:07:26.976380 20871 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:26.979737 14962 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
W20260709 13:07:26.981173 21071 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.757s	user 0.008s	sys 0.002s
I20260709 13:07:26.981559 20917 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:26.983503 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:27.023294 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:26.983731 20964 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.686s	user 0.005s	sys 0.005s
I20260709 13:07:26.989111 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:26.929685 20923 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:07:26.932822 20942 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.028517 14962 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:07:27.033398 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:27.005803 15548 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:27.034654 14969 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:27.006510 15549 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:27.010186 20996 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.011705 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1574) took 1082 ms. Trace:
I20260709 13:07:26.967729 21109 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:27.015728 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:26.912912 20972 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 13:07:26.943252 21057 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.049357 15516 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:26.954394 14886 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:27.016883 15039 rpcz_store.cc:276] 0709 13:07:25.920210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.921758 (+  1548us) service_pool.cc:224] Handling call
0709 13:07:25.931562 (+  9804us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.931866 (+   304us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.931892 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.936951 (+  5059us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.344808 (+407857us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:26.344843 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.345403 (+   560us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:26.968904 (+623501us) raft_consensus.cc:1685] finished
0709 13:07:26.968929 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:26.969051 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":7013,"thread_start_us":340007,"threads_started":1,"wal-append.queue_time_us":519096}
I20260709 13:07:27.020969 20993 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:27.024210 15037 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:07:27.037496 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:27.056466 15547 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.039381 15550 rpcz_store.cc:276] 0709 13:07:25.929102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.929244 (+   142us) service_pool.cc:224] Handling call
0709 13:07:25.932471 (+  3227us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:25.934802 (+  2331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:25.934830 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:25.935792 (+   962us) log.cc:844] Serialized 556 byte log entry
0709 13:07:26.006216 (+ 70424us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:26.077926 (+ 71710us) log.cc:844] Serialized 14 byte log entry
0709 13:07:26.078149 (+   223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:26.078216 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.011483 (+933267us) raft_consensus.cc:1685] finished
0709 13:07:27.011505 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.011649 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7242,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":63216,"threads_started":1,"wal-append.queue_time_us":345649}
I20260709 13:07:27.050401 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:27.051326 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:27.058787 14895 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.051641 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:27.045715 21048 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.648s	user 0.012s	sys 0.000s
I20260709 13:07:26.975260 20919 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.065963 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:27.068184 15041 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
W20260709 13:07:27.069952 21088 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.612s	user 0.003s	sys 0.000s
I20260709 13:07:27.038995 20964 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.071612 20917 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.072503 20964 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.073102 21055 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:27.073518 21055 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.073882 21055 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:27.023880 21020 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.025342 20871 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.047719 20996 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.078436 20993 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:27.055229 21057 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.037467 20942 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:27.037194 21104 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:27.083910 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:27.054021 21049 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:27.047705 20992 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:27.088485 15042 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 13:07:26.996680 21106 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.092252 14895 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:27.078817 20952 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.109406 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:27.038807 21071 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.117892 15547 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:27.126669 20961 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:27.127110 20961 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:27.127957 20961 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.129169 20961 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:27.110746 20992 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.131459 20992 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.132369 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:27.100885 15546 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:27.084954 21079 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:26.992002 21043 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.102739 15516 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:27.136667 15516 leader_election.cc:403] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:27.104167 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:27.091847 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:27.137665 14886 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:27.106451 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:27.107510 15039 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:27.135521 15037 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:27.107591 20923 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 8. Current term is 9.
I20260709 13:07:27.071619 20888 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.142868 14965 raft_consensus.cc:2368] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
W20260709 13:07:27.143311 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 226918us
I20260709 13:07:27.124771 20964 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:27.093430 21048 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.148510 14892 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:27.144260 21049 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:27.156641 15516 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:27.165673 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:27.165879 14891 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:27.167943 15541 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:07:27.167150 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:27.169345 15044 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:07:27.172374 14889 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:27.160583 20964 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:27.178381 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:27.180896 14895 raft_consensus.cc:2368] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:27.164350 20984 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:27.179790 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:27.185702 15043 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:27.189616 14888 raft_consensus.cc:2368] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:27.177578 21051 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:07:27.148025 20993 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.200135 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:27.200711 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:27.207792 14886 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
W20260709 13:07:27.196069 21111 log.cc:927] Time spent T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 13:07:27.189853 20984 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:27.219585 21106 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.220789 20964 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.225823 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:27.233450 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:27.234958 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:27.236514 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45466.8us
I20260709 13:07:27.238415 15513 leader_election.cc:400] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:27.238883 15513 leader_election.cc:403] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:27.243767 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:27.209501 21051 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:27.198918 21049 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:07:27.225124 20984 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:27.250707 21048 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:27.227324 21020 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.255913 20957 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:27.239878 20923 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:27.256587 20923 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:27.233410 20919 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.271551 20923 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:27.273550 21115 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:07:27.274045 20871 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.246439 20996 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.275178 21043 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.247486 20943 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.283766 21051 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.288170 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:27.288371 20888 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.289045 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:27.292289 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:27.303040 15044 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 20
W20260709 13:07:27.272400 21116 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:07:27.272231 21071 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.314491 14966 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 13:07:27.283286 21055 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.330909 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:27.331187 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:27.307886 20952 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:27.333444 15543 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEARNER]: Advancing to term 14
I20260709 13:07:27.333451 15550 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:27.530970 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:27.526497 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:27.322371 20996 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.542470 15547 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:27.546180 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 212251us
I20260709 13:07:27.640053 15543 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEARNER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:27.523880 20947 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.693743 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3540) took 1746 ms. Trace:
I20260709 13:07:27.646260 15550 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:27.324025 20942 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.701290 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:27.702098 15035 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:27.694335 15036 rpcz_store.cc:276] 0709 13:07:25.944057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.947316 (+  3259us) service_pool.cc:224] Handling call
0709 13:07:25.947595 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.306272 (+358677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.306311 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.306812 (+   501us) log.cc:844] Serialized 26 byte log entry
0709 13:07:26.592604 (+285792us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:07:27.546581 (+953977us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b1800465220. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f553876e3c7 00007f5534d809a7 00007f5534d900bf
0709 13:07:27.581316 (+ 34735us) log.cc:844] Serialized 14 byte log entry
0709 13:07:27.636200 (+ 54884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.636298 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:27.636352 (+    54us) raft_consensus.cc:1685] finished
0709 13:07:27.690379 (+ 54027us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:27.690524 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50967,"prepare.queue_time_us":29376,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":23121,"raft.queue_time_us":105158,"raft.run_cpu_time_us":302,"raft.run_wall_time_us":19155,"spinlock_wait_cycles":3697920,"thread_start_us":763009,"threads_started":3,"wal-append.queue_time_us":451979}
I20260709 13:07:27.685990 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:27.653709 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:27.316087 21065 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:27.545168 20954 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:27.697888 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:27.694221 15010 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:27.592460 21109 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
W20260709 13:07:27.754519 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61366.2us
I20260709 13:07:27.787572 15548 raft_consensus.cc:2368] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20.
I20260709 13:07:27.678236 20914 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:27.796231 15547 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:27.800541 14961 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
W20260709 13:07:27.808266 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 114157us
I20260709 13:07:27.705538 20947 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:27.819763 21122 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.515s	user 0.001s	sys 0.000s
I20260709 13:07:27.819993 20993 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:27.796778 21092 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:27.690704 20996 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.842952 15035 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:27.850087 21053 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.856484 20919 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:27.868791 21022 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:27.863127 20993 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:27.877130 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 1439) took 1467 ms. Trace:
I20260709 13:07:27.878265 20943 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.879256 21055 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.879329 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1582) took 1558 ms. Trace:
W20260709 13:07:27.892663 15044 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.000s
W20260709 13:07:27.884627 20984 consensus_meta.cc:287] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.634s	user 0.012s	sys 0.004s
I20260709 13:07:27.851092 21071 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:27.914193 15044 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:27.912396 15544 rpcz_store.cc:276] 0709 13:07:26.409553 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.409729 (+   176us) service_pool.cc:224] Handling call
0709 13:07:27.876717 (+1466988us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540036db54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:27.876912 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946428160}
I20260709 13:07:27.912657 15541 rpcz_store.cc:276] 0709 13:07:26.320589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.320697 (+   108us) service_pool.cc:224] Handling call
0709 13:07:26.340239 (+ 19542us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.169279 (+829040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.879004 (+709725us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54004c5254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:27.879256 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1903181696}
I20260709 13:07:27.886018 20947 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.879616 20942 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:27.899567 20945 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:27.912160 21064 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.927204 20952 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.933043 21055 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:27.940847 20945 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:27.941192 21055 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.879655 21039 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:07:27.950269 15514 leader_election.cc:400] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:27.950650 15514 leader_election.cc:403] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:27.913985 21107 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.907871 21043 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:27.907687 21022 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:27.811656 20954 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.951462 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:27.966912 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:27.941357 21085 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:27.912377 20919 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.924024 21109 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:27.986228 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:27.961120 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:27.940155 20952 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.969667 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:27.952971 15008 leader_election.cc:400] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:27.982409 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:27.954244 20945 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:27.988034 14967 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:27.952493 20888 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:27.925002 20984 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.988420 15008 leader_election.cc:403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:28.015782 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66199.4us
I20260709 13:07:27.912117 21053 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.990626 14964 raft_consensus.cc:2368] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20.
I20260709 13:07:27.928406 21071 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.959429 20942 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:27.958194 21104 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:27.982998 20923 consensus_meta.cc:287] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.673s	user 0.007s	sys 0.003s
I20260709 13:07:27.961635 21081 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:27.971974 20961 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:28.018000 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 205717us
I20260709 13:07:28.020160 14967 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:27.972311 21125 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:27.946925 21064 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:27.963580 21107 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.032919 15542 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:27.987215 21085 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.042761 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.041021 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:28.047727 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:28.049556 14962 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:28.049719 14970 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:27.967983 21043 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.046790 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2952) took 1698 ms. Trace:
I20260709 13:07:28.051374 15038 rpcz_store.cc:276] 0709 13:07:26.348599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.350669 (+  2070us) service_pool.cc:224] Handling call
0709 13:07:26.351016 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.512396 (+161380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.512426 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:26.986968 (+474542us) spinlock_profiling.cc:243] Waited 74.6 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:07:26.987424 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.160371 (+172947us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:27.160424 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.046495 (+886071us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b540014aad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:28.046551 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.046600 (+    49us) raft_consensus.cc:1685] finished
0709 13:07:28.046618 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.046738 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130254,"raft.queue_time_us":127501,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":80158,"spinlock_wait_cycles":249447552,"thread_start_us":172554,"threads_started":1,"wal-append.queue_time_us":205237}
I20260709 13:07:28.064985 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:28.072678 14887 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:28.066881 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:28.048633 21129 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:07:28.040060 20961 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:27.995682 21109 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.033869 20888 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 13:07:28.071177 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.034174 20942 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.046250 21135 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.037251 20923 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.014415 20993 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.036298 21104 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.050897 21125 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.093717 14888 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:28.114640 14887 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:28.030972 21022 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.042227 21081 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.070497 21065 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.102329 20996 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.121877 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.126602 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:28.098460 14962 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:28.161489 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 193431us
I20260709 13:07:28.116827 20919 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.122750 20984 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.153182 20917 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:28.181507 15514 leader_election.cc:400] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:28.188040 15514 leader_election.cc:403] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.103106 21135 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.109660 21125 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.163333 21022 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:28.159497 20952 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.187788 20917 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:28.190506 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:28.157900 21130 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:07:28.191847 15548 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:28.128192 21055 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.164507 20962 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:07:28.208315 15546 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:28.209410 15541 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:07:28.119946 20961 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.183072 20947 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.193714 21126 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:07:28.200739 20945 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:07:28.211181 14961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 1476) took 1387 ms (client timeout 1562 ms). Trace:
I20260709 13:07:28.220376 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2691) took 1481 ms. Trace:
I20260709 13:07:28.229899 14966 rpcz_store.cc:276] 0709 13:07:26.734806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.735819 (+  1013us) service_pool.cc:224] Handling call
0709 13:07:26.740429 (+  4610us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.315037 (+574608us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.216505 (+901468us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003093d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:28.216672 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319927552}
I20260709 13:07:28.162794 20918 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:28.220517 20917 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.223668 20875 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:28.199630 20984 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:28.239780 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 376190us
W20260709 13:07:28.229149 14961 rpcz_store.cc:269] 0709 13:07:26.812496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.882110 (+ 69614us) service_pool.cc:224] Handling call
0709 13:07:28.199328 (+1317218us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54000b77d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:28.199977 (+   649us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033880960}
I20260709 13:07:28.120775 21137 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14.
I20260709 13:07:28.214478 21053 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.214275 20952 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.220434 21055 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17.
I20260709 13:07:28.219132 21071 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:28.236375 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:28.245375 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 229010us
I20260709 13:07:28.254951 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:28.257952 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.258714 14962 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:28.263352 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.265664 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:28.241879 21128 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:07:28.293944 15513 leader_election.cc:400] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:28.241966 20961 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:28.295037 15513 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:28.238225 21064 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.241601 20875 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:28.240833 21043 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.239082 20945 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:28.245005 20917 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.303721 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1591) took 1136 ms. Trace:
I20260709 13:07:28.227087 20947 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.249008 21107 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:28.339449 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 253593us
I20260709 13:07:28.300032 21081 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.314850 21142 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.315048 14968 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:28.319675 21055 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.321650 20875 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.322494 21104 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.297447 21141 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:28.293926 20918 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:28.323868 20945 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.245234 20984 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.286936 21053 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.268513 20952 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.306918 15549 rpcz_store.cc:276] 0709 13:07:27.167183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.167430 (+   247us) service_pool.cc:224] Handling call
0709 13:07:27.179240 (+ 11810us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:27.179583 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:27.179611 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.188589 (+  8978us) log.cc:844] Serialized 26 byte log entry
0709 13:07:27.542500 (+353911us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:27.542543 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:27.542605 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.303473 (+760868us) raft_consensus.cc:1685] finished
0709 13:07:28.303500 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.303654 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":509,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10653,"thread_start_us":333557,"threads_started":1,"wal-append.queue_time_us":873453}
I20260709 13:07:28.284171 21137 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.302733 21109 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.309386 21064 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.309120 20942 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:28.361186 15514 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.562s (SENT) [suppressed 29 similar messages]
I20260709 13:07:28.364351 20875 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.344086 20923 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:28.377370 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 334985us
I20260709 13:07:28.395200 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 2963) took 1507 ms. Trace:
I20260709 13:07:28.395759 21064 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.398913 21064 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:28.400774 21133 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.385s	user 0.002s	sys 0.000s
I20260709 13:07:28.402916 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:28.404297 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:28.404585 20943 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.405102 20943 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.412081 21057 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.421482 20996 raft_consensus.cc:2764] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260709 13:07:28.422997 20996 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:28.423871 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1368) took 1382 ms. Trace:
I20260709 13:07:28.403224 20888 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:28.362694 21141 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:28.424362 15041 rpcz_store.cc:276] 0709 13:07:27.041316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:27.101963 (+ 60647us) service_pool.cc:224] Handling call
0709 13:07:28.423591 (+1321628us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b54000898d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:28.423771 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435922304}
I20260709 13:07:28.395593 15040 rpcz_store.cc:276] 0709 13:07:26.887925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.890933 (+  3008us) service_pool.cc:224] Handling call
0709 13:07:26.891496 (+   563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:26.895829 (+  4333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:26.895857 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:27.855955 (+960098us) spinlock_profiling.cc:243] Waited 4.97 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:07:27.911250 (+ 55295us) log.cc:844] Serialized 26 byte log entry
0709 13:07:28.103354 (+192104us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:07:28.103428 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:28.103522 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:28.394932 (+291410us) raft_consensus.cc:1685] finished
0709 13:07:28.394950 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:28.395143 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8324,"raft.queue_time_us":508,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":30650,"spinlock_wait_cycles":11427072,"thread_start_us":157586,"threads_started":1,"wal-append.queue_time_us":410852}
I20260709 13:07:28.386749 14970 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:28.362047 21055 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.411342 20947 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:28.449311 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 322835us
W20260709 13:07:28.460413 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 191143us
I20260709 13:07:28.462939 15008 leader_election.cc:400] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20.
I20260709 13:07:28.465889 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:28.466820 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62613.3us
I20260709 13:07:28.468736 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.469985 15037 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:28.470642 15044 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:28.468906 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.471662 20923 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:28.472365 15010 leader_election.cc:400] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20.
I20260709 13:07:28.472698 15010 leader_election.cc:403] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:28.473738 21107 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20.
I20260709 13:07:28.474324 20923 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:28.475214 20923 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.474932 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:28.471693 15042 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:28.481889 21107 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.482532 21107 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.481859 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:28.484759 21107 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.485283 21107 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:28.485850 21107 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:28.489200 20996 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.489840 20996 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.490692 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:28.491240 15035 raft_consensus.cc:606] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:28.491585 15035 raft_consensus.cc:614] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:28.497767 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:28.498440 15035 raft_consensus.cc:606] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:28.527837 20947 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:28.383812 21053 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.516996 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:28.385073 21137 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:28.537523 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 176398us
I20260709 13:07:28.537843 15043 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:28.448099 21135 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.544895 14966 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:07:28.544992 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.552474 14894 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:28.547433 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.553663 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:28.554847 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.516727 20943 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.511845 21076 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.561697 14961 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:28.564036 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.486897 21107 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.536724 20947 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.618685 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.623246 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.539274 21125 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.626271 14964 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:28.548827 20871 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.541714 20942 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:28.634116 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.635782 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.639930 14894 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:28.634990 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:28.560084 20996 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:28.636965 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.638296 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.550462 21051 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.640853 14887 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:28.567011 21146 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.559574 21163 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:28.658260 20914 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.660025 20942 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:28.660188 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.640377 20971 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:28.661192 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 366331us
W20260709 13:07:28.677986 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 313004us
I20260709 13:07:28.658041 21125 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:07:28.638875 20947 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:28.680001 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.677796 20971 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.680747 21125 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:28.681245 21147 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 13:07:28.681478 20947 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.681280 21125 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.683583 21125 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.684032 21125 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.684494 21125 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.675503 21051 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.686892 21125 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.687415 21125 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.687855 21125 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.676463 14887 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:28.689798 21125 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.690670 21125 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.690953 21119 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:07:28.691737 21051 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.692070 21064 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:28.692579 21064 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:28.690953 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:28.691129 21125 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.695219 15035 raft_consensus.cc:606] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:28.695574 15035 raft_consensus.cc:614] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:28.696609 21125 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.697988 21119 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:28.699473 21022 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:28.699910 21022 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:28.700536 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:28.701078 14886 raft_consensus.cc:606] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:28.701433 14886 raft_consensus.cc:614] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:28.703307 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.703559 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:28.704063 14895 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:28.707966 21152 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:07:28.708990 20952 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:28.709254 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.711023 20996 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.711723 20996 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.712410 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:28.714231 20996 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.714854 20996 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.719218 21155 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:28.720073 20942 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.622200 21149 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.109s
W20260709 13:07:28.722500 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.543079 21141 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.623062 21076 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.667690 21163 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.668910 20888 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.672035 21057 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.718967 20964 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:28.663058 20914 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:28.734684 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 203167us
I20260709 13:07:28.735860 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.748582 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:28.749158 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.750320 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:28.725373 14895 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:28.751638 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.754709 14888 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:28.641623 20871 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.743765 21159 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.752848 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.753955 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.752225 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.845498 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:28.752341 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.756595 14961 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:07:28.760689 20914 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.763677 20984 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:28.764031 21154 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:07:28.873690 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 161379us
I20260709 13:07:28.768316 21053 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.769408 21022 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.770382 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:28.842345 21145 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.846450 20947 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.771914 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.772048 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.773056 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:28.721236 20996 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.670341 21146 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.774560 21137 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.781885 21172 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.907951 21172 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.910920 21172 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.776152 21076 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.787954 21064 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.882652 20947 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.912299 21064 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:28.880214 20984 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.913261 20984 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.788513 20971 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.791896 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:28.754268 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.916777 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.917405 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:28.735775 21163 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:28.799518 21055 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.776903 21085 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.802181 21006 raft_consensus.cc:1064] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:28.803795 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:28.923877 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 120190us
I20260709 13:07:28.780941 20954 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.925156 21006 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.754878 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:28.805362 14963 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 13:07:28.926796 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 172222us
I20260709 13:07:28.927160 21172 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:28.808502 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.811133 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.812203 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.930016 14892 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
W20260709 13:07:28.744344 21119 consensus_queue.cc:1175] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "58ee9fe38eb8453098f6d964e7675e79" responder_term: 14 status { last_received { term: 14 index: 13 } last_committed_idx: 12 last_received_current_leader { term: 14 index: 13 } }
I20260709 13:07:28.946578 21055 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:28.947165 21055 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.948333 21173 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:28.949193 21055 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.948992 21173 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.822494 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:07:28.950543 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 128153us
I20260709 13:07:28.952697 21141 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.919075 21022 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:28.825901 14894 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:07:28.957679 14894 pending_rounds.cc:85] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 9
I20260709 13:07:28.957986 14894 pending_rounds.cc:107] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:07:28.958105 20984 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.958405 14894 raft_consensus.cc:2889] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:28.958950 20984 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:28.959450 20984 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.959921 20984 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.960312 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:28.961064 15544 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:28.962098 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:28.962762 15549 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:28.963814 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:28.826161 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.827716 15543 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:28.829115 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:28.831597 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.833405 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.970815 15037 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:07:28.837455 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:28.971494 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:28.840626 14889 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:28.841562 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.843717 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.844378 14962 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:28.846586 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.847821 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:28.848124 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:28.975296 14967 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:28.820868 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:28.975965 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 146961us
I20260709 13:07:28.976256 14895 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:28.976689 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:28.977456 21176 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:28.978125 21176 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:28.854384 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:28.979794 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125504us
I20260709 13:07:28.981040 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:28.982234 20943 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:28.982707 20943 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:28.983124 20943 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:28.855538 21159 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.859702 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:28.983835 15039 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:28.865540 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.867691 15040 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:28.849166 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:28.985412 21159 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.985668 15541 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:28.986928 20954 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:28.987450 20954 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:28.987902 20954 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.990087 20943 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.765106 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:28.979019 21176 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.968453 21053 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.877933 15043 raft_consensus.cc:2368] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:28.748395 21057 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.993649 15541 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:28.994496 21057 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.744076 20888 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.878046 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:28.995769 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 117820us
I20260709 13:07:28.996636 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:28.997437 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 72437.4us
I20260709 13:07:28.997694 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:28.998759 21142 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:28.999233 21142 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:28.999502 20914 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:28.999740 21142 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.000427 20914 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:29.001065 20914 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:29.002095 20914 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:28.873857 20875 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:29.003722 20875 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.005486 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:29.006194 20875 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.006407 20964 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:29.006968 21172 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:29.007458 21107 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:29.007876 21107 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:29.008219 21107 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:28.879921 21145 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.010300 21145 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:28.890853 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:29.011457 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 120699us
I20260709 13:07:29.012708 20971 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:29.012802 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.013309 20971 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:28.899751 15035 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.014671 21076 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:29.015046 21076 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.015199 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.015435 21076 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.015993 14969 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:28.901192 20996 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:28.904038 21146 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.917330 14966 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:28.794067 20871 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:28.925761 21137 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:29.020732 21137 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:29.020807 20947 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.021252 20888 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.021955 21173 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:28.933271 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.024485 20971 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:29.024974 20971 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:29.025847 20971 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.026398 14893 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:07:29.026894 20971 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:29.027374 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.028189 14895 raft_consensus.cc:2410] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 13:07:29.030095 14966 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:29.030297 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.032065 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.032402 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:28.939083 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:28.991992 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 227018us
I20260709 13:07:29.033421 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:28.875924 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.021695 21137 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:28.758594 21155 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:29.053583 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.022120 20945 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:29.034373 15541 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:29.034991 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.038059 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:29.046185 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.031522 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.054025 14936 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.057242 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:29.059391 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 120456us
I20260709 13:07:29.060987 15035 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:29.062351 14887 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:07:29.072216 14887 pending_rounds.cc:85] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 7
I20260709 13:07:29.072081 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.072479 14887 pending_rounds.cc:107] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:07:29.072762 14887 raft_consensus.cc:2889] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:29.074177 14887 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:29.074561 14887 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:29.081307 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.082444 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.083176 14886 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:29.084475 15548 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:29.084896 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.085498 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:29.086890 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58728.7us
I20260709 13:07:29.078787 14887 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.090935 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.091230 14887 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:29.093040 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.094461 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:29.098170 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.102221 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.103000 14888 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:29.080139 20871 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:29.106487 20952 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:07:29.114687 20871 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.115022 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.120438 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.080943 21173 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:29.088428 20888 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:29.081420 21064 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:29.117410 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.122244 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.122893 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.080075 20947 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:29.080616 21177 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.129320 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.124337 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.125607 15513 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.135185 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.142764 15043 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:29.135188 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.143965 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.141848 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.145999 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.109185 20923 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:29.107986 21155 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:29.155311 15513 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:29.155704 15513 leader_election.cc:403] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:07:29.116192 20942 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:29.163254 14887 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:29.131202 21151 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:29.131434 21044 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:29.169839 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.119840 20993 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.106738 21148 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:07:29.130419 20888 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:29.178326 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.151310 21172 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.145093 21053 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.157140 21173 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:29.184388 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46464.2us
I20260709 13:07:29.191074 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.173867 21104 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:29.168587 20996 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:29.172995 21069 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:29.192272 15516 leader_election.cc:400] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:29.173290 21125 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:29.198496 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.180548 20943 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.192799 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.193019 21163 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.173717 21151 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:29.203655 21151 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.149451 21149 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
W20260709 13:07:29.194293 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 48368.5us
I20260709 13:07:29.195519 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.196058 15545 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:29.208431 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.203389 21163 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:29.181380 21044 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:29.211452 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.150768 21064 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:29.186337 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.200227 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.214466 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.215233 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:29.216218 21149 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.217053 21149 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:29.217263 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.217509 21149 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:29.180409 21176 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.174743 20972 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.184584 20888 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:29.219206 21053 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:29.219784 21053 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:29.219256 21176 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.220180 21053 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.222338 21176 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.216043 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.219293 20972 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.225584 20972 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.210527 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.226884 14893 raft_consensus.cc:2410] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:29.196825 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.190469 21159 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:29.228171 21159 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.230124 15549 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:29.230491 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.231500 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.232102 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.232432 20888 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.232612 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.233464 15546 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:29.233745 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.236793 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.174682 21160 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.048s
I20260709 13:07:29.239488 14888 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:07:29.241420 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:29.243870 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.197351 21145 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:29.245272 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.253080 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.149772 21177 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:29.254050 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.254725 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.245642 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.255704 14963 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:29.210875 21173 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:29.257920 14886 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
W20260709 13:07:29.253810 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 135314us
I20260709 13:07:29.260087 21176 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.234930 21171 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:07:29.268442 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:29.269497 21183 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:07:29.218395 21149 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.256464 21051 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:29.253284 21135 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:07:29.210697 21104 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.280916 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.299641 14963 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:29.300894 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.290095 15513 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.212630 21044 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.292882 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.293159 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:29.295709 15039 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:07:29.240278 21076 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.246623 21155 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.286595 21145 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.285048 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:29.310264 21148 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:29.315646 21145 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.317270 21104 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.317396 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.317731 21145 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.318192 21125 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:29.320775 21076 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.297854 21193 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:07:29.323325 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:29.323760 21178 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
W20260709 13:07:29.325506 21181 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:07:29.312902 20961 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.331825 20961 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:29.334705 20961 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.348505 14962 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
W20260709 13:07:29.350052 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 65108.1us
I20260709 13:07:29.351076 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.352423 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:29.354884 14889 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:29.358134 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:29.363200 21186 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:07:29.366199 21125 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:29.366698 21171 raft_consensus.cc:2764] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260709 13:07:29.367821 21182 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:07:29.379381 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:29.381974 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.382856 14963 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:29.366282 21163 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:29.371258 21193 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:29.309537 21053 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:29.391708 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 337859us
I20260709 13:07:29.395048 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:29.368294 21142 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.400842 21142 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:29.402184 21151 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.402769 21053 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.371907 21148 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:29.409615 21148 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:29.404472 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.405169 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:29.414629 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.416627 14967 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:07:29.417801 14963 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:07:29.421060 21199 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:29.462741 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.466095 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.466874 14968 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:29.469326 21064 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.473500 21044 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:29.403752 20871 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.475854 21085 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:29.476274 20954 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.461410 20943 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:29.478125 20888 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:29.479332 21190 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 13:07:29.480152 21191 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:07:29.480291 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:29.483944 21196 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:07:29.554984 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:29.555333 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 164319us
I20260709 13:07:29.490525 15044 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:29.491113 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.381572 21171 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:29.492870 21170 raft_consensus.cc:993] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:29.393646 21193 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:29.498850 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.563483 15043 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:29.499428 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 321) took 4184 ms. Trace:
I20260709 13:07:29.528334 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:29.412760 20945 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:29.477505 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.545579 14893 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:29.544423 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 125101us
I20260709 13:07:29.478158 21151 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.559796 14964 raft_consensus.cc:2410] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 13:07:29.560550 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:29.566042 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:29.570078 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.550010 21173 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:29.572294 15044 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.575040 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:29.575570 15036 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:29.566812 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.573684 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.565778 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.577184 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.578166 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.579052 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.574496 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.579823 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:29.553045 20943 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:29.582886 20935 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:29.583328 20935 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:29.583858 20935 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:29.584761 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.585734 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.586675 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.587239 21135 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:29.587580 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.590809 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.593089 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.589223 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.596102 21135 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:29.598129 21043 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.598485 21159 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.598618 21043 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.600292 21044 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.600687 21043 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.601397 20943 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.603572 21206 raft_consensus.cc:1081] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:29.603904 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:29.605770 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:29.608172 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.609207 14966 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:29.610198 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:29.612021 21141 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.659s	user 0.011s	sys 0.000s
W20260709 13:07:29.612151 21197 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:29.613301 20935 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:29.566824 21193 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:29.623263 20935 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.624994 14969 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:07:29.628356 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.630631 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:29.564239 14792 rpcz_store.cc:276] 0709 13:07:25.314911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.328319 (+ 13408us) service_pool.cc:224] Handling call
0709 13:07:29.499349 (+4171030us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:26.705103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:26.842359 (+137256us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:26.842403 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:26.842426 (+    23us) tablet.cc:662] Decoding operations
0709 13:07:26.843794 (+  1368us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:26.843861 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:26.843894 (+    33us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:07:26.845123 (+  1229us) tablet.cc:701] Row locks acquired
0709 13:07:26.845144 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:07:26.845298 (+   154us) write_op.cc:270] Start()
0709 13:07:26.845418 (+   120us) write_op.cc:276] Timestamp: P: 1783602446845244 usec, L: 0
0709 13:07:26.845443 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:07:26.846168 (+   725us) log.cc:844] Serialized 5196 byte log entry
0709 13:07:27.763739 (+917571us) op_driver.cc:464] REPLICATION: finished
0709 13:07:28.419568 (+655829us) write_op.cc:301] APPLY: starting
0709 13:07:28.419679 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:28.796849 (+377170us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:28.796952 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:28.970124 (+173172us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:28.970395 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 13:07:28.970437 (+    42us) write_op.cc:312] APPLY: finished
0709 13:07:28.970812 (+   375us) log.cc:844] Serialized 121 byte log entry
0709 13:07:29.200501 (+229689us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.236302 (+ 35801us) write_op.cc:454] Released schema lock
0709 13:07:29.251372 (+ 15070us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:29.312048 (+ 60676us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:29.314796 (+  2748us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5904,"reported_tablets":14,"child_traces":[["op",{"apply.queue_time_us":583192,"apply.run_cpu_time_us":40984,"apply.run_wall_time_us":871451,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58467,"num_ops":13,"prepare.queue_time_us":300987,"prepare.run_cpu_time_us":98972,"prepare.run_wall_time_us":517492,"raft.queue_time_us":393057,"raft.run_cpu_time_us":43314,"raft.run_wall_time_us":544436,"replication_time_us":853354,"spinlock_wait_cycles":23164672,"thread_start_us":1108717,"threads_started":5,"wal-append.queue_time_us":697683,"wal-append.run_cpu_time_us":14333,"wal-append.run_wall_time_us":1098215}]]}
I20260709 13:07:29.566339 21163 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:29.636890 20914 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:29.639724 21163 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:29.615267 21107 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.607s	user 0.008s	sys 0.000s
I20260709 13:07:29.665508 14961 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:29.574215 20945 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:29.678030 15044 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:29.689343 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
W20260709 13:07:29.711863 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.634406 21151 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:07:29.726481 21146 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:29.727293 21146 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.730135 21146 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:29.747321 14967 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:29.751004 14967 raft_consensus.cc:1217] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Deduplicated request from leader. Original: 11.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 13:07:29.793313 14967 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 13:07:29.764567 20954 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.666777 21107 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:29.766812 21189 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.496s	user 0.005s	sys 0.000s
I20260709 13:07:29.786979 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:29.789031 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.790274 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.790732 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.793381 15543 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:29.762610 20945 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.809561 15040 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:29.831640 15035 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:29.808781 21146 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:29.838696 20984 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.878s	user 0.012s	sys 0.001s
I20260709 13:07:29.858343 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:29.876240 21184 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.598s	user 0.000s	sys 0.002s
I20260709 13:07:29.892108 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:29.893635 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:29.904857 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.871179 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.938001 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:29.943805 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.795316 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.799605 15548 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:29.951599 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.800258 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.954452 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:29.955561 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.955703 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:29.956252 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:29.954658 14966 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:29.957994 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:29.958877 15549 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:29.956976 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:29.963349 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:29.849992 20984 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:29.976286 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:29.980726 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.984825 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:29.988345 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:29.987310 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:29.993647 15544 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:07:29.988456 21151 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:29.986218 21187 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:29.997092 21187 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:30.000070 21218 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:30.000978 21187 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:29.976925 21057 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.007879 21057 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:30.008392 21057 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.010574 21193 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.025553 20918 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:30.026539 21193 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:30.028134 15542 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:29.989112 21104 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.011s	sys 0.015s
I20260709 13:07:29.850872 21146 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:30.022115 21155 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.004s	sys 0.008s
I20260709 13:07:30.034171 21141 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:30.036461 21141 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.037333 21141 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.030390 21022 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:30.038473 21141 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:30.038815 21146 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:30.034312 21151 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.038652 21022 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:30.044565 20972 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.044770 21044 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.045115 20972 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.043205 21022 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:30.045477 21044 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.043354 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:30.049191 14895 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:30.039911 21151 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.049513 21044 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.055505 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:30.065999 14895 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:07:30.032793 21104 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.011s	sys 0.016s
I20260709 13:07:30.077744 14887 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:30.096356 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.099200 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:30.100004 15036 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:30.035533 21155 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.004s	sys 0.008s
I20260709 13:07:30.123360 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:30.124029 15041 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:30.125257 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.057819 20972 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:30.065958 21107 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:30.152215 14964 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:30.149693 15546 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:30.197554 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:30.163095 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.198737 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 74854.1us
I20260709 13:07:30.199076 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.151499 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:30.189680 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.201061 14966 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:30.154135 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:30.206614 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:30.206781 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.208770 15036 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:30.106956 21199 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
W20260709 13:07:30.233405 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79376.8us
I20260709 13:07:30.245714 21135 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:30.206466 21146 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:30.248523 21146 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.248919 21146 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:30.188990 20954 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:07:30.259030 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:30.126315 21043 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260709 13:07:30.259882 20972 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:30.260413 20972 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.261463 20972 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:30.264559 20984 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:30.264959 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1602) took 1311 ms. Trace:
I20260709 13:07:30.265370 15542 rpcz_store.cc:276] 0709 13:07:28.953153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:28.965153 (+ 12000us) service_pool.cc:224] Handling call
0709 13:07:28.965503 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:30.028605 (+1063102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.264742 (+236137us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54005d1bd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:30.264901 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2443998464}
W20260709 13:07:30.268746 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 224552us
W20260709 13:07:30.274307 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.209538 21125 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.267845 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:30.279192 21119 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:30.280297 21119 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:30.280730 21119 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.281653 21119 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:30.283555 20971 consensus_meta.cc:287] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.256s	user 0.015s	sys 0.000s
W20260709 13:07:30.284118 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:30.265878 20984 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:30.298606 21057 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.300189 21163 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.303834 15041 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:07:30.271989 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66224.4us
I20260709 13:07:30.306882 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.305763 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:30.283316 21119 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.328200 21135 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:30.333148 21135 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.335912 14895 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:30.336042 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97790.9us
I20260709 13:07:30.300922 21146 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.338397 21146 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:30.339552 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:30.340106 14886 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:30.348405 14886 raft_consensus.cc:2410] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:07:30.260396 21043 consensus_queue.cc:1243] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:30.360176 21177 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.362095 20961 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:30.362638 20961 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:30.365010 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49033.5us
I20260709 13:07:30.366143 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:30.328769 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:30.375770 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:30.376113 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 171342us
I20260709 13:07:30.376900 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.328944 20971 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:30.328552 21125 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.391197 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.405242 20971 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:30.410815 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 82128.4us
I20260709 13:07:30.411432 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:30.384274 21119 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:30.412112 21146 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:30.383705 20961 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.408059 21151 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:30.410270 21192 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.418715 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4022) took 1178 ms. Trace:
I20260709 13:07:30.418414 20971 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.426182 14889 rpcz_store.cc:276] 0709 13:07:29.240650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.241188 (+   538us) service_pool.cc:224] Handling call
0709 13:07:30.418477 (+1177289us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540015bb54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:30.418630 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":235297152}
I20260709 13:07:30.421936 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.426594 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:30.426477 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:30.429091 14965 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:30.420112 21043 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:30.435535 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:30.427453 20961 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.439658 20984 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.425128 20917 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:30.426496 21141 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:30.444775 21022 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.436474 21173 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:30.445727 21100 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:30.447768 20942 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:30.424443 21146 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:30.453305 21057 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:30.454613 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1383) took 1423 ms. Trace:
I20260709 13:07:30.489792 15039 rpcz_store.cc:276] 0709 13:07:29.031482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.031801 (+   319us) service_pool.cc:224] Handling call
0709 13:07:29.052184 (+ 20383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:29.308340 (+256156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:30.454402 (+1146062us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540014bed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:30.454555 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":559522048}
I20260709 13:07:30.453342 21159 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:30.488507 20942 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:30.494347 15039 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:30.458938 14788 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.492676 21159 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.496706 21159 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.498301 21159 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:30.492805 21214 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.499704 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.499873 21214 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:30.502938 21214 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:30.492689 21177 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.504438 21177 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.486446 20984 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.507001 21177 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.429060 21192 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.478371 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.525800 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:30.481657 21149 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.006s	sys 0.000s
W20260709 13:07:30.487620 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 52164.6us
I20260709 13:07:30.533066 15514 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.491616 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.429700 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:30.534426 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 104858us
I20260709 13:07:30.493100 15037 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:30.507318 20984 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:30.554986 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 76728.9us
I20260709 13:07:30.537844 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:30.507690 21100 consensus_queue.cc:1243] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:30.508118 20942 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.435575 21119 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:30.510666 14788 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 14, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:30.513494 14965 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:30.570369 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.571434 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.514952 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.572795 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.515198 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.515552 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.519970 14887 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:30.520674 15044 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:30.524533 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.577071 15035 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:30.491158 21146 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:30.492370 21236 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:30.555748 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.554102 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.562919 15548 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:30.569456 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:30.513330 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:30.574044 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:30.556668 21149 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.006s	sys 0.001s
I20260709 13:07:30.581396 15543 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:30.581691 15545 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:30.605755 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:30.606418 14970 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:30.607503 15043 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:30.608173 15548 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:30.583745 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.608487 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.554080 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:30.588183 15550 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:30.579481 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.600284 15041 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:30.600467 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.582528 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:30.560509 21076 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:30.584477 15542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52838
I20260709 13:07:30.611816 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:30.616634 15542 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:30.617017 15542 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:30.574851 21156 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:30.613531 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 46816.1us
I20260709 13:07:30.612386 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:30.612434 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.557155 21053 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.572890 21173 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:30.622962 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:30.625046 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:07:30.669409 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44473.4us
I20260709 13:07:30.626187 15036 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:30.629149 14893 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:30.629470 14889 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:30.630856 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:30.631090 15546 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:30.632344 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:30.606564 21229 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:30.640311 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:30.612449 21207 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:30.682174 14894 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:30.633067 21100 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:30.693322 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 48441.8us
I20260709 13:07:30.698413 15542 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.699929 14970 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:30.724473 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:30.620563 20947 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260709 13:07:30.682443 21232 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:30.731709 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:30.744614 14970 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:30.736353 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.737596 15040 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:30.672838 21053 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.762028 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.753762 14970 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:30.756595 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:30.763964 21119 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:30.764415 21119 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:30.764498 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.764861 21119 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.787568 15040 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:30.788952 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:30.699923 21236 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:07:30.796182 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.800184 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:30.804558 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.805027 14889 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:30.802438 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:30.796303 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:30.805989 15041 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:30.804165 15546 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:30.814014 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:30.820286 15040 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 13:07:30.756996 21232 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:30.818553 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:30.765304 21043 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:30.785971 21076 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:30.850028 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:30.823985 14894 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:30.810690 20962 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.809041 21149 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:30.820587 21235 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.338s	user 0.000s	sys 0.001s
I20260709 13:07:30.876278 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:30.870926 14890 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:30.876577 20962 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.878393 20996 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:30.879657 20923 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:30.876057 21233 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:30.881839 21233 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:30.882263 21233 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:30.882542 21244 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:07:30.880111 21246 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:30.883641 21022 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.883033 21233 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.885960 21053 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:30.819377 20972 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:07:30.888456 20972 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:30.888892 20972 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.891572 21232 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.851449 21151 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:30.896417 14893 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:30.896883 21151 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:30.897390 21151 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:30.852280 21069 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:30.900252 21069 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.899324 20962 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.889884 20972 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:30.849536 20984 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:30.819775 21125 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:30.807723 20918 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
I20260709 13:07:30.868470 20964 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:30.905495 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:30.910851 14895 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 13:07:30.918635 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100802us
I20260709 13:07:30.910055 20918 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:30.869799 21192 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.903369 21069 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:30.906736 20972 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:30.924716 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:30.928793 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 110354us
W20260709 13:07:30.930543 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 330213us
I20260709 13:07:30.955488 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:30.956264 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:30.957050 21199 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:30.957912 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:30.958199 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.958797 15549 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:07:30.959347 21199 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:30.962333 21213 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:07:30.952638 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 282323us
I20260709 13:07:30.923552 21100 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:30.964581 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:30.969125 21100 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:30.925669 20918 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:30.974860 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:30.979591 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:30.978726 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:30.974057 21100 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:30.985416 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:30.983755 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 104465us
I20260709 13:07:30.986114 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:30.989646 15546 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:30.971052 21053 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:30.971766 20984 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:30.993635 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:30.970350 21199 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
W20260709 13:07:30.986033 21257 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:07:31.058163 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:30.984917 21207 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.235s
I20260709 13:07:31.055684 21146 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:31.219131 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 161071us
I20260709 13:07:31.146528 14894 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:31.221125 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:31.221328 21146 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:31.046506 21160 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:31.197850 14962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.042s	sys 0.078s
I20260709 13:07:31.145848 14895 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
W20260709 13:07:31.222409 14962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.043s	sys 0.080s
I20260709 13:07:31.075117 21119 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:31.054509 21241 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.298s	user 0.002s	sys 0.004s
I20260709 13:07:31.046731 20918 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.224445 21119 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:31.204174 14969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.000s	sys 0.021s
W20260709 13:07:31.225735 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 251018us
I20260709 13:07:31.036180 21135 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:31.225584 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.111184 15542 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:31.232674 14969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.001s	sys 0.022s
I20260709 13:07:31.134534 14890 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:31.122345 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:31.125191 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:31.235374 14889 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:31.234061 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:31.174466 15040 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:30.969610 21251 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:31.128746 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2730) took 1565 ms. Trace:
I20260709 13:07:30.986773 20962 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:07:31.240353 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 246863us
I20260709 13:07:31.246517 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:31.254240 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:31.052138 20942 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:07:31.241540 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 119287us
I20260709 13:07:31.248515 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:31.250902 14968 rpcz_store.cc:276] 0709 13:07:29.563780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:29.592911 (+ 29131us) service_pool.cc:224] Handling call
0709 13:07:31.128572 (+1535661us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54003089d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:31.128694 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3229228416}
I20260709 13:07:31.260627 15036 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:31.059512 21233 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:31.045003 21254 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:31.276859 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.286491 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:31.286811 20954 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:31.287196 21249 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.287453 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.287717 21249 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.288549 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.288743 20954 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:31.289134 21214 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:31.289460 20954 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:31.289886 20954 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.290208 21249 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:31.290385 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.290781 21249 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:31.291559 21194 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:31.263235 20947 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:07:31.292337 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.292649 20947 consensus_queue.cc:1243] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 15.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:07:31.262243 21250 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:31.293138 21194 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:31.293221 20945 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:31.293743 21194 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:31.294562 20996 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:31.295172 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.296283 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.296751 21163 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:31.297132 21163 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:31.297303 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.240191 21053 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.060286 21125 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.177925 20917 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.281060 21069 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:31.283910 21156 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:31.284039 20964 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:31.285753 21207 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:31.286170 21104 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:31.257107 21213 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:07:31.298367 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:31.222430 21160 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.250434 20984 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.298393 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:31.303591 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:31.219354 21264 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:31.253908 20962 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.253790 21171 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:31.253705 20923 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:31.311715 14961 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:31.302654 21249 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:31.315501 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:31.316908 15547 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEARNER]: Advancing to term 15
I20260709 13:07:31.254137 21268 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.259917 21266 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:31.332784 20917 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:31.327490 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:31.328845 14887 pending_rounds.cc:85] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 9
I20260709 13:07:31.240388 21135 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:31.260123 21199 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:31.290237 20954 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:31.297869 21163 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.304704 20945 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:31.448697 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 160421us
I20260709 13:07:31.310935 21187 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:31.042786 21149 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:31.311230 21053 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:31.324179 21125 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:31.346189 14962 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:31.277101 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:31.138010 21212 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.195s
I20260709 13:07:31.260314 21151 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.342698 21107 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 13:07:31.262637 21265 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.091s
I20260709 13:07:31.323457 20971 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:07:31.407792 20918 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:31.367796 20923 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:31.364614 20962 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:31.409231 21264 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:31.333349 21064 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:31.419621 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:31.325942 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:31.348536 20964 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:31.425362 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 89606.6us
I20260709 13:07:31.446827 14887 pending_rounds.cc:107] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:07:31.304859 20947 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:31.450038 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:31.425032 21269 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 13:07:31.294584 21194 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:31.529927 21259 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:07:31.529755 20964 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:31.530613 21194 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:31.476008 15547 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:31.459950 21266 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:31.539507 21266 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.480691 21250 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.543848 21250 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.544739 21160 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:31.546370 21250 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:31.482115 20917 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:31.367799 20943 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.086s
I20260709 13:07:31.547766 20943 consensus_queue.cc:1243] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:31.450886 21199 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:31.548938 21199 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.477542 21149 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:31.521189 14887 raft_consensus.cc:2889] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.559587 20993 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:31.559864 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 109948us
I20260709 13:07:31.561880 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:31.524487 14962 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
W20260709 13:07:31.527418 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 201558us
I20260709 13:07:31.564481 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:31.515700 20923 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:31.484583 21214 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:07:31.580612 21276 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.583845 21264 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.589071 20984 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:31.561342 20993 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.428402 21268 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:31.597231 21170 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.652971 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:31.653090 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 355901us
I20260709 13:07:31.654269 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:31.679373 15547 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:31.623471 21276 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.679728 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:31.683766 21276 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:31.688591 21064 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:07:31.688721 21135 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:31.689944 21064 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:31.690061 21135 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:31.690514 21064 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:31.704522 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:31.705425 14962 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:07:31.721180 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:31.643659 21249 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:31.727079 15043 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:07:31.728420 20945 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:31.657262 21109 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:31.629895 20993 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:31.630709 21149 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:31.640394 21281 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
I20260709 13:07:31.857625 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:31.873847 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 310488us
I20260709 13:07:31.660254 21053 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:31.880030 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 138803us
I20260709 13:07:31.885777 20972 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:31.929543 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50986.4us
W20260709 13:07:31.931278 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 370158us
I20260709 13:07:31.932157 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:31.933009 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:31.933625 14964 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:07:31.934669 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:31.935813 14962 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:31.940461 14964 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:07:31.940835 14964 pending_rounds.cc:85] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 9
I20260709 13:07:31.889519 21109 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:31.941042 14964 pending_rounds.cc:107] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 12.10
I20260709 13:07:32.183360 14964 raft_consensus.cc:2917] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Aborting config change with OpId 12.10: Aborted: Op aborted by new leader
I20260709 13:07:31.934589 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:31.942725 15547 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:32.183849 14964 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:32.184262 14964 pending_rounds.cc:107] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:32.184494 14964 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:31.942981 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:31.931596 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:31.659137 21170 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:32.050817 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:31.736549 21249 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:32.070498 20962 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.508s	user 0.006s	sys 0.002s
I20260709 13:07:31.929037 21266 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.143s
W20260709 13:07:32.072559 21284 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 13:07:32.074631 21278 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:07:31.873301 21064 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:32.051805 21259 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:07:32.045493 21282 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.945683 21151 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.179611 21289 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:32.059298 21125 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:07:32.081133 21053 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:32.084343 20942 consensus_meta.cc:287] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.822s	user 0.008s	sys 0.003s
W20260709 13:07:32.302172 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 414685us
W20260709 13:07:32.304256 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:32.199908 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 265465us
I20260709 13:07:32.189610 15546 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:32.055203 14967 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:32.129844 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.371654 21265 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.310321 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 370411us
I20260709 13:07:32.372785 21265 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.311885 21151 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:32.234225 21125 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.376135 21151 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.377528 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:32.378506 21125 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:32.237913 21226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.056s	sys 0.118s
W20260709 13:07:32.382007 21226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.056s	sys 0.118s
I20260709 13:07:32.384473 15541 raft_consensus.cc:2410] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:07:32.190570 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.386994 15545 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:32.157488 15513 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.144s	sys 0.251s
I20260709 13:07:32.190002 15548 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 13:07:32.389710 15513 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.755s	user 0.144s	sys 0.251s
W20260709 13:07:32.390158 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 762994us
I20260709 13:07:32.084551 20923 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.399366 15043 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:32.400635 20923 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.222041 21254 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:32.164060 20918 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.648s	user 0.013s	sys 0.000s
I20260709 13:07:32.401854 21254 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.057682 21267 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:32.405275 21267 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.408288 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.409078 14894 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
W20260709 13:07:32.179807 15544 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.001s	sys 0.001s
W20260709 13:07:32.410374 15544 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.001s	sys 0.001s
I20260709 13:07:32.410629 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.411501 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1673) took 1162 ms. Trace:
I20260709 13:07:32.412844 15543 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:32.189291 15547 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:32.133627 20917 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.418458 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.226940 21282 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.213304 20964 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:32.424397 21151 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.425010 14889 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:31.879732 21212 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:32.128386 21283 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:31.939424 20972 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.432806 14886 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:32.432314 21283 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.434587 21267 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.086143 20993 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:31.957252 21100 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.128s
I20260709 13:07:32.236182 21289 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.437839 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.438752 21267 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:31.945178 21207 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.155s
W20260709 13:07:32.442786 21135 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.752s	user 0.013s	sys 0.004s
I20260709 13:07:31.946841 21213 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:32.443619 21213 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:32.444096 14965 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:07:32.445055 21213 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.182931 21232 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:32.100966 21236 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.451906 21236 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.453199 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:32.211949 20962 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.458535 20962 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.331027 21053 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.337183 21249 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.339609 21170 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.341912 21109 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.345768 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:32.460697 15037 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:32.460146 21053 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.347663 21305 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:32.448096 21232 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.463809 21305 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.347815 21306 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:32.466183 21232 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:32.466416 21286 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.568s	user 0.009s	sys 0.001s
I20260709 13:07:32.466825 21306 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:32.469445 21288 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.331s	user 0.003s	sys 0.002s
I20260709 13:07:32.469563 21306 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.349187 21307 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:32.470599 21104 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:32.470495 21307 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.466428 21305 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.471195 21104 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:32.411994 15544 rpcz_store.cc:276] 0709 13:07:31.249595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.249736 (+   141us) service_pool.cc:224] Handling call
0709 13:07:31.278322 (+ 28586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:31.278526 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:07:31.425872 (+147346us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.410897 (+985025us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:32.411006 (+   109us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:32.411146 (+   140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.411227 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.411423 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20793,"prepare.queue_time_us":295854,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":46,"raft.queue_time_us":38699,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":18247552,"thread_start_us":1078276,"threads_started":3,"wal-append.queue_time_us":472320}
I20260709 13:07:32.475416 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.476090 15038 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:07:32.476382 21254 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.360828 15035 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:32.477407 21254 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.478411 21254 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.478850 21251 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.341938 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.479817 20923 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.480968 15513 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:32.480767 20923 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.481765 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3184) took 1154 ms. Trace:
I20260709 13:07:32.245654 21064 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:32.463078 21053 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.482273 14888 rpcz_store.cc:276] 0709 13:07:31.327606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.327715 (+   109us) service_pool.cc:224] Handling call
0709 13:07:31.339291 (+ 11576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.483192 (+143901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.483220 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.486105 (+  2885us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.639814 (+153709us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:31.639871 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.481128 (+841257us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54000cc954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:32.481183 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.481257 (+    74us) raft_consensus.cc:1685] finished
0709 13:07:32.481270 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.481554 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":631,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10905,"spinlock_wait_cycles":331002368,"thread_start_us":152957,"threads_started":1,"wal-append.queue_time_us":393587}
I20260709 13:07:32.483938 21053 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.455075 21236 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.479596 20918 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.368734 21264 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.418668 21299 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.485399 20918 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.485795 21264 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.486824 20923 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.487592 21283 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.369521 14966 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:32.434685 20972 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:32.388986 20954 consensus_meta.cc:287] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.923s	user 0.011s	sys 0.007s
I20260709 13:07:32.489168 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1404) took 1069 ms. Trace:
I20260709 13:07:32.489382 20954 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.489610 15041 rpcz_store.cc:276] 0709 13:07:31.419564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.419684 (+   120us) service_pool.cc:224] Handling call
0709 13:07:31.419951 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.420231 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:07:31.420266 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.423872 (+  3606us) log.cc:844] Serialized 26 byte log entry
0709 13:07:31.610393 (+186521us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:07:31.610463 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:31.610559 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.465538 (+854979us) spinlock_profiling.cc:243] Waited 9.06 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:32.488678 (+ 23140us) raft_consensus.cc:1685] finished
0709 13:07:32.488696 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.488959 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20849024,"thread_start_us":186175,"threads_started":1,"wal-append.queue_time_us":278052}
I20260709 13:07:32.093163 21149 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.440100 21289 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.492834 21107 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.493574 21107 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:32.252547 21250 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.496085 21264 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.496006 21250 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.496500 21107 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.440303 21265 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.447134 21213 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:32.497327 20954 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.498478 21250 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.177294 20945 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.496520 20918 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.393126 21277 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:32.359033 21313 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.504202 21149 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:32.502713 21313 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.504828 21149 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:32.505664 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:32.506340 21313 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.506460 15041 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.499636 20945 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:32.507493 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.485857 21299 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.479588 21251 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.509060 20945 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.419492 20917 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.509639 21251 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.509848 21299 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.488673 21194 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:32.510952 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58237.8us
I20260709 13:07:32.426877 21151 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:32.510860 21194 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.511943 21151 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:32.481240 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.507678 15545 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:32.496776 21267 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.514959 15039 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:32.515628 21267 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.483158 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:32.521054 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:32.522411 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:32.522871 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:32.524770 15040 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:32.525159 15040 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:32.502043 21277 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.525858 21283 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.528084 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.529568 21277 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.472906 21104 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.473114 21307 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.506100 21149 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.529500 21268 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.526726 21283 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:32.539956 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 111041us
I20260709 13:07:32.526295 15040 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.532595 20917 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.570670 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.572952 14968 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 13:07:32.575948 21187 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.080s	user 0.013s	sys 0.009s
I20260709 13:07:32.576519 21187 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:32.577673 14890 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:32.581128 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.570832 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:32.554450 21267 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:32.582964 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.590265 15040 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:32.589080 21299 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:32.593165 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:32.594050 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 73187.1us
I20260709 13:07:32.594105 14968 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:32.593290 21085 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.598299 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 1670) took 1351 ms. Trace:
I20260709 13:07:32.598685 15541 rpcz_store.cc:276] 0709 13:07:31.247394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.247552 (+   158us) service_pool.cc:224] Handling call
0709 13:07:32.598095 (+1350543us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b54002e7a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:32.598227 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069905280}
I20260709 13:07:32.599861 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:32.600766 21085 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.601215 21104 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.601511 21085 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.603788 21306 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:32.604290 21306 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.604504 21283 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.604732 21306 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.605551 20961 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:32.606353 20961 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.606382 14791 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 6 to 7, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:32.620492 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:32.621151 15039 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:32.619354 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.625350 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 321) took 7200 ms. Trace:
W20260709 13:07:32.631853 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 66843.3us
I20260709 13:07:32.634574 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.630627 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:32.638314 21320 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.638913 21320 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.639940 15041 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:32.620801 21151 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.646644 14961 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:32.647722 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.650910 15545 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:32.655165 21254 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.657253 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:32.657949 14887 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.659775 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.635635 20961 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.631434 21085 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.664036 15037 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:32.665352 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.650245 20917 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.670686 14962 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:32.679638 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.680433 14892 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:32.669486 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.681420 21320 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.670890 20917 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.682745 21282 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.684528 20917 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.685927 21199 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:32.687565 21213 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:32.688539 21213 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:32.689122 21194 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.689785 21194 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:32.690992 21194 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:32.691089 20954 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:32.710698 14887 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:32.711831 15040 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:32.714187 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:32.659772 21283 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:32.729686 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.730096 21283 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:32.727051 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57354.2us
I20260709 13:07:32.732542 21283 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.732501 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:32.734037 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:32.734792 15043 raft_consensus.cc:2368] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:07:32.734685 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.735896 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.736184 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.737093 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.737771 21299 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:32.737908 21125 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.735917 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.738389 21299 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.738590 21125 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:32.739593 21214 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260709 13:07:32.740155 21171 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:32.741102 21299 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.741329 21085 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:32.741601 15037 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:07:32.741977 21085 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.691556 20954 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:32.691399 21194 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:32.709798 14791 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 18 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:32.728859 15040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1403) took 1301 ms (client timeout 1500 ms). Trace:
W20260709 13:07:32.750779 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54041.7us
I20260709 13:07:32.742588 21085 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.748196 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.757249 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:32.759447 21085 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.760213 21163 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.762100 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.762485 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.764147 20954 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.751391 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.741104 21125 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.769835 14963 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:07:32.775996 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.776866 15543 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:32.777395 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:32.778188 21151 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:07:32.779675 21319 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.208s	user 0.000s	sys 0.004s
I20260709 13:07:32.779852 21151 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:32.777477 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.780695 21214 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.780900 21085 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.781292 21214 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.781700 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.781466 21085 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.783380 21214 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.785220 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.783499 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.784530 14968 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:32.786669 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.787889 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:32.784818 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:32.789947 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 167547us
I20260709 13:07:32.791350 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:32.792778 21275 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:07:32.793301 21295 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:32.793853 21295 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.794301 21295 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.796267 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.627074 14788 rpcz_store.cc:276] 0709 13:07:25.382637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:25.382766 (+   129us) service_pool.cc:224] Handling call
0709 13:07:26.053306 (+670540us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:07:32.583304 (+6529998us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:30.816172 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:30.888060 (+ 71888us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:30.888108 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:07:30.888137 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:30.888619 (+   482us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:30.888726 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:30.888766 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:07:30.889143 (+   377us) tablet.cc:701] Row locks acquired
0709 13:07:30.889167 (+    24us) write_op.cc:260] PREPARE: finished
0709 13:07:30.889350 (+   183us) write_op.cc:270] Start()
0709 13:07:30.889486 (+   136us) write_op.cc:276] Timestamp: P: 1783602450889294 usec, L: 0
0709 13:07:30.889513 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:07:30.890302 (+   789us) log.cc:844] Serialized 913 byte log entry
0709 13:07:31.342573 (+452271us) op_driver.cc:464] REPLICATION: finished
0709 13:07:31.672284 (+329711us) write_op.cc:301] APPLY: starting
0709 13:07:31.727031 (+ 54747us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:32.097014 (+369983us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:32.097168 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:32.098924 (+  1756us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:32.099211 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:07:32.099284 (+    73us) write_op.cc:312] APPLY: finished
0709 13:07:32.146046 (+ 46762us) log.cc:844] Serialized 33 byte log entry
0709 13:07:32.174032 (+ 27986us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.189669 (+ 15637us) write_op.cc:454] Released schema lock
0709 13:07:32.195056 (+  5387us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:32.231968 (+ 36912us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:32.236494 (+  4526us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":71437,"reported_tablets":4,"spinlock_wait_cycles":27805440,"child_traces":[["op",{"apply.queue_time_us":299277,"apply.run_cpu_time_us":11400,"apply.run_wall_time_us":568583,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":160459,"prepare.run_cpu_time_us":46518,"prepare.run_wall_time_us":432831,"raft.queue_time_us":124693,"raft.run_cpu_time_us":49735,"raft.run_wall_time_us":232297,"replication_time_us":452914,"thread_start_us":687273,"threads_started":4,"wal-append.queue_time_us":325485}]]}
I20260709 13:07:32.784897 21306 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.804286 21194 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.804986 21295 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.805526 21306 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.806339 21085 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.807832 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.808542 20954 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:32.807447 21295 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.811452 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1405) took 1221 ms. Trace:
I20260709 13:07:32.811723 21171 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:32.813735 21125 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.814440 14887 raft_consensus.cc:2368] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:07:32.814333 21125 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.817234 21125 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:32.807173 15037 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:32.819453 21312 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:32.820510 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:32.820454 21312 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.821626 21268 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:32.805624 21194 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:32.811978 15036 rpcz_store.cc:276] 0709 13:07:31.421052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.421164 (+   112us) service_pool.cc:224] Handling call
0709 13:07:31.421431 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.423884 (+  2453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.423909 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.427450 (+  3541us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.523098 (+1095648us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b1800485fe0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:07:32.560153 (+ 37055us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:32.560608 (+   455us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.568945 (+  8337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.593055 (+ 24110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:32.611801 (+ 18746us) raft_consensus.cc:1685] finished
0709 13:07:32.620488 (+  8687us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:32.642616 (+ 22128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3684,"prepare.queue_time_us":229,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":4144,"raft.queue_time_us":5602,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":40820,"spinlock_wait_cycles":9927680,"thread_start_us":36371,"threads_started":1,"wal-append.queue_time_us":1093028}
I20260709 13:07:32.802266 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:32.827916 14791 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:32.835758 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.840806 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.841061 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:32.841895 15548 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:32.842108 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54436.7us
I20260709 13:07:32.845745 21214 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.846364 21214 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.848538 21214 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.850519 21268 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:07:32.850786 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48624.2us
I20260709 13:07:32.851557 21268 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:32.851891 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:32.852876 21226 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:32.853120 14964 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:32.853663 21226 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:32.854144 21226 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:32.855096 21226 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.857203 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:32.858199 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:32.858685 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.852074 21268 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:32.860280 21268 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.860946 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.861510 21268 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.861749 15037 raft_consensus.cc:2410] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:32.863112 21267 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:32.864730 21324 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:07:32.841192 21312 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:32.871554 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:32.749846 15040 rpcz_store.cc:269] 0709 13:07:31.419265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.419372 (+   107us) service_pool.cc:224] Handling call
0709 13:07:32.524358 (+1104986us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540019a120. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d79e18 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6
0709 13:07:32.720253 (+195895us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260589824}
I20260709 13:07:32.882766 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:32.883759 15039 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:32.884866 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.886066 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.886620 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.887768 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.888026 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:32.888427 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.888963 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.889194 14893 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:32.889827 14889 raft_consensus.cc:2410] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:07:32.887809 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.889992 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.890587 14890 raft_consensus.cc:2410] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:32.891216 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.887091 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.892655 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.893487 14891 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:32.896024 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:32.898257 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:32.897687 21299 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:32.898018 21104 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:32.909240 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49900.9us
I20260709 13:07:32.907063 21149 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:32.861611 20945 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:32.912470 14933 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:32.922811 21104 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:32.923300 21104 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:32.923713 15041 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:32.920717 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:32.920203 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:32.912163 21149 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:32.930073 14967 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:07:32.936252 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.938211 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.923749 21104 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.940065 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.957582 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:32.957981 14890 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:32.958370 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.958873 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:32.963646 21160 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.964224 20945 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:32.964377 21160 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:32.965700 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.966328 14968 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:32.966913 21160 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:32.967160 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.935973 21149 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:32.963716 20943 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:32.967821 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.940106 21199 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.957288 21064 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:32.975230 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.977877 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.978528 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:32.981235 14889 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:32.977418 14969 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:32.982419 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:32.978461 14961 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:32.990352 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:32.993316 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:32.994293 14969 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:33.001685 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.005330 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.006593 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.005486 21146 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:33.007309 21146 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:33.007813 21146 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.009402 20984 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260709 13:07:33.014665 21064 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.016959 21064 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.002326 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.025071 14964 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:33.037581 21069 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.038168 21069 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:32.992421 21306 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:33.036986 21146 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.040184 21306 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.040829 21306 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:33.040259 21069 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.043756 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.044902 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.005429 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.045972 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.046129 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.002272 14961 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:33.050993 14895 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:32.976696 21160 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:07:33.069880 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.071183 14961 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
W20260709 13:07:33.075373 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 161818us
I20260709 13:07:33.077452 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.078055 14965 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:33.079782 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.083096 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:32.981062 21199 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.054922 21194 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.085496 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.089463 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:33.090541 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.074755 21268 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:33.088267 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.094823 14970 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:33.094921 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.095573 14961 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
W20260709 13:07:33.099972 21327 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:07:33.105448 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.106014 15040 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:33.094179 14967 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:33.110056 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.113716 14894 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:33.116767 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.120501 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:33.120730 14936 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:33.084962 21125 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.013s
I20260709 13:07:33.094653 21226 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:33.121024 15041 raft_consensus.cc:2376] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19. Re-sending same reply.
I20260709 13:07:33.091753 21268 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.128744 21268 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.097368 21069 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:33.129312 21069 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.129699 21069 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.130796 21146 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.134202 21306 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.094167 21194 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.135802 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.136967 21194 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.137454 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.138088 14890 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:33.139253 14890 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:07:33.139644 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.140254 21069 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:33.144007 21141 raft_consensus.cc:1064] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
W20260709 13:07:33.144441 21141 raft_consensus.cc:1068] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Unable to promote non-voter 58ee9fe38eb8453098f6d964e7675e79: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:07:33.146749 21146 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:33.147373 21146 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.148046 20984 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:33.148589 20984 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.149430 21146 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.149943 21146 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.151588 14888 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:33.152061 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:33.152438 21104 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.152871 21277 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:33.153056 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.153435 14963 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:33.153548 21277 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:33.153650 14961 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:33.154472 21104 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.157155 21199 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.160584 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:33.162998 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:33.164201 21233 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:33.164673 21233 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.165127 21233 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.165294 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.167799 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:33.168488 21149 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.169952 21249 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:33.170459 21249 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:33.170885 21149 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.150597 20984 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.175490 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.175824 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.180502 14964 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:07:33.179351 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.185676 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.186507 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:33.186646 15041 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
W20260709 13:07:33.189195 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.182121 14965 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:33.151155 21146 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.187439 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.188522 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:33.197440 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:33.191128 14888 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:33.179729 21199 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:33.203270 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.208312 21296 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:33.208914 21296 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:33.209810 21296 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.212888 21146 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.215533 21212 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:33.215803 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.216598 21141 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:33.216018 21212 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.186077 21187 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:33.223096 14892 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
W20260709 13:07:33.229713 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 43874.7us
I20260709 13:07:33.230989 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:33.231544 21332 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.164s	user 0.000s	sys 0.002s
I20260709 13:07:33.227581 21305 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:33.236193 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:33.239555 21305 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:33.239925 21305 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:33.240298 21305 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:33.225406 21159 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:33.241680 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1473) took 1298 ms. Trace:
I20260709 13:07:33.241977 21159 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:33.242457 21159 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:33.243522 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:33.242269 15550 rpcz_store.cc:276] 0709 13:07:31.943476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:31.943626 (+   150us) service_pool.cc:224] Handling call
0709 13:07:31.944009 (+   383us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:31.949073 (+  5064us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:31.949121 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:31.949700 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:07:32.796903 (+847203us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800424120. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:07:32.887587 (+ 90684us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:32.913928 (+ 26341us) log.cc:844] Serialized 14 byte log entry
0709 13:07:32.934563 (+ 20635us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:32.941920 (+  7357us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:33.230808 (+288888us) spinlock_profiling.cc:243] Waited 4.36 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:33.241272 (+ 10464us) raft_consensus.cc:1685] finished
0709 13:07:33.241301 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:33.241483 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4584,"prepare.queue_time_us":113479,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":5872,"raft.queue_time_us":18227,"raft.run_cpu_time_us":289,"raft.run_wall_time_us":107035,"spinlock_wait_cycles":14833280,"thread_start_us":98280,"threads_started":2,"wal-append.queue_time_us":913399}
I20260709 13:07:33.245688 21256 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:33.246236 14966 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:33.246387 21141 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:33.226087 14933 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:33.252550 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.250962 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:33.222821 21212 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:33.187065 21280 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 13:07:33.171360 21249 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.255295 20962 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:33.255023 21312 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:33.301512 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85828.6us
I20260709 13:07:33.306042 21312 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.311980 21312 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:33.295118 21187 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:33.284956 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.265376 21256 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:33.319849 21306 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.302557 20954 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:33.307240 20962 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.264609 21141 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.324622 21187 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:33.336522 20962 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.325292 21151 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:33.367941 21336 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:33.368220 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:33.366348 21233 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:33.370764 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 116240us
I20260709 13:07:33.377010 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:33.381278 21281 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:33.381753 21281 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:33.381950 21141 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.382133 21281 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:33.378218 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:33.379976 21151 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:33.396699 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.385607 20943 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:33.400064 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.407678 21151 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:33.408733 21151 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.418145 21159 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.419979 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.432929 15040 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:33.423549 21256 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.427611 21187 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.428587 14968 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:33.429171 21305 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.434428 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.400966 21141 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:33.445564 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.447258 14892 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:33.448824 15044 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:33.451778 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.452011 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:33.448489 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55994.8us
I20260709 13:07:33.454566 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.455292 15035 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:33.455585 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:33.457742 21149 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:33.458317 21149 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:33.469465 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.479641 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:33.448462 21141 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.481986 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:33.469014 21146 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:07:33.504830 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.490521 21141 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.489804 21160 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:33.503129 21254 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:33.503582 21159 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.482379 21149 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.562494 14964 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:07:33.571794 21233 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.515880 21160 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.581923 21305 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.582060 21160 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.585035 21312 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.514588 21254 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:33.587808 21254 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.590276 20962 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.591570 15516 leader_election.cc:400] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:07:33.592002 15516 leader_election.cc:403] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 13:07:33.594789 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:33.600776 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:33.606935 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96297us
I20260709 13:07:33.607231 15513 leader_election.cc:400] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:07:33.607868 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.609274 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.624487 14963 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:33.630059 15037 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:07:33.594902 20962 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.579016 21212 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.628885 21160 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:33.641883 14970 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:07:33.643505 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.644392 14964 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:33.645555 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 250687us
I20260709 13:07:33.646262 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:33.677416 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:33.638010 21146 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:07:33.641122 21312 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.724846 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:33.632879 21344 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:07:33.723981 21343 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:33.729122 14963 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:33.725036 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 78861.6us
W20260709 13:07:33.750775 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:33.787739 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:33.788583 14892 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:33.732275 21299 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:33.800686 21187 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:33.805545 21212 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:33.843489 21069 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.751538 21149 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:33.805214 21281 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.792207 21306 raft_consensus.cc:2764] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
W20260709 13:07:33.828260 21348 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 13:07:33.748276 21064 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:33.731501 21344 consensus_queue.cc:1243] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:07:33.842407 21187 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.730293 21160 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.067s
I20260709 13:07:33.843876 20996 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:33.857455 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.883044 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:33.884588 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:33.886108 14891 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:33.886525 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:33.889631 14888 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:33.887064 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:33.897506 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 333022us
I20260709 13:07:33.854110 21296 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:33.895565 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:33.899832 14889 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:33.900396 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:33.875813 21214 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:33.904713 21299 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:33.904808 21214 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.905388 21299 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.902810 14886 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:33.907315 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:33.882578 21064 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:33.851872 21149 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.933758 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:33.934405 21299 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:33.935005 21299 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:33.936501 21299 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:33.936190 21064 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:33.936972 21299 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:33.897794 21194 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:07:33.953620 14861 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:33.954100 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 344352us
I20260709 13:07:33.960044 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:33.961611 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:33.983332 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 306062us
I20260709 13:07:33.964275 21214 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:33.939385 21344 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
I20260709 13:07:33.939926 21283 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:33.895202 20996 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:33.982074 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 372903us
I20260709 13:07:33.922977 21296 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:33.971108 14964 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:33.996618 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:33.993546 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:33.977932 14892 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:34.005400 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.009272 14963 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:34.014473 21359 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:07:34.016395 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:33.937816 21299 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.015296 20996 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.020112 21357 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:34.021801 14892 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:34.024540 21187 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.026001 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.032447 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:34.036090 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 118419us
I20260709 13:07:33.998724 21283 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:34.042946 21267 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:34.029860 21312 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:34.010536 21358 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:34.062495 15040 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:34.060307 21312 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:34.065565 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.066589 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:34.064710 21141 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.551s	user 0.017s	sys 0.000s
I20260709 13:07:34.072764 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:34.050769 21187 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 13:07:34.067615 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:34.073932 14964 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:34.071195 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:34.073047 21361 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:07:34.081079 14963 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:07:34.069190 21312 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.068125 21367 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.090068 21367 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.075088 21373 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:34.092499 21373 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:34.092576 21375 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:34.084447 21249 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:34.095328 21249 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:34.087052 21283 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:34.076216 21299 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.078354 21356 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:34.096156 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2764) took 1053 ms. Trace:
I20260709 13:07:34.079933 21366 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:34.076548 21141 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:34.110863 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 115510us
I20260709 13:07:34.100396 14961 rpcz_store.cc:276] 0709 13:07:33.042949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.154481 (+111532us) service_pool.cc:224] Handling call
0709 13:07:33.154903 (+   422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:33.155391 (+   488us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.173528 (+ 18137us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:33.345710 (+172182us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b2c00010828. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:07:33.359992 (+ 14282us) log.cc:844] Serialized 26 byte log entry
0709 13:07:33.637156 (+277164us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:33.637197 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.637263 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.095776 (+458513us) raft_consensus.cc:1685] finished
0709 13:07:34.095804 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.096076 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14,"raft.queue_time_us":1780,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":2666240,"thread_start_us":275989,"threads_started":1,"wal-append.queue_time_us":638941}
I20260709 13:07:34.116405 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:34.117213 21299 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.117390 14892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d3b63f39d444317899acc30914f8801"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:34.118435 14892 raft_consensus.cc:606] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.118978 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:34.119786 21299 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:34.120180 21299 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.120529 21299 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.121922 21367 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.129494 15041 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 13:07:34.102878 21366 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:07:34.113304 21254 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.525s	user 0.008s	sys 0.004s
I20260709 13:07:34.136422 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.138691 14887 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:34.133163 21159 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:34.142263 21159 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:34.142429 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.127992 20972 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 13:07:34.140410 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:34.142742 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59575.5us
I20260709 13:07:34.132191 21149 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:34.136025 21283 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:34.147465 21358 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:34.149272 21343 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16.
I20260709 13:07:34.152017 21312 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.146746 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.112185 21356 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.158905 21149 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.165977 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:34.169257 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:34.169966 15041 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:34.165465 21358 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.181411 21358 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.138667 21357 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:07:34.111503 21249 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.189378 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.139612 21254 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.137269 21299 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.203677 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.204982 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.207962 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.183820 21187 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:34.207235 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:34.218632 15545 raft_consensus.cc:2368] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16.
I20260709 13:07:34.219060 14967 raft_consensus.cc:2368] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15.
I20260709 13:07:34.218793 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.211498 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.188241 21366 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.216360 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:34.226550 14961 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:34.214399 14970 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:34.211825 21254 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:34.210218 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.217989 15041 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:34.210991 21312 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.212508 21194 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:34.239267 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:34.239477 21146 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:34.239943 21146 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:34.239681 21194 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.240882 21146 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.241822 21194 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.188482 21296 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:34.220920 21226 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:34.242551 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.242815 21226 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:34.243477 21372 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:34.242291 21146 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:34.243870 21226 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:34.244024 21372 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:34.222788 21355 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:07:34.223134 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:34.223845 21160 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:34.225407 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.218801 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:34.206362 21358 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:34.237497 21380 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.228905 21249 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:34.255460 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.263602 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.263676 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.265802 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.266299 14859 leader_election.cc:400] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15.
I20260709 13:07:34.266598 14859 leader_election.cc:403] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260709 13:07:34.267071 21377 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:07:34.267472 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:34.268306 21312 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.268714 21357 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:34.269007 21312 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:34.269441 21312 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:34.269812 21312 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:34.265430 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:34.272845 21212 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:34.273311 21212 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:34.274168 21212 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.226490 21187 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.277231 21187 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.277397 21357 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15.
I20260709 13:07:34.278947 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.253738 21358 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:34.279773 21358 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:34.264396 21366 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:34.250394 21160 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.285292 21160 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.285460 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:34.286695 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:34.288450 21356 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.259765 21296 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:34.291515 21375 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:34.302114 21296 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:34.302191 21375 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:34.303159 21296 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:34.303212 21375 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.291954 21254 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:34.293802 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.294596 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.295276 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.295733 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:34.254643 21379 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:07:34.306734 21254 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:34.297905 21299 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.298390 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.299088 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.300118 21382 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:34.316773 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:34.317006 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.300335 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.317685 15547 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 13: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:34.301133 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.301252 21380 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.318326 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:34.320231 14970 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:07:34.320689 14970 pending_rounds.cc:85] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 14
I20260709 13:07:34.317972 15550 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:34.324880 15541 raft_consensus.cc:2368] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14.
I20260709 13:07:34.310670 14963 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:07:34.263756 21104 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.313731 21125 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:34.316347 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.323050 21382 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.321040 14970 pending_rounds.cc:107] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:07:34.384380 14970 raft_consensus.cc:2889] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:07:34.364156 15010 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.4:39473 timed out after 1.590s (SENT) [suppressed 4 similar messages]
I20260709 13:07:34.370738 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.317430 21254 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.376931 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:34.385607 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 69355.5us
I20260709 13:07:34.375900 15548 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:34.381523 14969 raft_consensus.cc:2410] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:34.386065 15550 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:34.385337 21299 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.007s
I20260709 13:07:34.392831 21382 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.396210 21382 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:34.388268 21187 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:34.396600 21312 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.400485 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:34.401548 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.405609 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.406379 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:34.402107 15550 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:34.409267 14961 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 13:07:34.384053 21125 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:34.430727 21312 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.433369 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:34.434010 21345 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.704s	user 0.006s	sys 0.006s
I20260709 13:07:34.435243 21125 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.436017 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1486) took 1354 ms. Trace:
I20260709 13:07:34.436879 21125 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:34.441556 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.445449 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:34.446600 15545 raft_consensus.cc:2410] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260709 13:07:34.436560 15543 rpcz_store.cc:276] 0709 13:07:33.081265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.081395 (+   130us) service_pool.cc:224] Handling call
0709 13:07:33.093948 (+ 12553us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:33.097506 (+  3558us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:33.097535 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:33.139647 (+ 42112us) log.cc:844] Serialized 52 byte log entry
0709 13:07:33.433171 (+293524us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:33.433207 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:33.433267 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:34.433195 (+999928us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:34.435612 (+  2417us) raft_consensus.cc:1685] finished
0709 13:07:34.435641 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:34.435935 (+   294us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":345,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":18935,"spinlock_wait_cycles":41584896,"thread_start_us":293157,"threads_started":1,"wal-append.queue_time_us":497010}
I20260709 13:07:34.448385 15543 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:34.451802 21141 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.451891 21159 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:34.453660 21159 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:34.456960 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.460134 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.444056 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.473905 21254 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.477259 21085 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:34.479743 21281 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:34.482860 21371 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.413s	user 0.001s	sys 0.001s
I20260709 13:07:34.486966 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.457006 21358 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:34.498468 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 134369us
I20260709 13:07:34.492623 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.503922 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.504701 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.507654 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:34.508507 14961 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:34.510612 14969 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:34.515512 14936 leader_election.cc:400] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16.
I20260709 13:07:34.518728 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.519264 14888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:34.519909 14888 raft_consensus.cc:606] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.520263 14888 raft_consensus.cc:614] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:34.520931 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.523994 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:34.530622 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:34.531224 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.533908 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.535220 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.536103 15040 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
W20260709 13:07:34.536362 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.537166 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:34.541751 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.544425 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.546456 15041 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 9.
I20260709 13:07:34.538611 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.549293 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:34.549544 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:34.549232 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.513695 21249 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:34.566726 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.566854 15036 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:34.568228 15545 raft_consensus.cc:2368] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14.
I20260709 13:07:34.566747 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.568045 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:34.569161 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50486.6us
I20260709 13:07:34.519555 20945 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:34.579341 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.579833 14893 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:34.572994 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:34.578504 15040 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:34.574004 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.539106 21375 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.544380 21357 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.591934 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.593658 14891 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:34.594187 14889 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:34.594372 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:34.591827 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:34.594771 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.568632 21362 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:34.530192 21104 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 13:07:34.581218 21280 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:34.575126 21249 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:34.611616 21296 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:34.530027 21312 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:07:34.578969 20945 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:34.590858 21085 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:34.633282 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 59366.5us
I20260709 13:07:34.646252 21407 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:34.646977 21407 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:34.648128 21407 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.649852 21104 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.650717 21104 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.678025 21104 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.679112 21163 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:34.681660 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:34.683944 21163 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.690061 15007 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:34.618445 21249 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:34.623847 20945 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:34.626377 21280 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:34.711892 21403 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:34.713613 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:34.715494 21296 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:34.715715 21280 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:34.716879 21395 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:07:34.716830 21296 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:34.630015 21400 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:34.603153 21357 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.723625 14891 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:34.724224 14891 raft_consensus.cc:606] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.720755 15546 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 15. (term mismatch)
I20260709 13:07:34.724850 15546 pending_rounds.cc:85] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 14
I20260709 13:07:34.725071 15546 pending_rounds.cc:107] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 20.15
I20260709 13:07:34.725288 15546 raft_consensus.cc:2889] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:34.728551 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.702826 21104 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:34.728606 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:34.732903 14893 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:34.733405 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:34.735141 21357 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:34.731616 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 97341.5us
I20260709 13:07:34.740170 15035 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:34.718312 21163 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:34.746342 15516 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.717890 21296 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:34.693589 21085 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:34.773445 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:34.777081 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 246562us
I20260709 13:07:34.774330 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.785626 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.789404 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.789497 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:34.795542 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.771600 21296 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:34.770201 21163 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:34.799988 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:34.792949 21382 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.787427 21400 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:34.803543 21381 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:34.796397 21380 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 13:07:34.815999 21406 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.788651 21344 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:34.793612 21064 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:34.794042 21149 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:34.853825 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53929.7us
I20260709 13:07:34.797590 20972 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:34.770991 21104 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:34.885066 21104 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.892175 21413 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:34.933193 21413 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:34.882649 21408 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:07:34.893857 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:34.922498 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:34.883494 14861 leader_election.cc:400] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14.
W20260709 13:07:34.937701 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 54375.3us
I20260709 13:07:34.928177 21357 raft_consensus.cc:993] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:34.935273 21413 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.931555 21372 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.900838 21085 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.904978 21254 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:34.971642 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:34.979903 15035 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:34.976454 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:34.982857 14886 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:34.944257 21358 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:34.945255 21104 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:35.013034 14891 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:34.972569 21357 raft_consensus.cc:1081] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:35.018826 15042 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:35.031903 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:35.022787 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:35.032374 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.033664 14889 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:34.895889 21163 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:35.039178 14861 leader_election.cc:400] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14.
I20260709 13:07:35.039750 14861 leader_election.cc:403] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:35.040805 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:35.038600 20943 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:35.042639 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:35.043749 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.047940 14970 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:35.045591 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 265358us
I20260709 13:07:35.048003 14891 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.046556 14968 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:35.048861 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:35.019119 21214 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:35.050439 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:35.057117 14886 raft_consensus.cc:606] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:35.057514 14886 raft_consensus.cc:614] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:35.053110 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.060325 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.062312 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:35.065377 14887 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:35.067385 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.067854 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:35.069886 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:35.066787 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.070456 15044 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.044507 21159 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:35.050643 21312 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.050690 20943 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:35.089056 15035 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:35.090174 15040 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:35.050819 21409 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:35.094461 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:35.024485 21104 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.096444 14968 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:35.072777 20962 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:35.103866 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:35.055516 21249 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:35.042059 21085 consensus_queue.cc:1175] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "25b8f0cc46f748468395543b8b174bf4" responder_term: 15 status { last_received { term: 15 index: 10 } last_committed_idx: 9 last_received_current_leader { term: 15 index: 10 } }
I20260709 13:07:35.102793 14894 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:35.091925 20943 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:35.105496 21414 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
W20260709 13:07:35.106281 21418 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:07:35.138154 21312 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 14.
I20260709 13:07:35.139532 21407 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.110206 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:35.140805 15545 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEARNER]: Advancing to term 16
I20260709 13:07:35.143572 21358 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:35.143740 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:35.145262 21254 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:35.145390 15513 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:35.145998 21254 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:35.146301 21420 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:35.112121 15549 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:07:35.149335 21296 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:35.150519 21296 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.116760 21104 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.081840 21214 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:35.151886 21214 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:35.152410 21214 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.103956 20962 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:35.155679 20962 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:35.082705 21141 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:35.120283 14964 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:35.121832 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:35.160302 15543 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260709 13:07:35.129285 14970 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:35.160698 15543 pending_rounds.cc:85] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 15
I20260709 13:07:35.160988 15543 pending_rounds.cc:107] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260709 13:07:35.161216 15543 raft_consensus.cc:2889] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.161921 21249 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.174752 15044 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:35.155875 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:35.178526 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 141496us
I20260709 13:07:35.178090 21171 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:07:35.191474 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 122347us
I20260709 13:07:35.191751 21419 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:35.191910 21399 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:35.194658 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:35.198769 14891 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:35.195314 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:35.199934 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:35.200613 21409 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:07:35.200949 15543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d3b63f39d444317899acc30914f8801"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52858
I20260709 13:07:35.201339 21409 consensus_queue.cc:1243] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:07:35.201587 15543 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.188956 21408 raft_consensus.cc:993] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:35.202512 21408 raft_consensus.cc:1081] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:35.203523 21104 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:35.205101 21367 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:35.205602 21367 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:35.206425 21367 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.202006 15543 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.208792 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:35.214480 15545 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEARNER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:35.243867 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:35.180472 21254 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:35.248828 15543 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.250187 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:35.253845 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:35.248497 20945 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.007s
I20260709 13:07:35.216743 21419 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 13:07:35.273111 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:35.273717 14893 raft_consensus.cc:606] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:35.274031 14893 raft_consensus.cc:614] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:35.279322 21405 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:35.280162 21405 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:35.284117 21405 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:35.295461 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.310907 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:35.313401 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:07:35.272779 20945 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.347996 15543 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:35.337212 21409 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:35.312422 20962 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.356653 14969 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:35.365855 14888 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
W20260709 13:07:35.369128 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 117580us
I20260709 13:07:35.370312 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:35.371470 21433 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:35.371969 21433 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:35.372449 21433 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:35.374653 21404 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.677s	user 0.004s	sys 0.000s
I20260709 13:07:35.376823 20945 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.361542 21405 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.379742 21405 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.380606 21433 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.381804 21405 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.382054 21214 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.351812 20943 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.347752 21358 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 13:07:35.359484 21409 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:35.382663 21433 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.407271 14891 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:35.401969 14895 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:35.386739 21171 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:35.407219 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.445101 14967 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:35.447820 14964 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:35.449455 14965 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:35.423131 21171 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:35.476414 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 68589us
I20260709 13:07:35.489714 14966 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:35.486552 21141 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:35.512939 21400 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:07:35.543704 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:35.546964 21425 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.343s	user 0.000s	sys 0.002s
I20260709 13:07:35.549930 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:35.550796 21366 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:35.552204 21366 raft_consensus.cc:2764] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election decision vote started in defunct term 14: won
W20260709 13:07:35.556110 21432 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:35.558485 21163 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:35.559721 21430 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 13:07:35.569701 20962 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.572471 20943 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.573505 21214 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:35.515281 21409 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.575681 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:35.593549 21254 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:35.594362 21254 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.596771 21254 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:35.610574 14893 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:35.611109 14893 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:35.612046 14893 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.613515 14893 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.621133 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.624315 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.624892 14890 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.626590 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.627244 15513 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:35.627715 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.629045 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:35.635283 14890 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:35.636693 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 219) took 9042 ms. Trace:
I20260709 13:07:35.644176 14788 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:35.645274 14893 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
W20260709 13:07:35.645761 21312 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 15 is higher.
I20260709 13:07:35.646027 14788 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:35.660537 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:35.641233 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:07:35.662665 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.664891 14788 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 16 to 17, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 17 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:35.666306 21149 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:35.667203 14788 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 9 to 10, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 10 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.668073 21149 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.668509 14788 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 19 to 20, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.668676 21149 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.677115 15036 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 13:07:35.677872 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50732.4us
I20260709 13:07:35.677959 15545 pending_rounds.cc:85] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 13
I20260709 13:07:35.678442 15545 pending_rounds.cc:107] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:07:35.678758 15545 raft_consensus.cc:2889] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:35.678840 21160 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:35.679901 15548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52858
I20260709 13:07:35.680413 15548 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:35.637104 14791 rpcz_store.cc:276] 0709 13:07:26.593909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.594040 (+   131us) service_pool.cc:224] Handling call
0709 13:07:35.636629 (+9042589us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:33.379384 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:33.425331 (+ 45947us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:33.425388 (+    57us) write_op.cc:435] Acquired schema lock
0709 13:07:33.425407 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:33.426000 (+   593us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:33.426089 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:33.426116 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:07:33.426554 (+   438us) tablet.cc:701] Row locks acquired
0709 13:07:33.426600 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:07:33.426761 (+   161us) write_op.cc:270] Start()
0709 13:07:33.426908 (+   147us) write_op.cc:276] Timestamp: P: 1783602453426701 usec, L: 0
0709 13:07:33.426945 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:07:33.485477 (+ 58532us) log.cc:844] Serialized 1355 byte log entry
0709 13:07:34.331292 (+845815us) op_driver.cc:464] REPLICATION: finished
0709 13:07:34.503601 (+172309us) write_op.cc:301] APPLY: starting
0709 13:07:34.507685 (+  4084us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:34.510910 (+  3225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:34.511050 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:34.712310 (+201260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:34.712552 (+   242us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 13:07:34.712599 (+    47us) write_op.cc:312] APPLY: finished
0709 13:07:34.712898 (+   299us) log.cc:844] Serialized 41 byte log entry
0709 13:07:34.713095 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:34.713191 (+    96us) write_op.cc:454] Released schema lock
0709 13:07:34.713232 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:34.713685 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:34.713720 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":86051,"apply.run_cpu_time_us":8199,"apply.run_wall_time_us":286309,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16667,"num_ops":3,"prepare.queue_time_us":344096,"prepare.run_cpu_time_us":66632,"prepare.run_wall_time_us":591605,"raft.queue_time_us":175319,"raft.run_cpu_time_us":12550,"raft.run_wall_time_us":80496,"replication_time_us":904203,"thread_start_us":716326,"threads_started":4,"wal-append.queue_time_us":573083}]]}
I20260709 13:07:35.680745 15548 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:35.681061 21160 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:35.686084 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:35.693198 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 205198us
I20260709 13:07:35.709147 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:35.709833 15549 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:35.686532 14788 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 12 to 13, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.713747 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:35.716365 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:35.717670 15040 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:35.712015 14788 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 14, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.722131 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.723632 15550 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 13. Current term is 15. Ops: []
I20260709 13:07:35.724805 14788 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 19 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 20 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.728127 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:35.733867 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:35.680794 21141 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:35.737655 15042 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:35.739431 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49801us
I20260709 13:07:35.736099 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:35.732748 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:35.744738 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:35.733788 14788 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.764703 14788 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 17 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.766721 14788 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 15, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 15 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.770833 14788 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.709040 21357 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.689360 21149 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:35.772979 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:35.785044 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:35.789920 15040 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:07:35.743011 21366 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:35.742467 21352 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 13:07:35.773563 21381 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:35.821676 21381 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:35.710146 21254 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.066s
I20260709 13:07:35.747370 21141 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:35.824275 21149 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:35.824695 21149 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:35.825472 21149 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.826606 21149 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:35.806418 20945 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:35.788623 20943 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:07:35.790455 21434 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:07:35.827908 20943 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:35.827802 20945 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:35.828883 20943 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.830018 21171 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.830523 20945 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:35.833005 21430 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:35.791673 21357 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:35.835973 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:35.836575 15040 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:35.836983 21357 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:35.839339 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.841063 21399 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:35.841531 21399 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:35.844317 21406 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:35.845458 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:35.845784 21280 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:35.848099 21367 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:35.816257 14788 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:35.850929 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:35.739068 21420 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:07:35.741751 21160 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.812515 15548 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.822710 21381 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.852795 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:35.853315 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:35.854836 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:35.848819 21367 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:35.863245 15541 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:35.867298 15035 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:35.868278 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:35.871198 15549 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:35.873962 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:35.874308 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:35.873716 15548 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:35.872691 15010 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:35.877127 14788 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 16, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:35.857780 21399 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:35.863873 20972 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:35.880623 14788 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 18 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:35.893688 14788 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:35.871647 21280 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:07:35.879753 21275 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:35.879935 21448 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:35.885838 21444 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:36.004118 21356 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:35.897119 20972 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:36.030445 21403 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:36.031208 21085 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:36.031596 21296 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:36.032990 21433 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:36.024919 21254 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.036415 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:36.038699 15043 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:36.038833 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:36.042448 21380 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.043891 14962 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:36.044314 21366 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.045724 21373 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.049639 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:35.885632 21406 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.055987 20945 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.026561 21171 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:36.039139 21457 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:07:36.077296 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 332705us
I20260709 13:07:36.083359 15041 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.082952 15036 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:36.077883 21356 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.088637 21280 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 13:07:36.112113 20972 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.099517 21407 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.128811 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:36.101732 21457 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:36.169299 21407 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.123292 21356 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:36.185374 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60527.9us
I20260709 13:07:36.186244 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:36.099712 21366 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.196884 15041 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:36.102885 21406 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:36.189726 21436 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:07:36.201763 21141 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.207471 21171 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:07:36.104281 21373 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.088761 21254 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.102824 20945 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.210995 21367 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.099933 21380 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.220328 15041 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:36.223754 21406 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.227943 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:36.242214 21380 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.242365 15043 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:36.243377 21171 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.243925 21171 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:36.245028 21141 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:36.238181 20945 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:36.245934 21171 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:36.238824 14969 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:07:36.246392 14969 pending_rounds.cc:85] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 12
I20260709 13:07:36.246637 14969 pending_rounds.cc:107] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 13:07:36.246863 14969 raft_consensus.cc:2889] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:36.249516 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:36.250142 14964 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:36.252831 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:36.254076 15545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.025s	sys 0.044s
I20260709 13:07:36.236783 21366 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.245527 14893 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:36.239274 21373 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.216078 21420 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.267316 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:36.261724 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.009s
W20260709 13:07:36.268541 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.006s	sys 0.009s
I20260709 13:07:36.253914 21306 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:36.254418 15545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.025s	sys 0.044s
I20260709 13:07:36.236821 21254 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.292510 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:36.353645 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:36.362608 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:36.255229 21367 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.264025 21447 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:36.368330 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:36.369032 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:36.369804 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:36.368587 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:36.356098 21306 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:36.386425 15542 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.010s	sys 0.022s
I20260709 13:07:36.351311 21450 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:36.387701 15542 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.011s	sys 0.022s
W20260709 13:07:36.384985 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 486400us
I20260709 13:07:36.388259 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:36.388885 14895 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:36.399291 15041 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:36.368353 21405 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:36.268802 21420 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.377763 21358 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.408396 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:36.407883 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:36.390954 21306 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:36.373833 21367 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:36.425453 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 62938.6us
I20260709 13:07:36.426905 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:36.430413 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:36.433512 21380 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.435254 21373 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:36.434254 21380 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.395931 21450 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:36.442269 14886 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:36.444092 14895 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:36.415207 21405 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:36.420032 21358 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:36.465459 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57139.7us
I20260709 13:07:36.438033 21474 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.476344 21362 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:36.476800 21450 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:36.478478 20945 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:36.481069 21367 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.480257 21306 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:36.481673 21477 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:36.468042 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:36.465692 21482 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 13:07:36.467790 21461 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:36.494756 21474 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:36.541396 21475 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:07:36.541539 21474 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.542196 20945 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.542785 20945 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:36.543972 21482 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:36.544404 21482 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:36.545051 20945 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:36.545701 21466 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:07:36.545280 21482 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.546981 21482 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.547676 21487 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:07:36.547864 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 80664.6us
W20260709 13:07:36.754138 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 194844us
I20260709 13:07:36.756570 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:36.760581 15041 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:36.781487 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 328399us
I20260709 13:07:36.782290 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:36.788432 15550 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:36.798525 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:36.549968 21461 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:36.795099 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1506) took 1105 ms. Trace:
I20260709 13:07:36.558229 21487 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:36.779663 21463 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.351s	user 0.000s	sys 0.001s
I20260709 13:07:36.805850 15542 rpcz_store.cc:276] 0709 13:07:35.689955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.690089 (+   134us) service_pool.cc:224] Handling call
0709 13:07:35.690422 (+   333us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:35.690834 (+   412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.690872 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:35.691361 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:07:35.868801 (+177440us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b1800360340. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:07:36.388274 (+519473us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:07:36.388328 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.388430 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.781018 (+392588us) raft_consensus.cc:1685] finished
0709 13:07:36.781045 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.795018 (+ 13973us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1222,"raft.queue_time_us":19637,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":8542,"spinlock_wait_cycles":3954944,"thread_start_us":519252,"threads_started":1,"wal-append.queue_time_us":724519}
W20260709 13:07:36.784058 21149 consensus_meta.cc:287] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.957s	user 0.013s	sys 0.000s
I20260709 13:07:36.754339 21233 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:36.868572 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:36.794458 21474 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.537750 21356 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:36.826257 21461 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:36.821985 21381 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:36.853138 21487 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:36.843304 21477 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:36.842852 21489 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:36.793154 21367 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 20.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.120s
W20260709 13:07:36.939038 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.029s	sys 0.110s
W20260709 13:07:36.943115 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.030s	sys 0.110s
W20260709 13:07:36.943747 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 513462us
I20260709 13:07:36.945214 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:36.841912 21468 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 13:07:36.948252 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:36.951754 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:36.940225 21471 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.959362 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1672) took 1282 ms. Trace:
I20260709 13:07:36.914918 21233 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:36.964470 21490 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:36.964582 21405 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.965354 21405 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:36.965258 21490 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:36.966132 21405 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:36.966845 21405 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:36.967211 21405 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:36.967657 21405 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:36.946297 20962 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:36.961097 15545 rpcz_store.cc:276] 0709 13:07:35.677164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.677321 (+   157us) service_pool.cc:224] Handling call
0709 13:07:35.677723 (+   402us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:35.683097 (+  5374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:35.683139 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:35.683783 (+   644us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.334769 (+650986us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:36.334827 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.335872 (+  1045us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:36.959005 (+623133us) raft_consensus.cc:1685] finished
0709 13:07:36.959036 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:36.959269 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4582,"raft.queue_time_us":6448,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":35924,"thread_start_us":650553,"threads_started":1,"wal-append.queue_time_us":707610}
W20260709 13:07:36.989529 14970 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.063s	sys 0.077s
W20260709 13:07:36.989969 14970 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.063s	sys 0.077s
I20260709 13:07:36.958564 21420 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.951650 21486 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:07:36.943344 21477 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.006141 21407 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:36.990011 21380 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:36.950592 21489 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.990688 20962 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.039996 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1448) took 1003 ms. Trace:
I20260709 13:07:37.040446 15042 rpcz_store.cc:276] 0709 13:07:36.036254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.036357 (+   103us) service_pool.cc:224] Handling call
0709 13:07:36.036670 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.037004 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.037034 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.208422 (+171388us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:07:36.208830 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.405581 (+196751us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:36.405622 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.405688 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.035607 (+629919us) raft_consensus.cc:1685] finished
0709 13:07:37.035632 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.039917 (+  4285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":525,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":44220160,"thread_start_us":196378,"threads_started":1,"wal-append.queue_time_us":823233}
W20260709 13:07:37.042934 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 83735us
I20260709 13:07:36.923329 21474 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:36.972944 21471 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.016225 21306 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.060724 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.030342 21358 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.042974 20943 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:37.062520 21479 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:07:37.027837 21490 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.082162 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:37.083489 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.083652 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.084311 14964 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:37.072225 21233 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.084334 14961 raft_consensus.cc:2410] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:37.092271 20962 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.078965 21356 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.096055 21464 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:37.107952 21471 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.079386 20943 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.089133 21491 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:37.089040 21496 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:37.111694 21492 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 13:07:37.119702 21381 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:37.120136 21381 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:37.120999 21381 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.122040 21381 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.125221 21405 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.127158 21486 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.127758 21486 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.128494 21477 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.129757 21405 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.129972 21486 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.134402 21457 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.136809 21366 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:37.137230 21366 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:37.138114 21366 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.140728 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.141384 14893 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:37.144047 14890 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:07:37.145139 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.145934 14888 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:37.146765 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.126703 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1569) took 1025 ms. Trace:
I20260709 13:07:37.150120 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.152966 14889 raft_consensus.cc:2368] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:37.150424 14969 rpcz_store.cc:276] 0709 13:07:36.101400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.102321 (+   921us) service_pool.cc:224] Handling call
0709 13:07:36.102675 (+   354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:36.247289 (+144614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:37.126465 (+879176us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5400109fd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:37.126647 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312387328}
I20260709 13:07:37.153681 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.159554 14893 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:37.163218 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.166319 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.166946 14888 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:37.167938 14887 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:37.170368 20972 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:37.171813 14933 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:37.172657 21413 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:37.173096 21413 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.173416 21413 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.178121 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.179208 14969 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:37.177289 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:37.184079 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.185158 21477 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:37.187369 21476 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.193419 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.196374 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.191584 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:37.153090 21491 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:37.159919 21366 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.157766 21486 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:37.239866 15044 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:37.239120 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.158234 21405 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:37.203293 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.204262 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.208312 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.243171 14892 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:37.210189 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.210428 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.189702 21457 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:37.212821 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:37.242178 14895 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:37.210924 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.253186 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.256183 14968 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:37.257266 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.260061 14969 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.264076 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.264667 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:37.265231 14961 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.265323 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.201944 21464 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:37.216382 14962 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:37.202175 21149 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:37.117314 21496 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.273056 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.270419 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:37.252137 21501 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.288007 21381 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.288335 21501 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.288645 21381 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.257360 21486 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.240918 21491 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.293069 21401 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:37.293557 21401 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.293929 21401 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.297995 21487 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.277586 21498 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:37.299690 21498 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.300587 21380 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:37.301143 21380 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.301793 21498 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.285006 21496 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.287835 21474 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.280963 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:37.252362 21356 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:37.312196 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.313237 14966 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:37.269152 21464 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:37.320274 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:37.321319 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.281635 21149 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:37.287031 21461 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.268043 21405 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.199659 21367 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.105s
I20260709 13:07:37.334173 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.316375 21419 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:37.339682 14893 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:37.334414 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.212323 21476 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.343119 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.343797 14966 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:37.323549 21464 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.345901 21381 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.350870 21367 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.352396 14969 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:37.352681 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.353381 21476 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.316203 21356 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.357753 14961 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:37.328958 21484 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.329896 21149 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.341800 21419 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.365600 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.367338 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.368420 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.371295 14961 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:37.405539 15044 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:37.324088 21474 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.374974 21484 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.369460 21367 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.415330 21496 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:37.415726 21484 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.416057 21496 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.401991 21476 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.403609 20943 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.368114 21381 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:37.406482 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.405326 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:37.418699 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 86415.5us
W20260709 13:07:37.421202 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 98669.2us
I20260709 13:07:37.423337 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.423557 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.423835 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.424278 14893 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:37.407896 21419 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:37.427747 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:37.431064 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.420272 21367 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.425513 21356 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.430085 21381 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.438886 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.428383 21513 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:37.425293 21476 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.422000 21413 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.444134 21517 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.443248 21520 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:37.422367 21474 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.433835 21487 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.441430 21513 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.441568 21518 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:37.443205 21496 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.444999 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:37.444973 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:37.441001 21367 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:37.464322 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:37.469523 21461 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.470867 21367 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.474346 21367 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.475025 21487 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:37.475679 21487 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.476203 21487 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:37.477551 21405 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.483587 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.446360 21520 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.459746 21513 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:37.491295 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63616us
I20260709 13:07:37.492547 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.488557 21149 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.496865 21513 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.484463 21518 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:37.498795 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:37.499593 15040 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:37.488268 21520 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.501185 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:37.509639 15040 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:37.510030 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.511682 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:37.512214 21482 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.768s	user 0.015s	sys 0.000s
I20260709 13:07:37.512398 15044 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:37.510816 15516 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:37.514806 21476 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.515908 21401 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.518438 21401 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.519449 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:37.520007 14967 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:37.523936 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:37.498498 21367 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:37.526690 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.498927 21413 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.528524 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.528627 14967 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:37.530251 14891 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:37.499234 21518 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:37.537496 21518 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:37.508764 21381 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:37.533198 21474 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.536199 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.526664 21149 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.537016 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 3095) took 1129 ms. Trace:
I20260709 13:07:37.540901 15041 rpcz_store.cc:276] 0709 13:07:36.407437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.407596 (+   159us) service_pool.cc:224] Handling call
0709 13:07:37.536831 (+1129235us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540014cdd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:37.536961 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":791697280}
I20260709 13:07:37.538789 21381 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.543628 21381 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:37.547508 15548 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:37.543257 21487 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.550892 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.554682 21447 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.554910 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.555330 21447 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.535205 21464 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:37.557511 21447 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.558125 21464 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.559849 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.561264 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:37.562151 15516 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.563189 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.568352 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.571225 15516 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.551023 21401 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.573532 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.574117 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.549929 20943 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:37.575330 15044 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 13:07:37.575978 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.576710 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:37.576290 21296 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:37.576567 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:37.576694 21476 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:07:37.567829 21474 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:37.595098 21296 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.577225 21444 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:37.596678 21444 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.597913 21296 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.591029 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:37.598737 21444 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.570600 21366 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:37.599452 21476 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:37.594699 15036 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:37.596160 21474 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:37.601037 21474 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:37.604542 21483 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.122s	user 0.007s	sys 0.005s
I20260709 13:07:37.592482 21295 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:37.605923 21295 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:37.572777 21367 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:37.606724 21295 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.607126 21367 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:37.607754 21295 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:37.607764 21367 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:37.610225 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3575) took 1392 ms. Trace:
I20260709 13:07:37.575169 21381 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:37.610591 14963 rpcz_store.cc:276] 0709 13:07:36.218301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.219623 (+  1322us) service_pool.cc:224] Handling call
0709 13:07:36.224286 (+  4663us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:36.224682 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.224710 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:36.225257 (+   547us) log.cc:844] Serialized 52 byte log entry
0709 13:07:36.389992 (+164735us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:36.390029 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.390107 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:37.603904 (+1213797us) spinlock_profiling.cc:243] Waited 9.79 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:37.609928 (+  6024us) raft_consensus.cc:1685] finished
0709 13:07:37.609950 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:37.610144 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3082,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":2433,"spinlock_wait_cycles":22523648,"thread_start_us":162574,"threads_started":1,"wal-append.queue_time_us":256293}
I20260709 13:07:37.620133 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.622922 14933 leader_election.cc:400] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:37.623313 14933 leader_election.cc:403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:37.624275 20945 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17.
I20260709 13:07:37.625499 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.625924 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.627135 21280 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:37.627357 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:37.627710 21280 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.633471 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:37.632906 21280 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:37.558903 21520 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.629267 21518 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.724849 21520 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:37.728397 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:38.058390 21518 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:38.698685 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08000c4e40 after lost signal to thread 13795
I20260709 13:07:40.116456 21501 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:40.130537 21171 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:40.131124 21171 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:40.132041 21171 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:40.133395 21171 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.078768 21533 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.079805 21533 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:41.150041 13797 debug-util.cc:398] Leaking SignalData structure 0x7b080000fde0 after lost signal to thread 21477
W20260709 13:07:41.150674 13797 kernel_stack_watchdog.cc:198] Thread 21477 stuck at /apache/dev/git/kudu/src/kudu/util/thread.cc:642 for 2523ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
I20260709 13:07:37.641590 14886 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:41.083176 21533 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.310933 21533 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.312412 21533 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.315730 20945 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.316030 21533 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.317440 21533 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.317891 21534 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.318055 21533 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.318516 21534 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.316340 20945 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:41.319320 14861 connection.cc:256] RPC call timeout handler was delayed by -3.3321198080000158s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:07:41.320269 14861 connection.cc:256] RPC call timeout handler was delayed by -2.8115621939998618s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 13:07:41.320740 14861 connection.cc:256] RPC call timeout handler was delayed by -2.7764534619999495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260709 13:07:41.320863 21534 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:41.325348 14861 connection.cc:256] RPC call timeout handler was delayed by -2.7323000999999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:07:41.322458 20945 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.325812 14861 connection.cc:256] RPC call timeout handler was delayed by -2.7316688839998733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.166s for a response
I20260709 13:07:41.325912 21534 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.326021 20945 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:41.326282 14861 connection.cc:256] RPC call timeout handler was delayed by -2.4485259079999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
W20260709 13:07:41.326835 14861 connection.cc:256] RPC call timeout handler was delayed by -2.4485259079999651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 13:07:41.326586 21534 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.323638 21533 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.321785 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.884s	user 0.023s	sys 0.052s
I20260709 13:07:41.327756 21533 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:41.327266 14861 connection.cc:256] RPC call timeout handler was delayed by -2.3592040059999135s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:07:41.327919 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.890s	user 0.024s	sys 0.052s
I20260709 13:07:41.326694 20945 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:41.329540 14861 connection.cc:256] RPC call timeout handler was delayed by -2.2016836869998997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:07:41.328342 21533 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.329905 21534 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.330464 14861 connection.cc:256] RPC call timeout handler was delayed by -2.0991198079999549s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3145s for a response
I20260709 13:07:41.331152 21534 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.331878 21489 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.331444 14861 connection.cc:256] RPC call timeout handler was delayed by -2.0074897460000329s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
I20260709 13:07:41.332476 21533 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:41.332672 14861 connection.cc:256] RPC call timeout handler was delayed by -1.4684106370000336s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2464s for a response
I20260709 13:07:41.310034 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1461) took 3673 ms. Trace:
I20260709 13:07:41.332737 21535 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.333144 21533 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.329879 20945 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.334323 20972 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.333920 14886 rpcz_store.cc:276] 0709 13:07:37.636885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.637046 (+   161us) service_pool.cc:224] Handling call
0709 13:07:37.641249 (+  4203us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:41.309695 (+3668446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.309944 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20864}
I20260709 13:07:41.334487 21535 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.331693 21534 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:41.333305 14933 connection.cc:256] RPC call timeout handler was delayed by -2.0653605770000922s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 13:07:41.335239 20972 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:41.335970 14933 connection.cc:256] RPC call timeout handler was delayed by -1.997781471000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:07:41.336445 14933 connection.cc:256] RPC call timeout handler was delayed by -1.844619611999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
W20260709 13:07:41.336867 14933 connection.cc:256] RPC call timeout handler was delayed by -1.8306222119999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:07:41.337231 14933 connection.cc:256] RPC call timeout handler was delayed by -1.8143329560000439s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260709 13:07:41.337574 21267 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.334326 21533 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.338290 21267 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.338795 21534 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.333753 14861 connection.cc:256] RPC call timeout handler was delayed by -1.4645515629999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2464s for a response
W20260709 13:07:41.339588 14861 connection.cc:256] RPC call timeout handler was delayed by -1.3901259079999591s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2885s for a response
I20260709 13:07:41.340058 21533 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.340656 21267 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.341279 21267 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.337534 20972 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.337636 14933 connection.cc:256] RPC call timeout handler was delayed by -1.6992222119999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 13:07:41.342149 20972 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:41.342401 14933 connection.cc:256] RPC call timeout handler was delayed by -1.5392154450000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19940000000000002s for a response
W20260709 13:07:41.342785 14933 connection.cc:256] RPC call timeout handler was delayed by -1.5255723940000507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
W20260709 13:07:41.343173 14933 connection.cc:256] RPC call timeout handler was delayed by -1.3981657729999597s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
I20260709 13:07:41.342718 20972 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:41.343442 14933 connection.cc:256] RPC call timeout handler was delayed by -1.3252216199999793s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:07:41.344982 20972 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.337186 21535 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.345525 20972 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.346038 20972 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:41.346544 14933 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.534s (SENT) [suppressed 1 similar messages]
I20260709 13:07:41.346740 21401 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:41.348109 20972 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.341771 21267 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.348937 21401 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.351300 21267 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.378300 15513 connection.cc:256] RPC call timeout handler was delayed by -3.3569623160001356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2389s for a response
I20260709 13:07:41.379096 21267 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.379634 21141 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.380221 21141 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.382328 21141 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.382372 21484 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.378358 20972 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.382987 21484 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.383829 21491 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.383680 20972 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:37.642195 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.385823 14888 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:07:41.386499 14888 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4098) took 3768 ms (client timeout 1971 ms). Trace:
W20260709 13:07:41.386844 14888 rpcz_store.cc:269] 0709 13:07:37.618460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.633309 (+ 14849us) service_pool.cc:224] Handling call
0709 13:07:41.386400 (+3753091us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.387804 21539 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.385183 21484 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.388773 21484 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.388365 21539 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.389397 21484 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.391367 21539 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.391984 21539 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.382922 21141 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.392500 21539 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.392863 21474 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.385761 20972 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.393501 21474 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.393234 21141 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.392125 21484 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.398046 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.379657 21267 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.398131 21540 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.399003 21540 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.399492 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.400076 14888 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:41.400887 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.401165 21540 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.401937 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.402730 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.402382 21267 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.402489 14888 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:41.396091 21484 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.405458 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.406055 14886 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:41.406008 21484 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.408880 21484 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.410955 14886 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:41.410821 21484 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.411629 21484 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.412110 21474 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.412791 21474 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.413242 21474 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.414150 21484 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.415153 21484 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:41.416790 21484 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.415560 21474 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.418058 21484 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.418537 21484 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:41.422295 21295 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 3.814s	user 0.017s	sys 0.022s
I20260709 13:07:41.424721 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.426717 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.426980 21484 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.427385 14888 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 10.
I20260709 13:07:41.428670 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.429291 14888 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:41.429955 21484 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.431928 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.433593 21484 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:41.433665 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.434108 21484 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.434259 14895 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.434525 21484 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.436981 15040 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:41.441367 14895 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:41.442428 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.443562 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.441406 21484 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.444160 14895 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.450963 14895 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:41.451340 21484 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.451972 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.452701 14895 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:07:41.453956 15010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.879s	user 0.017s	sys 0.037s
W20260709 13:07:41.455284 15010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.880s	user 0.017s	sys 0.038s
W20260709 13:07:41.456588 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 3.88212e+06us
W20260709 13:07:41.439304 15040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3616) took 3865 ms (client timeout 1929 ms). Trace:
W20260709 13:07:41.463752 15040 rpcz_store.cc:269] 0709 13:07:37.573783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.573888 (+   105us) service_pool.cc:224] Handling call
0709 13:07:41.439062 (+3865174us) spinlock_profiling.cc:243] Waited 3.85 s on lock 0x7b5400404cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:41.439192 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8845319424}
I20260709 13:07:41.459712 14895 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:41.465334 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.466501 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.469527 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:41.474263 15548 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 1709) took 4718 ms (client timeout 2236 ms). Trace:
W20260709 13:07:41.474704 15548 rpcz_store.cc:269] 0709 13:07:36.756217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.756332 (+   115us) service_pool.cc:224] Handling call
0709 13:07:41.474048 (+4717716us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54005d02d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:41.474155 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1744354048}
I20260709 13:07:41.475466 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:41.476285 21295 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:41.477489 15010 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:41.478238 21295 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:07:41.483330 15010 connection.cc:256] RPC call timeout handler was delayed by -3.6330267940001022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260709 13:07:41.483954 21295 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:41.484108 14891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1430) took 5610 ms (client timeout 2389 ms). Trace:
I20260709 13:07:41.484516 21295 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.487322 21295 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.484521 14891 rpcz_store.cc:269] 0709 13:07:35.873595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:35.873715 (+   120us) service_pool.cc:224] Handling call
0709 13:07:41.483919 (+5610204us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54000cbf54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:41.484020 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3778395008}
I20260709 13:07:41.489015 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.490149 21533 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.490630 21533 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.489722 14891 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 10.
I20260709 13:07:41.492290 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.492980 21533 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.493252 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.493961 14891 raft_consensus.cc:2368] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15.
I20260709 13:07:41.490633 21535 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.495282 21535 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.497911 21535 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.500484 14933 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.501524 21535 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.502230 21535 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.502935 21535 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:37.634104 14892 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.509166 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.512472 14933 leader_election.cc:400] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15.
I20260709 13:07:41.513583 14933 leader_election.cc:403] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.514230 20943 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:07:41.490913 21491 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.516873 21491 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.519004 21491 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:41.520972 21419 consensus_meta.cc:287] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 4.087s	user 0.031s	sys 0.017s
I20260709 13:07:41.521391 21419 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.521811 20943 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15.
I20260709 13:07:41.523860 14895 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:41.524883 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.525450 14895 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:41.526237 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.527747 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.528565 21533 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.529101 21533 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.530272 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.530853 14964 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:41.531038 21533 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.531605 21533 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.531998 21533 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.534240 21419 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.534474 21533 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.534657 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.534968 21491 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.535343 14893 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:07:41.535900 14893 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4105) took 3903 ms (client timeout 1994 ms). Trace:
I20260709 13:07:41.536283 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.537313 21533 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:41.536260 14893 rpcz_store.cc:269] 0709 13:07:37.632850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.634305 (+  1455us) service_pool.cc:224] Handling call
0709 13:07:41.534508 (+3900203us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d3c0a0 00007f5539d3b984 00007f55332b66d4 00007f55332b6662
0709 13:07:41.535819 (+  1311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3587062144}
I20260709 13:07:41.538503 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.537794 21533 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.539110 14893 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:41.539436 21533 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:41.540043 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.540481 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.535364 21491 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.541263 21491 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.540673 14891 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:41.544245 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.544806 14891 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:41.544955 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.545753 21495 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:41.546190 21495 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.546586 21495 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:41.551853 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.552994 21489 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:41.553453 21489 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.553885 21489 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:41.570161 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:41.588438 21477 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 3.962s	user 0.020s	sys 0.035s
W20260709 13:07:41.589172 21477 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 3.963s	user 0.020s	sys 0.035s
I20260709 13:07:41.604624 20945 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.605190 20945 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.606029 21406 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.606588 21406 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.607345 20945 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.614594 20945 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.615092 20945 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.609004 21064 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.619465 21064 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.621356 21064 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.619503 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:41.622318 14892 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:41.622800 21358 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.541203 14893 raft_consensus.cc:2376] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16. Re-sending same reply.
I20260709 13:07:41.622736 14793 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:41.623317 21358 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.624356 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.625516 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.626060 14893 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:41.626873 21358 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.627679 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4106) took 3994 ms (client timeout 1954 ms). Trace:
I20260709 13:07:41.610208 21534 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.630921 21534 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.632915 21534 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.633347 21534 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.633780 21534 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.617796 20945 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.611505 14936 connection.cc:256] RPC call timeout handler was delayed by -3.0781796480000594s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 13:07:41.635954 14936 connection.cc:256] RPC call timeout handler was delayed by -3.0115796479999517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16770000000000002s for a response
W20260709 13:07:41.636274 14936 connection.cc:256] RPC call timeout handler was delayed by -2.92249558900005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:07:41.636533 14936 connection.cc:256] RPC call timeout handler was delayed by -2.9214341370000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:07:41.636782 14936 connection.cc:256] RPC call timeout handler was delayed by -2.8765796479999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1827s for a response
W20260709 13:07:41.637044 14936 connection.cc:256] RPC call timeout handler was delayed by -2.7847796480000397s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 13:07:41.637319 14936 connection.cc:256] RPC call timeout handler was delayed by -2.7033089349999955s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260709 13:07:41.637578 14936 connection.cc:256] RPC call timeout handler was delayed by -2.5489777110000205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2117s for a response
I20260709 13:07:41.609405 21473 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.639817 21473 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.642760 21473 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.643834 21534 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.618427 20943 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.647748 20943 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.650939 20943 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.613515 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.671783 14894 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:41.613572 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.608796 21406 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.609203 14859 connection.cc:256] RPC call timeout handler was delayed by -2.9223118959999965s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
W20260709 13:07:41.673167 14859 connection.cc:256] RPC call timeout handler was delayed by -2.5353118959999392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 13:07:41.673534 14859 connection.cc:256] RPC call timeout handler was delayed by -2.5061040849999472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18830000000000002s for a response
I20260709 13:07:41.673599 21141 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.673879 14859 connection.cc:256] RPC call timeout handler was delayed by -2.2957873830000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:07:41.674239 14859 connection.cc:256] RPC call timeout handler was delayed by -1.7045565350000516s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2885s for a response
I20260709 13:07:41.609310 21159 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.675733 21159 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.678081 21159 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.679037 14890 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
W20260709 13:07:41.679610 14887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.049s	user 0.018s	sys 0.036s
W20260709 13:07:41.682669 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002d75a0 after lost signal to thread 14827
W20260709 13:07:41.685539 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 133788us
I20260709 13:07:41.687762 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.688807 21407 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:41.689265 21407 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.689714 21407 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.690035 21380 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.696941 15038 raft_consensus.cc:2393] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:41.698184 15038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3619) took 4123 ms (client timeout 2117 ms). Trace:
I20260709 13:07:41.699148 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.700273 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.612476 21477 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.701181 21477 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.651610 21487 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.610108 21464 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.702993 21464 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:41.704496 21366 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 4.099s	user 0.017s	sys 0.031s
W20260709 13:07:41.705013 21366 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.100s	user 0.017s	sys 0.031s
I20260709 13:07:41.705869 21464 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.653007 21381 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:37.634155 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.612352 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.654197 21420 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.654474 21419 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:41.708992 21419 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:41.708709 21420 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.709952 21419 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.711123 21420 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.708664 21477 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.711958 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.712121 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.712590 14962 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:07:41.713593 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:41.714129 14964 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:41.714222 21159 raft_consensus.cc:2764] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 13:07:41.714962 21159 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:41.715451 21159 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:41.716821 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:41.716612 21159 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:07:41.717515 15008 connection.cc:256] RPC call timeout handler was delayed by -2.9988837289999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17420000000000002s for a response
I20260709 13:07:41.659703 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.720743 15545 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:41.662376 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.664083 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.722199 15550 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 9.
I20260709 13:07:41.658349 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.718734 21399 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.726847 21399 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.727921 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3596) took 4164 ms. Trace:
I20260709 13:07:41.728271 14967 rpcz_store.cc:276] 0709 13:07:37.563788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.564142 (+   354us) service_pool.cc:224] Handling call
0709 13:07:37.564420 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:37.645109 (+ 80689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.645149 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:37.645200 (+    51us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:37.645250 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.727674 (+4082424us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b540025ba54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:41.727717 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.727848 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185110784}
I20260709 13:07:41.728892 21399 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.656339 21539 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.730507 14964 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
W20260709 13:07:41.731544 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 252236us
I20260709 13:07:41.732537 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.706748 21381 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.733805 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:07:41.653780 21457 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.712661 14965 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:41.668820 21491 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.717968 21401 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.735733 21457 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:41.736266 15008 connection.cc:256] RPC call timeout handler was delayed by -2.7912810349999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1554s for a response
W20260709 13:07:41.736657 15008 connection.cc:256] RPC call timeout handler was delayed by -2.5104551480000055s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260709 13:07:41.736532 21401 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:41.738045 15039 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:41.738304 21487 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:41.738518 21401 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:41.721645 21486 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:41.738837 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:41.735965 20943 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:41.670699 21535 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.734987 21381 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.738054 21457 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.738947 21487 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:07:41.665395 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 45993.6us
I20260709 13:07:41.740417 14963 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:41.741484 21486 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:41.741267 21487 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.741848 21486 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:41.742651 21486 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.743655 21486 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:41.743862 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.744432 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:41.746232 21481 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 5.277s	user 0.029s	sys 0.026s
I20260709 13:07:41.746568 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.746680 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.746806 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.743865 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.747198 15035 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:07:41.747627 21468 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:41.747671 15036 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:41.748118 21468 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.748543 21468 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.749320 21491 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.750155 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.750697 15035 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:41.754527 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:41.740701 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 4.300s	user 0.015s	sys 0.032s
W20260709 13:07:41.755550 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 4.314s	user 0.015s	sys 0.033s
W20260709 13:07:41.755847 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 4.31522e+06us
I20260709 13:07:41.756856 15514 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:41.756661 21468 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.757103 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.757474 21517 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:41.758029 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:41.755864 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.759050 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.759595 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.759706 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3574) took 5634 ms. Trace:
I20260709 13:07:41.759747 15042 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:41.758963 21517 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.760161 14970 rpcz_store.cc:276] 0709 13:07:36.124926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:36.125070 (+   144us) service_pool.cc:224] Handling call
0709 13:07:36.125854 (+   784us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:36.126183 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:36.126214 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:36.127351 (+  1137us) log.cc:844] Serialized 26 byte log entry
0709 13:07:36.210048 (+ 82697us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18002f5e40. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:07:36.386586 (+176538us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:36.435347 (+ 48761us) log.cc:844] Serialized 14 byte log entry
0709 13:07:36.990378 (+555031us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:36.990467 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.745653 (+4755186us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:41.759503 (+ 13850us) raft_consensus.cc:1685] finished
0709 13:07:41.759527 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.759631 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13998,"prepare.queue_time_us":82544,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":102018,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":37267,"spinlock_wait_cycles":56903808,"thread_start_us":757198,"threads_started":3,"wal-append.queue_time_us":244800}
I20260709 13:07:41.761966 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.763032 21373 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.763144 15042 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:41.763549 21373 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.763976 21373 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.764253 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.764971 21160 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:41.765451 21160 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:41.765673 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.766342 15042 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:41.766301 21160 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.767382 21535 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:41.768353 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08003c7160 after lost signal to thread 14919
W20260709 13:07:41.768671 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08002e98c0 after lost signal to thread 14920
I20260709 13:07:41.768823 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.768114 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.769366 14886 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:41.769752 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800238000 after lost signal to thread 14994
W20260709 13:07:41.770057 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800349c40 after lost signal to thread 14995
I20260709 13:07:41.771768 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.774237 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:41.698673 15038 rpcz_store.cc:269] 0709 13:07:37.574577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.574941 (+   364us) service_pool.cc:224] Handling call
0709 13:07:41.697948 (+4123007us) spinlock_profiling.cc:243] Waited 4.1 s on lock 0x7b54001ce154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:41.698103 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9437744512}
I20260709 13:07:41.776522 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.777169 15036 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:41.777719 14886 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:41.778986 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.779347 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.779757 21381 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:41.780265 21381 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:41.781018 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.781241 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.781809 14891 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.783646 21299 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:41.784158 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.785027 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:41.785095 21299 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:41.785735 21299 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.786137 21299 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:41.781108 21381 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.780534 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.791211 14891 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
W20260709 13:07:41.792738 14824 debug-util.cc:398] Leaking SignalData structure 0x7b080024a7c0 after lost signal to thread 15068
W20260709 13:07:41.794623 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800381100 after lost signal to thread 15574
W20260709 13:07:41.796156 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800359300 after lost signal to thread 21467
I20260709 13:07:41.796398 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.797362 14891 raft_consensus.cc:2393] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 10: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:07:41.801191 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 62430.1us
W20260709 13:07:41.664568 14892 rpcz_store.cc:269] 0709 13:07:37.633127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.633243 (+   116us) service_pool.cc:224] Handling call
0709 13:07:41.627608 (+3994365us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:41.805627 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.807570 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:41.807610 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 119967us
I20260709 13:07:41.808264 15035 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.809754 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.810390 14890 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:41.792178 21468 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:41.812284 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.812966 14890 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:41.814482 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.527196 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.823834 14895 raft_consensus.cc:2368] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20.
I20260709 13:07:41.808902 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.832042 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.833449 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.833695 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:41.835127 14887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 4.205s	user 0.019s	sys 0.036s
I20260709 13:07:41.836289 15038 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 13:07:41.837306 15007 connection.cc:256] RPC call timeout handler was delayed by -3.6429235379999909s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
W20260709 13:07:41.837673 15007 connection.cc:256] RPC call timeout handler was delayed by -3.5822122519999766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2121s for a response
I20260709 13:07:41.826683 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.828606 15548 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:41.838583 14891 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:07:41.682324 21367 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 4.072s	user 0.033s	sys 0.029s
I20260709 13:07:41.843088 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.830294 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.812896 21486 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:41.854820 15549 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 13:07:41.840548 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.841934 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.842175 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.842835 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.829474 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.856137 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.839717 21478 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:41.845538 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.856406 15543 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:07:41.845805 15039 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.847299 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.857277 15549 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:41.816090 21403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 5.340s	user 0.009s	sys 0.070s
I20260709 13:07:41.851050 15035 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:41.852691 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4104) took 4207 ms. Trace:
I20260709 13:07:41.855518 15042 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:41.854221 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.860669 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.856386 15545 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:41.844143 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:41.861368 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.841542 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.861433 15548 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:41.862452 14967 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:41.862958 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.862834 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.863751 14892 raft_consensus.cc:2376] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15. Re-sending same reply.
I20260709 13:07:41.864128 14894 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:41.811722 21160 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.865065 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.867525 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.868134 14967 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:07:41.860364 14887 rpcz_store.cc:276] 0709 13:07:37.628715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:37.628821 (+   106us) service_pool.cc:224] Handling call
0709 13:07:37.629126 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:37.629494 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:37.629525 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:37.630011 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:07:41.835593 (+4205582us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:41.835624 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:41.835674 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:41.835704 (+    30us) raft_consensus.cc:1685] finished
0709 13:07:41.835711 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:41.835790 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2844,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":4205216,"threads_started":1,"wal-append.queue_time_us":575635,"wal-append.run_cpu_time_us":1678,"wal-append.run_wall_time_us":1001701}
I20260709 13:07:41.869287 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.870997 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.872318 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.811721 21419 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:41.879618 14965 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:41.880314 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.881182 14967 raft_consensus.cc:2410] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:41.881557 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:41.872933 14890 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:41.876704 14788 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 322) took 8646 ms. Trace:
I20260709 13:07:41.877287 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.877811 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:41.865584 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.890887 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.841410 21535 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:41.883698 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:41.866466 21403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 5.384s	user 0.009s	sys 0.071s
I20260709 13:07:41.859426 21486 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.898217 14893 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:07:41.894914 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.854156 21306 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:41.866480 20943 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.883107 14788 rpcz_store.cc:276] 0709 13:07:33.230126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:33.237605 (+  7479us) service_pool.cc:224] Handling call
0709 13:07:41.876609 (+8639004us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:36.463854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:36.548467 (+ 84613us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:36.548505 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:36.548525 (+    20us) tablet.cc:662] Decoding operations
0709 13:07:37.036050 (+487525us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:37.044001 (+  7951us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:37.046060 (+  2059us) tablet.cc:685] Acquiring locks for 16 operations
0709 13:07:37.093826 (+ 47766us) tablet.cc:701] Row locks acquired
0709 13:07:37.093849 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:07:37.094012 (+   163us) write_op.cc:270] Start()
0709 13:07:37.094125 (+   113us) write_op.cc:276] Timestamp: P: 1783602457093965 usec, L: 0
0709 13:07:37.094147 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:07:37.099466 (+  5319us) log.cc:844] Serialized 6389 byte log entry
0709 13:07:37.403795 (+304329us) op_driver.cc:464] REPLICATION: finished
0709 13:07:38.141227 (+737432us) write_op.cc:301] APPLY: starting
0709 13:07:38.141334 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:38.214402 (+ 73068us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:38.214512 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:38.227841 (+ 13329us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:38.228466 (+   625us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 13:07:38.228531 (+    65us) write_op.cc:312] APPLY: finished
0709 13:07:38.229195 (+   664us) log.cc:844] Serialized 148 byte log entry
0709 13:07:38.229421 (+   226us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:38.229638 (+   217us) write_op.cc:454] Released schema lock
0709 13:07:38.229709 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:38.230209 (+   500us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:38.230248 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":293799,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":737106,"apply.run_cpu_time_us":21493,"apply.run_wall_time_us":88981,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71007,"num_ops":16,"prepare.queue_time_us":399720,"prepare.run_cpu_time_us":16703,"prepare.run_wall_time_us":710264,"raft.queue_time_us":79089,"raft.run_cpu_time_us":44332,"raft.run_wall_time_us":300089,"replication_time_us":309499,"thread_start_us":548246,"threads_started":4,"wal-append.queue_time_us":85709,"wal-append.run_cpu_time_us":7412,"wal-append.run_wall_time_us":2043394}]]}
I20260709 13:07:41.866144 21372 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.911720 14933 leader_election.cc:400] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20.
I20260709 13:07:41.912297 14933 leader_election.cc:403] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:41.912238 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.902001 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:41.919726 15039 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 13:07:41.911801 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.909204 14894 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.922473 15546 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:41.923100 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.922052 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:41.928311 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:41.897118 21490 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.904974 21486 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:41.947206 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.948236 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.932294 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.901355 21468 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:41.933925 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:41.903975 21464 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:41.855756 21367 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.931957 21399 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:41.865510 21478 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.939347 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.941998 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.980705 15543 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:41.981647 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.943181 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.982923 15550 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:41.943964 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.984807 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.985131 15541 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:41.985924 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.986122 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.986694 15541 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 9.
I20260709 13:07:41.944620 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.905220 21535 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:41.948688 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.893410 21419 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.965521 15040 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:41.910319 20943 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.963800 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.948814 15041 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:41.966245 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.920575 20945 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:41.973639 21464 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:41.971617 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:41.938367 21534 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:41.932672 21159 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:41.973413 14890 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:42.006817 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.008278 15545 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:41.974246 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.976603 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.976542 14967 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:41.978739 14893 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:07:41.978788 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:42.010723 14893 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:07:42.010859 14887 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:41.979792 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.937299 21490 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:41.984454 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:41.988353 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:41.982265 14895 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:41.913033 21306 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.990968 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:41.990962 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:41.973441 21468 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:42.003161 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.019110 15039 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:42.019837 15549 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:41.999583 20943 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.970894 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:42.004400 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 110905us
I20260709 13:07:42.022850 15040 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:42.019071 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.024116 15043 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.006462 20945 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:42.026996 15542 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:42.000836 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.004185 15038 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:41.937431 21489 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:41.982322 21405 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:41.929951 21372 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:42.015482 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:41.985478 21399 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.015379 21159 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:42.020416 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:42.040712 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.012671 21464 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.042485 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.026604 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.042682 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.049749 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.013972 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.065589 15037 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
W20260709 13:07:42.065804 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51943.1us
I20260709 13:07:42.054771 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.021297 21490 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.062393 14895 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:42.063282 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.070452 14968 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:42.072526 15549 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 21: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:42.073227 15544 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.041455 20945 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:41.999647 21495 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:42.077838 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51341.3us
I20260709 13:07:42.079696 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.053735 21405 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.084403 15044 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.085856 14892 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.021621 21407 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:42.091666 21548 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:07:42.093418 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.084678 21556 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:42.064502 21159 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.075445 21420 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:07:42.103022 15044 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:42.090219 21405 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.106870 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.108453 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:42.096781 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 54181us
I20260709 13:07:42.107479 15542 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:07:42.121084 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.122947 14970 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:42.089767 21477 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:42.123697 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.123931 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.116827 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.092569 21554 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.125698 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.133383 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.130483 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.129671 21556 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.090540 21373 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.141691 21556 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.142171 21399 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.142840 21373 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.140820 21554 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.144543 21554 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.148442 21489 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.148578 21407 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:42.139086 14777 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 90627.9us
I20260709 13:07:42.149102 21489 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:42.097034 21299 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.149483 21489 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:42.149937 21489 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:42.140803 21306 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.152453 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.156095 14892 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.156168 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.153257 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.157058 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.157665 15036 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:42.084437 21535 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.160826 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.161384 14893 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.162801 21420 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:42.158779 21564 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:42.163679 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.163875 21564 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:42.164348 21564 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:42.166410 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.166996 14888 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.168275 21495 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:42.169108 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 144072us
I20260709 13:07:42.171836 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.172539 15037 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:42.173411 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.173537 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.174522 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.174669 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:42.171964 21533 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.632s	user 0.009s	sys 0.000s
I20260709 13:07:42.171993 15039 raft_consensus.cc:1240] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:42.199950 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.179083 20943 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.179761 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.204491 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.205073 14887 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:42.205251 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.205248 15037 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:42.208797 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.208848 14893 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:42.210865 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.211484 14889 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.130503 21477 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:42.211875 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.213410 20943 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.213428 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.220705 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.136267 21561 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:42.217274 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.151024 21299 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.225474 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.227308 14892 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:42.225631 15043 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:42.230212 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.230822 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.234555 20943 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:42.234961 20943 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.214480 21477 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.229337 21254 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.175824 21533 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.241808 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.229195 21495 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:42.242588 20943 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.241951 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.223832 21561 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:42.248811 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.251636 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.251498 14888 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:42.254073 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.256141 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.228987 21407 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260709 13:07:42.135782 21468 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.241672 21367 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.260727 14887 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:42.263038 21407 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:42.264482 14995 heartbeater.cc:646] Failed to heartbeat to 127.13.120.62:42905 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.13.120.62:42905 timed out after 15.000s (SENT)
I20260709 13:07:42.270119 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.267371 14889 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:42.251567 21561 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:42.269979 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.271692 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.265898 21540 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:42.273448 21540 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:42.274308 21540 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.275916 15547 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.280020 21160 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:42.280975 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:42.256088 21254 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:42.282124 21254 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.259248 21495 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.284242 21495 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.284745 21533 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.287503 20945 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.289069 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.289361 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.289925 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.265419 21372 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:42.290935 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.247136 21420 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.386215 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.307109 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.291647 15545 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 21: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:42.388202 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 81200.5us
I20260709 13:07:42.291780 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:42.392546 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 266968us
I20260709 13:07:42.392716 14895 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:07:42.393159 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.393978 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.393257 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.396778 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.397400 14889 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.399827 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.390823 15550 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:42.402778 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:42.403659 15041 raft_consensus.cc:2393] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 11: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:42.404644 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.405573 14967 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:42.406622 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.411553 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:42.413049 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.417161 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.415719 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.424160 15545 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:07:42.425437 15544 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:07:42.309923 21533 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:42.291425 20945 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.269760 21407 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.432762 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.430720 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.437631 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:42.438284 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.442677 14967 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:42.439289 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.443671 14966 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 9.
I20260709 13:07:42.423465 21419 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:42.445339 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 294413us
I20260709 13:07:42.313315 21489 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.460772 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.461560 14969 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:42.455603 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.457352 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.359938 21405 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:42.444849 21567 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:07:42.466627 15008 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.459062 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.468207 14889 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:42.452665 21572 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.472086 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.462659 21535 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:42.484010 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.490725 14969 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:42.486249 14967 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.491828 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.495201 14969 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:42.496523 14961 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:07:42.467890 21468 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.499537 21533 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.500003 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:42.501102 21570 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:07:42.503679 21407 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.495841 21372 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:42.444744 21564 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.477720 21579 raft_consensus.cc:2804] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:42.506916 21464 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.508471 21489 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.510603 21159 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.435951 21486 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:42.513453 21490 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.477435 21572 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.514915 21254 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:42.515571 21367 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:42.516925 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.517427 21299 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:42.496100 21535 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.519529 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:42.526938 21372 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.525805 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.507200 21534 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20.
I20260709 13:07:42.525255 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.528455 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:42.529630 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.497325 21399 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:07:42.543007 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.543066 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:42.541244 21407 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.546111 21159 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.546178 21490 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.546790 21381 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:07:42.547031 21571 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:07:42.549038 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.534175 21579 raft_consensus.cc:697] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.525760 21468 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.535859 21405 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.541512 21535 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:42.551173 21373 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:42.555083 21373 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:42.541785 21372 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.547533 21459 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:42.542929 21366 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.552356 21160 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:42.562270 21468 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.560554 21486 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.560727 21477 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.561633 21459 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:42.563694 21579 consensus_queue.cc:237] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.563814 21459 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.560113 21572 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.562331 21160 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:42.567705 21160 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:42.562976 21576 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 13:07:42.577684 21564 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.578523 21477 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.578590 21464 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.557914 21533 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:42.616143 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.632678 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.634429 14894 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.639896 14887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34356
I20260709 13:07:42.640956 14887 raft_consensus.cc:606] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Received request to transfer leadership
I20260709 13:07:42.642802 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:42.644646 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:42.646241 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:42.512645 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.528455 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:42.667088 14962 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
W20260709 13:07:42.668534 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:42.519011 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 125849us
I20260709 13:07:42.669656 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.670406 14933 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.671175 14962 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:42.673123 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.673354 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.674372 14962 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:42.675009 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.676357 14895 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.668581 14961 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:42.676975 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.677811 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:42.678961 14961 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:42.512063 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:42.680114 14963 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.680980 14961 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:42.681187 14965 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.682833 14961 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:07:42.684425 14961 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:42.685662 14961 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:42.686336 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.690883 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.691210 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.692539 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:42.693327 14886 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.695847 21592 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:42.696768 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.522356 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:42.699792 14968 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:42.533488 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:42.710635 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 177189us
W20260709 13:07:42.712045 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 163162us
I20260709 13:07:42.717274 21367 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:07:42.539556 21254 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.721311 15043 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:42.724493 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:42.556988 21373 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.730438 21373 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:42.734599 21306 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:42.735117 21306 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.723315 21254 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.737185 14969 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:42.737464 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:42.745316 21399 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:42.674405 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:42.754822 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58200.8us
I20260709 13:07:42.756316 14966 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:42.757321 14961 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:42.651127 14894 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:42.761209 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:42.762267 21561 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.765795 14895 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:42.766897 14889 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:42.753790 21306 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:42.771734 14962 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:42.772944 21539 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:42.775699 21399 consensus_queue.cc:1243] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:42.776484 21399 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:42.776963 21399 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.777743 14892 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:42.778090 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:42.778180 21399 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.783856 21564 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.788071 21408 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:42.788919 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.789386 21408 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:42.789793 15546 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:07:42.789904 21408 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:42.790740 14890 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:42.791502 21539 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:42.793668 21491 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:42.793867 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.794219 21491 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.794658 21491 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:42.799805 21486 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:42.800726 21486 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.800859 21490 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:42.801317 21490 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.801789 21490 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:42.802388 21572 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:42.802124 21486 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.802848 21572 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.803282 21572 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:42.799913 21534 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:42.806345 21534 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.806759 21534 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:42.791333 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:42.812161 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:42.816311 14964 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.816852 14970 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.785984 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:42.792737 21408 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.825904 21408 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:42.826040 21568 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.686s	user 0.003s	sys 0.001s
W20260709 13:07:42.831655 14841 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:07:42.832248 14841 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 754b0ca0f8c0459c8b6f122a5ff76b39 already in progress
W20260709 13:07:42.832599 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 754b0ca0f8c0459c8b6f122a5ff76b39 already in progress
W20260709 13:07:42.843566 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52410.6us
I20260709 13:07:42.845131 21584 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:42.845250 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:42.846597 21584 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.846508 21160 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.847096 15036 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:42.847262 21584 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:42.847474 21399 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.848819 15041 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:42.849017 21160 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:42.851902 21171 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.013s
I20260709 13:07:42.853052 21171 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:42.853511 21171 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.854580 21171 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.792654 21373 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.863329 14887 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
W20260709 13:07:42.867106 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84203.5us
I20260709 13:07:42.856392 21584 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.872282 15036 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:42.872686 15036 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.873708 21584 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.873816 15036 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:42.875952 21561 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:42.877034 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 99172.6us
I20260709 13:07:42.878197 21535 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.879559 21295 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:07:42.880821 21295 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:42.881249 21295 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.882386 21295 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.891556 14963 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.899735 21547 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:42.900959 21447 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:42.901361 21447 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.901911 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.902186 21539 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:42.902361 21447 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.903643 21561 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:42.904246 21561 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.904610 21447 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.905349 21561 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.905969 15543 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:42.900964 14889 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.913261 15036 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:42.914506 21478 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:42.915083 14890 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:42.903278 14933 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:42.916450 21589 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 13:07:42.917071 14894 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:42.919448 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:42.921036 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:42.921346 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:42.921852 21160 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.922269 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.922657 21160 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:42.923072 21160 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:42.923302 21584 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:42.923475 21160 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:42.923974 21584 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:42.924185 21171 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:42.925026 21584 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.878516 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:42.931718 21443 raft_consensus.cc:2764] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:07:42.932201 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53907.4us
I20260709 13:07:42.932502 14887 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:42.933126 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:42.934321 15010 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:42.934695 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:42.934592 21490 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.936192 21554 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:42.936678 21554 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:42.937767 21554 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.938201 21457 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:42.938796 21554 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:42.914542 14888 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:42.942111 21401 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:07:42.942626 21401 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:42.943032 21401 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:42.628947 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:42.944056 21295 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:42.945091 14793 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 330) took 17005 ms (client timeout 15000 ms). Trace:
W20260709 13:07:42.913283 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 53481.5us
I20260709 13:07:42.936219 14889 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.964962 21408 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:42.922282 21491 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:42.966099 21579 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:07:42.971331 14886 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:42.983433 14968 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:42.998629 15036 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 13:07:42.999219 15036 pending_rounds.cc:85] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 11
I20260709 13:07:42.967267 21478 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:42.967298 21547 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:07:42.970877 21592 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:42.984190 21064 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.007083 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:42.999501 15036 pending_rounds.cc:107] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 13:07:42.967157 21443 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:07:43.027242 20945 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 13:07:43.009420 21160 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.027980 21407 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 13:07:42.945529 14793 rpcz_store.cc:269] 0709 13:07:25.939138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:26.008008 (+ 68870us) service_pool.cc:224] Handling call
0709 13:07:26.105098 (+ 97090us) spinlock_profiling.cc:243] Waited 30.1 ms on lock 0x7b54002b0110. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c520b2 00007f553abcba89 00007f553ab63da6 00007f553ab35088 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc
0709 13:07:42.944838 (+16839740us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:42.000069 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:42.000653 (+   584us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:42.000697 (+    44us) write_op.cc:435] Acquired schema lock
0709 13:07:42.000716 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:42.001063 (+   347us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:42.001142 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:42.001177 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:07:42.001350 (+   173us) tablet.cc:701] Row locks acquired
0709 13:07:42.001368 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:07:42.001512 (+   144us) write_op.cc:270] Start()
0709 13:07:42.001625 (+   113us) write_op.cc:276] Timestamp: P: 1783602462001458 usec, L: 0
0709 13:07:42.001648 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:07:42.002292 (+   644us) log.cc:844] Serialized 533 byte log entry
0709 13:07:42.151363 (+149071us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b1800449500. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:07:42.505478 (+354115us) op_driver.cc:464] REPLICATION: finished
0709 13:07:42.557193 (+ 51715us) write_op.cc:301] APPLY: starting
0709 13:07:42.559040 (+  1847us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:42.571579 (+ 12539us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:42.571602 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:42.580100 (+  8498us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:42.580379 (+   279us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 13:07:42.580446 (+    67us) write_op.cc:312] APPLY: finished
0709 13:07:42.580703 (+   257us) log.cc:844] Serialized 25 byte log entry
0709 13:07:42.582216 (+  1513us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:42.582327 (+   111us) write_op.cc:454] Released schema lock
0709 13:07:42.582382 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:42.582940 (+   558us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:42.582993 (+    53us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":180454,"reported_tablets":10,"spinlock_wait_cycles":69168000,"child_traces":[["op",{"apply.queue_time_us":47942,"apply.run_cpu_time_us":3842,"apply.run_wall_time_us":29234,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8307,"num_ops":1,"prepare.queue_time_us":365656,"prepare.run_cpu_time_us":22155,"prepare.run_wall_time_us":83561,"raft.queue_time_us":206872,"raft.run_cpu_time_us":4011,"raft.run_wall_time_us":84792,"replication_time_us":487799,"spinlock_wait_cycles":7924480,"thread_start_us":533435,"threads_started":4,"wal-append.queue_time_us":88789}]]}
I20260709 13:07:43.031757 21478 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:43.099918 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.031839 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:43.026093 21372 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:07:43.038395 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 104251us
W20260709 13:07:43.030366 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 481336us
W20260709 13:07:43.064145 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 117053us
I20260709 13:07:43.068291 21373 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:43.104630 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.105477 21457 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:43.108088 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.106835 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.110127 21457 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:43.110370 21064 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:43.110630 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 100849us
I20260709 13:07:43.110868 21064 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:43.111342 21064 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:43.111884 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:43.112792 21592 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.117936 21372 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:43.121071 21478 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:43.123387 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.124107 21295 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:43.124316 21233 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:43.124933 14967 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:43.125133 21233 consensus_queue.cc:1243] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:43.125630 21554 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:43.125705 21556 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:43.126086 21554 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.126187 21556 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.127502 21547 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:43.128347 14968 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:43.127251 21554 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.129060 21233 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:43.129462 21233 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.127256 21556 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.130995 21556 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:43.130388 21233 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.132203 21233 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:43.135067 14968 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:43.136708 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:43.138281 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:43.139870 14968 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:43.140422 21403 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:43.140842 21403 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.136865 14967 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:43.141796 21403 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.013494 15036 raft_consensus.cc:2889] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:43.074290 21490 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.075552 21572 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.077721 21401 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.146144 21572 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.147528 21401 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:43.074281 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 89891.5us
I20260709 13:07:43.149132 21554 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.150802 21064 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.081956 21535 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.152784 21408 consensus_queue.cc:1059] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:07:43.154881 21408 raft_consensus.cc:3055] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:43.082399 21534 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.157039 21534 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:43.155476 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48525.3us
I20260709 13:07:43.167901 21420 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:07:43.084932 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 94408.8us
I20260709 13:07:43.085245 21489 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:07:43.087832 21597 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.081s	user 0.004s	sys 0.000s
I20260709 13:07:43.079720 21491 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.094907 21160 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.095598 21306 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.155234 21408 raft_consensus.cc:740] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:43.178339 21306 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:43.178022 21408 consensus_queue.cc:260] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.084054 21399 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:43.178941 21399 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.179363 21408 raft_consensus.cc:3060] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:43.179913 21399 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.181169 21399 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:43.175953 21489 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:43.184239 21489 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.188738 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:43.190143 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:43.193295 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:43.198035 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.212831 14888 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:43.172322 21579 consensus_queue.cc:1243] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:43.219839 21403 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:43.221757 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 106490us
I20260709 13:07:43.225018 14889 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:43.233093 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:43.241592 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56536.8us
I20260709 13:07:43.241765 21401 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:43.242281 21401 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:43.242668 21401 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:43.246362 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 109986us
W20260709 13:07:43.247138 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.249811 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:43.263724 14968 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:43.269953 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:43.272939 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 59296.7us
I20260709 13:07:43.276916 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:43.286288 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.286762 21572 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:43.287707 21491 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:43.289865 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.291335 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.292292 21373 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:43.292546 15044 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:43.292721 21373 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:43.293025 21564 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:43.293198 21373 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:43.293509 21564 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.294564 21160 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.296557 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:43.277889 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:43.309743 15036 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:43.297520 14967 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:07:43.318783 21601 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:07:43.322249 21419 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:07:43.326830 21572 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.327354 21572 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:43.328178 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.329659 21572 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.274585 21372 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:07:43.274358 21447 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.315897 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:43.328123 21535 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:43.314416 21064 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.332966 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:43.350258 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53048.5us
I20260709 13:07:43.355259 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:43.339349 21420 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 13:07:43.358152 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:43.352140 21599 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:07:43.365118 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.366519 15040 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:43.331329 21306 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:07:43.358511 21408 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:43.358755 21457 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:43.376798 21408 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:43.378996 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:43.393266 14936 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:43.398120 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.408521 14892 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260709 13:07:43.408987 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 93589.8us
I20260709 13:07:43.389676 21064 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:43.385557 21408 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:43.415863 21540 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:43.420778 21408 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.423240 21408 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.425369 21401 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.420941 21373 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.449682 14967 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
I20260709 13:07:43.450845 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:43.450965 21491 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:43.451910 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.452486 21490 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:07:43.455158 14890 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:43.455204 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:43.393673 21592 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.076s
I20260709 13:07:43.456804 14894 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:07:43.464882 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.473948 15548 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:43.491458 14966 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:43.492192 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.494019 21373 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.494616 21373 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:43.495766 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.496227 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.496770 21603 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:43.497501 21603 consensus_queue.cc:1243] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:07:43.396775 21160 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.077s
I20260709 13:07:43.465040 21491 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:43.469769 21064 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:43.520637 15044 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:43.531798 15040 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:07:43.495088 21373 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.541577 15036 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:43.557479 21592 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:43.558581 21592 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:43.558959 21592 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:43.559942 21592 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:43.561918 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 210839us
I20260709 13:07:43.521643 21491 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:43.566421 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.566815 15036 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:43.567219 15040 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:43.568084 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.569156 21401 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.573161 15038 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 13:07:43.525038 21064 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.576560 21064 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.578258 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.578027 21564 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.580345 21572 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:43.583336 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:43.602380 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 252786us
I20260709 13:07:43.603710 15043 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:43.607456 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.613070 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.613889 15043 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:43.592599 21564 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.624985 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:43.623296 14890 raft_consensus.cc:1275] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:43.625005 15039 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:43.625434 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.630298 21594 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:43.630728 21594 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:43.631587 21594 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.632139 21447 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:43.635906 21447 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.637959 21447 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:43.642165 15039 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:43.607226 21478 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:07:43.662887 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:43.665354 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 335281us
I20260709 13:07:43.648320 21490 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:43.673264 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.685685 15007 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.669210 21447 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:43.691702 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 88991.5us
I20260709 13:07:43.669629 21403 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:43.695284 15043 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:43.698947 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.699784 15044 raft_consensus.cc:2410] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 13:07:43.700762 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.702338 21604 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:43.683684 21592 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:43.703107 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.687273 21419 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:43.714102 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.721022 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.721866 15044 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.717391 21403 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.725948 21539 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.697731 21447 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.727573 21403 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.728089 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.728778 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.729125 21447 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:43.729671 21447 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:43.730134 21447 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.712898 21572 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:43.732156 21572 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:43.732560 21572 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:43.732343 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.733079 21572 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:43.733870 21490 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:43.735500 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.736603 21490 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:43.739212 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:43.739923 21490 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:43.740283 21490 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:43.740634 21490 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:43.742260 21606 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.250s	user 0.001s	sys 0.001s
I20260709 13:07:43.744199 21233 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:43.744570 21233 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:43.720163 21535 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:43.747813 21535 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:43.748152 21535 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:43.749282 21608 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:07:43.752087 21373 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:43.712250 21556 consensus_queue.cc:1048] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:07:43.761312 21489 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:43.761521 21561 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:07:43.763046 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:43.761507 15037 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:43.727526 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:43.801492 15044 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
W20260709 13:07:43.804131 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 172492us
W20260709 13:07:43.808264 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.807061 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:43.784211 21420 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:43.811160 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:43.811383 14964 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:43.812834 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:43.832862 14969 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:43.786111 21447 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.812000 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:43.837859 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 110442us
I20260709 13:07:43.838385 15042 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:43.839730 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:43.843497 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:43.846866 15041 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:43.849577 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.800063 21160 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260709 13:07:43.853050 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:43.859532 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 170138us
W20260709 13:07:43.863312 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:43.836948 21401 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:43.811368 21489 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:07:43.801894 21620 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 13:07:43.867767 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:43.866906 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:43.872649 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 111454us
I20260709 13:07:43.878196 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:43.867148 21617 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:43.892572 21490 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.894904 21490 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:43.854071 21420 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.896664 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:43.896781 21623 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:43.897511 14893 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:43.897040 21539 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:43.913443 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:43.914347 14892 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:43.874068 21401 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:43.939383 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 176459us
I20260709 13:07:43.874656 21491 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.941597 21535 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.903626 21539 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:43.950841 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63670.5us
I20260709 13:07:43.909375 21617 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:07:43.952371 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53750.9us
I20260709 13:07:43.905380 21160 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 13:07:43.948334 21539 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.954111 21626 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:43.960309 21623 consensus_queue.cc:1243] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:07:43.973603 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95550.9us
I20260709 13:07:43.952244 21478 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:43.980798 21624 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:43.981149 14964 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:43.981323 21624 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:43.981767 21624 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:43.974035 21626 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:43.982975 21626 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 20.18, Last appended by leader: 18, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:43.992815 21233 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:43.994051 21233 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:43.999506 15041 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:44.003713 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:44.010138 14969 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: []
I20260709 13:07:43.963572 21620 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:07:44.016784 14961 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:44.013864 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:44.013036 14962 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:44.010510 15007 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:44.018335 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:44.024560 14970 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:44.019321 21635 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:07:44.027920 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:44.023509 14963 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:44.023833 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:44.031507 14969 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19.
I20260709 13:07:44.040066 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:44.039153 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 134177us
I20260709 13:07:44.028714 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:44.056030 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45606.1us
I20260709 13:07:44.056834 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:44.058833 14970 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:44.061379 14965 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 22: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:44.074752 14968 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:44.070996 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:44.075559 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:44.009936 21628 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:44.012773 21556 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:44.074344 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:44.080381 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:44.189692 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 109716us
I20260709 13:07:44.192406 14969 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:44.192976 14968 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:44.070673 21419 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.079588 21306 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:07:44.207847 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 204228us
I20260709 13:07:44.208602 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:44.204985 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:44.218560 14962 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.188534 21554 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.233896 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 153635us
I20260709 13:07:44.081544 21602 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.149s
I20260709 13:07:44.207582 21633 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.274223 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.205366 21408 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:07:44.239598 21457 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:07:44.285730 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 77214.1us
I20260709 13:07:44.087749 21628 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:44.080996 21617 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.297871 21602 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Stepping down as leader of term 21
W20260709 13:07:44.299520 21627 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.292s	user 0.001s	sys 0.000s
I20260709 13:07:44.300176 21408 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:44.319723 21408 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:44.320660 21408 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.322057 21408 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:44.295569 21457 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:44.324144 21457 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.274881 21632 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:07:44.326707 21632 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:07:44.327136 21632 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:44.328187 21632 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.295308 21620 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:44.330368 21620 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.332723 21620 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:44.332832 21626 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:44.333448 21626 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.335935 21594 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.300554 21623 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:07:44.302086 21592 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.587s	user 0.010s	sys 0.000s
W20260709 13:07:44.307518 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:44.352465 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.292300 21535 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.308449 21420 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:44.309859 21624 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.306820 21539 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.275588 21579 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.278206 21491 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.314266 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:44.319159 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.237694 21554 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:44.337666 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 256815us
I20260709 13:07:44.368373 21399 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.318017 21602 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:44.351217 21623 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:44.371824 21632 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.405808 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.406515 14886 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:44.397498 21625 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:44.399598 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 80577.2us
I20260709 13:07:44.382809 21399 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:44.409600 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:44.399052 14888 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d3b63f39d444317899acc30914f8801"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:44.379220 21626 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:44.418025 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 103862us
I20260709 13:07:44.381237 21592 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.397737 21539 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.419978 14888 raft_consensus.cc:606] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:44.405280 21621 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:07:44.401284 21572 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.668s	user 0.011s	sys 0.000s
I20260709 13:07:44.429857 21572 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.431360 21401 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:44.431602 14964 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:44.432092 21572 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.427958 14888 raft_consensus.cc:614] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:44.398783 21556 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.432572 21064 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:44.433081 21064 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:44.434015 21064 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.429162 21447 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:44.435972 21447 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.437994 21447 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.438804 21373 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:44.439213 21373 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:44.439599 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.440172 21419 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.442157 21399 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:44.426213 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.417032 21564 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.401960 21624 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.440194 21373 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.405004 21554 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:44.406720 21628 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:44.435215 21064 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.458949 14962 raft_consensus.cc:2410] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:07:44.462287 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:44.458230 21564 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.472481 14969 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:44.472754 21564 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.472932 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.474659 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:44.482277 15044 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:44.483165 15038 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:07:44.483584 15038 pending_rounds.cc:85] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 9
I20260709 13:07:44.483384 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:44.483925 15038 pending_rounds.cc:107] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:07:44.484233 15038 raft_consensus.cc:2889] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.484766 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:44.486126 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:44.492470 21447 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:44.493089 21447 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.472565 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:44.500689 14970 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:44.502038 21623 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.503717 21373 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.504662 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:44.505300 15041 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:44.506783 15043 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:07:44.507151 15043 pending_rounds.cc:85] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 10
I20260709 13:07:44.507445 15043 pending_rounds.cc:107] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:07:44.507704 15043 raft_consensus.cc:2889] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:44.511324 21306 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:07:44.515867 21233 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.521s	user 0.010s	sys 0.001s
I20260709 13:07:44.524758 21579 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:44.411943 21625 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.531181 21625 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.532402 21602 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.533560 21602 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:44.537911 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 128953us
I20260709 13:07:44.541433 14892 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:44.543543 15037 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:44.540230 21564 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:44.559157 21564 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:44.578020 21556 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:44.584656 21491 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.585216 21491 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.587196 21491 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.589807 21630 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.590061 21457 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:44.590349 21630 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.592536 21630 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.594215 21630 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.594724 21630 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.596834 21630 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:44.549381 21613 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.672s	user 0.002s	sys 0.011s
I20260709 13:07:44.561848 21615 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:44.637358 21615 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:44.562548 21399 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:44.639103 21399 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:44.639487 21399 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:44.640311 21399 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.641477 21399 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.598235 21491 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:44.645737 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1499) took 1443 ms. Trace:
I20260709 13:07:44.646095 15035 rpcz_store.cc:276] 0709 13:07:43.202751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.202887 (+   136us) service_pool.cc:224] Handling call
0709 13:07:43.224168 (+ 21281us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:43.283211 (+ 59043us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b48002001d8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:07:43.295545 (+ 12334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:43.295589 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:43.296013 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:07:43.385430 (+ 89417us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:43.385479 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:43.385566 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:44.548741 (+1163175us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:44.645512 (+ 96771us) raft_consensus.cc:1685] finished
0709 13:07:44.645543 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:44.645663 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15820,"raft.queue_time_us":14313,"raft.run_cpu_time_us":2379,"raft.run_wall_time_us":10089,"spinlock_wait_cycles":14354688,"thread_start_us":89008,"threads_started":1,"wal-append.queue_time_us":503689}
I20260709 13:07:44.598670 21623 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.602118 14961 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:44.602684 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:44.545567 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.600104 14793 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 15 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.652208 14793 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 19 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 20 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:07:44.653481 14793 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 15, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.655689 14793 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 14, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 14 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:44.657727 14793 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 18, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.659777 14793 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 19 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:44.660848 21615 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.664098 21615 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:44.661758 14793 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 15 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 17 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:44.606766 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.608284 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:44.671504 14895 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.672079 21564 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.672639 21233 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.672578 21564 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.673266 21233 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.674860 21564 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.609272 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.675226 21233 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.676862 15035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:44.677542 15035 raft_consensus.cc:606] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:44.676563 14793 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:44.683918 14793 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.624583 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.690794 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:44.604004 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:44.692082 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 88182.9us
I20260709 13:07:44.692441 14886 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:07:44.693496 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:44.694253 21564 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.495353 21447 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.604933 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.695577 21579 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.695962 21491 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:44.697003 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 92198.4us
I20260709 13:07:44.698820 14936 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.684362 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:44.699697 14890 raft_consensus.cc:606] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:44.695713 21447 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:44.699566 21306 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:44.700618 21447 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:44.700670 21306 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:44.701105 21447 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:44.701188 21306 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:44.702145 21447 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.703387 21447 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:44.704015 14793 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 16 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:07:44.714010 14793 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 21, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 21 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:44.702852 21306 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.722582 21306 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:44.723083 14793 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:44.728123 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.728830 14888 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:44.703588 14890 raft_consensus.cc:614] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:44.687862 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.735071 14893 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:44.712203 21630 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.736101 21630 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.544703 21633 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:44.706116 21579 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:44.717558 21233 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.737984 21233 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.739041 21630 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.740023 21233 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.613555 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.740568 21654 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:44.741349 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 127928us
I20260709 13:07:44.741180 21654 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.742026 21491 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:44.742409 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.743149 21632 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:07:44.747244 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.751727 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.744482 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.756934 21636 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:44.763352 15549 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:44.746794 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.763725 21636 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.765000 15544 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:44.752424 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.741775 21594 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.757856 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.743264 21654 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:44.744634 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:44.748054 15546 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:44.766582 15543 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:44.767655 21629 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:44.768098 21629 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.768469 21629 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:44.768682 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.769021 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.769546 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.754942 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.747247 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.755511 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.771723 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.772557 15541 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:07:44.772907 15548 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:44.772133 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.774132 14895 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:44.774878 14892 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 13:07:44.768712 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.776847 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:44.766732 21633 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:44.758607 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59862.8us
I20260709 13:07:44.777592 15043 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:44.771723 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:44.771652 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.784379 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:44.785146 15041 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:44.797312 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:44.798353 15041 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:44.747776 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:44.817701 15037 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:44.820086 15547 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:44.765901 21594 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.780792 21233 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.825603 15041 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:44.766589 21636 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:44.830086 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49767us
W20260709 13:07:44.806892 21635 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.007s	sys 0.027s
I20260709 13:07:44.804728 21628 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:44.856365 21628 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:07:44.856825 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.788677 21630 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.878819 21556 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.879505 21556 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.881956 21556 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:44.839775 21594 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:44.840282 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 71694.5us
I20260709 13:07:44.844157 15550 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:07:44.844435 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:44.836678 21635 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.008s	sys 0.027s
I20260709 13:07:44.833974 21233 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:44.849251 15541 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 10.
W20260709 13:07:44.850703 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.895467 15548 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:44.857272 21628 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.805173 21632 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.836333 21572 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
I20260709 13:07:44.867623 15544 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
W20260709 13:07:44.870839 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 159230us
I20260709 13:07:44.853082 15547 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
W20260709 13:07:44.908777 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.909637 15541 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEARNER]: Advancing to term 17
I20260709 13:07:44.911393 15543 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 13:07:44.912639 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:44.914120 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:44.914580 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.915663 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:44.916443 14961 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 10: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:44.916517 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85620.5us
I20260709 13:07:44.917882 21572 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:44.918365 21572 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:44.919267 21572 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:44.921240 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:44.928085 15541 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEARNER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:44.930673 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:44.928150 21447 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:44.938891 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:44.943773 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.944437 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.953545 14966 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:07:44.938196 21630 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.955896 14895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:44.958804 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:44.958236 15041 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:07:44.962734 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.951627 21489 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260709 13:07:44.951809 21654 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:44.939297 21603 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:44.966244 14966 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:44.943444 21602 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:44.971877 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:44.943806 21399 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:44.937145 21373 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:07:44.960983 21657 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:44.962834 14895 raft_consensus.cc:606] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:44.972342 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:44.976837 14895 raft_consensus.cc:614] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:44.977056 15514 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19.
I20260709 13:07:44.972536 15043 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:44.977564 15042 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:07:44.978197 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.963691 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:44.972007 15541 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:44.948774 21641 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:44.966702 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:44.975201 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:44.980147 14966 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:44.971475 21564 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:44.981906 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:44.980322 21631 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:44.984786 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.982252 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.953912 21623 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 13:07:44.976883 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.971990 21603 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:44.992740 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:44.973743 21419 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:44.971493 21654 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:44.952742 21632 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.947083 21447 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.998507 21650 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.014s
I20260709 13:07:44.999236 21561 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:44.983302 21657 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.980866 21641 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:45.000666 21633 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:44.981326 21399 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.004621 14936 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:44.983808 21564 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:45.005766 14966 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:45.014603 14886 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:44.972524 21630 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:44.993427 21626 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:45.006011 21603 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:45.012548 21615 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:45.016867 21631 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.037537 14894 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:45.033815 14961 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:45.017485 21654 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.020851 21064 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:45.040779 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.024993 21554 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:07:45.044961 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 74833.7us
I20260709 13:07:45.032138 21564 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.042992 21619 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:45.053280 21641 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.054512 21641 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:45.046939 21399 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.055855 21233 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.056236 21657 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.032408 21594 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:07:45.058648 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.060679 21447 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.063598 21572 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:45.016489 21419 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.068845 21602 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:45.069260 21419 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.035176 21615 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.072321 21615 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:45.069334 21602 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:45.081753 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.082518 14965 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:45.104008 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:45.108443 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 84774.8us
I20260709 13:07:45.109479 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.044219 21534 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:45.122377 21534 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:45.123304 21534 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.131536 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.120560 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:45.112378 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 107847us
I20260709 13:07:45.136421 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:45.137662 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:45.112946 21671 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:07:45.114569 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.115970 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.135541 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.117014 21447 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.109159 21633 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.121702 21632 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.140461 14892 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:45.145635 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:45.102485 21662 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260709 13:07:45.164057 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 200452us
I20260709 13:07:45.024868 21629 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:45.110237 21665 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:07:45.153695 14892 raft_consensus.cc:606] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:45.174542 14892 raft_consensus.cc:614] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:45.158041 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:45.159075 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.165056 15010 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:45.132714 21617 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:07:45.140100 21661 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:07:45.166774 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.146955 21670 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:45.177738 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:45.152233 21064 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.152994 21556 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.152136 21673 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:45.165912 21631 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.189231 14961 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:45.193768 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73310.2us
I20260709 13:07:45.192220 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:45.199000 15546 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:45.175309 21561 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:45.139709 21626 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 13:07:45.181135 21623 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:45.162874 21160 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:07:45.207219 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:45.163514 21447 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.216495 15010 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:45.215457 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:45.188529 21556 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.217803 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:45.183284 21679 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:45.170042 21633 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:45.228255 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49571.5us
I20260709 13:07:45.203893 21673 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:45.228899 21419 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:45.228741 21579 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:07:45.231184 15007 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.203685 21631 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.222978 15549 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:45.185195 21554 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:07:45.229511 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:45.189647 21491 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 13:07:45.234373 14895 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e466470834d346b8a99b98e620844e85"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:45.241639 14895 raft_consensus.cc:606] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:45.225961 21556 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.238871 21373 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 13:07:45.224313 21233 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:45.247043 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.247949 15546 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:45.249869 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.242126 14895 raft_consensus.cc:614] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:45.212047 21306 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:45.225749 21679 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:45.232745 21160 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:45.232867 21672 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.243464 21064 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:45.237170 21419 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:45.379540 21233 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:45.262434 21160 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:45.381331 21633 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.381762 21399 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:45.383169 21654 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:45.383662 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.384608 21631 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.264703 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:45.384892 21603 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.397871 21629 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.263797 21679 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:45.385703 21675 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
I20260709 13:07:45.386996 21564 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.516741 15038 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:07:45.259897 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:45.263996 21666 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 13:07:45.388170 21615 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.232746 21673 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.520159 21683 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.520531 21637 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:45.520992 21637 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:45.520679 21683 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.521826 21637 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.391103 21401 raft_consensus.cc:993] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
W20260709 13:07:45.394083 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 169669us
I20260709 13:07:45.522912 21683 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.523131 21401 raft_consensus.cc:1081] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:07:45.523438 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:45.251950 21306 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:45.527617 21064 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:07:45.395970 21680 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:45.528115 21632 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:45.528767 21680 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:45.529662 21680 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.379962 21554 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.418723 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 186922us
I20260709 13:07:45.531656 21554 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.533581 21554 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.533936 21556 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:45.534849 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.535025 15037 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:07:45.431308 15010 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:45.453611 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.552153 14892 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:45.300990 21630 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:45.474596 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.523041 21637 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:45.455216 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.479435 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.557346 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:45.419791 21233 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.432855 21651 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.513312 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.564647 14886 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:45.430233 21399 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.387271 21602 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.451829 21579 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.570035 15041 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:45.431952 21419 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.571542 15044 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:45.431141 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.541911 21564 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.515055 21633 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:45.513837 21672 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.539970 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 280225us
I20260709 13:07:45.535620 21160 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.598503 21419 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.540707 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.599622 21160 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:45.565165 21651 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.519089 21635 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.541826 21535 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:45.602061 21535 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:45.601899 21635 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.602560 21651 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.602963 21535 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.604218 21635 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:45.604331 21579 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.607254 21603 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.608060 21654 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:45.569034 21399 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:45.527659 21306 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:45.551251 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.454021 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:45.557418 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 126211us
I20260709 13:07:45.614660 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:45.622692 15044 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:45.557700 14895 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:45.560245 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:45.560429 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:45.561549 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.593089 15041 raft_consensus.cc:1240] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:45.564385 21687 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:45.591662 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:45.596927 14894 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:45.598268 21672 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.546095 21679 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.609958 15043 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:45.613654 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:07:45.616554 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:45.627257 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:45.650910 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.652199 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.652995 15544 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:45.595130 21681 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:45.658432 15547 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:45.660146 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:45.645488 14861 connection.cc:256] RPC call timeout handler was delayed by -2.7385915239999576s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1595s for a response
I20260709 13:07:45.654616 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:45.663725 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.664263 15541 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.666877 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.667022 15040 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
W20260709 13:07:45.670588 14861 connection.cc:256] RPC call timeout handler was delayed by -2.1954354600001125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260709 13:07:45.671084 14861 connection.cc:256] RPC call timeout handler was delayed by -1.8471354600001177s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
W20260709 13:07:45.673286 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97640.1us
I20260709 13:07:45.675045 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.679050 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.679335 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.679935 14967 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:45.679697 14966 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:45.683634 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.685421 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:45.608625 21633 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.694001 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.692288 15010 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:45.622048 21572 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 13:07:45.695779 15042 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:07:45.699185 14892 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:45.644838 21534 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:07:45.701565 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.702296 15544 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:45.672930 21654 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:45.702992 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.673246 15549 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52838
I20260709 13:07:45.704397 14892 raft_consensus.cc:1275] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 13:07:45.704535 15549 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:07:45.705057 15549 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.703619 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.705713 15548 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
W20260709 13:07:45.705965 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 90427.5us
I20260709 13:07:45.706621 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:45.708581 21697 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:45.709095 21697 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.709539 21697 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.714474 15541 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:45.714612 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.715173 15042 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:45.691985 21401 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.718806 15541 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:07:45.718933 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:45.719554 15042 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:45.721575 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:45.722280 15042 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:45.726048 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.726541 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.735656 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.736276 14892 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:45.704185 21654 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.714331 21699 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
W20260709 13:07:45.748328 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 59452.4us
I20260709 13:07:45.712055 21694 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:45.662647 21681 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.753674 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.754683 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:45.755798 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:45.760490 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52694us
I20260709 13:07:45.749714 21654 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.747012 21561 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:45.761783 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:45.772599 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:45.773813 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:45.774224 21684 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.774739 21684 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.723847 21401 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.777364 14886 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:45.783931 15041 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:45.786931 14886 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:45.788376 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.786482 21698 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:07:45.789463 21684 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.790144 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.791594 21681 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.792141 21681 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:45.791611 21401 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.792593 21681 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:45.793766 21681 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.795729 21401 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.796401 21401 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.799626 21401 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.800165 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.801056 15543 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:45.803524 15543 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.804119 21700 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:45.769958 21673 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:45.770731 21561 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.787770 21602 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:45.787312 21688 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:07:45.808219 15549 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.804781 21694 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:45.817649 21686 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
W20260709 13:07:45.818149 21695 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:45.825639 15549 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:45.824570 14886 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: [20.17-20.17]
I20260709 13:07:45.829911 21615 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:45.830055 21399 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.830871 21447 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.833354 21556 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.835536 21654 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.837630 21654 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:45.838734 21399 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.840328 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.842900 21654 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:45.843271 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.843544 21064 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.843833 21654 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:45.844053 21064 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.844350 21615 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:45.844807 21623 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:45.845198 21623 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:45.846191 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.846021 21623 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.846866 21635 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:45.843883 15543 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:45.847668 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.848237 14895 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:45.849045 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:45.850226 21682 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:45.850600 21682 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:45.850929 21682 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:45.851742 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.852100 14961 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260709 13:07:45.852278 14893 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.852459 14961 pending_rounds.cc:85] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 11
I20260709 13:07:45.852727 14961 pending_rounds.cc:107] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:07:45.852946 14961 raft_consensus.cc:2889] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:45.855085 15543 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:45.856096 14890 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:45.847225 21635 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:45.858285 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.858093 21635 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.858845 14965 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:45.847209 21623 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:45.860755 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.859287 21635 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:45.865940 21696 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:45.866297 15010 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.867580 21399 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:45.867666 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.868273 21399 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.869189 21556 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:45.869618 21556 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:45.870075 21556 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:45.869663 21689 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:07:45.835569 15544 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:45.846426 21064 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.847573 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.872488 15010 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.878159 21689 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:45.878685 21689 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.877545 21615 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:45.879863 21615 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:45.879760 21689 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.880858 21615 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.881839 21615 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.825404 21694 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.884892 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.885329 14895 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:45.809489 21534 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:07:45.885793 14889 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:45.890260 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:45.812608 21561 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:45.875905 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.876611 14888 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:45.873621 14893 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:45.890202 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:45.911669 15037 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:45.891073 15038 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:45.912418 15038 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.913209 15038 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.914402 15038 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:45.874789 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.894145 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:45.894585 21679 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.894724 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.894845 21683 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:45.911363 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.916157 21694 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.916491 14893 raft_consensus.cc:2410] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:07:45.895440 21633 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:45.896826 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.822950 21672 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.896447 21233 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.917305 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.918123 21233 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:45.897927 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.919126 14894 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:45.920390 14894 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:07:45.920483 14888 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:45.921625 14894 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:45.922549 21672 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.923060 21672 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.925443 21672 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.869196 21399 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.899565 21579 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:45.823465 21673 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:45.927143 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:45.928130 21673 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.927304 21579 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:45.933665 21579 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:45.936137 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:45.936483 21697 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.938104 21683 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:45.938810 21697 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:45.939909 21683 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:45.940511 21683 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:45.941432 21683 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.945055 14894 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:45.946146 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:45.948127 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53491.1us
I20260709 13:07:45.947239 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.899492 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.901237 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:45.900063 21682 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.900115 21160 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:07:45.904740 14890 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:45.905207 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.954337 14892 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 22
I20260709 13:07:45.906445 14891 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:45.907806 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.955348 14887 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 22: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:45.908720 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.956283 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.956903 14895 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:45.915266 15542 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:45.915488 15041 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:45.918660 14893 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:45.950206 15549 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:45.882929 21556 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:45.951992 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.968372 14888 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:45.935146 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:45.956736 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.909588 15548 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:07:45.962088 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.962642 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.963721 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.964076 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.971797 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.972919 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.967322 15037 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:45.973587 14965 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:45.976349 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.977972 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:45.982657 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:45.982697 14892 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
W20260709 13:07:45.984853 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 211116us
I20260709 13:07:45.988329 15038 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:45.977385 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:45.994541 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:45.983295 14970 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:45.987038 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:45.995604 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.003324 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:45.996773 15041 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
W20260709 13:07:45.998061 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.000351 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:46.006623 14892 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:46.002393 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:45.967877 21401 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:46.009301 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:46.011456 14895 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:46.013218 14895 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:45.977439 21615 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:45.996546 21687 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:07:46.019833 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 84784.8us
I20260709 13:07:46.000085 21447 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:07:46.023958 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.024369 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:46.023903 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:46.023703 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:46.002249 21633 raft_consensus.cc:2764] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 13:07:46.002960 21623 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:46.039814 21697 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:46.023547 21447 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.015272 21401 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.010898 21602 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:46.048457 14894 raft_consensus.cc:2376] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22. Re-sending same reply.
I20260709 13:07:45.977167 21306 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.022470 21694 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:07:46.046483 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 109206us
I20260709 13:07:46.058917 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:46.060246 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:46.046345 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 226924us
I20260709 13:07:46.017664 21615 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:46.083606 15039 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 12: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:46.084296 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:46.085505 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:46.086611 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:46.087586 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.062036 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:46.047999 21401 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.008553 21561 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
W20260709 13:07:46.077766 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.111979 21633 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:46.081029 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.045591 21534 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:46.045763 21447 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:46.089576 14892 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 22 index: 19. (index mismatch)
I20260709 13:07:46.093217 21687 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:46.117645 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:46.094370 15042 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:46.118387 15544 raft_consensus.cc:2376] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17. Re-sending same reply.
I20260709 13:07:46.119200 15041 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:07:46.096248 21556 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.097204 21682 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.097611 15542 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:46.099083 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.101233 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:46.134112 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:46.136420 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.137151 15549 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:46.101809 21579 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:46.102238 21602 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:46.048336 21623 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:46.105201 21306 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.106309 21697 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:46.107523 21706 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:07:46.112948 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.152329 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:46.152664 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.112599 21633 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.153208 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.153738 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.153975 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.113241 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:46.154567 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.154704 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:46.155227 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:46.156351 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:46.093684 21679 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:46.123812 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.058306 21694 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.127681 15037 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:07:46.140612 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:46.078991 21689 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:46.144376 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:46.165463 15541 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:46.144784 15550 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:46.145272 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:46.147765 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 85819.9us
I20260709 13:07:46.148779 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.169667 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.170358 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.149333 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.170660 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.113803 21561 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:46.154361 14961 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:46.162205 15044 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:46.162839 15545 raft_consensus.cc:2410] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 21 because replica has last-logged OpId of term: 20 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 16.
I20260709 13:07:46.163831 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.146337 21685 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.173669 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.141459 21579 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.142257 21630 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:46.177935 14969 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:46.178308 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.178857 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.228154 15549 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:46.171718 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.146821 21534 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:46.219925 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.243484 15550 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.151923 21631 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.220618 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.171998 21654 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:46.167375 21694 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:46.107148 21615 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.245458 15548 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:07:46.164431 21635 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:46.164781 21603 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:46.221392 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.250523 15548 pending_rounds.cc:85] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 14
I20260709 13:07:46.157013 21632 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 13:07:46.144241 21064 consensus_queue.cc:1059] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:46.268626 15546 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:46.263588 15548 pending_rounds.cc:107] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:07:46.269259 15548 raft_consensus.cc:2889] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.183570 21689 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:46.221781 21579 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.271761 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.272701 14963 raft_consensus.cc:2368] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16.
W20260709 13:07:46.273190 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.011s	sys 0.013s
W20260709 13:07:46.273558 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.011s	sys 0.013s
I20260709 13:07:46.274672 15038 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
W20260709 13:07:46.276141 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 515240us
I20260709 13:07:46.283010 15549 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:07:46.285607 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 152079us
I20260709 13:07:46.288684 14889 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:46.304937 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:46.306718 15550 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:46.325439 15038 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:46.326601 21687 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:46.328092 21687 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.337505 15042 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:46.363648 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.366456 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:46.367499 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:46.369411 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.338218 21629 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:46.369009 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.372870 14967 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:46.370061 14966 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.364378 14963 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
I20260709 13:07:46.246802 21685 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:46.381667 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:46.382042 14969 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:46.382257 14886 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:46.253670 21631 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.384106 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:46.386170 15038 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.336262 21615 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:46.349799 15513 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.956s (SENT) [suppressed 39 similar messages]
I20260709 13:07:46.270846 21630 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 20.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
W20260709 13:07:46.392223 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 137981us
W20260709 13:07:46.405638 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 228493us
I20260709 13:07:46.404520 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:46.414044 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64285us
I20260709 13:07:46.348304 21233 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:46.412420 14886 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:46.344411 21654 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:46.427345 14968 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
I20260709 13:07:46.383492 21701 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:46.377187 21635 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:46.348749 21697 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 13:07:46.443063 14966 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:46.405215 21651 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:46.373893 21681 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 13:07:46.413518 21064 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:46.455772 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 143543us
I20260709 13:07:46.448480 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:46.386234 21534 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.439826 21683 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.461671 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:46.388218 21702 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260709 13:07:46.462076 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.371255 21623 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.445242 21701 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:46.443707 21160 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:46.425930 21561 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 13:07:46.491137 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:46.470643 14967 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:46.433990 21233 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.467927 15038 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:46.459648 21637 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:46.461359 21724 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:46.514606 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 110149us
W20260709 13:07:46.514012 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 65629us
I20260709 13:07:46.449342 21651 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.521196 15550 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:46.467182 21630 raft_consensus.cc:3055] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:46.462582 21064 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.554128 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:46.545986 21722 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:46.545435 21701 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.514529 21637 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.519654 21726 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:46.548281 21685 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:46.549405 21631 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.551102 21721 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:46.552292 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.464005 21719 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:07:46.494408 21160 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:46.556903 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 65817.1us
I20260709 13:07:46.551717 21630 raft_consensus.cc:740] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:46.485376 21373 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.037s
W20260709 13:07:46.533955 21711 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:07:46.593799 14967 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:07:46.587236 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.598546 21628 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:46.677395 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 75466.8us
W20260709 13:07:46.544260 21714 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
W20260709 13:07:46.535918 21727 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:07:46.616959 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 203045us
I20260709 13:07:46.483865 21683 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:46.536593 21709 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 13:07:46.497061 21632 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:46.494076 21729 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
W20260709 13:07:46.633833 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.687764 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.500485 21654 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.442396 21689 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.672287 14859 leader_election.cc:400] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16.
I20260709 13:07:46.716639 14859 leader_election.cc:403] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
W20260709 13:07:46.675050 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.519945 21724 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.617062 21684 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.617676 21726 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:46.545107 21736 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.543305 21401 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:46.723137 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.726800 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:46.732965 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.734381 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:46.551994 21635 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.677100 21628 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:07:46.739645 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61177.8us
I20260709 13:07:46.737222 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:46.686762 21632 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:46.715561 21723 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.721004 21373 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:07:46.753700 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.753904 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.719837 21633 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.633204 21733 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.118s
I20260709 13:07:46.758303 14967 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:46.769146 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:46.728760 21726 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:46.779306 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:46.739764 21683 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:46.735522 21721 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:46.780185 14887 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:07:46.757939 21706 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:46.777247 21713 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:07:46.763602 21373 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:46.811561 15544 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:07:46.763101 21743 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:46.765237 21540 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:46.735626 21684 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.751338 21554 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:07:46.815104 21419 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 13:07:46.739925 21736 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:46.814569 14933 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:46.820178 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:46.828872 15542 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:07:46.840170 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 315573us
I20260709 13:07:46.847745 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:46.803910 21633 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:07:46.855873 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 183732us
I20260709 13:07:46.790673 21739 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:46.862198 14859 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:46.871677 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:46.822321 21447 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.681s	user 0.008s	sys 0.002s
I20260709 13:07:46.817256 21730 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:46.767350 21723 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.815774 21737 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:46.900175 21737 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.900559 21737 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:46.843684 21603 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:46.903728 21603 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.905948 21603 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.820266 21233 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.764353 21630 consensus_queue.cc:260] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:46.907310 21630 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:46.823130 21064 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:46.876236 21694 consensus_meta.cc:287] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 13:07:46.912233 21694 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.912647 21684 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.914287 21694 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.887539 21730 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.914978 21730 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.917769 21736 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:46.919206 15039 raft_consensus.cc:2368] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20.
I20260709 13:07:46.924561 21724 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:46.928236 21633 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:46.928670 21633 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.929023 21633 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:46.929066 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:46.881521 21447 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:46.931339 21447 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:46.931795 21750 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:07:46.932215 21750 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:46.932541 21750 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:46.935345 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.935916 14963 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:46.936267 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.936802 21160 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:46.937155 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.937822 14966 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:46.938679 21637 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:46.939558 21651 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:46.940115 21721 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.941066 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.941810 14961 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:46.942090 21723 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:46.943895 21401 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:46.858610 21743 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:46.892441 21632 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:46.945214 21743 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.818027 21706 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.878923 21679 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 13:07:46.897755 21728 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
I20260709 13:07:46.948094 21728 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:46.938792 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:46.948777 21681 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:46.949059 14969 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:46.949198 21681 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:46.894531 21725 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 13:07:46.949558 21681 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:46.951076 21717 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.177s	user 0.000s	sys 0.002s
I20260709 13:07:46.950730 21373 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:46.878777 21727 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:46.812515 21628 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.970011 21706 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:46.970724 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:46.956166 21739 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 15. Current term is 16.
I20260709 13:07:46.846168 21540 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:46.971833 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:46.936856 14967 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:46.972486 15548 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:07:46.960855 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:46.973217 15038 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:46.971320 15549 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:46.961320 15544 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 15. (term mismatch)
I20260709 13:07:46.962872 14963 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:46.963553 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:46.974138 15544 pending_rounds.cc:85] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 14
I20260709 13:07:46.974406 15544 pending_rounds.cc:107] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 18.15
I20260709 13:07:46.974545 15042 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:46.948750 21728 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:46.974646 15544 raft_consensus.cc:2889] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:46.967475 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:46.976056 14969 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:46.968662 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:46.966194 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:46.970862 21615 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.567s	user 0.009s	sys 0.000s
I20260709 13:07:46.945750 21632 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:46.965262 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:46.977396 15037 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:07:46.977469 15546 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:46.981810 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:46.993542 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.881s (SENT)
W20260709 13:07:47.004405 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 132828us
I20260709 13:07:47.005245 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:47.006484 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 272185us
I20260709 13:07:46.978461 21728 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.016901 15548 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
W20260709 13:07:47.017805 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.035688 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.992836 21419 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:47.061625 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:46.973111 21672 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 13:07:46.991299 21373 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:47.007571 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:46.993165 21615 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:47.072196 15541 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 17. (term mismatch)
I20260709 13:07:47.072582 15541 pending_rounds.cc:85] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 16
I20260709 13:07:47.072791 15541 pending_rounds.cc:107] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 20.17
I20260709 13:07:47.073089 15541 raft_consensus.cc:2889] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:47.072217 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.051683 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.054556 14963 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 13:07:47.075183 15548 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:07:47.058909 15044 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:47.068827 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 258100us
W20260709 13:07:47.070205 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62729.8us
I20260709 13:07:47.076741 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:47.077244 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.070670 14969 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:47.056114 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.033149 21729 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.082971 14892 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:47.084709 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:47.092012 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.061379 21419 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.099370 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.064518 21160 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.100423 14969 raft_consensus.cc:2368] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:47.100514 15043 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:47.094313 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.109365 14961 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:47.123118 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.124157 14961 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:47.126794 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.128096 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.128647 14967 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:07:47.129148 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:47.129753 14886 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:47.134495 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.141654 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:47.142584 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.101442 21698 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:47.111294 21419 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:47.139875 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:47.125916 21749 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:07:47.180506 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:47.182364 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:47.151031 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.167309 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3673) took 1021 ms. Trace:
I20260709 13:07:47.169164 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.185813 15544 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:07:47.187178 15544 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:47.143208 15542 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 10.
W20260709 13:07:47.189096 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45192.9us
I20260709 13:07:47.176680 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3681) took 1038 ms. Trace:
I20260709 13:07:47.176993 15043 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 13:07:47.114116 21733 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:47.184904 15039 rpcz_store.cc:276] 0709 13:07:46.118177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.118592 (+   415us) service_pool.cc:224] Handling call
0709 13:07:47.139492 (+1020900us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400088ed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:47.139636 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734077696}
I20260709 13:07:47.194738 15041 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:47.197773 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.191346 15040 rpcz_store.cc:276] 0709 13:07:46.138453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.138566 (+   113us) service_pool.cc:224] Handling call
0709 13:07:46.159608 (+ 21042us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:46.166114 (+  6506us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:46.581907 (+415793us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b48002001d8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:07:46.742030 (+160123us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.841371 (+ 99341us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:46.841875 (+   504us) log.cc:844] Serialized 26 byte log entry
0709 13:07:46.842006 (+   131us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:46.842213 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 13:07:46.886816 (+ 44603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:46.886920 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:47.176455 (+289535us) raft_consensus.cc:1685] finished
0709 13:07:47.176480 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:47.176619 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90789,"prepare.queue_time_us":368024,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":55304,"raft.run_cpu_time_us":1619,"raft.run_wall_time_us":445156,"spinlock_wait_cycles":9922816,"thread_start_us":545924,"threads_started":2,"wal-append.queue_time_us":171751}
I20260709 13:07:47.199848 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:47.200770 15544 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:47.142325 21729 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.207762 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:47.209774 14895 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:47.089871 21615 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.216318 14895 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:47.222945 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:47.224100 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:47.216899 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:47.224651 14887 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:47.118502 21160 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.226764 14892 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:07:47.225841 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 124915us
W20260709 13:07:47.218262 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 88764.4us
I20260709 13:07:47.228952 14890 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:07:47.233397 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:47.236011 15007 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:47.238700 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:47.239269 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:47.167846 21673 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.059s
I20260709 13:07:47.145160 21706 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.081s
W20260709 13:07:47.248453 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 68061.9us
I20260709 13:07:47.249670 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:47.221822 21579 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.920s	user 0.011s	sys 0.000s
I20260709 13:07:47.240682 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:47.250869 14890 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:47.253079 15007 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:47.228271 21733 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:47.262167 15541 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:07:47.230262 21731 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.263100 15513 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:47.262985 14891 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:47.207960 21651 consensus_queue.cc:1048] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 13:07:47.273023 14891 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.274920 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:47.248587 21637 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.259672 21447 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260709 13:07:47.276165 21698 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:47.253274 21672 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:47.114152 21728 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.278386 15514 leader_election.cc:400] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:47.283560 15514 leader_election.cc:403] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:47.232699 21654 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260709 13:07:47.281059 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:47.270588 21689 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:47.262492 21540 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:47.215435 21762 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260709 13:07:47.259804 21751 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.219282 21729 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.277781 14891 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.260442 21579 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.294610 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:47.283304 21672 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.319746 21672 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.320819 21651 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:47.283478 21733 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.269878 21401 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:07:47.323874 21733 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:47.324352 21733 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.276820 21753 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:47.325254 21753 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.325170 21733 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.278554 21731 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.330137 21760 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.330880 21760 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:47.331245 21760 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.331535 21757 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:07:47.332978 21763 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:47.333746 21763 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:47.335532 21716 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 13:07:47.335909 21672 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.337558 21759 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.338375 21734 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.095s
I20260709 13:07:47.339988 21742 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:07:47.331593 21760 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.316239 21761 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:47.325697 21753 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.301867 21540 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20.
I20260709 13:07:47.367501 14890 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:47.368988 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:47.369320 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:47.369555 14890 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:47.353457 14887 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:07:47.371448 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:47.358608 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 64104.7us
I20260709 13:07:47.401156 15035 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:47.424371 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 145100us
I20260709 13:07:47.296494 21723 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.083s
I20260709 13:07:47.434954 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:47.367127 21742 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.327898 21731 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:47.283557 21637 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.442670 14890 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:47.400665 21401 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:47.455449 14890 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:47.405691 21685 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:07:47.458671 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 180431us
I20260709 13:07:47.343439 21730 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.463519 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:47.334954 21763 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:47.451938 21672 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:47.313616 21751 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.468751 21401 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:47.487502 21786 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.488584 21731 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.488646 21771 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:07:47.490756 21765 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 13:07:47.491982 21773 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
W20260709 13:07:47.492228 21774 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:07:47.493011 21776 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:07:47.496783 21769 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:47.505688 21419 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.509099 21739 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:47.509943 21777 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:47.381966 21761 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.511698 21160 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:47.511950 21756 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260709 13:07:47.513067 21579 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:47.513119 21768 log.cc:927] Time spent T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 13:07:47.513970 21726 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.714s	user 0.001s	sys 0.007s
W20260709 13:07:47.515086 21778 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:07:47.475909 21754 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.202s
I20260709 13:07:47.516877 21689 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:47.517872 21637 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:47.518028 21764 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
I20260709 13:07:47.470363 21685 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:47.518747 21615 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:47.519706 21730 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:47.639719 21777 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.524544 21632 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
W20260709 13:07:47.524616 21633 consensus_meta.cc:287] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
W20260709 13:07:47.511175 21681 consensus_meta.cc:287] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.001s
I20260709 13:07:47.532583 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:47.695878 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 163421us
I20260709 13:07:47.696854 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:47.476660 21723 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:47.560845 21729 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:47.569520 21753 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:47.578583 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 152921us
W20260709 13:07:47.554976 21750 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.622s	user 0.005s	sys 0.006s
I20260709 13:07:47.527070 21766 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
W20260709 13:07:47.612737 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 174671us
I20260709 13:07:47.704246 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:47.602967 21775 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:47.575572 21786 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.577764 21731 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.453019 21742 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.645072 21739 consensus_queue.cc:1243] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 13:07:47.704092 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:47.753584 21766 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:47.753881 21554 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:07:47.703051 21633 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.709949 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:47.754997 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45135us
I20260709 13:07:47.755836 21633 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:47.756414 21633 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:47.688160 21654 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.757277 21654 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.759722 14894 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:47.716205 21762 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:47.762019 21762 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:47.700276 21630 consensus_meta.cc:287] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.792s	user 0.011s	sys 0.000s
I20260709 13:07:47.684891 21721 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:47.684576 21447 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:47.715112 21689 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:47.706249 21788 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:47.699882 21777 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:47.711638 21750 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.708688 21679 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:47.733119 21741 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.712128 21774 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:07:47.734934 21719 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:47.749140 21753 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:47.751549 21742 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:47.753006 21419 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:47.707247 21681 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.708841 14887 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:47.753777 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49819.7us
I20260709 13:07:47.756573 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:47.714072 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:47.799818 14895 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: []
I20260709 13:07:47.720172 21775 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.778373 21447 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.702394 21723 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:47.713335 21773 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:07:47.708952 21579 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:47.654304 21726 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.775789 14892 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:07:47.778577 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:47.836148 15550 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:47.780664 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.780637 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:47.655212 21401 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.783149 21679 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.754069 21766 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.787129 21730 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:47.769773 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:47.812745 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.784652 21719 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.820066 14887 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:47.798257 21761 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:47.778764 21721 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.802743 21731 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:47.833829 21723 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:47.849026 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:47.832094 21419 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:47.787825 21741 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.835568 21579 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:47.863435 15548 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:47.845602 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:47.864951 15550 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:07:47.842532 21679 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:47.832669 21742 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 13:07:47.868383 21419 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.879173 21447 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:47.869305 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:47.877772 15548 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:47.790555 21685 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.19, Last appended by leader: 19, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.889688 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:47.851718 21689 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:47.890961 14964 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:47.851558 21554 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:47.841236 21751 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:47.869647 21579 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:07:47.901311 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 187366us
I20260709 13:07:47.900483 21631 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:07:47.883107 21788 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:47.891808 21739 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:47.851269 21730 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:47.892669 21630 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:47.883279 21795 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:47.910840 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:47.913566 15037 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:47.919147 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:47.919735 14966 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:47.920868 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.921556 14963 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 11.
I20260709 13:07:47.923748 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:47.924986 21419 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:47.914623 21630 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:47.925762 21630 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:47.926476 14966 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:47.899098 21801 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:47.916128 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:47.897938 21733 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 13:07:47.930107 21739 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.962057 21064 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:47.980211 21750 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:47.967691 21801 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:47.999264 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:47.974856 21540 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.000982 15542 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:48.002151 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:47.917411 21788 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.003991 15547 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:47.909317 21766 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:47.981590 21064 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:47.996974 21742 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:47.996627 21775 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:48.015735 21737 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 1.115s	user 0.013s	sys 0.000s
W20260709 13:07:48.017946 21794 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 13:07:47.916576 21719 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:47.969612 21689 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:48.031448 21796 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260709 13:07:48.069360 21737 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.071817 21737 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:48.031344 21801 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.072456 15041 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 22. Ops: []
I20260709 13:07:48.073396 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:48.063232 21726 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.014091 21540 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.078058 21540 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.078253 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.078763 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.078902 15038 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:07:48.078994 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.079764 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.079988 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3678) took 1949 ms. Trace:
I20260709 13:07:48.080355 15043 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:48.080314 15035 rpcz_store.cc:276] 0709 13:07:46.130337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.130444 (+   107us) service_pool.cc:224] Handling call
0709 13:07:46.150186 (+ 19742us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.406934 (+1256748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.079773 (+672839us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54004056d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:48.079935 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2876761344}
I20260709 13:07:47.969905 21554 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.081688 15041 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:48.049654 14961 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:48.051110 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.079766 15039 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:48.037245 21777 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.029776 21742 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.081691 15042 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:07:48.031188 21064 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.074455 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1632) took 1315 ms. Trace:
I20260709 13:07:48.060746 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:48.106482 14967 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:48.113262 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:48.080564 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.089372 15037 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 22: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:48.074816 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.071030 21628 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:48.106928 14968 rpcz_store.cc:276] 0709 13:07:46.759208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.759848 (+   640us) service_pool.cc:224] Handling call
0709 13:07:46.780878 (+ 21030us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:46.947148 (+166270us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:46.947193 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:46.947249 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:46.947295 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.074234 (+1126939us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540016d854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:48.074274 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.074379 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":381887232}
I20260709 13:07:48.117180 15546 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:48.098999 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.121690 15547 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 11.
W20260709 13:07:48.035951 21803 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:07:48.129887 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:48.032853 21797 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:07:48.120121 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:48.123131 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:48.133436 14967 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
W20260709 13:07:48.114243 21760 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.772s	user 0.012s	sys 0.001s
I20260709 13:07:48.144950 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:48.140487 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.141660 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:48.063225 21719 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.032377 21730 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.144124 15038 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:48.036175 21721 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:48.039947 21741 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:48.144044 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.151324 15545 raft_consensus.cc:2368] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:48.117779 21637 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:48.128261 21160 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.148139 21064 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:48.034413 21579 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:48.182113 15513 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.697s (SENT)
I20260709 13:07:48.208709 15546 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:48.145375 21751 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:07:48.262117 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 80066.9us
W20260709 13:07:48.266564 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.262465 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.150450 21706 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:48.152438 21788 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:48.325008 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 316217us
I20260709 13:07:48.051635 21739 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.317337 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:48.352579 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.150321 21787 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:48.285593 15513 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.758s (SENT)
W20260709 13:07:48.383138 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97580.1us
I20260709 13:07:48.207609 21540 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.207791 21795 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:48.150393 21698 consensus_queue.cc:1059] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.178s
I20260709 13:07:48.153008 21630 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.281829 21726 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:48.156077 21679 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.156123 21760 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.412180 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.412994 14968 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:48.414148 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.261948 21160 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.354913 21706 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:48.317981 21733 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:48.418219 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3361) took 1090 ms. Trace:
I20260709 13:07:48.398447 21615 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:07:48.416466 21723 consensus_meta.cc:287] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.002s
I20260709 13:07:48.425323 14890 rpcz_store.cc:276] 0709 13:07:47.327863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.466193 (+138330us) service_pool.cc:224] Handling call
0709 13:07:47.466639 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.709069 (+242430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.709098 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.716515 (+  7417us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.880426 (+163911us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:47.880465 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:47.880527 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.418005 (+537478us) raft_consensus.cc:1685] finished
0709 13:07:48.418039 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.418166 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31247,"raft.queue_time_us":248564,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":2244,"thread_start_us":322126,"threads_started":2,"wal-append.queue_time_us":132554}
W20260709 13:07:48.433578 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.436412 14893 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:48.442951 14968 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:48.392203 21540 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.446424 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.424597 21786 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:48.448391 14890 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:48.452417 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.427116 21706 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.458580 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.459362 14890 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:48.435122 21615 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:48.410718 21726 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.480036 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.477591 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.468804 21689 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:48.481132 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 339563us
I20260709 13:07:48.489960 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:48.490764 14890 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:48.236760 21637 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.498514 21637 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:48.397130 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 254595us
I20260709 13:07:48.432927 21733 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.471453 21786 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:48.518087 14890 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:48.477993 21615 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:48.482100 21561 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:48.526487 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.481704 21798 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:48.527693 21798 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.530311 21798 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.501329 21742 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.518766 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:48.441479 21723 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.520397 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.521679 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:48.501842 21689 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:48.543670 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 157775us
I20260709 13:07:48.548184 14890 raft_consensus.cc:2368] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23.
I20260709 13:07:48.535038 21777 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.582203 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3344) took 1381 ms. Trace:
I20260709 13:07:48.582769 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.586314 14894 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:48.586793 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.589038 21760 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.590783 14968 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:48.551692 21828 raft_consensus.cc:3055] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:48.522965 21786 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:48.582808 21808 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260709 13:07:48.551889 21579 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:48.556393 21801 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.534029 21561 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:48.537352 21821 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.061s
W20260709 13:07:48.813750 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.672212 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:48.733673 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.597054 15035 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 13:07:48.666507 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1546) took 1711 ms. Trace:
I20260709 13:07:48.585783 14889 rpcz_store.cc:276] 0709 13:07:47.198790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.198962 (+   172us) service_pool.cc:224] Handling call
0709 13:07:47.216376 (+ 17414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.598419 (+382043us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.598451 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.604174 (+  5723us) log.cc:844] Serialized 26 byte log entry
0709 13:07:47.820830 (+216656us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:47.820891 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.547252 (+726361us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54000f7654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:48.547300 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:48.547339 (+    39us) raft_consensus.cc:1685] finished
0709 13:07:48.547353 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.579992 (+ 32639us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2141,"raft.queue_time_us":122186,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":143,"spinlock_wait_cycles":830327552,"thread_start_us":132789,"threads_started":1,"wal-append.queue_time_us":253910}
I20260709 13:07:48.671396 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.639179 15043 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:48.896641 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:48.658578 14891 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:48.673450 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:48.849341 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.756635 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:48.765313 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.584928 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.899920 15044 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:48.584638 21629 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.902086 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1528) took 1143 ms. Trace:
I20260709 13:07:48.926263 14890 rpcz_store.cc:276] 0709 13:07:47.758773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.582021 (+823248us) service_pool.cc:224] Handling call
0709 13:07:48.902023 (+320002us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.608923 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.927508 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
W20260709 13:07:48.596946 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 78277us
I20260709 13:07:48.923921 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:48.895292 15036 rpcz_store.cc:276] 0709 13:07:46.954661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:46.955133 (+   472us) service_pool.cc:224] Handling call
0709 13:07:48.068292 (+1113159us) spinlock_profiling.cc:243] Waited 2.19 ms on lock 0x7b5800144398. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:07:48.068506 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.140763 (+ 72257us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.140795 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:48.140847 (+    52us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:48.140883 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.666294 (+525411us) spinlock_profiling.cc:243] Waited 72.1 ms on lock 0x7b54001f3bd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:48.666343 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:48.666454 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":170760320}
I20260709 13:07:48.925259 15042 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:48.928711 14966 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:48.928892 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:48.929873 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:48.590047 21822 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:48.935093 21822 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.937201 21822 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.938490 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.656591 21762 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.939117 14889 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:48.939494 21783 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 13:07:48.700784 21751 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:48.943018 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:48.942801 21751 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.943799 14890 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:48.939263 21730 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:48.944922 21730 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.945269 21730 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:48.941648 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1532) took 1174 ms. Trace:
I20260709 13:07:48.946389 14889 rpcz_store.cc:276] 0709 13:07:47.767953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.901276 (+1133323us) service_pool.cc:224] Handling call
0709 13:07:48.941593 (+ 40317us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.944224 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1519) took 1187 ms. Trace:
I20260709 13:07:48.947700 14890 rpcz_store.cc:276] 0709 13:07:47.756627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.942778 (+1186151us) service_pool.cc:224] Handling call
0709 13:07:48.944157 (+  1379us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:48.593084 21637 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:48.949414 14966 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:48.940972 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:48.841837 21687 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.954478 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:48.788322 21827 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 13:07:48.658058 21823 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 13:07:48.662004 21815 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260709 13:07:48.643851 21812 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 13:07:48.952095 14961 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:48.593169 21554 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:48.662688 21819 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:07:48.953630 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:48.659273 21817 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260709 13:07:48.665948 21826 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:48.653649 21635 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:48.593277 21828 raft_consensus.cc:740] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:48.955260 14891 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:49.013614 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3356) took 1781 ms. Trace:
I20260709 13:07:48.954216 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:48.956167 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:48.661356 21818 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:07:48.839738 21721 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.837169 21540 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.840791 21737 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:48.626078 21630 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.959249 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:48.782727 21726 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.750800 21160 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.664726 21733 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.752408 21681 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.847118 21654 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.790848 21579 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:48.628815 21679 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.667229 21723 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.663795 21689 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:48.963882 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:48.934386 21825 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.057350 15544 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:48.965729 15036 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:49.047129 21064 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.785s	user 0.004s	sys 0.007s
I20260709 13:07:48.954733 21637 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:48.959100 21787 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
W20260709 13:07:48.970949 21719 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.815s	user 0.011s	sys 0.001s
I20260709 13:07:48.972839 21706 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.902287 21747 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 13:07:48.961982 21687 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.949450 21629 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.992542 21615 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.994949 21786 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:48.996223 21632 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:48.996663 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.104178 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.104830 14861 leader_election.cc:400] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:49.105293 14861 leader_election.cc:403] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.062738 21637 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:48.998100 21561 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.009182 15043 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:49.011317 14961 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:07:48.595587 21698 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.368s
W20260709 13:07:49.015247 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 61989.9us
I20260709 13:07:49.014082 14891 rpcz_store.cc:276] 0709 13:07:47.232064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.232251 (+   187us) service_pool.cc:224] Handling call
0709 13:07:47.262877 (+ 30626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:48.658200 (+1395323us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b540003cb20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceba1d 00007f5534cd21a4 00007f5534d54447 00007f5534d6cfe7 00007f5534d6e7de 00007f5534d78b49 00007f5534d79416 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419
0709 13:07:49.013363 (+355163us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.013558 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1021315456}
I20260709 13:07:48.626552 21780 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.338s
W20260709 13:07:49.020018 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 346701us
I20260709 13:07:49.022398 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.132103 14894 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:49.024015 14966 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.013566 21635 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:49.029860 21737 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:49.153960 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50519.2us
I20260709 13:07:49.155174 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:49.030197 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:49.048396 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.156023 14891 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 13:07:49.021255 21731 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:48.903962 21801 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:48.965044 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:48.969161 15044 raft_consensus.cc:2410] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:07:49.060611 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.061748 21835 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:49.017319 21554 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.082572 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3708) took 1164 ms. Trace:
I20260709 13:07:49.025597 21721 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.098587 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.058363 21836 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.107913 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.129915 21630 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.195912 15550 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.056367 21579 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.140987 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.156692 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1533) took 1388 ms. Trace:
I20260709 13:07:49.199383 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.199981 15546 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:49.156713 15548 raft_consensus.cc:2410] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 13:07:49.199131 14891 rpcz_store.cc:276] 0709 13:07:47.768156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.155488 (+1387332us) service_pool.cc:224] Handling call
0709 13:07:49.155802 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.156455 (+   653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.156641 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.160002 14966 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:49.162508 15041 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:49.161996 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.204211 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1572) took 2141 ms. Trace:
I20260709 13:07:49.093735 21730 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.186885 15544 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:49.210412 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.211333 15544 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 23: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:49.187790 15035 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.111290 21064 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:49.229425 21064 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:49.110267 21632 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.232200 21632 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:49.234884 21628 consensus_meta.cc:287] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.097s	user 0.007s	sys 0.003s
I20260709 13:07:49.235816 14970 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 13:07:49.236249 14970 pending_rounds.cc:85] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 12
I20260709 13:07:49.236521 14970 pending_rounds.cc:107] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 13:07:49.236794 14970 raft_consensus.cc:2889] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.081058 21828 consensus_queue.cc:260] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.245735 21801 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.247870 21737 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.193250 21835 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.252456 21835 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.254410 21554 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.208340 21834 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.255398 21834 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.257434 21834 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.260998 21730 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.262205 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1517) took 1506 ms. Trace:
I20260709 13:07:49.262336 21629 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.262581 14893 rpcz_store.cc:276] 0709 13:07:47.756066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.756253 (+   187us) service_pool.cc:224] Handling call
0709 13:07:49.262002 (+1505749us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b54003d5ed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:49.262123 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1468976384}
I20260709 13:07:49.264295 21687 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:49.265074 14887 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3358) took 2031 ms (client timeout 2637 ms). Trace:
I20260709 13:07:49.264926 21630 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:49.265446 14887 rpcz_store.cc:269] 0709 13:07:47.233444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.396461 (+163017us) service_pool.cc:224] Handling call
0709 13:07:49.264929 (+1868468us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54000ae1d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:49.265021 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627744000}
I20260709 13:07:49.266970 21630 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.295351 21561 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:49.129750 21726 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.190364 14969 rpcz_store.cc:276] 0709 13:07:47.918257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.919505 (+  1248us) service_pool.cc:224] Handling call
0709 13:07:47.919935 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:47.967347 (+ 47412us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.967379 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:47.987237 (+ 19858us) log.cc:844] Serialized 26 byte log entry
0709 13:07:48.386996 (+399759us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:48.387029 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:48.387092 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.082338 (+695246us) raft_consensus.cc:1685] finished
0709 13:07:49.082358 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.082514 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2247,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":419004,"threads_started":2,"wal-append.queue_time_us":442584}
I20260709 13:07:49.108361 21751 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:49.108104 21719 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.205068 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:49.206993 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45036.5us
I20260709 13:07:49.364231 15008 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.060828 21825 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.204720 15549 rpcz_store.cc:276] 0709 13:07:47.054974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.055103 (+   129us) service_pool.cc:224] Handling call
0709 13:07:47.071986 (+ 16883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.241605 (+169619us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:47.241650 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:47.241706 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:47.241759 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.195704 (+1953945us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400bc7854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:49.195752 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.195861 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389555968}
I20260709 13:07:49.208304 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.365682 15548 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:49.214443 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.366586 14961 raft_consensus.cc:2393] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:49.215034 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.215518 21615 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.216763 21579 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:49.218298 15545 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 10. Current term is 11. Ops: [10.8-10.8]
W20260709 13:07:49.220064 21799 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 1.359s	user 0.010s	sys 0.005s
I20260709 13:07:49.221917 21679 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:49.130231 21733 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260709 13:07:49.226193 15550 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:49.267005 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4235) took 1338 ms. Trace:
I20260709 13:07:49.372339 14887 rpcz_store.cc:276] 0709 13:07:47.928671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.266216 (+1337545us) service_pool.cc:224] Handling call
0709 13:07:49.266548 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.266723 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.266746 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.266786 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:49.266817 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.266870 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.266958 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:49.267772 14892 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3357) took 2035 ms (client timeout 2112 ms). Trace:
I20260709 13:07:49.270717 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3365) took 1414 ms. Trace:
W20260709 13:07:49.281685 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.373392 14893 rpcz_store.cc:276] 0709 13:07:47.855953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.263389 (+1407436us) service_pool.cc:224] Handling call
0709 13:07:49.270236 (+  6847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.270406 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.270433 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.270472 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:49.270510 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.270561 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.270652 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.374497 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.375077 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4236) took 1446 ms. Trace:
I20260709 13:07:49.375136 15545 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
W20260709 13:07:49.301642 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 1.44548e+06us
I20260709 13:07:49.375640 14893 rpcz_store.cc:276] 0709 13:07:47.928966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.374398 (+1445432us) service_pool.cc:224] Handling call
0709 13:07:49.374671 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.374814 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.374837 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.374871 (+    34us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:49.374900 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.374945 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.375028 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.193740 15043 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:07:49.275944 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3353) took 2061 ms. Trace:
I20260709 13:07:49.288854 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1576) took 2232 ms. Trace:
I20260709 13:07:49.191644 21829 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.121s
I20260709 13:07:49.268999 21706 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.272821 21742 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.386377 15547 raft_consensus.cc:1275] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:07:49.365796 21792 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.198625 21836 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.283682 15543 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:07:49.295086 14889 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:07:49.292699 21775 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:49.286849 21833 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260709 13:07:49.322824 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.198890 21786 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:49.313722 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.376412 21679 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:49.336714 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.336941 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.375387 21721 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.368249 21751 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.109084 21728 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:49.344377 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.346939 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1530) took 1587 ms. Trace:
I20260709 13:07:49.267552 21635 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.369592 21719 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.363220 21726 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.370384 21840 raft_consensus.cc:2804] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:49.385027 21630 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.456859 14968 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:49.356177 15035 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:49.360857 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:49.361431 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.104s	sys 0.129s
W20260709 13:07:49.462606 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.104s	sys 0.129s
W20260709 13:07:49.462925 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 866595us
I20260709 13:07:49.196635 21830 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.165s
I20260709 13:07:49.367785 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.370597 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.465853 15548 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:49.376727 15545 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 22 index: 19. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
W20260709 13:07:49.373314 14892 rpcz_store.cc:269] 0709 13:07:47.232447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.233166 (+   719us) service_pool.cc:224] Handling call
0709 13:07:49.267614 (+2034448us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540024e0d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:49.267721 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1246084480}
I20260709 13:07:49.466414 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.467382 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.379803 15541 rpcz_store.cc:276] 0709 13:07:47.056309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.094236 (+ 37927us) service_pool.cc:224] Handling call
0709 13:07:47.117693 (+ 23457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.264841 (+147148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.288583 (+2023742us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400bfac54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:49.288783 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315001216}
I20260709 13:07:49.459628 14886 rpcz_store.cc:276] 0709 13:07:47.759233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.991762 (+1232529us) service_pool.cc:224] Handling call
0709 13:07:48.992101 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:48.992477 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:48.992506 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:48.992985 (+   479us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.058431 (+ 65446us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:49.346410 (+287979us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.346647 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.346716 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:49.346757 (+    41us) raft_consensus.cc:1685] finished
0709 13:07:49.346768 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.346888 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":313790,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1380,"raft.queue_time_us":12333,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":4147,"thread_start_us":323058,"threads_started":2,"wal-append.queue_time_us":234007}
I20260709 13:07:48.178299 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:49.378961 14895 rpcz_store.cc:276] 0709 13:07:47.215053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.224000 (+  8947us) service_pool.cc:224] Handling call
0709 13:07:47.224342 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:47.801251 (+576909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.275730 (+1474479us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b54000f6c54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:49.275889 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1323171712}
I20260709 13:07:49.390019 14887 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:07:49.471153 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4237) took 1541 ms. Trace:
I20260709 13:07:49.471230 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.471541 14887 rpcz_store.cc:276] 0709 13:07:47.929248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.384818 (+1455570us) service_pool.cc:224] Handling call
0709 13:07:49.389724 (+  4906us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.470934 (+ 81210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.471099 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.471833 14895 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
W20260709 13:07:49.426591 15513 connection.cc:256] RPC call timeout handler was delayed by -1.0224410230000558s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
I20260709 13:07:49.455888 14967 raft_consensus.cc:2368] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:49.392617 15549 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:07:49.472777 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.473033 15549 pending_rounds.cc:85] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 9
I20260709 13:07:49.473286 15549 pending_rounds.cc:107] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:07:49.473333 14895 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:49.473582 15549 raft_consensus.cc:2889] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:49.453346 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.474138 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:49.474632 14895 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:49.430094 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.457361 15036 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:49.432950 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1527) took 1674 ms. Trace:
I20260709 13:07:49.476078 14889 rpcz_store.cc:276] 0709 13:07:47.758555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.947076 (+1188521us) service_pool.cc:224] Handling call
0709 13:07:49.294722 (+347646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.388936 (+ 94214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.432713 (+ 43777us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54003d5ed0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:49.432881 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772366208}
I20260709 13:07:49.351828 15546 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:49.358659 21561 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:49.480842 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:49.483534 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:49.485550 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.490532 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.491631 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:49.390455 21792 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.480168 21786 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:49.448864 21761 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.494478 21761 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.494513 21786 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.495172 21792 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.496006 21679 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.496587 21761 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.497105 21761 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:49.465273 21632 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.497610 21761 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.498008 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.497961 21632 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.499444 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.500794 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:49.502167 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.502839 14887 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:49.503113 21751 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.452363 21766 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.506821 21635 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:49.408951 21825 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.393971 21793 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:49.508733 21726 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.508962 21793 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:49.509986 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.509871 21793 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.482303 21840 raft_consensus.cc:697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:49.511866 21654 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:49.512295 21840 consensus_queue.cc:237] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.514904 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.522704 15544 raft_consensus.cc:2410] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260709 13:07:49.515873 21834 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:49.465456 21733 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.518258 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.518594 21631 consensus_queue.cc:1059] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:49.390244 21836 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.480948 21754 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.519253 21579 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:49.519713 14965 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:49.519994 21724 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.394286 21775 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.521365 14892 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:49.420791 21752 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:07:49.515349 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 147641us
I20260709 13:07:49.486161 15546 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:49.488642 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:49.524142 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:49.389997 21742 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.415086 21637 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.525149 15547 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:07:49.449054 21753 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.530138 14889 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:49.535980 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.546384 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:49.550510 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 350131us
I20260709 13:07:49.556731 14895 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:49.557606 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.560253 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.487337 21730 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.520855 21615 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.508754 21719 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.550558 21829 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:49.618256 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4238) took 1671 ms. Trace:
I20260709 13:07:49.634872 14889 rpcz_store.cc:276] 0709 13:07:47.947477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.477837 (+1530360us) service_pool.cc:224] Handling call
0709 13:07:49.529846 (+ 52009us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.617937 (+ 88091us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.618183 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.619575 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.637674 14895 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:49.638852 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.640208 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.640864 14895 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:49.578063 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:49.578976 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 90410.6us
I20260709 13:07:49.580323 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.482685 21630 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.580188 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:49.622932 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 98868.5us
I20260709 13:07:49.647018 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.622198 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.647917 15035 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:49.558872 21761 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.653056 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.643393 15514 leader_election.cc:400] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:49.654162 15037 raft_consensus.cc:2410] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:49.654240 15514 leader_election.cc:403] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.655172 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.621774 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.656639 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.657160 15043 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:07:49.576200 21832 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:49.649660 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69566.5us
I20260709 13:07:49.658396 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.577574 21752 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:49.660297 21637 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.661156 21752 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.616829 21822 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.662153 21742 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.662415 21822 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:49.662864 21822 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.664319 21844 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:07:49.664723 21844 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:49.665582 21844 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.667011 21844 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:49.667677 21832 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.645650 21730 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.670710 15541 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:49.670822 21793 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.557840 21733 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.671695 21730 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.649977 21845 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.673748 21845 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.676047 21845 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.677124 21632 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.662191 21752 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:49.677958 21772 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:49.678424 21772 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:49.678800 21772 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:49.679509 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.633960 21753 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.644940 21787 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:49.673112 21733 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.681406 21830 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:07:49.682045 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.682489 21775 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.682631 14886 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:49.585693 21838 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.098s
I20260709 13:07:49.683898 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.634287 21747 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.684793 21747 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:49.687001 21747 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:49.687932 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4239) took 1727 ms. Trace:
I20260709 13:07:49.688678 21630 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:49.577733 21835 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 13:07:49.690543 14893 raft_consensus.cc:3060] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:49.653704 21763 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:49.645146 21554 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.693462 21554 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.696177 21828 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:49.696242 14892 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:07:49.697083 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4240) took 1734 ms. Trace:
I20260709 13:07:49.697456 14892 rpcz_store.cc:276] 0709 13:07:47.962613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.694845 (+1732232us) service_pool.cc:224] Handling call
0709 13:07:49.695129 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.696837 (+  1708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.697029 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.699031 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4241) took 1733 ms. Trace:
I20260709 13:07:49.492769 21561 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:49.650570 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 93061.6us
I20260709 13:07:49.700093 21561 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.701026 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.701952 21697 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:49.617398 21700 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 13:07:49.703665 21763 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:49.577792 21687 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.127s
I20260709 13:07:49.634291 21829 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.706100 21829 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:49.708393 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.709172 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:49.710525 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 132568us
I20260709 13:07:49.717100 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.651859 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.719061 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.699374 14892 rpcz_store.cc:276] 0709 13:07:47.965944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.698244 (+1732300us) service_pool.cc:224] Handling call
0709 13:07:49.698537 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.698723 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.698752 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.698798 (+    46us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:49.698834 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.698888 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.698981 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.669831 21832 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.641798 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.718286 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.723752 14895 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:49.727253 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.730062 14895 raft_consensus.cc:2368] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18.
I20260709 13:07:49.732290 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:49.736901 14895 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:07:49.738029 14970 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:49.739043 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.688344 14887 rpcz_store.cc:276] 0709 13:07:47.961195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.687115 (+1725920us) service_pool.cc:224] Handling call
0709 13:07:49.687367 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.687575 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.687604 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.687652 (+    48us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:49.687693 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.687752 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.687875 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:07:49.744118 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 92351us
I20260709 13:07:49.744869 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.744241 14966 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:07:49.746752 15513 leader_election.cc:400] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23.
I20260709 13:07:49.747047 15513 leader_election.cc:403] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:07:49.747291 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.562849 21834 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:49.563326 21724 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.563685 21721 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:49.753078 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.757401 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4242) took 1789 ms. Trace:
I20260709 13:07:49.758527 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 322) took 6470 ms. Trace:
I20260709 13:07:49.760264 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.767722 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4243) took 1798 ms. Trace:
I20260709 13:07:49.768155 15541 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
W20260709 13:07:49.760704 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.761364 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.769474 14892 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:49.769853 15544 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:49.770093 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4245) took 1710 ms. Trace:
I20260709 13:07:49.707921 21654 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.763029 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.763660 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:49.763985 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 183745us
I20260709 13:07:49.764221 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.764225 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.767318 14895 rpcz_store.cc:276] 0709 13:07:47.967819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.738016 (+1770197us) service_pool.cc:224] Handling call
0709 13:07:49.739207 (+  1191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.739421 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.739461 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.739529 (+    68us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:49.739575 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.757221 (+ 17646us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.757347 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.775168 14969 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:07:49.721982 21554 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.735492 21723 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:49.780591 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.765739 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.761664 15513 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:49.783179 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.783325 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:49.783934 15545 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:49.767067 15548 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 12: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:49.772908 15541 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:07:49.575824 21754 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:49.773074 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.771785 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:49.563875 21699 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.198s
I20260709 13:07:49.776482 15549 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEARNER]: Advancing to term 18
I20260709 13:07:49.777419 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:49.765019 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.770558 14892 rpcz_store.cc:276] 0709 13:07:48.059270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.769050 (+1709780us) service_pool.cc:224] Handling call
0709 13:07:49.769296 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.769878 (+   582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.770047 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.759567 21761 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.791752 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.785948 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.784057 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.786468 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4244) took 1727 ms. Trace:
I20260709 13:07:49.759721 21787 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:49.763111 21724 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.789676 15037 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:07:49.799166 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.577432 21737 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.196s
I20260709 13:07:49.766492 21801 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:49.794009 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.794694 14886 rpcz_store.cc:276] 0709 13:07:48.058997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.767325 (+1708328us) service_pool.cc:224] Handling call
0709 13:07:49.786033 (+ 18708us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.786202 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.786227 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.786263 (+    36us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:49.786291 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.786334 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.786421 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.796243 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.743081 21792 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.045s
I20260709 13:07:49.767071 21730 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:49.766594 21721 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.819782 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.821391 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.798026 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.735524 21673 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:07:49.796384 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:49.799705 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.823439 15038 raft_consensus.cc:2368] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18.
I20260709 13:07:49.800010 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:49.800329 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:49.800796 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.785795 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:49.768082 14887 rpcz_store.cc:276] 0709 13:07:47.969281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.766961 (+1797680us) service_pool.cc:224] Handling call
0709 13:07:49.767241 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.767433 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.767461 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.767498 (+    37us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:49.767527 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.767580 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.767673 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.805212 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.825736 15037 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:07:49.805389 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.826411 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.774246 21654 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.807585 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4246) took 1664 ms. Trace:
I20260709 13:07:49.808377 14966 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 12: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:49.719475 21806 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:07:49.839474 14895 rpcz_store.cc:276] 0709 13:07:48.143381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.806233 (+1662852us) service_pool.cc:224] Handling call
0709 13:07:49.807100 (+   867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:49.807260 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.807288 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:49.807326 (+    38us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:49.807354 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.807403 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:49.807526 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:49.769716 14793 rpcz_store.cc:276] 0709 13:07:43.287965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.288177 (+   212us) service_pool.cc:224] Handling call
0709 13:07:49.758279 (+6470102us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:45.048270 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:45.048924 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:45.048962 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:07:45.048980 (+    18us) tablet.cc:662] Decoding operations
0709 13:07:45.050081 (+  1101us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:45.050163 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:45.050187 (+    24us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:45.051122 (+   935us) tablet.cc:701] Row locks acquired
0709 13:07:45.051153 (+    31us) write_op.cc:260] PREPARE: finished
0709 13:07:45.051303 (+   150us) write_op.cc:270] Start()
0709 13:07:45.098138 (+ 46835us) write_op.cc:276] Timestamp: P: 1783602465051244 usec, L: 0
0709 13:07:45.110008 (+ 11870us) op_driver.cc:348] REPLICATION: starting
0709 13:07:45.233551 (+123543us) log.cc:844] Serialized 4739 byte log entry
0709 13:07:45.755959 (+522408us) op_driver.cc:464] REPLICATION: finished
0709 13:07:46.245527 (+489568us) write_op.cc:301] APPLY: starting
0709 13:07:46.265436 (+ 19909us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:46.900017 (+634581us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:46.900372 (+   355us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:47.724291 (+823919us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:47.724766 (+   475us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:07:47.724836 (+    70us) write_op.cc:312] APPLY: finished
0709 13:07:47.725398 (+   562us) log.cc:844] Serialized 113 byte log entry
0709 13:07:47.853093 (+127695us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:47.868517 (+ 15424us) write_op.cc:454] Released schema lock
0709 13:07:47.879473 (+ 10956us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:47.907971 (+ 28498us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:47.909088 (+  1117us) write_op.cc:454] Released schema lock
0709 13:07:49.163362 (+1254274us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
Metrics: {"mutex_wait_us":1777,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":400781,"apply.run_cpu_time_us":37235,"apply.run_wall_time_us":1704871,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":192321,"prepare.run_cpu_time_us":70316,"prepare.run_wall_time_us":478629,"raft.queue_time_us":170391,"raft.run_cpu_time_us":18476,"raft.run_wall_time_us":346388,"replication_time_us":612248,"spinlock_wait_cycles":104749952,"thread_start_us":710213,"threads_started":5,"wal-append.queue_time_us":398237,"wal-append.run_cpu_time_us":10369,"wal-append.run_wall_time_us":1141194}]]}
I20260709 13:07:49.840889 21719 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:49.781370 21579 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:49.774503 14893 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:49.828655 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.829728 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.831022 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:49.835793 15549 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:07:49.836480 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.837107 15040 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:49.773350 21742 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:07:49.787022 21766 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:49.837720 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:49.772619 21835 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.841421 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.862872 14889 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 12.
I20260709 13:07:49.841578 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.798432 21830 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:49.844914 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 48642.5us
I20260709 13:07:49.845368 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.806941 21637 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:49.809114 21629 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.808231 21630 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:49.792513 21064 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:07:49.847173 21787 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:49.922379 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.827255 21820 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
I20260709 13:07:49.843730 21654 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:49.827155 21721 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:49.821221 21716 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:49.879477 14962 raft_consensus.cc:2410] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:07:49.853631 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:49.866089 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.893872 21830 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:49.972445 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.891543 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:49.973301 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 81838us
I20260709 13:07:49.859596 14791 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 13 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.974736 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.975224 14791 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 15 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:49.850891 21719 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.906975 21793 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:49.860879 21615 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:49.854159 21579 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.922885 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.813695 21761 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:49.852919 21753 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:49.875864 21786 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:49.930603 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:49.933130 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:49.939239 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:49.854781 15549 pending_rounds.cc:85] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 10
I20260709 13:07:50.031661 15549 pending_rounds.cc:107] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:07:49.908008 21637 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:49.906072 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.035607 15547 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:49.977720 14791 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 15 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:49.983978 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:49.911154 21630 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:49.930334 21785 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.032s	sys 0.029s
I20260709 13:07:49.922951 21787 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:49.862898 21836 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.891189 21834 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.026165 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:49.960440 21716 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.029534 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:49.961184 14966 raft_consensus.cc:2368] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:49.893235 21835 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:49.981251 21830 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.004693 21719 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:49.960741 21766 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:50.034530 15549 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.024149 21579 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.001273 21733 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.007503 21632 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.037833 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:50.039319 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 55442.2us
I20260709 13:07:50.037804 14791 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.068312 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:50.069521 14791 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 17 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 18 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.048902 21716 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:49.927083 21629 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:49.933531 21838 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.099s
I20260709 13:07:50.005162 21846 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:50.048195 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:50.090874 21846 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:50.038739 21785 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.033s	sys 0.030s
I20260709 13:07:50.091325 21846 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.030218 21786 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.092371 21786 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:50.056083 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 255837us
W20260709 13:07:50.058614 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.038656 21637 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:50.038602 21630 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:50.041164 21787 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.102885 14893 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 13:07:50.103266 14893 pending_rounds.cc:85] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 10
I20260709 13:07:50.017102 21793 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.103500 14893 pending_rounds.cc:107] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 13:07:50.104125 14893 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:50.104709 14886 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:50.106101 14893 raft_consensus.cc:1240] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 13:07:50.106555 14969 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:07:50.066946 21701 raft_consensus.cc:3055] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:50.109668 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 463856us
I20260709 13:07:50.065234 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.046990 21753 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.070647 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:50.040578 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:50472
I20260709 13:07:50.071640 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.111718 21753 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:50.072978 14791 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 15 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:50.062327 21728 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.595s	user 0.007s	sys 0.002s
I20260709 13:07:50.112203 21753 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:50.112293 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:50.112841 14888 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:50.113297 21795 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.113125 21753 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.113736 21795 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.115583 21739 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:07:50.116600 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.117331 15040 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:50.117596 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.058293 21635 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:07:50.064159 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 225708us
I20260709 13:07:50.117667 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.115432 14791 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 13 to 17, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.072348 21801 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:50.134997 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:50.089772 21064 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:50.122005 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.130398 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.123965 14964 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.146382 15035 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:50.152439 14969 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:07:50.154599 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.063719 21766 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.183087 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:50.118685 21701 raft_consensus.cc:740] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:50.132408 14791 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 15 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.220252 14791 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 18 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.136111 15044 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:50.136423 15513 leader_election.cc:400] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18.
I20260709 13:07:50.223187 15513 leader_election.cc:403] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:50.223763 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 87493.6us
I20260709 13:07:50.139053 14886 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:50.144927 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:50.224996 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 80164.2us
I20260709 13:07:50.224550 14791 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 16 to 17, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:07:50.196545 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:50.228395 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.229765 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.197127 21687 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:50.198787 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3348) took 2998 ms. Trace:
I20260709 13:07:50.200040 21754 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.135272 21728 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.201025 21763 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:50.201793 21851 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.160s	user 0.000s	sys 0.000s
I20260709 13:07:50.201452 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:50.202474 21853 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
W20260709 13:07:50.203137 21854 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 13:07:50.206435 21630 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.183014 21840 consensus_queue.cc:1048] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:07:50.209772 21561 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.509s	user 0.009s	sys 0.001s
I20260709 13:07:50.211577 21631 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.207312 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.214171 21752 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:50.081554 21632 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.232635 14886 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:07:50.224583 15513 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:50.233309 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:50.237723 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:50.237939 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:50.303872 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79399us
W20260709 13:07:50.187299 21848 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.348s	user 0.001s	sys 0.000s
W20260709 13:07:50.307920 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 74740.7us
I20260709 13:07:50.146164 21064 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:50.105674 21772 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.226980 14791 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 14 to 18, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 18 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:07:50.086889 14963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.020s	sys 0.011s
W20260709 13:07:50.313076 14963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.020s	sys 0.011s
W20260709 13:07:50.262022 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 107539us
I20260709 13:07:50.236755 21687 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.238942 21679 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.209471 14895 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:50.181161 21841 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.065s
W20260709 13:07:50.284510 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83229.3us
I20260709 13:07:50.245596 21682 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:50.245759 21737 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:50.268772 21829 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.000s
I20260709 13:07:50.301170 15044 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:07:50.250378 21554 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.305613 14886 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:07:50.307971 14961 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:50.266026 21615 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18.
I20260709 13:07:50.249945 21867 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:50.237053 14888 rpcz_store.cc:276] 0709 13:07:47.200201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:47.200320 (+   119us) service_pool.cc:224] Handling call
0709 13:07:47.200591 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.113182 (+2912591us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.198508 (+ 85326us) spinlock_profiling.cc:243] Waited 2.91 s on lock 0x7b540015b154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:50.198709 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6697727744}
W20260709 13:07:50.315428 21844 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
I20260709 13:07:50.307670 21801 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.318548 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1529) took 2559 ms. Trace:
I20260709 13:07:50.319005 21793 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.319810 21836 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.321506 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3363) took 2466 ms. Trace:
I20260709 13:07:50.350574 14890 rpcz_store.cc:276] 0709 13:07:47.759016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:48.951839 (+1192823us) service_pool.cc:224] Handling call
0709 13:07:48.952229 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.391746 (+439517us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.391791 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.392410 (+   619us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.753386 (+360976us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:49.782026 (+ 28640us) log.cc:844] Serialized 14 byte log entry
0709 13:07:49.783395 (+  1369us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.786159 (+  2764us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54003f9154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:49.786199 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.318274 (+532075us) raft_consensus.cc:1685] finished
0709 13:07:50.318373 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.318494 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12634,"prepare.queue_time_us":28664,"prepare.run_wall_time_us":34,"raft.queue_time_us":4337,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":21102,"spinlock_wait_cycles":986439680,"thread_start_us":360567,"threads_started":1,"wal-append.queue_time_us":614842}
I20260709 13:07:50.352000 14891 rpcz_store.cc:276] 0709 13:07:47.855227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.202738 (+1347511us) service_pool.cc:224] Handling call
0709 13:07:49.203007 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.385573 (+182566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.385607 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.390793 (+  5186us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.773403 (+382610us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:07:49.773440 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.773505 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.321307 (+547802us) raft_consensus.cc:1685] finished
0709 13:07:50.321330 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.321451 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29499,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"thread_start_us":558768,"threads_started":2,"wal-append.queue_time_us":537352}
I20260709 13:07:50.322337 21881 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:50.324209 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.353333 21881 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.353756 21881 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:50.354068 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.334494 21682 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:50.355129 14970 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:50.355347 21682 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:50.355437 14966 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:50.325110 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.309670 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:50.325147 14791 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 18 to 21. New cstate: current_term: 21 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:50.326277 21747 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:50.313366 21064 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.356280 21829 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.361057 21737 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.361529 21737 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:50.361932 21737 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.362718 21829 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:50.364436 21795 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:50.365497 21859 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.437s	user 0.004s	sys 0.000s
I20260709 13:07:50.309054 21869 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:50.328738 21687 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:50.377961 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1787) took 1208 ms. Trace:
I20260709 13:07:50.306780 21631 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:50.360579 21858 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 13:07:50.333480 21679 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.337111 15516 leader_election.cc:400] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18.
W20260709 13:07:50.359284 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49697.6us
I20260709 13:07:50.379240 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:50.379349 21863 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260709 13:07:50.398566 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 65142.8us
I20260709 13:07:50.387981 21766 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.388890 14968 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:50.380053 15542 rpcz_store.cc:276] 0709 13:07:49.169227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.169339 (+   112us) service_pool.cc:224] Handling call
0709 13:07:49.169715 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.170085 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.170111 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.190235 (+ 20124us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.561795 (+371560us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:49.561852 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.561941 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.377529 (+815588us) raft_consensus.cc:1685] finished
0709 13:07:50.377578 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.377842 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":23057,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9817,"thread_start_us":341620,"threads_started":1,"wal-append.queue_time_us":575198}
I20260709 13:07:50.389266 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1531) took 2629 ms. Trace:
I20260709 13:07:50.390645 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.405882 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:50.412789 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.414844 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.392181 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.322337 21830 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.394984 14890 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:50.398056 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.398486 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.360407 21747 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.400146 21772 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.312026 21701 consensus_queue.cc:260] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.385200 21716 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:50.388325 21822 consensus_meta.cc:287] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.002s
I20260709 13:07:50.405882 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:50.435133 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.435600 21846 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.332231 21724 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.379786 21629 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.405525 14894 rpcz_store.cc:276] 0709 13:07:47.766898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.156265 (+1389367us) service_pool.cc:224] Handling call
0709 13:07:49.193611 (+ 37346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.384151 (+190540us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:49.793740 (+409589us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.109477 (+315737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.109914 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.110070 (+   156us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:50.110325 (+   255us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.110507 (+   182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.110583 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.204766 (+ 94183us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b18002f9bc0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1
0709 13:07:50.206280 (+  1514us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b18002f9bc0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:07:50.389050 (+182770us) raft_consensus.cc:1685] finished
0709 13:07:50.389078 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.389205 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":107044,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":79,"raft.queue_time_us":35435,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":3443,"spinlock_wait_cycles":76676992,"thread_start_us":731316,"threads_started":3,"wal-append.queue_time_us":466289}
I20260709 13:07:50.455447 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.441897 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.473543 14968 raft_consensus.cc:2393] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:50.441565 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.476310 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:50.476222 21822 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.477361 21701 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.477916 14961 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:50.478354 21822 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.479743 14888 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
W20260709 13:07:50.480208 21654 consensus_meta.cc:287] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.002s
I20260709 13:07:50.480254 21716 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.480685 21724 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.480790 21654 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.481925 15548 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:50.482682 14969 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:50.491367 15541 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
W20260709 13:07:50.491276 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49800.1us
I20260709 13:07:50.483712 15542 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 13: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:50.397189 21721 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.401789 21679 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.496513 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:50.498593 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1801) took 1140 ms. Trace:
I20260709 13:07:50.501541 15547 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:50.439334 21829 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:50.406514 21752 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.502525 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.509697 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.397751 21637 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.467756 21682 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.440449 21867 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:50.460461 21841 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:50.499063 15543 rpcz_store.cc:276] 0709 13:07:49.357997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.388754 (+ 30757us) service_pool.cc:224] Handling call
0709 13:07:49.405331 (+ 16577us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.405664 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.405696 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.455335 (+ 49639us) log.cc:844] Serialized 26 byte log entry
0709 13:07:49.909042 (+453707us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:49.909090 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:49.909180 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.498339 (+589159us) raft_consensus.cc:1685] finished
0709 13:07:50.498368 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.498517 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10346,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":443680,"threads_started":1,"wal-append.queue_time_us":600265}
I20260709 13:07:50.534832 21737 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.512856 21834 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:07:50.560793 21780 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:07:50.563197 21730 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.736s	user 0.010s	sys 0.000s
I20260709 13:07:50.563685 21730 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23.
I20260709 13:07:50.564374 15550 raft_consensus.cc:1240] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:50.565078 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.566107 21682 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:50.566897 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.514117 21791 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:50.572383 15544 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:50.515703 21632 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.517469 21687 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.521844 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:50.505751 21579 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:50.523939 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 191509us
W20260709 13:07:50.530681 21866 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.315s	user 0.000s	sys 0.001s
I20260709 13:07:50.530867 21654 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.531643 14894 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:50.534307 21761 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.464772 21631 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.543689 21752 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.546123 15547 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:50.548058 21064 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.548951 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.673496 21834 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.087s
I20260709 13:07:50.684552 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:50.591837 21841 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260709 13:07:50.684914 21064 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.685803 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:50.686887 21889 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:07:50.501116 21840 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.686939 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:50.687903 14890 raft_consensus.cc:2376] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16. Re-sending same reply.
I20260709 13:07:50.523273 14964 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:50.688385 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1656) took 1278 ms. Trace:
W20260709 13:07:50.555299 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 45678.1us
I20260709 13:07:50.556017 15039 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:07:50.689234 15041 raft_consensus.cc:606] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:50.689517 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:50.689765 15041 raft_consensus.cc:614] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:50.690959 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:50.696936 21579 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.449349 21747 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:50.512763 21554 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:50.567361 21846 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.567956 21700 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:50.703776 21700 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.704649 21700 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:50.705050 21700 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:50.706068 21700 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.401973 21786 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.709506 21786 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:50.569509 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.570143 15543 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:50.514756 21719 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.711199 21631 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:50.711966 21631 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.713001 21719 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.511077 21689 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:50.714013 21689 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:50.714429 21689 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.714636 21631 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.716444 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:50.576833 15008 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:50.717774 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 141045us
I20260709 13:07:50.718511 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:50.719671 21834 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:50.720441 21834 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:50.577179 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:50.721391 14886 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:50.721994 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.722283 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.558991 21629 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:50.509097 21772 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.065s
I20260709 13:07:50.724166 21737 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:50.641140 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.711153 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.725879 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.726951 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.727561 15543 raft_consensus.cc:2410] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 13:07:50.572669 21791 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:50.728776 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:50.730022 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.737178 14894 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.688794 14963 rpcz_store.cc:276] 0709 13:07:49.410280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.410418 (+   138us) service_pool.cc:224] Handling call
0709 13:07:49.452037 (+ 41619us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.452500 (+   463us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:07:50.325276 (+872776us) log.cc:844] Serialized 14 byte log entry
0709 13:07:50.398931 (+ 73655us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.400149 (+  1218us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.400288 (+   139us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:50.400320 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.400383 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.688200 (+287817us) raft_consensus.cc:1685] finished
0709 13:07:50.688221 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.688329 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":423296,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":178,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":152,"thread_start_us":899417,"threads_started":2,"wal-append.queue_time_us":175567}
I20260709 13:07:50.748140 14886 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:50.749295 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.756083 21687 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:50.761802 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1750) took 1103 ms. Trace:
I20260709 13:07:50.762663 21791 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:50.762187 15546 rpcz_store.cc:276] 0709 13:07:49.658357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.725551 (+ 67194us) service_pool.cc:224] Handling call
0709 13:07:49.725822 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:49.726176 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:49.726203 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:49.743005 (+ 16802us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.119633 (+376628us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:07:50.119670 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.119730 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.529979 (+410249us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:50.761529 (+231550us) raft_consensus.cc:1685] finished
0709 13:07:50.761549 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.761748 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13561,"raft.queue_time_us":83,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":16678,"spinlock_wait_cycles":39277824,"thread_start_us":310927,"threads_started":1,"wal-append.queue_time_us":414475}
I20260709 13:07:50.763803 21791 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:50.763976 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.767570 21721 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:50.771293 21629 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:07:50.773108 21629 consensus_queue.cc:1059] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:07:50.774339 21629 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:50.774757 21629 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:50.775553 21682 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:50.776650 21637 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:50.789548 15546 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:07:50.790477 21752 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:50.792138 15546 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:07:50.796170 21787 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:07:50.796726 21787 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.795734 21629 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.798043 15545 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:50.798939 21787 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.799269 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1814) took 1020 ms. Trace:
I20260709 13:07:50.799643 15545 rpcz_store.cc:276] 0709 13:07:49.778831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.909109 (+130278us) service_pool.cc:224] Handling call
0709 13:07:49.933179 (+ 24070us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.798505 (+865326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.799056 (+   551us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b54005d02d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:50.799220 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1988685056}
I20260709 13:07:50.800704 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.747352 21700 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:50.806417 14966 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:50.800218 21629 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:50.813444 15040 raft_consensus.cc:1240] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
W20260709 13:07:50.815909 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 87215.2us
W20260709 13:07:50.817760 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53883us
W20260709 13:07:50.826903 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:50.828434 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.829030 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.832885 15037 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:07:50.836673 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:50.837419 14969 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:50.840278 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:50.840662 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.845966 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:50.847729 14892 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 13:07:50.852845 14966 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:07:50.856938 14894 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:50.865130 15040 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:50.866542 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:50.870410 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:50.840214 21682 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 13:07:50.878957 15545 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 21. Current term is 22. Ops: [21.18-21.18]
I20260709 13:07:50.871055 14892 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 23 index: 20. (index mismatch)
I20260709 13:07:50.873507 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.747200 21719 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:50.886114 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:50.887861 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:50.888192 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47642.8us
I20260709 13:07:50.889771 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:50.889252 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 57441.6us
I20260709 13:07:50.748171 21772 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:50.893049 14969 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:50.903532 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:50.905328 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 466814us
I20260709 13:07:50.843729 21064 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:07:50.873215 21861 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.657s	user 0.004s	sys 0.000s
I20260709 13:07:50.909847 15037 raft_consensus.cc:1240] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:50.913482 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:50.914232 14894 raft_consensus.cc:1275] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:07:50.915997 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.919934 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.890357 21719 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.933342 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:50.897359 21632 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:50.907341 21772 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.869475 21721 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:07:50.944729 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.944924 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:50.887598 21687 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:50.915012 21795 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:50.839481 21881 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:50.917634 21845 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:50.938369 21706 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:50.940044 21064 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:50.905699 21631 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:07:50.897720 21846 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:07:50.954612 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2866) took 1067 ms. Trace:
I20260709 13:07:50.943320 21772 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:50.956094 21873 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.741s	user 0.002s	sys 0.000s
I20260709 13:07:50.934060 21719 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:50.966930 21630 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:50.971055 21728 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:50.979187 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4260) took 1269 ms. Trace:
I20260709 13:07:50.932530 21787 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:50.980314 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1591) took 1213 ms. Trace:
I20260709 13:07:50.985037 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:50.993407 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:50.996049 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 51216.7us
W20260709 13:07:50.997306 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52675.1us
W20260709 13:07:51.004232 14962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2862) took 1208 ms (client timeout 1535 ms). Trace:
I20260709 13:07:51.006433 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1596) took 1219 ms. Trace:
W20260709 13:07:51.008138 14889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3381) took 1363 ms (client timeout 1552 ms). Trace:
I20260709 13:07:51.011126 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:50.935732 21679 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.011746 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:51.023780 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:51.024631 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:51.026993 14887 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:51.048494 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:51.028666 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.032315 15039 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:51.029274 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.078274 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:51.098662 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 87623.3us
I20260709 13:07:51.059916 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1811) took 1282 ms. Trace:
I20260709 13:07:51.074417 15549 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 23. Current term is 24. Ops: [23.20-23.20]
I20260709 13:07:51.101626 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:51.099259 14895 rpcz_store.cc:276] 0709 13:07:49.709681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.357074 (+647393us) service_pool.cc:224] Handling call
0709 13:07:50.386180 (+ 29106us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.386492 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.386519 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.386920 (+   401us) log.cc:844] Serialized 26 byte log entry
0709 13:07:50.573789 (+186869us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:07:50.573848 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.573952 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:50.978948 (+404996us) raft_consensus.cc:1685] finished
0709 13:07:50.978973 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:50.979118 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2509,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":9100,"thread_start_us":186468,"threads_started":1,"wal-append.queue_time_us":551289}
I20260709 13:07:51.103480 15550 rpcz_store.cc:276] 0709 13:07:49.787435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.060966 (+273531us) service_pool.cc:224] Handling call
0709 13:07:50.061457 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.564712 (+503255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.006233 (+441521us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54005f91d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:51.006377 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1156348288}
I20260709 13:07:51.104785 14970 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:51.098647 14964 rpcz_store.cc:276] 0709 13:07:49.886870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.893738 (+  6868us) service_pool.cc:224] Handling call
0709 13:07:50.954375 (+1060637us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b540031c254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:50.954517 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":214808960}
I20260709 13:07:51.100095 15548 rpcz_store.cc:276] 0709 13:07:49.776992 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.792534 (+ 15542us) service_pool.cc:224] Handling call
0709 13:07:49.792786 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.482262 (+689476us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.059618 (+577356us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400512cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:51.059837 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584562048}
W20260709 13:07:51.100504 14889 rpcz_store.cc:269] 0709 13:07:49.644401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.683589 (+ 39188us) service_pool.cc:224] Handling call
0709 13:07:51.007986 (+1324397us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54002eb3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:51.008085 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":410255232}
I20260709 13:07:51.099427 15544 rpcz_store.cc:276] 0709 13:07:49.766809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.775516 (+  8707us) service_pool.cc:224] Handling call
0709 13:07:49.792723 (+ 17207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.572783 (+780060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.980046 (+407263us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54004de9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:50.980242 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792879872}
I20260709 13:07:51.107856 15547 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:51.099512 14962 rpcz_store.cc:269] 0709 13:07:49.795398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:49.795523 (+   125us) service_pool.cc:224] Handling call
0709 13:07:51.004057 (+1208534us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b54003ec454. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:51.004180 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134564096}
I20260709 13:07:51.021713 21840 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.109133 21654 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:51.110973 21679 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.007503 21637 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 13:07:51.020982 21635 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:51.106823 21728 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.062240 21747 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.113283 21701 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:07:51.114187 21806 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:51.114535 21806 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:51.114954 21747 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.115267 21806 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.18, Last appended by leader: 18, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.116726 21806 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:51.120627 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:51.121176 14970 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:51.122027 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 98357.9us
I20260709 13:07:51.126906 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:51.075007 21885 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.674s	user 0.000s	sys 0.002s
I20260709 13:07:51.021621 21629 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:51.069741 21554 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:51.149470 14889 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:51.075421 21881 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:51.098527 21706 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:51.054649 21835 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.172310 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3368) took 1708 ms. Trace:
I20260709 13:07:51.172750 14893 rpcz_store.cc:276] 0709 13:07:49.463738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.106877 (+643139us) service_pool.cc:224] Handling call
0709 13:07:50.152315 (+ 45438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:50.152755 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.152795 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:50.153481 (+   686us) log.cc:844] Serialized 52 byte log entry
0709 13:07:50.294306 (+140825us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:50.294350 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:50.294415 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.074426 (+780011us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:51.172040 (+ 97614us) raft_consensus.cc:1685] finished
0709 13:07:51.172061 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.172253 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47059,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":95,"spinlock_wait_cycles":80019840,"thread_start_us":78897,"threads_started":1,"wal-append.queue_time_us":185449}
I20260709 13:07:51.139390 21554 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:51.175202 14963 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:07:51.175705 14963 pending_rounds.cc:85] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 10
I20260709 13:07:51.175962 14963 pending_rounds.cc:107] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:07:51.176229 14963 raft_consensus.cc:2889] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:51.175266 21554 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:51.179036 21554 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:51.133204 21838 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
W20260709 13:07:51.154754 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.181222 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.121206 21615 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.118997 21561 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:51.133774 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:51.028287 21786 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260709 13:07:51.129246 21687 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:51.168129 21772 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.135171 21679 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 13:07:51.187487 21706 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:51.205529 14970 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:51.214251 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 80561.5us
I20260709 13:07:51.230304 21728 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:51.256633 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.204506 21615 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:51.268893 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:51.271507 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:51.273418 14962 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:07:51.229866 21846 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:51.286931 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:51.266790 21795 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 13:07:51.292518 21615 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.266474 21687 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:51.296444 21689 consensus_meta.cc:287] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260709 13:07:51.296144 21687 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.296862 21689 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.288250 14891 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:51.299649 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:51.301657 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:51.303227 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:51.306927 14970 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:51.309546 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:51.310287 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.222097 21561 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.318359 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.318912 15542 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:51.319317 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.320799 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.273695 21761 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:51.321606 15550 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:51.322285 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:51.266908 21845 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
W20260709 13:07:51.329043 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.329911 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.334882 15548 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.267168 21835 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:07:51.311035 21723 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:51.341262 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1816) took 1011 ms. Trace:
I20260709 13:07:51.351176 15549 rpcz_store.cc:276] 0709 13:07:50.330427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.330675 (+   248us) service_pool.cc:224] Handling call
0709 13:07:50.331041 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.101532 (+770491us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.340943 (+239411us) spinlock_profiling.cc:243] Waited 743 ms on lock 0x7b5400afc8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:51.341192 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1709063424}
I20260709 13:07:51.345389 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:51.336261 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:51.360128 14893 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:07:51.369769 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:51.370615 14891 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:07:51.372884 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 459496us
I20260709 13:07:51.374374 14859 leader_election.cc:400] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
W20260709 13:07:51.349014 14890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.022s	sys 0.018s
I20260709 13:07:51.347959 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:51.317462 21795 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:51.375387 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:51.394359 14890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.022s	sys 0.018s
I20260709 13:07:51.311347 21737 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
I20260709 13:07:51.468536 14891 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:07:51.350839 21723 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:07:51.315987 21801 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.015s	sys 0.038s
I20260709 13:07:51.396747 15547 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260709 13:07:51.401441 15549 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:07:51.402140 15542 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:51.314672 21747 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
W20260709 13:07:51.477226 14892 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.031s
I20260709 13:07:51.313452 21721 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:07:51.321938 21761 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:51.396570 21064 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:07:51.508239 14968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.022s	sys 0.051s
W20260709 13:07:51.508646 14968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.022s	sys 0.051s
W20260709 13:07:51.509361 14967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.027s	sys 0.045s
W20260709 13:07:51.509703 14967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.027s	sys 0.045s
W20260709 13:07:51.482051 21801 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.015s	sys 0.038s
I20260709 13:07:51.449662 15548 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:51.519353 15550 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:51.484966 14886 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.024s
W20260709 13:07:51.486608 14892 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.005s	sys 0.031s
W20260709 13:07:51.529264 14886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.012s	sys 0.024s
W20260709 13:07:51.498471 21766 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.028s	sys 0.021s
I20260709 13:07:51.461490 21795 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:51.535921 21766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.028s	sys 0.021s
W20260709 13:07:51.550086 14888 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.009s	sys 0.027s
W20260709 13:07:51.578616 14888 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.027s
W20260709 13:07:51.581933 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:51.544243 21700 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.740s	user 0.006s	sys 0.005s
W20260709 13:07:51.588789 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.541692 21845 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:51.530611 21737 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.058s
I20260709 13:07:51.534884 21719 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.583609 21630 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:51.590126 21742 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:51.616936 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1759) took 1066 ms. Trace:
I20260709 13:07:51.617393 15543 rpcz_store.cc:276] 0709 13:07:50.550686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.759677 (+208991us) service_pool.cc:224] Handling call
0709 13:07:50.760348 (+   671us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:50.760931 (+   583us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.760968 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:50.762209 (+  1241us) log.cc:844] Serialized 520 byte log entry
0709 13:07:51.229732 (+467523us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:07:51.229769 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.229834 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:51.616688 (+386854us) raft_consensus.cc:1685] finished
0709 13:07:51.616713 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.616876 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2478,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":132,"thread_start_us":467118,"threads_started":1,"wal-append.queue_time_us":781695}
I20260709 13:07:51.599267 21728 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:51.620213 21867 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.015s	sys 0.047s
I20260709 13:07:51.617200 21900 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.591799 21772 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.617553 21752 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:51.617969 21742 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:51.629565 21867 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.047s
I20260709 13:07:51.628576 21845 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.637269 14894 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.015s
I20260709 13:07:51.620553 21689 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:51.636155 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.002s	sys 0.014s
W20260709 13:07:51.696069 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.002s	sys 0.014s
W20260709 13:07:51.636350 15545 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.003s	sys 0.011s
W20260709 13:07:51.636932 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.004s	sys 0.015s
W20260709 13:07:51.697957 15545 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.004s	sys 0.012s
W20260709 13:07:51.698012 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.005s	sys 0.015s
W20260709 13:07:51.698382 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 575283us
W20260709 13:07:51.637903 14969 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.011s	sys 0.013s
I20260709 13:07:51.598769 21723 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:51.648063 21820 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.009s	sys 0.006s
W20260709 13:07:51.670274 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.633522 21561 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.634344 21728 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.638931 21787 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.000s	sys 0.016s
W20260709 13:07:51.639647 21654 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.005s	sys 0.014s
W20260709 13:07:51.699913 14969 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.011s	sys 0.013s
W20260709 13:07:51.669806 14894 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.000s	sys 0.016s
I20260709 13:07:51.714460 21830 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:51.647068 21752 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.699663 21772 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:51.722785 21654 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:07:51.706154 21637 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.009s
I20260709 13:07:51.728721 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:51.718968 21820 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.010s	sys 0.006s
I20260709 13:07:51.639103 21900 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:51.738940 15546 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.008s	sys 0.011s
I20260709 13:07:51.742111 15036 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
W20260709 13:07:51.739799 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 416558us
I20260709 13:07:51.751638 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:51.729743 21753 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.330s	user 0.013s	sys 0.021s
I20260709 13:07:51.696951 21845 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:51.730664 21761 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:51.778606 14887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.001s	sys 0.022s
W20260709 13:07:51.794871 14887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.001s	sys 0.022s
W20260709 13:07:51.738796 21637 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.011s	sys 0.009s
I20260709 13:07:51.733341 21631 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.725605 21728 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.726282 21700 consensus_queue.cc:1059] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260709 13:07:51.743023 21830 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:51.781637 21753 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.014s	sys 0.021s
W20260709 13:07:51.820516 15010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.014s	sys 0.013s
W20260709 13:07:51.839823 15010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.014s	sys 0.014s
W20260709 13:07:51.840147 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 543231us
I20260709 13:07:51.843786 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:51.844521 14891 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:51.845268 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 19 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:51.845819 14891 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:51.847393 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:51.708711 21742 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:51.801831 21561 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:51.850167 15035 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260709 13:07:51.739604 21772 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.851369 15040 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:51.852065 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.799809 21795 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.858793 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:51.842489 21897 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260709 13:07:51.862423 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:51.867069 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 491799us
I20260709 13:07:51.867995 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:51.853355 15007 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.013s	sys 0.025s
W20260709 13:07:51.869751 15007 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.013s	sys 0.025s
W20260709 13:07:51.870080 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 742433us
I20260709 13:07:51.886554 14891 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
I20260709 13:07:51.882367 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:51.816623 21631 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.846009 21830 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.885922 21795 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:51.897441 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:51.899979 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:51.861603 21615 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:51.894927 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:51.911903 15035 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:07:51.887835 21899 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.266s	user 0.001s	sys 0.000s
I20260709 13:07:51.917970 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:51.888356 21719 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:51.905200 21701 raft_consensus.cc:3055] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:51.928540 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3392) took 1396 ms. Trace:
I20260709 13:07:51.865828 21561 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:51.916303 21893 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 13:07:51.932121 14894 rpcz_store.cc:276] 0709 13:07:50.532155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.929334 (+397179us) service_pool.cc:224] Handling call
0709 13:07:50.929697 (+   363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.077134 (+147437us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:51.129858 (+ 52724us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.724992 (+595134us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.725057 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:51.725119 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.928280 (+203161us) spinlock_profiling.cc:243] Waited 147 ms on lock 0x7b54000f7654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:51.928337 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.928474 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1447,"prepare.queue_time_us":55286,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":2033,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":7387,"spinlock_wait_cycles":338443520,"thread_start_us":593264,"threads_started":1,"wal-append.queue_time_us":492997}
I20260709 13:07:51.886909 21913 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:07:51.863996 21654 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.894884 21554 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:07:51.901077 21679 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
I20260709 13:07:51.932304 21630 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:51.932030 21701 raft_consensus.cc:740] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:51.968102 21632 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:51.969230 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3389) took 1438 ms. Trace:
I20260709 13:07:51.970937 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.970858 14892 rpcz_store.cc:276] 0709 13:07:50.530416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.880804 (+350388us) service_pool.cc:224] Handling call
0709 13:07:50.881064 (+   260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:50.881248 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:07:50.925805 (+ 44557us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.967293 (+1041488us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:51.967898 (+   605us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:07:51.967962 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.969087 (+  1125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:51.969183 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5820,"prepare.queue_time_us":44205,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":62803,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6934,"thread_start_us":1041091,"threads_started":2,"wal-append.queue_time_us":789697}
I20260709 13:07:51.974277 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:51.977659 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:51.978389 15546 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:51.987977 15513 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:51.989106 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:51.990919 21867 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:51.989849 21719 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:51.993175 21891 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:51.994480 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:51.995460 15543 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:51.995759 21867 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:51.996881 21867 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 22.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.983093 21579 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:51.999853 21579 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.000859 21579 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.002969 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.005108 21635 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:52.005570 21635 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:52.004869 21795 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:52.006558 21635 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.009236 21635 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.018611 21723 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:51.926928 21615 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:51.935825 21747 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.027s
I20260709 13:07:52.026258 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3709) took 1217 ms. Trace:
W20260709 13:07:52.039330 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.044493 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.045535 15038 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:51.936025 21689 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:07:52.041909 15043 rpcz_store.cc:276] 0709 13:07:50.809266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.809395 (+   129us) service_pool.cc:224] Handling call
0709 13:07:50.809695 (+   300us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:50.810088 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.810114 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:50.810672 (+   558us) log.cc:844] Serialized 52 byte log entry
0709 13:07:51.222214 (+411542us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:51.282532 (+ 60318us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.286584 (+  4052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.286679 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.026007 (+739328us) raft_consensus.cc:1685] finished
0709 13:07:52.026034 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.026189 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":620,"prepare.queue_time_us":43991,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2154,"raft.queue_time_us":11794,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":39775,"thread_start_us":411098,"threads_started":1,"wal-append.queue_time_us":710638}
I20260709 13:07:52.057821 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3741) took 1207 ms. Trace:
W20260709 13:07:52.039302 21893 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 13:07:52.054118 15007 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.520s (SENT)
I20260709 13:07:52.055476 15037 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 13:07:52.086561 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.089242 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:52.089301 14891 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:52.043953 21840 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.057546 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 131848us
I20260709 13:07:52.059091 14961 rpcz_store.cc:276] 0709 13:07:50.850691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.850959 (+   268us) service_pool.cc:224] Handling call
0709 13:07:50.867373 (+ 16414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.887639 (+ 20266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.887672 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.896666 (+  8994us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.204596 (+307930us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:51.204635 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.204703 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.057611 (+852908us) raft_consensus.cc:1685] finished
0709 13:07:52.057634 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.057756 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19894,"raft.queue_time_us":22600,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":11154,"spinlock_wait_cycles":838016,"thread_start_us":307182,"threads_started":1,"wal-append.queue_time_us":681215}
W20260709 13:07:52.109406 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 372959us
W20260709 13:07:52.058929 21836 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.004s	sys 0.008s
I20260709 13:07:52.111395 15035 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:52.086015 21846 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:52.095856 21904 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 13:07:52.119005 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64933.5us
I20260709 13:07:52.061632 21752 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:52.137231 15546 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
W20260709 13:07:52.155242 21907 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:07:52.119556 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:52.157181 21906 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 13:07:52.158360 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3394) took 1625 ms. Trace:
I20260709 13:07:52.055606 21632 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:07:52.159687 21632 consensus_queue.cc:1243] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 10.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:07:52.042173 21554 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
I20260709 13:07:52.158732 14888 rpcz_store.cc:276] 0709 13:07:50.533395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.981488 (+448093us) service_pool.cc:224] Handling call
0709 13:07:50.981920 (+   432us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.982361 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.982397 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.983006 (+   609us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.579313 (+596307us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:51.579373 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.579492 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.158146 (+578654us) raft_consensus.cc:1685] finished
0709 13:07:52.158179 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.158305 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1613,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6351,"thread_start_us":595845,"threads_started":1,"wal-append.queue_time_us":862216}
I20260709 13:07:52.160955 21554 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:07:52.161355 21554 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.108510 21795 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
I20260709 13:07:52.096570 21701 consensus_queue.cc:260] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.163370 21701 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.165158 21689 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.165692 21632 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.165877 21689 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:52.166288 21689 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:52.165256 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45818.6us
I20260709 13:07:52.167665 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3399) took 1431 ms. Trace:
I20260709 13:07:52.167984 21830 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.168922 21772 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.109331 21926 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:07:52.169986 21926 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.159035 14861 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:52.121331 15548 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:52.170885 21926 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.172518 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.173098 14888 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:52.162149 21554 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.20, Last appended by leader: 20, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.174567 21632 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:52.175635 21632 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:52.150650 21846 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.176657 21632 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.146600 21845 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.178623 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3745) took 1286 ms. Trace:
I20260709 13:07:52.178846 21615 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.179123 14968 rpcz_store.cc:276] 0709 13:07:50.892991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.893129 (+   138us) service_pool.cc:224] Handling call
0709 13:07:50.893527 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.901256 (+  7729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.901298 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.901761 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.509018 (+607257us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:51.509058 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.509120 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.175259 (+666139us) raft_consensus.cc:1685] finished
0709 13:07:52.175281 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.178556 (+  3275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7297,"raft.queue_time_us":11505,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":2172,"thread_start_us":564966,"threads_started":1,"wal-append.queue_time_us":814136}
I20260709 13:07:52.180474 21742 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.181898 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:52.174183 21913 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 13:07:52.174292 21554 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:52.183683 21920 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 13:07:52.156661 21909 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:07:52.185222 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3748) took 1104 ms. Trace:
I20260709 13:07:52.185580 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:52.186470 15542 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:52.185549 14969 rpcz_store.cc:276] 0709 13:07:51.080559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.081165 (+   606us) service_pool.cc:224] Handling call
0709 13:07:51.081515 (+   350us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.106110 (+ 24595us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.106152 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.106712 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.722965 (+616253us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:51.723015 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.723092 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.185040 (+461948us) raft_consensus.cc:1685] finished
0709 13:07:52.185058 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.185171 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24207,"raft.queue_time_us":25046,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":92,"thread_start_us":613716,"threads_started":1,"wal-append.queue_time_us":754848}
W20260709 13:07:52.082753 21682 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.004s	sys 0.014s
W20260709 13:07:52.187572 21682 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.005s	sys 0.014s
I20260709 13:07:52.187939 21561 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.090358 21637 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:52.188488 15007 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.583s (SENT) [suppressed 7 similar messages]
I20260709 13:07:52.188724 21637 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.192951 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:52.168427 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.168037 14887 rpcz_store.cc:276] 0709 13:07:50.735951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.102930 (+366979us) service_pool.cc:224] Handling call
0709 13:07:51.103187 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.128465 (+ 25278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.128508 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.153169 (+ 24661us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.795368 (+642199us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:51.795424 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.795486 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.167464 (+371978us) raft_consensus.cc:1685] finished
0709 13:07:52.167483 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.167614 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19919,"raft.queue_time_us":20042,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":3405,"thread_start_us":553790,"threads_started":1,"wal-append.queue_time_us":834725}
W20260709 13:07:52.194487 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45322.8us
I20260709 13:07:52.168617 14895 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:07:52.203783 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:52.205418 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.207621 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.211598 21630 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:52.212073 21845 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.212240 21630 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.214829 21630 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.167076 21689 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.115744 21747 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:07:52.216271 21900 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.191248 21846 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.217085 21579 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.217280 21913 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:07:52.217521 21631 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.218039 21938 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:52.218564 21706 consensus_meta.cc:287] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.957s	user 0.002s	sys 0.010s
W20260709 13:07:52.219219 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50934.7us
I20260709 13:07:52.219059 21706 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:52.219786 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.220037 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:52.220810 21766 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:52.220942 21938 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.221244 21766 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:52.221407 21706 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.222118 21766 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.208467 14887 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
W20260709 13:07:52.114933 21901 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
W20260709 13:07:52.225203 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.235128 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:52.116591 21679 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:07:52.147555 21836 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.004s	sys 0.011s
I20260709 13:07:52.239089 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4266) took 1118 ms. Trace:
I20260709 13:07:52.243431 14895 rpcz_store.cc:276] 0709 13:07:51.120296 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.134402 (+ 14106us) service_pool.cc:224] Handling call
0709 13:07:52.168362 (+1033960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.198423 (+ 30061us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.238846 (+ 40423us) spinlock_profiling.cc:243] Waited 992 ms on lock 0x7b54000ce250. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:52.239015 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2281539968}
I20260709 13:07:52.224503 15543 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:52.191226 21637 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.216648 21747 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.249636 21820 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.250197 21820 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:52.250650 21820 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.231827 21701 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:07:52.114898 21840 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.260990 21747 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.262881 21913 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:07:52.265292 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.266149 15040 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:52.267449 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:52.268337 15543 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 22: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:52.269218 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.271003 21728 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.271559 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1546) took 1879 ms. Trace:
I20260709 13:07:52.284688 21840 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.284051 14886 rpcz_store.cc:276] 0709 13:07:50.391915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.750229 (+358314us) service_pool.cc:224] Handling call
0709 13:07:50.750557 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.816590 (+ 66033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:50.816619 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:50.845192 (+ 28573us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.529719 (+684527us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:51.529756 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.529822 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.271302 (+741480us) raft_consensus.cc:1685] finished
0709 13:07:52.271325 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.271499 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":66491,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":36195,"thread_start_us":610897,"threads_started":1,"wal-append.queue_time_us":815553}
I20260709 13:07:52.231834 21615 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:52.272853 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4262) took 2061 ms. Trace:
I20260709 13:07:52.278663 21766 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:52.262423 21747 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:52.282437 21830 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:52.224042 21721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.005s	sys 0.021s
W20260709 13:07:52.288053 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45244us
I20260709 13:07:52.293107 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.287822 14890 rpcz_store.cc:276] 0709 13:07:50.211728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:50.690660 (+478932us) service_pool.cc:224] Handling call
0709 13:07:50.690936 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:50.691288 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:07:50.691602 (+   314us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.470118 (+778516us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.470698 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 13:07:51.477526 (+  6828us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:07:51.483152 (+  5626us) log.cc:844] Serialized 14 byte log entry
0709 13:07:51.945598 (+462446us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:51.945702 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.272643 (+326941us) raft_consensus.cc:1685] finished
0709 13:07:52.272662 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.272796 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5153,"prepare.queue_time_us":5541,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":78,"raft.queue_time_us":180604,"raft.run_cpu_time_us":340,"raft.run_wall_time_us":37173,"thread_start_us":1186134,"threads_started":2,"wal-append.queue_time_us":933410}
I20260709 13:07:52.326915 14886 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:07:52.311172 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.240103 21679 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.327631 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1824) took 1009 ms. Trace:
W20260709 13:07:52.339478 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.290632 21615 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:52.349994 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.014s
W20260709 13:07:52.350381 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.006s	sys 0.014s
W20260709 13:07:52.350682 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 614029us
W20260709 13:07:52.326316 21721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.005s	sys 0.021s
W20260709 13:07:52.351608 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56052.6us
W20260709 13:07:52.346129 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 122784us
I20260709 13:07:52.345103 15541 rpcz_store.cc:276] 0709 13:07:51.318411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.343915 (+ 25504us) service_pool.cc:224] Handling call
0709 13:07:51.415583 (+ 71668us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:51.415765 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:51.888003 (+472238us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.327213 (+439210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.327274 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:52.327329 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.327430 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.327562 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30650,"prepare.queue_time_us":339374,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":31930,"thread_start_us":819140,"threads_started":2}
I20260709 13:07:52.356415 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:52.361444 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.326916 21631 raft_consensus.cc:3055] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:52.305624 21728 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:52.343036 21787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.013s
I20260709 13:07:52.367889 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.348551 21846 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.353531 21615 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.346529 21786 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:52.343734 21933 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 13:07:52.390497 21787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.007s	sys 0.013s
I20260709 13:07:52.328325 21830 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.409722 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.396209 21630 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:52.385632 21944 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.372687 21631 raft_consensus.cc:740] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.386876 21900 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:52.432955 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:52.414361 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46576.3us
W20260709 13:07:52.451452 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.451290 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:52.399092 21635 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:52.383872 21913 consensus_queue.cc:1059] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 13:07:52.372430 21938 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:07:52.442056 21934 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.461941 21942 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 13:07:52.462442 15010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.015s	sys 0.014s
I20260709 13:07:52.389801 21629 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.057s
I20260709 13:07:52.461485 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.432291 21700 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.390666 21937 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260709 13:07:52.470716 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:52.471282 14888 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.473198 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.474334 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.475380 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.475574 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.475867 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.476634 14894 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:52.477149 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:52.394791 21728 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.469159 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "156c010162bf4cb99b535677eccb2740"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:52.477874 14890 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:52.478176 14886 raft_consensus.cc:606] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:52.448761 21630 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:52.465369 15039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.008s	sys 0.022s
W20260709 13:07:52.484380 15039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.009s	sys 0.022s
I20260709 13:07:52.478629 14887 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:07:52.459786 21933 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.430816 21786 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.491143 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.440562 21561 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 13:07:52.497186 14888 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:52.478607 15008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.013s	sys 0.019s
I20260709 13:07:52.481492 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:52.498835 15008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.013s	sys 0.019s
I20260709 13:07:52.481168 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:52.499274 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 609424us
I20260709 13:07:52.499064 14892 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
W20260709 13:07:52.476621 15010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.016s	sys 0.014s
I20260709 13:07:52.478636 14886 raft_consensus.cc:614] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:52.486416 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:52.423110 21679 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.482702 21687 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.477337 21840 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:52.538079 21631 consensus_queue.cc:260] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.487993 21630 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:52.514801 21941 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260709 13:07:52.569427 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.517056 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:52.517948 21682 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:07:52.519522 21561 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 13:07:52.522245 21948 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:52.491357 21874 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:52.523598 21772 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:52.524631 14886 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "376f02b12a354291b7600c9c176e3885"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:52.587639 14886 raft_consensus.cc:606] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:52.588019 14886 raft_consensus.cc:614] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:52.506505 21701 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:52.531217 21820 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.536859 21679 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.459589 21635 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.512576 14895 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:07:52.508453 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 608528us
W20260709 13:07:52.593822 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 202663us
I20260709 13:07:52.476980 21946 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:52.550472 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 117622us
I20260709 13:07:52.595412 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.568369 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:52.517165 21951 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:52.454378 21944 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.571153 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.572160 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.594426 15010 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:52.574349 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.497473 21918 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.603507 14963 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:07:52.577153 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.491482 21954 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:52.469964 21934 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.604141 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.580946 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:52.581173 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64258.4us
I20260709 13:07:52.666321 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.480701 21700 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.487370 21721 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260709 13:07:52.487753 21801 consensus_queue.cc:1048] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.081s
I20260709 13:07:52.582433 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:52.674611 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 92258.8us
I20260709 13:07:52.676163 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.574277 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.539456 21631 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:52.589327 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.573961 21791 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:52.600844 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.680317 14969 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:52.682018 14969 pending_rounds.cc:85] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 7
I20260709 13:07:52.682325 14969 pending_rounds.cc:107] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:07:52.601666 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.577615 21561 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.602944 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.604408 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.604635 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.580395 21933 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:52.606010 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.587461 21772 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.607780 15040 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:52.602873 21938 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:52.589833 21840 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:52.591509 21701 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:52.650487 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.698704 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.651924 21939 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:52.652190 21632 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.703773 21632 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.652693 15035 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:52.653327 14961 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
W20260709 13:07:52.706044 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 55772.6us
I20260709 13:07:52.684233 21838 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:52.659926 21835 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:52.660691 21947 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 13:07:52.660924 21820 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.649137 21615 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.723868 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.591053 21945 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:52.701700 21701 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.682578 14969 raft_consensus.cc:2889] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.685351 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:52.664132 21723 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.645s	user 0.005s	sys 0.006s
I20260709 13:07:52.648994 21918 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.664260 21874 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:52.663937 21719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34356 (request call id 16) took 10729 ms. Trace:
I20260709 13:07:52.701200 15008 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:52.673715 21946 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:52.702662 21939 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.657009 21689 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:07:52.695580 21955 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 13:07:52.710242 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.658675 21830 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:52.694418 21900 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:52.696568 21929 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:52.696473 21972 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.722450 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.670001 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:52.725891 14970 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:52.726002 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.748144 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:52.711956 21835 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.703791 21786 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.736199 21945 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.753041 21918 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.737164 21772 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.754292 21772 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:52.754942 21945 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.728685 21632 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.729261 21615 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.759202 21972 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.762073 21972 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.764813 21946 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:52.765268 21946 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:52.765637 21946 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:52.742874 21934 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:52.744388 21728 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:52.729947 21845 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.517s	user 0.007s	sys 0.003s
I20260709 13:07:52.705711 21840 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.731845 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:52.694963 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 89035.5us
I20260709 13:07:52.772670 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:52.774013 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 104108us
W20260709 13:07:52.736315 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51075.6us
I20260709 13:07:52.713346 21869 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.693207 21791 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.701496 21938 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.695746 21933 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.752184 21835 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.737588 21846 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:52.736800 21971 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:52.775177 21845 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:52.740070 21838 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:07:52.794183 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.794113 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.746022 21874 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:52.768970 14970 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:52.733027 21561 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.819491 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:52.817731 14970 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.817732 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.805281 21728 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:52.825734 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 114683us
I20260709 13:07:52.822713 15037 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 11.
I20260709 13:07:52.799878 21972 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:07:52.816706 21936 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.222s	user 0.001s	sys 0.001s
I20260709 13:07:52.829300 14891 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:52.831341 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:52.832500 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:52.833109 14890 raft_consensus.cc:606] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:52.820830 14970 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.835342 14970 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:52.819222 21635 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:52.816938 21961 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:52.825958 21846 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:52.808313 21682 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:52.817258 21835 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:52.834666 21845 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:52.834549 21766 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:52.864961 14970 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 13:07:52.866616 14970 pending_rounds.cc:85] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 10
I20260709 13:07:52.866925 14970 pending_rounds.cc:107] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:07:52.867297 14970 raft_consensus.cc:2889] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.868746 14970 pending_rounds.cc:107] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 13:07:52.869314 14970 raft_consensus.cc:2889] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.816210 21971 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.873574 21939 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:52.852391 21700 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.875883 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.896427 14970 raft_consensus.cc:2393] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:52.897415 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.898383 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.870074 21845 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.901450 21845 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.899377 14963 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:52.737023 21719 rpcz_store.cc:276] 0709 13:07:41.876496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:41.876641 (+   145us) service_pool.cc:224] Handling call
0709 13:07:41.968620 (+ 91979us) log.cc:844] Serialized 494 byte log entry
0709 13:07:42.316648 (+348028us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18003f67c0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f5534ccfb0b 00007f5534d54b63 00007f5534d7c752 00007f5534d749fa
0709 13:07:52.599494 (+10282846us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":514160,"raft.queue_time_us":213565,"raft.run_cpu_time_us":18397,"raft.run_wall_time_us":96231,"spinlock_wait_cycles":3670400,"thread_start_us":100084,"threads_started":1,"wal-append.queue_time_us":95724,"wal-append.run_cpu_time_us":1757,"wal-append.run_wall_time_us":1003301}
I20260709 13:07:52.903177 21933 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.903507 21791 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.903141 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.883869 21978 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:07:52.885064 21938 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.886346 21971 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.904028 21874 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.859979 21961 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:52.905004 21961 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:52.905036 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.906165 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.853672 21972 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.907087 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:52.833655 21728 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.910899 14963 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:52.870627 21840 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.912415 21728 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.868703 21838 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.913146 21838 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.876742 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:52.915040 21838 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:52.902081 21747 consensus_meta.cc:287] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.578s	user 0.004s	sys 0.004s
I20260709 13:07:52.916786 15038 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260709 13:07:52.917019 14961 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:52.917202 15038 pending_rounds.cc:85] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 9
I20260709 13:07:52.917570 15038 pending_rounds.cc:107] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260709 13:07:52.917860 15038 raft_consensus.cc:2889] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:52.890384 21630 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.882200 21701 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:52.932976 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:52.895579 21963 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:07:52.953981 21978 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:07:52.957412 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:52.946808 21706 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:52.958778 21978 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.969281 21946 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:52.971092 21958 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.447s	user 0.001s	sys 0.002s
I20260709 13:07:52.961755 21706 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:52.972353 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1768) took 1639 ms. Trace:
I20260709 13:07:52.972476 21706 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.973176 21701 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.973572 21706 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:52.960289 21972 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.972713 15547 rpcz_store.cc:276] 0709 13:07:51.332901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.484245 (+151344us) service_pool.cc:224] Handling call
0709 13:07:51.520490 (+ 36245us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.945181 (+424691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.945226 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.947047 (+  1821us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.479675 (+532628us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.479712 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.479771 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.970585 (+490814us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:52.972059 (+  1474us) raft_consensus.cc:1685] finished
0709 13:07:52.972078 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:52.972292 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5000,"raft.queue_time_us":320938,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":11070,"spinlock_wait_cycles":59440000,"thread_start_us":879050,"threads_started":2,"wal-append.queue_time_us":563009}
W20260709 13:07:52.975835 21952 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.460s	user 0.000s	sys 0.003s
I20260709 13:07:52.964352 21630 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.977653 21961 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:52.978680 21946 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:52.978888 21944 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:52.982165 21961 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:52.982682 21950 log.cc:927] Time spent T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.447s	user 0.003s	sys 0.000s
I20260709 13:07:52.983716 21932 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:52.984226 21932 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:52.972618 21956 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.233s	user 0.000s	sys 0.002s
W20260709 13:07:52.995293 21965 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
I20260709 13:07:52.995478 21932 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:53.000146 21968 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.292s	user 0.002s	sys 0.000s
W20260709 13:07:53.002718 21960 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.487s	user 0.001s	sys 0.002s
I20260709 13:07:53.004513 21978 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:53.005898 21978 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.069976 14888 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:53.070423 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.073454 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.074915 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.075718 14777 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8fa9dae6116418f8b520fc591ae5757 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:07:53.076422 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.078141 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.079253 14887 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:53.080314 14887 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "25b8f0cc46f748468395543b8b174bf4"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:53.081192 14887 raft_consensus.cc:606] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Received request to transfer leadership to TS 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:53.081668 14887 raft_consensus.cc:614] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.086050 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1555) took 1240 ms. Trace:
I20260709 13:07:53.087606 14890 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574"
dest_uuid: "e4938453819c469599f515b22d92fe27"
mode: GRACEFUL
new_leader_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:55532
I20260709 13:07:53.086598 14893 rpcz_store.cc:276] 0709 13:07:51.844984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.919130 (+ 74146us) service_pool.cc:224] Handling call
0709 13:07:51.942064 (+ 22934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.942492 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.942533 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.957304 (+ 14771us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.402409 (+445105us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:52.402466 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.402554 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.994687 (+592133us) spinlock_profiling.cc:243] Waited 8.71 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:53.085330 (+ 90643us) raft_consensus.cc:1685] finished
0709 13:07:53.085367 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.085821 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":128,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":7211,"spinlock_wait_cycles":20029312,"thread_start_us":335008,"threads_started":1,"wal-append.queue_time_us":504128}
I20260709 13:07:53.089210 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.090374 14887 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:53.095217 14887 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: [12.11-16.12]
I20260709 13:07:53.102674 14887 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:53.121264 14961 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
W20260709 13:07:53.124891 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 253831us
I20260709 13:07:53.127243 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:53.128208 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:53.129825 14961 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:53.131578 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:53.139209 14963 raft_consensus.cc:2410] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:07:53.140731 14969 raft_consensus.cc:2955] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:53.146510 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.147517 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:53.148772 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.147339 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:53.151902 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 3186) took 1846 ms. Trace:
I20260709 13:07:53.153812 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3723) took 1302 ms. Trace:
I20260709 13:07:53.152390 15039 rpcz_store.cc:276] 0709 13:07:51.304919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.305291 (+   372us) service_pool.cc:224] Handling call
0709 13:07:51.322576 (+ 17285us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:07:51.817668 (+495092us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:51.847997 (+ 30329us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.487230 (+639233us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:07:52.580654 (+ 93424us) log.cc:844] Serialized 608 byte log entry
0709 13:07:52.580813 (+   159us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:52.580845 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.580903 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.151173 (+570270us) raft_consensus.cc:1685] finished
0709 13:07:53.151215 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.151626 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2471,"prepare.queue_time_us":7711,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":214455,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":16385,"thread_start_us":1082051,"threads_started":2,"wal-append.queue_time_us":856159}
I20260709 13:07:53.155336 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:53.156085 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:53.156975 15040 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:53.158301 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:53.139045 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3754) took 1391 ms. Trace:
I20260709 13:07:53.159650 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:53.160068 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:53.160583 14887 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.154199 15042 rpcz_store.cc:276] 0709 13:07:51.850969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.851074 (+   105us) service_pool.cc:224] Handling call
0709 13:07:51.851371 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.851681 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.851704 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.855014 (+  3310us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.325359 (+470345us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:52.351004 (+ 25645us) log.cc:844] Serialized 14 byte log entry
0709 13:07:52.351278 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.351377 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.888117 (+536740us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b18003acd80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c89522 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:07:52.981394 (+ 93277us) spinlock_profiling.cc:243] Waited 32.2 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:53.153269 (+171875us) raft_consensus.cc:1685] finished
0709 13:07:53.153308 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.153611 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8734,"prepare.queue_time_us":25437,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":14104,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":30849,"spinlock_wait_cycles":86049920,"thread_start_us":466659,"threads_started":1,"wal-append.queue_time_us":647949}
I20260709 13:07:53.146399 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:53.162362 14963 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:53.161191 15036 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:53.163681 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:53.166174 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:53.170183 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:53.171247 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:53.159932 14967 rpcz_store.cc:276] 0709 13:07:51.747905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:51.748523 (+   618us) service_pool.cc:224] Handling call
0709 13:07:51.748869 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:51.966840 (+217971us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:51.966870 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:51.967290 (+   420us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.357373 (+390083us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:52.357426 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.357513 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:52.972365 (+614852us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b24002a63c8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531b0f9c4 00007f5531b0dacb 00007f5531cc8dc9 00007f5531cc8a55 00007f5531cc809d 00007f55348fa10e 00007f553491188c 00007f5534910bb6 00007f55349107d8 00007f553491a221
0709 13:07:53.138424 (+166059us) raft_consensus.cc:1685] finished
0709 13:07:53.138474 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.138873 (+   399us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133790,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":6922,"spinlock_wait_cycles":6095232,"thread_start_us":607270,"threads_started":2,"wal-append.queue_time_us":745172}
I20260709 13:07:53.190249 15548 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:53.191342 15547 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: [12.11-16.12]
I20260709 13:07:53.194231 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1773) took 1050 ms. Trace:
I20260709 13:07:53.196398 15550 rpcz_store.cc:276] 0709 13:07:52.143765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.143938 (+   173us) service_pool.cc:224] Handling call
0709 13:07:52.144356 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.144669 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:52.144706 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.145234 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.469421 (+324187us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:52.469455 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:52.469522 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.002186 (+532664us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:53.191568 (+189382us) raft_consensus.cc:1685] finished
0709 13:07:53.191627 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.193999 (+  2372us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125499776,"thread_start_us":323872,"threads_started":1,"wal-append.queue_time_us":370476}
I20260709 13:07:53.197631 21845 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:53.200119 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.202292 21900 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:53.202786 21900 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:53.203193 21900 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:53.204150 21806 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:53.204970 21806 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:53.205346 21806 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:53.205708 21806 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:53.208272 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:53.209787 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:53.210289 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.213805 21579 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:53.214639 21579 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.215101 21938 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:53.217710 21689 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:53.237841 21629 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.228258 21689 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:53.237957 21942 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.238148 14970 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:07:53.252661 21635 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.253302 21786 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:53.254645 21635 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.257287 21630 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.258329 21723 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:53.259115 21723 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:53.260746 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 676293us
W20260709 13:07:53.261420 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.261905 21723 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:53.258502 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.258049 21630 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.255359 21786 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.265506 21630 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:53.246140 21689 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:53.282548 14887 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:53.258059 21635 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:53.292675 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:53.293471 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 122577us
I20260709 13:07:53.294476 21881 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:53.295344 21881 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.295717 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:53.297456 21615 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:53.298429 21615 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:53.299165 21579 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:53.233237 21706 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.073s
I20260709 13:07:53.301265 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:53.301397 21723 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:07:53.301787 21706 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:53.302214 14888 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:53.302403 21706 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:53.306908 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:53.310129 15549 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:07:53.310869 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 331) took 9555 ms. Trace:
I20260709 13:07:53.311306 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.312618 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.313835 21881 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:53.314311 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.334602 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:53.335136 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64693.5us
I20260709 13:07:53.318174 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.340392 15545 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 23.
I20260709 13:07:53.287923 21629 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:53.355931 15543 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
W20260709 13:07:53.357074 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50272.7us
I20260709 13:07:53.358441 21629 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:53.356053 15541 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:53.355973 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:53.364360 14859 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:53.384909 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.385793 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:53.385983 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 235094us
I20260709 13:07:53.387476 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:53.387080 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:53.385803 14889 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:07:53.334971 21942 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:53.404955 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64138.4us
W20260709 13:07:53.409456 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 166649us
I20260709 13:07:53.386137 21786 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:53.393117 21881 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:53.397324 21742 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:53.479552 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.484269 14890 raft_consensus.cc:606] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Received request to transfer leadership to TS 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:53.494295 14890 raft_consensus.cc:614] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:07:53.463450 21630 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:07:53.502424 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:53.318836 14791 rpcz_store.cc:276] 0709 13:07:43.754905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.755188 (+   283us) service_pool.cc:224] Handling call
0709 13:07:53.310610 (+9555422us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:51.060105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:51.060894 (+   789us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:51.060942 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:07:51.060971 (+    29us) tablet.cc:662] Decoding operations
0709 13:07:51.062376 (+  1405us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:51.062452 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:51.062512 (+    60us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:51.283633 (+221121us) tablet.cc:701] Row locks acquired
0709 13:07:51.285185 (+  1552us) write_op.cc:260] PREPARE: finished
0709 13:07:51.289053 (+  3868us) write_op.cc:270] Start()
0709 13:07:51.289202 (+   149us) write_op.cc:276] Timestamp: P: 1783602471288996 usec, L: 0
0709 13:07:51.289232 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 13:07:51.290027 (+   795us) log.cc:844] Serialized 4749 byte log entry
0709 13:07:52.762947 (+1472920us) op_driver.cc:464] REPLICATION: finished
0709 13:07:52.877160 (+114213us) write_op.cc:301] APPLY: starting
0709 13:07:52.877242 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:52.884640 (+  7398us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:52.884740 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:52.892297 (+  7557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:52.892945 (+   648us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:07:52.892988 (+    43us) write_op.cc:312] APPLY: finished
0709 13:07:52.893261 (+   273us) log.cc:844] Serialized 113 byte log entry
0709 13:07:52.894030 (+   769us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.894162 (+   132us) write_op.cc:454] Released schema lock
0709 13:07:52.894211 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:52.894608 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:52.894636 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":33485,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":113973,"apply.run_cpu_time_us":16176,"apply.run_wall_time_us":17431,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":526705,"prepare.run_cpu_time_us":26125,"prepare.run_wall_time_us":772722,"raft.queue_time_us":573330,"raft.run_cpu_time_us":18666,"raft.run_wall_time_us":99668,"replication_time_us":1473552,"thread_start_us":1139896,"threads_started":4,"wal-append.queue_time_us":861268}]]}
I20260709 13:07:53.420806 21706 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:53.557360 14889 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:07:53.563568 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 220416us
I20260709 13:07:53.563716 21679 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:53.564543 21679 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:53.565631 21742 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:53.567692 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:53.502629 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:53.502961 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:53.570405 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.504920 21772 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:07:53.587069 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 144498us
I20260709 13:07:53.584642 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:53.566951 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:53.504941 21937 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:53.603597 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:53.494751 21786 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:53.504820 21766 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:53.618886 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:53.619540 21846 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:53.621465 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:53.623534 21970 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
W20260709 13:07:53.624326 22000 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
I20260709 13:07:53.661006 21742 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:53.661342 21994 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:53.662298 21942 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:53.506052 21961 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:53.672560 21706 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:53.603544 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:53.677042 21900 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.593326 21772 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:53.678928 22003 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:07:53.681583 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.683655 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:53.684213 21937 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:53.685804 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:53.687124 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3757) took 1103 ms. Trace:
I20260709 13:07:53.605058 21723 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:53.688138 21929 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:53.689138 21687 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.109s
I20260709 13:07:53.552065 21630 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:53.701402 14886 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:07:53.687230 21999 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.303s	user 0.000s	sys 0.004s
W20260709 13:07:53.710759 14969 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.004s
I20260709 13:07:53.712146 14963 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:53.712852 21953 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:07:53.716481 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3756) took 1133 ms. Trace:
I20260709 13:07:53.717101 21719 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:53.720782 21938 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:54.239075 15541 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:53.592466 21679 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:54.023890 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 434966us
I20260709 13:07:54.099825 21561 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:54.100685 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3416) took 1270 ms. Trace:
I20260709 13:07:54.101200 21728 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:54.285820 21938 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:54.286438 21938 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.287518 21926 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.288285 21926 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.288805 21927 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.289408 21942 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.289537 21927 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.290022 21942 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.290988 21926 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.293026 21926 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:54.293866 21926 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.264230 15041 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:53.811570 21846 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:53.833526 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.169660 15038 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:54.215766 15543 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
W20260709 13:07:53.746846 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.237190 21900 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.237389 21937 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.237643 21629 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.202020 14966 rpcz_store.cc:276] 0709 13:07:52.583248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.696522 (+113274us) service_pool.cc:224] Handling call
0709 13:07:52.699474 (+  2952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:52.755586 (+ 56112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.755614 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:52.755653 (+    39us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:52.755682 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.686680 (+930998us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b54003e6f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:53.686734 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.686942 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128624896}
W20260709 13:07:54.242853 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 671122us
W20260709 13:07:54.237809 21934 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.079s	sys 0.117s
I20260709 13:07:54.276443 21987 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:54.276770 21929 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.277465 21687 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:54.237933 21932 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:54.238306 14962 rpcz_store.cc:276] 0709 13:07:52.582876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.695987 (+113111us) service_pool.cc:224] Handling call
0709 13:07:52.696301 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.762891 (+ 66590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.762925 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.763399 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 13:07:52.825214 (+ 61815us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:52.825269 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.715915 (+890646us) spinlock_profiling.cc:243] Waited 66.2 ms on lock 0x7b540031b354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:53.715972 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:53.716027 (+    55us) raft_consensus.cc:1685] finished
0709 13:07:53.716040 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:53.716325 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6612,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9961,"spinlock_wait_cycles":152331008,"thread_start_us":60984,"threads_started":1,"wal-append.queue_time_us":132447,"wal-append.run_cpu_time_us":13563,"wal-append.run_wall_time_us":1278995}
I20260709 13:07:54.238533 21630 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:54.238133 21917 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.284204 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3413) took 1454 ms. Trace:
I20260709 13:07:54.269444 14892 rpcz_store.cc:276] 0709 13:07:52.830093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.830201 (+   108us) service_pool.cc:224] Handling call
0709 13:07:52.830449 (+   248us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.830775 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.830799 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.831284 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.233242 (+401958us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:53.233329 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.233401 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.100347 (+866946us) raft_consensus.cc:1685] finished
0709 13:07:54.100374 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.100518 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3194,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":12225,"thread_start_us":320494,"threads_started":1,"wal-append.queue_time_us":400694}
I20260709 13:07:54.107125 14788 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 18 to 21, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.288739 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:54.393306 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.024s	sys 0.038s
I20260709 13:07:54.264480 21723 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.291714 21874 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.438660 21874 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.292026 21942 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:54.292232 21953 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:07:54.158468 14888 consensus_meta.cc:287] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.856s	user 0.008s	sys 0.008s
I20260709 13:07:54.464728 14888 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:53.504880 21838 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:54.235774 21994 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:54.133935 21689 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.811s	user 0.009s	sys 0.000s
W20260709 13:07:54.300601 14887 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.008s	sys 0.024s
W20260709 13:07:54.478965 14887 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.009s	sys 0.024s
I20260709 13:07:54.178768 21615 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:07:54.478994 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 912112us
I20260709 13:07:54.201269 21772 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:07:54.357899 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.370231 14886 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:07:54.264240 21719 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:54.364717 21934 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.079s	sys 0.118s
I20260709 13:07:54.416281 21926 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.415977 21987 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.416460 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:54.403486 21937 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:54.417240 21629 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.418946 21927 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.421715 14964 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:54.424044 21917 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.426307 14788 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 17 to 20, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.427712 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:54.430414 21933 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.022s
W20260709 13:07:54.430796 14860 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.016s	sys 0.024s
I20260709 13:07:54.435680 21932 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:54.435819 21737 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:54.438027 21846 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.473344 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4287) took 1281 ms. Trace:
I20260709 13:07:54.380441 21938 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.380251 21687 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:54.394377 14895 rpcz_store.cc:276] 0709 13:07:52.829221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.829448 (+   227us) service_pool.cc:224] Handling call
0709 13:07:52.849921 (+ 20473us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:52.850275 (+   354us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.850303 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:52.859650 (+  9347us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.267007 (+407357us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:53.426605 (+159598us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.461574 (+ 34969us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.485285 (+ 23711us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.283858 (+798573us) raft_consensus.cc:1685] finished
0709 13:07:54.283876 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.284020 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":80540,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":19868,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":21693,"spinlock_wait_cycles":24704,"thread_start_us":218387,"threads_started":2,"wal-append.queue_time_us":496464}
I20260709 13:07:54.485978 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4286) took 1302 ms. Trace:
W20260709 13:07:54.395630 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.025s	sys 0.038s
I20260709 13:07:54.493357 14890 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: [22.14-22.14]
I20260709 13:07:54.506963 21874 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.333984 21786 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.253105 21961 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.529062 14892 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:54.533291 14886 rpcz_store.cc:276] 0709 13:07:53.183657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.366695 (+183038us) service_pool.cc:224] Handling call
0709 13:07:54.485915 (+1119220us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.502684 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:54.520423 14860 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.016s	sys 0.024s
W20260709 13:07:54.508126 21806 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.302s	user 0.009s	sys 0.006s
I20260709 13:07:54.526540 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:07:54.495595 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 47928.6us
I20260709 13:07:54.530314 14888 rpcz_store.cc:276] 0709 13:07:53.184028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.300928 (+116900us) service_pool.cc:224] Handling call
0709 13:07:54.465184 (+1164256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:07:54.569065 15513 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:54.493690 21689 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:54.538569 21845 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.340s	user 0.011s	sys 0.011s
W20260709 13:07:54.532342 22015 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:07:54.605607 14895 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 13:07:54.584690 14788 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.585548 21719 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.586057 21737 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.567765 21806 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.588058 21932 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.589634 21987 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.590339 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.591146 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.591722 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:54.592352 21994 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.592542 21723 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.516460 21615 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.531232 21926 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.594606 21917 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.596203 21629 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.577970 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:54.615867 21845 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:54.616808 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:54.658159 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 80275us
I20260709 13:07:54.610212 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.622153 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:54.616089 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 64539.8us
I20260709 13:07:54.629420 14967 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:54.631835 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.533011 21953 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.579464 21874 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:54.640383 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:54.640506 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3426) took 1075 ms. Trace:
I20260709 13:07:54.602267 21561 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.604905 21933 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.644052 21900 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:54.651476 21737 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.651901 21830 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:54.653380 21806 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:54.653738 22017 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:07:54.610158 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:54.586895 21687 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:54.664094 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:54.630175 21938 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:54.629946 21846 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:54.666586 14886 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:07:54.568518 21937 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.672183 21615 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.671663 21719 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Committing config change with OpId 14.12: config changed from index 10 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:54.676551 21929 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.676994 21926 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.678158 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.678817 21689 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:54.528813 21838 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.679464 14895 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:54.680099 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3766) took 1557 ms. Trace:
I20260709 13:07:54.667510 14788 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 12 to 14, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 14 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.666198 14890 rpcz_store.cc:276] 0709 13:07:53.565271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.749293 (+184022us) service_pool.cc:224] Handling call
0709 13:07:54.486320 (+737027us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.533668 (+ 47348us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.638909 (+105241us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54000ae1d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:54.640443 (+  1534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1559487872}
I20260709 13:07:54.689186 14967 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:54.768887 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.698597 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:54.770359 14970 raft_consensus.cc:2376] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22. Re-sending same reply.
W20260709 13:07:54.708113 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50165.3us
I20260709 13:07:54.731875 14892 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:54.745553 14962 raft_consensus.cc:2368] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19.
I20260709 13:07:54.745020 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:54.708029 21737 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:54.777192 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:54.757965 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:54.703341 21830 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.706012 21728 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:54.728593 21900 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:54.783499 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.798112 14967 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:07:54.767817 14966 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
W20260709 13:07:54.789762 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 288252us
I20260709 13:07:54.766284 14961 rpcz_store.cc:276] 0709 13:07:53.122503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.177990 (+ 55487us) service_pool.cc:224] Handling call
0709 13:07:53.220608 (+ 42618us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.351562 (+130954us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.351614 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.428431 (+ 76817us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.496884 (+ 68453us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:53.497408 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.497883 (+   475us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.679903 (+1182020us) raft_consensus.cc:1685] finished
0709 13:07:54.679922 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.680048 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13072,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":16320,"thread_start_us":66590,"threads_started":1,"wal-append.queue_time_us":1215502}
I20260709 13:07:54.791764 14965 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:54.796135 14788 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:07:54.805182 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.034s	sys 0.036s
W20260709 13:07:54.808350 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.034s	sys 0.036s
I20260709 13:07:54.736994 21933 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.820976 21933 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.822425 21926 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.812388 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:54.825686 14886 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:54.762639 21706 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.727612 21561 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.834681 14894 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:54.843870 14963 raft_consensus.cc:2410] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 13:07:54.845955 21838 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.847524 21953 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.790410 21687 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:54.756989 21938 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.853138 21938 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.749928 21874 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.854111 21900 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.855782 21874 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.857566 21937 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:54.862481 21561 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:54.865186 21630 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.866225 14892 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 18. Preceding OpId from leader: term: 24 index: 20. (index mismatch)
I20260709 13:07:54.743321 21845 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:07:54.867138 21786 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.868052 14788 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 17 to 18, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 18 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.869649 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:07:54.870322 14970 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 18. Preceding OpId from leader: term: 22 index: 18. (term mismatch)
I20260709 13:07:54.784169 21737 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:54.874248 14970 pending_rounds.cc:85] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 17
I20260709 13:07:54.792083 21806 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:54.872596 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:54.804266 21830 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:54.767518 21846 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.890125 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4276) took 1835 ms. Trace:
I20260709 13:07:54.876099 14970 pending_rounds.cc:107] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 21.18
I20260709 13:07:54.899441 14970 raft_consensus.cc:2889] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:54.874606 21933 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.899066 14893 rpcz_store.cc:276] 0709 13:07:53.054492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.091823 (+ 37331us) service_pool.cc:224] Handling call
0709 13:07:53.092336 (+   513us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.093122 (+   786us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:07:53.243166 (+150044us) log.cc:844] Serialized 14 byte log entry
0709 13:07:53.498375 (+255209us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.508035 (+  9660us) log.cc:844] Serialized 26 byte log entry
0709 13:07:53.508792 (+   757us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:53.508943 (+   151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:53.509191 (+   248us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:54.889894 (+1380703us) raft_consensus.cc:1685] finished
0709 13:07:54.889918 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:54.890064 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9018,"prepare.queue_time_us":263343,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":99704,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":34726,"thread_start_us":308390,"threads_started":2,"wal-append.queue_time_us":433427}
I20260709 13:07:54.879235 21737 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:54.912586 14788 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 14 to 15, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 15 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.889286 21994 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.879983 21806 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:54.915120 14788 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 14 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 15 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.915748 21994 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.914763 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:07:54.927085 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:07:54.923681 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 148221us
I20260709 13:07:54.901938 21929 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.898388 21938 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:54.940423 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:54.940349 14966 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:54.941100 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.882678 21728 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.921844 21806 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:54.951468 14961 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:54.947547 14788 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 14 to 16, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.956980 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:54.957459 15007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.011s	sys 0.015s
W20260709 13:07:54.958323 15007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.012s	sys 0.015s
I20260709 13:07:54.911535 21706 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:54.960155 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.961555 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:54.964695 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 546935us
W20260709 13:07:54.963135 21766 consensus_meta.cc:287] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.020s	user 0.010s	sys 0.002s
I20260709 13:07:54.970429 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.970537 14788 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 12 to 15, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 15 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.940305 21933 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.951098 21938 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.979580 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.980360 14970 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:54.947656 21929 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:54.982704 14966 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:54.998772 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:54.994063 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:54.985595 22023 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 13:07:54.978542 14788 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 16 to 17, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:54.974432 21766 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:54.999166 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:55.027837 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:54.995919 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:54.962733 21838 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:55.028573 15038 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:54.994436 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:55.008234 22013 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.650s	user 0.000s	sys 0.003s
I20260709 13:07:55.008968 14933 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:54.988821 22022 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 13:07:54.997797 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:54.991621 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:54.997419 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:54.988796 21630 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.991245 21772 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:54.990027 21561 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:54.992901 21706 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:54.988235 21728 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.015487 22018 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:54.990290 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4288) took 1806 ms. Trace:
I20260709 13:07:55.020252 21846 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.031100 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.057339 14968 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:55.057025 14894 rpcz_store.cc:276] 0709 13:07:53.184320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.713266 (+528946us) service_pool.cc:224] Handling call
0709 13:07:53.713553 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.835156 (+1121603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.989993 (+154837us) spinlock_profiling.cc:243] Waited 991 ms on lock 0x7b540024e5d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:54.990220 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2278859648}
I20260709 13:07:55.029665 15041 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.028059 15040 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:55.048367 21838 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.028059 21766 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.052500 14788 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 13 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 15 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:07:55.054045 15545 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
W20260709 13:07:55.004510 14964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 3765) took 2231 ms (client timeout 1603 ms). Trace:
I20260709 13:07:54.981741 21987 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:54.979113 22019 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.062603 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53750.9us
I20260709 13:07:54.988984 22024 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.064670 14964 rpcz_store.cc:269] 0709 13:07:52.772935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.817491 (+ 44556us) service_pool.cc:224] Handling call
0709 13:07:55.004201 (+2186710us) spinlock_profiling.cc:243] Waited 1.6 s on lock 0x7b540031ae54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:55.004409 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3680030592}
I20260709 13:07:55.028134 21881 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:55.070139 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:54.988544 22026 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.080750 15549 raft_consensus.cc:1813] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Handling vote request from an unknown peer eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:55.058339 22018 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.084621 14968 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:55.086406 15549 raft_consensus.cc:2410] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:55.063448 21846 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:55.061378 21937 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:54.988406 22020 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.202s
I20260709 13:07:55.124389 15543 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: []
I20260709 13:07:55.081671 21706 raft_consensus.cc:2804] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:55.146373 15547 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:07:55.085777 14933 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:55.099552 14889 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.024s	sys 0.008s
I20260709 13:07:55.056106 21679 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
W20260709 13:07:55.090169 21554 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.009s	sys 0.009s
W20260709 13:07:55.150686 14936 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.854s	user 0.011s	sys 0.031s
W20260709 13:07:55.162591 14936 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.011s	sys 0.032s
I20260709 13:07:55.081429 21561 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.083107 21961 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.169945 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2894) took 2581 ms. Trace:
I20260709 13:07:55.160002 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.172187 14969 rpcz_store.cc:276] 0709 13:07:52.579799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:52.681120 (+101321us) service_pool.cc:224] Handling call
0709 13:07:52.681669 (+   549us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:52.847656 (+165987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:52.847685 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:52.848985 (+  1300us) log.cc:844] Serialized 520 byte log entry
0709 13:07:53.140072 (+291087us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.226815 (+1086743us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.084732 (+857917us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.085525 (+   793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.154354 (+ 68829us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.156238 (+  1884us) raft_consensus.cc:1685] finished
0709 13:07:55.156258 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.161478 (+  5220us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":51394,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":21692,"thread_start_us":1120650,"threads_started":4,"wal-append.queue_time_us":820927,"wal-append.run_cpu_time_us":6674,"wal-append.run_wall_time_us":1131713}
I20260709 13:07:55.173796 21706 raft_consensus.cc:697] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:55.090219 21987 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.179190 14964 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:55.154397 21629 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:55.189720 21987 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:55.191288 21838 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:55.192145 21706 consensus_queue.cc:237] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.187806 21929 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.180893 21772 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.170140 21561 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.202555 15041 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:55.086422 22018 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:55.071026 21766 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.213689 15545 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 13:07:55.210872 21629 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.214293 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:55.215760 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.219766 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.224642 14964 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:55.145089 21881 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.252396 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.144200 21846 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:55.150017 22024 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:55.231089 22021 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 13:07:55.246173 15545 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:07:55.230027 21561 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:07:55.245730 22025 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:07:55.149909 22019 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:55.285951 15010 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.009s	sys 0.039s
W20260709 13:07:55.286405 15010 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.009s	sys 0.039s
I20260709 13:07:55.288676 21629 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:55.290171 22032 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
W20260709 13:07:55.290802 22005 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 13:07:55.291929 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3427) took 1726 ms. Trace:
I20260709 13:07:55.292424 14891 rpcz_store.cc:276] 0709 13:07:53.565562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.868679 (+303117us) service_pool.cc:224] Handling call
0709 13:07:54.158010 (+289331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:54.397579 (+239569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.397731 (+   152us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:54.471501 (+ 73770us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.903833 (+432332us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:54.903882 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.903962 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.289402 (+385440us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:55.291586 (+  2184us) raft_consensus.cc:1685] finished
0709 13:07:55.291615 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.291856 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84380,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":26050,"spinlock_wait_cycles":27197184,"thread_start_us":384316,"threads_started":1,"wal-append.queue_time_us":465255}
I20260709 13:07:55.149658 22026 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.276221 14969 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:55.268630 21846 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:55.279641 21561 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:55.285039 21933 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.209973 21937 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.237098 21994 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.310796 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:55.308794 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1571) took 2157 ms. Trace:
I20260709 13:07:55.310974 21961 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.334522 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.321225 14889 rpcz_store.cc:276] 0709 13:07:53.151514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.705633 (+554119us) service_pool.cc:224] Handling call
0709 13:07:54.157546 (+451913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.494289 (+336743us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 13:07:54.525034 (+ 30745us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.155851 (+630817us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.155901 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:07:55.155950 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.308470 (+152520us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003d5ed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:55.308526 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.308719 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":37881,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":108,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":10596,"spinlock_wait_cycles":569348864,"thread_start_us":586174,"threads_started":1}
I20260709 13:07:55.339519 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.340579 15547 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:55.325489 21938 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:55.344177 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:55.341699 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.346370 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.349610 14964 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:55.342970 22019 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:55.356817 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.357807 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1566) took 2208 ms. Trace:
I20260709 13:07:55.361063 15545 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:07:55.362282 22031 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.362978 22031 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.352849 21961 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.374136 21961 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:55.379230 22026 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.379537 21561 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.380128 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.381402 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.382007 14961 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:55.385042 21937 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.358307 14887 rpcz_store.cc:276] 0709 13:07:53.149340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:53.664628 (+515288us) service_pool.cc:224] Handling call
0709 13:07:53.665022 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:53.717116 (+ 52094us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:53.717148 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:53.717762 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 13:07:54.479466 (+761704us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:07:54.479509 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:54.479587 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:55.357518 (+877931us) raft_consensus.cc:1685] finished
0709 13:07:55.357548 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.357748 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51525,"raft.queue_time_us":619930,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":761217,"threads_started":1,"wal-append.queue_time_us":978619}
I20260709 13:07:55.406165 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.407936 21838 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.408499 21838 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.410702 21838 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.403970 21961 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.413751 21953 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:55.414065 21961 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.414552 21953 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.392402 22031 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.390528 21994 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.421492 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.423997 14961 raft_consensus.cc:2368] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17.
W20260709 13:07:55.422817 14963 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.013s	sys 0.028s
W20260709 13:07:55.426393 14963 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.014s	sys 0.028s
I20260709 13:07:55.440222 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:55.423250 21927 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.031s
I20260709 13:07:55.441077 14964 raft_consensus.cc:2468] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
W20260709 13:07:55.423658 21900 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.002s	sys 0.040s
I20260709 13:07:55.445089 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:55.447624 15514 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.030s	sys 0.064s
W20260709 13:07:55.448015 15514 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.030s	sys 0.064s
W20260709 13:07:55.448349 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 565740us
W20260709 13:07:55.439982 21737 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.527s	user 0.012s	sys 0.000s
I20260709 13:07:55.462394 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:55.464617 14970 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:07:55.444455 21927 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.010s	sys 0.032s
W20260709 13:07:55.464123 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 446784us
I20260709 13:07:55.424507 21766 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:55.444620 21900 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.003s	sys 0.040s
I20260709 13:07:55.406427 21830 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.466078 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:55.462783 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.473114 15547 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:55.474416 14961 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 23.
I20260709 13:07:55.446095 21937 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.465245 21786 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.483959 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.493266 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.494284 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.494674 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.495774 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.496788 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.497743 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.504128 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.504287 22033 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.507800 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.521744 14964 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:07:55.471043 21737 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:55.527882 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44653.3us
I20260709 13:07:55.423451 21994 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.520223 15549 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 13.
I20260709 13:07:55.531270 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:55.537310 15543 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
W20260709 13:07:55.519467 21806 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.002s
W20260709 13:07:55.549767 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.566781 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.567529 15036 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 13:07:55.572381 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.573629 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.573166 15546 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:55.578292 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.000s	sys 0.025s
W20260709 13:07:55.578720 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.025s
I20260709 13:07:55.531818 21786 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.605639 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.531713 22033 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:55.588047 14935 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.007s	sys 0.009s
W20260709 13:07:55.610743 14935 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.008s	sys 0.009s
W20260709 13:07:55.608470 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.530323 22029 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.098s
W20260709 13:07:55.611649 14858 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.007s	sys 0.030s
I20260709 13:07:55.606393 15548 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:55.613695 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:55.612522 14858 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.008s	sys 0.030s
I20260709 13:07:55.531736 21937 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.620280 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:55.614544 14861 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.000s	sys 0.018s
W20260709 13:07:55.621297 14861 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.000s	sys 0.018s
W20260709 13:07:55.606209 21932 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.012s	sys 0.034s
I20260709 13:07:55.621127 14891 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:55.564842 21806 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.637248 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.638417 15548 raft_consensus.cc:2410] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 24 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 15.
W20260709 13:07:55.647564 14962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.000s	sys 0.019s
W20260709 13:07:55.622829 21932 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.012s	sys 0.034s
W20260709 13:07:55.621627 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 689126us
I20260709 13:07:55.609279 21987 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.654156 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 582161us
I20260709 13:07:55.656138 14966 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:07:55.658778 14962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.001s	sys 0.019s
I20260709 13:07:55.620380 21679 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 13:07:55.646770 21554 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:55.647665 21900 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:55.657960 21719 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.862s	user 0.008s	sys 0.006s
I20260709 13:07:55.673316 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.674101 15543 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:55.645424 21766 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:55.657262 21728 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:55.645938 21846 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.674877 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:55.660890 22020 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:55.672523 21554 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:55.721282 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:55.666860 21987 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.668494 22028 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260709 13:07:55.719040 22019 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:55.742830 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.743669 14966 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:55.673045 21900 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.691710 21766 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.697058 22026 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 13:07:55.746695 15545 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:55.725598 21554 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:55.748167 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 216984us
I20260709 13:07:55.753786 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:55.755445 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.752637 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:55.761067 14970 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 15 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:07:55.754554 15547 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
W20260709 13:07:55.762141 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 92880.4us
I20260709 13:07:55.746928 21994 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.728101 21728 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.726989 22020 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.734637 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:55.784732 22038 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260709 13:07:55.791520 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57050.9us
I20260709 13:07:55.792142 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:55.796675 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:55.798916 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:55.800212 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:55.788504 21932 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:55.812794 22020 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.804270 22045 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:55.813614 14936 connection.cc:256] RPC call timeout handler was delayed by -1.699906661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1532s for a response
W20260709 13:07:55.814082 14936 connection.cc:256] RPC call timeout handler was delayed by -1.327306660999966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:07:55.814498 14936 connection.cc:256] RPC call timeout handler was delayed by -1.2175066609999021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:07:55.814798 22033 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.817333 21881 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.817909 21881 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:07:55.818742 21881 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:07:55.814795 14936 connection.cc:256] RPC call timeout handler was delayed by -1.2175066609999021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2068s for a response
I20260709 13:07:55.802834 21994 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:07:55.820890 21561 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.790889 21806 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.803687 22029 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:55.794314 22024 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.796221 22060 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:55.819371 21937 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:55.823599 22028 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.824995 22026 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.823675 21994 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.836413 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:55.845907 14891 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:55.834714 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:55.846560 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 96354.2us
W20260709 13:07:55.845081 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 231451us
I20260709 13:07:55.829237 22029 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:55.847293 14889 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
W20260709 13:07:55.863265 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 73340.5us
I20260709 13:07:55.863436 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:55.865104 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:55.865792 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:55.866233 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:55.847800 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:55.866605 14889 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:07:55.870214 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:55.833947 21881 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:07:55.864903 22018 consensus_meta.cc:287] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.628s	user 0.010s	sys 0.002s
I20260709 13:07:55.859457 21994 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:55.880035 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:55.881845 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:55.892477 15008 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:55.869025 22024 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:55.896489 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:55.894490 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:55.897166 14894 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:55.899313 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:55.900192 15041 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:55.877374 22033 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:55.893496 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:55.903039 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 267018us
I20260709 13:07:55.881289 22031 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:55.838819 21561 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.907636 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:55.844946 22060 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.895848 21927 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:55.859570 22028 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.896044 21679 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:55.903160 21900 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.913516 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3775) took 1010 ms. Trace:
I20260709 13:07:55.906577 22031 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.872097 22026 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:55.916322 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:55.901495 21937 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:07:55.902443 22033 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:55.905407 21987 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:55.898548 22045 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:55.913755 15043 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:55.907277 22063 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:07:55.904232 21766 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:55.921972 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 121856us
I20260709 13:07:55.896530 21846 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:55.923944 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:55.927343 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 45652.4us
I20260709 13:07:55.894286 22018 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.922735 14963 rpcz_store.cc:276] 0709 13:07:54.902739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.902968 (+   229us) service_pool.cc:224] Handling call
0709 13:07:54.909897 (+  6929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:54.912220 (+  2323us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:07:55.426842 (+514622us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.913097 (+486255us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:55.913147 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:55.913191 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.913334 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:55.913464 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3194,"prepare.queue_time_us":575212,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":34841,"raft.run_wall_time_us":16907,"spinlock_wait_cycles":20020864,"thread_start_us":960671,"threads_started":3,"wal-append.queue_time_us":432073}
I20260709 13:07:56.006387 15040 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:55.917047 14889 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:07:55.929965 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:55.932462 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50706.2us
I20260709 13:07:55.917894 21927 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:55.934990 22043 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 13:07:55.935336 21881 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.936038 22042 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:07:55.939498 22074 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:07:55.945132 22020 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.947677 21845 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:55.950567 22060 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:55.919385 21679 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:55.948257 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:55.948297 22022 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:55.963362 14859 leader_election.cc:400] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17.
I20260709 13:07:55.914935 22024 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:55.966706 22019 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:55.968653 21561 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:55.921530 22029 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:55.925956 22031 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:55.918370 22071 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:07:55.977415 22034 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.440s	user 0.001s	sys 0.002s
I20260709 13:07:55.991963 14891 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:56.000919 14894 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:55.927799 21728 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.011474 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:55.991575 22033 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.013345 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:56.015309 22068 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:07:56.015583 22018 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.016121 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.017647 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.018236 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.018472 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.018887 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.082177 15038 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:56.019955 15514 leader_election.cc:400] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19.
I20260709 13:07:56.021010 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.082929 15514 leader_election.cc:403] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:56.000643 22063 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.020602 21927 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.083451 21881 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:56.085086 21874 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:07:56.087350 22063 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:56.026535 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:56.087782 22024 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.005529 22027 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:56.030011 21961 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:56.023360 21926 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.081704 15042 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 23.
I20260709 13:07:56.091915 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.091741 21926 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:56.092795 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 84869.2us
I20260709 13:07:56.093120 22027 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.032450 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1690) took 1370 ms. Trace:
I20260709 13:07:56.036178 21737 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.035801 21987 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:07:56.051512 21845 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.053368 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:07:56.053344 21786 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.056071 22074 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:56.057405 21830 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:07:56.058466 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 110844us
W20260709 13:07:56.061764 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 133636us
W20260709 13:07:56.064644 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 101510us
I20260709 13:07:56.009876 22045 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.108822 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.050911 21994 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.140281 21994 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.077318 15041 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:56.060469 21766 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:56.083774 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 70533us
W20260709 13:07:56.149041 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50019.4us
I20260709 13:07:56.149312 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:56.044516 22020 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.093123 22060 raft_consensus.cc:3060] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.036473 21953 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.076534 22071 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:56.096596 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 80545.9us
I20260709 13:07:56.098181 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.093912 14962 rpcz_store.cc:276] 0709 13:07:54.662431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:54.792273 (+129842us) service_pool.cc:224] Handling call
0709 13:07:54.870835 (+ 78562us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:54.883489 (+ 12654us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:54.883537 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:54.921666 (+ 38129us) log.cc:844] Serialized 52 byte log entry
0709 13:07:55.659286 (+737620us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:55.665195 (+  5909us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.665853 (+   658us) log.cc:844] Serialized 14 byte log entry
0709 13:07:55.666033 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:55.666228 (+   195us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:56.032071 (+365843us) raft_consensus.cc:1685] finished
0709 13:07:56.032095 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:56.032377 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5514,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":3593,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":8037,"thread_start_us":695476,"threads_started":1,"wal-append.queue_time_us":829334}
I20260709 13:07:56.102522 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.103999 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:56.104558 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.161274 14886 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:07:56.104888 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.106976 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.107538 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.107798 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:56.161887 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 57957.1us
I20260709 13:07:56.108285 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.059479 21679 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:56.101385 21961 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:56.109956 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.110638 21926 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:56.171082 21806 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:56.171399 21961 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:56.180032 21806 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.180639 21806 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:56.110567 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.181838 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.182070 14893 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:07:56.101588 22074 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.076340 22022 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.111809 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.112383 22050 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:56.180745 21961 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.184190 22050 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:56.184818 21961 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.185056 22050 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.186412 22050 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.114959 22045 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.186512 22074 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.186720 21953 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260709 13:07:56.115935 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:56.118860 15038 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:56.187642 14778 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 71755.4us
I20260709 13:07:56.188341 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.189112 15038 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:56.189947 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.190670 15038 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:56.191495 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.191692 22045 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.192138 15038 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:56.192233 22045 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.121240 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.194382 22045 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.197860 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.183804 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:56.198905 15038 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 25 because replica has last-logged OpId of term: 23 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 18.
I20260709 13:07:56.126616 22029 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.171239 22018 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.199806 22018 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:56.200326 22018 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.126927 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.127643 21629 raft_consensus.cc:1064] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:07:56.128142 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.203770 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.205072 21629 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.206254 22020 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.207001 21881 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:56.200297 15010 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.213997 15010 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:56.214231 14886 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:07:56.126104 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.102041 22026 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.134732 22028 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:56.224498 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 121074us
I20260709 13:07:56.135345 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.226307 14963 raft_consensus.cc:1813] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Handling vote request from an unknown peer eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.227123 14963 raft_consensus.cc:2410] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:07:56.138046 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.095150 22027 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:56.022363 21554 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.141010 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.144260 22062 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:56.233632 14966 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:56.149793 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.151312 21766 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.151583 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.153038 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.151029 15035 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:56.155763 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.100410 22081 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.163126 14890 raft_consensus.cc:2410] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
W20260709 13:07:56.163522 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56620.5us
I20260709 13:07:56.162448 14889 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:56.168323 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.159128 22024 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.163825 14933 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:56.171783 14894 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
W20260709 13:07:56.174247 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 79051.4us
I20260709 13:07:56.163515 22071 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.252187 22062 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:56.178174 22060 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19.
I20260709 13:07:56.252120 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.253369 14889 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:56.253695 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:56.113674 22065 log.cc:927] Time spent T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
I20260709 13:07:56.198884 21961 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.174875 21994 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:07:56.118410 21845 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.256489 21881 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:07:56.257179 21881 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:07:56.134136 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.259997 15039 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:07:56.260706 21554 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:56.230356 21737 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.261756 21737 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:56.262110 21737 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.217330 22022 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.265203 21961 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:56.218029 21927 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:56.219045 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53296.3us
I20260709 13:07:56.220881 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:07:56.267940 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 47102.3us
I20260709 13:07:56.268237 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.269145 21927 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.235011 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.147032 21786 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:07:56.239135 15041 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
W20260709 13:07:56.242851 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79120.6us
I20260709 13:07:56.250200 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.240167 21766 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.250725 14890 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:07:56.242519 22024 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:56.279459 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:07:56.251497 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95843.4us
I20260709 13:07:56.251609 22028 raft_consensus.cc:2804] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:56.239102 14965 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:56.240453 14892 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:07:56.252331 22029 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:56.183238 21874 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 13:07:56.132766 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.269552 22080 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:56.233729 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:56.302150 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.302646 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.240731 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.230566 21838 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.277153 14887 raft_consensus.cc:1275] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:56.280275 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:56.281607 15040 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 20. Current term is 21. Ops: []
W20260709 13:07:56.281070 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 126811us
I20260709 13:07:56.277906 21961 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:56.351460 21679 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.293402 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.352695 15541 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:56.353883 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.354151 21838 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:56.354559 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 20 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.293676 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.294198 14964 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:56.294664 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.356107 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.237062 21719 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:56.356617 15043 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: []
W20260709 13:07:56.303877 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63233.6us
W20260709 13:07:56.311831 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.357456 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.357429 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.318742 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.211277 22018 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.312520 14895 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 24: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:56.312391 22075 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:56.313633 15041 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:07:56.314569 15543 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 10 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:56.315901 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.363210 14892 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:56.282141 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.364081 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.319157 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.364928 15548 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:07:56.318207 22022 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.322132 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:56.293473 22029 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:56.371624 14889 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:56.372268 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.322754 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.323819 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.376986 15038 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:07:56.324548 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.328075 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.331813 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:56.332770 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62717.4us
I20260709 13:07:56.334573 22074 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.301605 22028 raft_consensus.cc:697] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:56.335829 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.340550 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.341579 22033 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.345240 14894 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:56.396474 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.284307 22024 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.347790 22031 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.349675 21737 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.351773 21961 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:56.283813 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.301261 21561 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:56.355713 15036 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:56.356278 22073 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:07:56.299163 14970 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:56.331851 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.359728 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.417709 14966 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 11.
I20260709 13:07:56.357688 14886 raft_consensus.cc:2393] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:07:56.360548 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 57973.4us
I20260709 13:07:56.312651 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.373338 21719 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.322777 14893 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:07:56.357400 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.359052 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.364081 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.423146 15550 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:56.394940 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.395000 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:56.425407 14887 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:56.397881 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.378620 15542 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:56.404422 14968 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:56.397166 14963 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:56.394630 15549 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:56.417049 14890 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:07:56.384636 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:56.428090 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.378319 21881 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:56.411417 22091 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.415447 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.394230 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.426369 14969 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:56.409246 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:07:56.429641 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 70639.7us
I20260709 13:07:56.423377 14892 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
W20260709 13:07:56.430744 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.424397 14895 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:56.431515 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:56.411038 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 70547.9us
I20260709 13:07:56.429693 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.447446 15008 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.372090 22022 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:56.448558 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.450153 14962 raft_consensus.cc:2410] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 13:07:56.450572 15037 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:56.453955 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:56.444679 14889 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:56.456197 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.415571 21961 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.445019 15007 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.457242 14892 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:56.460299 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.460449 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.456291 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.462771 14963 raft_consensus.cc:3060] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:56.463091 14894 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:56.463304 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:56.467307 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 82768.2us
I20260709 13:07:56.470304 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.432737 21719 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:56.466667 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.444445 21845 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:56.443612 22020 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:56.443137 22091 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.451797 22045 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:56.481124 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.457924 22088 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.454983 22022 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.483278 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.484859 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.482101 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:56.527138 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 116465us
W20260709 13:07:56.527675 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45681.3us
I20260709 13:07:56.487797 15545 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:56.471472 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:56.461040 21561 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:07:56.529423 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 58034.4us
I20260709 13:07:56.515085 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.520216 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.520555 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.531132 14968 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:56.519868 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.461596 21874 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.468008 21953 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:56.468314 21554 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:56.521564 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.467178 21679 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.532756 15541 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:56.485858 21845 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:07:56.533015 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 67657.3us
I20260709 13:07:56.530582 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:56.474172 21719 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.532013 14890 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:56.489254 22026 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:56.493788 22091 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.561236 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.542901 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.461024 21927 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 13:07:56.545804 14889 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:07:56.491415 21900 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:56.444679 22063 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:56.554371 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 63050.6us
I20260709 13:07:56.527076 22088 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.558718 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.539582 21881 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:07:56.542448 14887 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:56.536240 21874 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.474066 22071 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.551167 21845 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:56.571274 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 98793.6us
I20260709 13:07:56.567668 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:56.568449 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.489081 21926 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 13:07:56.540211 22060 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:56.585980 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.574769 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.543761 21554 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:56.576203 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.464210 22029 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.576709 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.591804 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.552428 22045 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.552217 22026 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.576756 21881 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:56.493108 22020 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.585753 14890 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:56.588645 15040 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:56.604939 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.603123 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.589576 22060 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.592303 21554 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.609658 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.570233 21900 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.578467 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:56.587555 14887 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:56.611881 21900 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.573680 22088 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.574600 21786 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:56.617286 22090 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
W20260709 13:07:56.595902 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 43988.4us
I20260709 13:07:56.619503 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.621204 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.621948 21629 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:56.622682 21629 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:56.572882 21937 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:56.623591 21937 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:56.624025 21937 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.560770 22019 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:56.578197 21874 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:56.585402 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:56.609144 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57635.2us
I20260709 13:07:56.609123 15541 raft_consensus.cc:2468] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
W20260709 13:07:56.636161 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50865.5us
I20260709 13:07:56.637120 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.528589 22028 consensus_queue.cc:237] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.567641 22098 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:56.613394 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.613850 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45496.9us
I20260709 13:07:56.616317 21838 consensus_queue.cc:1048] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:56.606227 22031 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.627209 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.600157 22026 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:56.610345 22060 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:56.596849 21932 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 13:07:56.604580 21881 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:56.606261 22018 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.643464 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.644722 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.645711 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.613507 21728 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:56.653614 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:56.629833 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 87060.2us
I20260709 13:07:56.683656 15516 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.645889 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:56.626833 22069 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:56.666522 22019 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:56.668258 22102 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:56.670753 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.681165 15541 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:56.680904 15550 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:07:56.630254 22033 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.653087 22080 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:07:56.700333 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.709429 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.710094 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.629264 22075 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260709 13:07:56.712761 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.708766 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.707463 22104 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:07:56.716665 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.683534 21926 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:07:56.719031 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48387.7us
I20260709 13:07:56.722380 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.722676 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.725425 14961 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:56.725279 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.727023 15541 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:56.728179 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.731091 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.733531 15541 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:07:56.734694 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.735446 15550 raft_consensus.cc:2410] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 20 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:07:56.629870 21561 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.712749 22074 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.688074 21806 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.790146 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.656724 22098 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.717960 22104 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:56.724699 22075 consensus_queue.cc:1243] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:07:56.806666 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:56.810500 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.829646 14966 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:56.841921 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:56.843479 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:56.848975 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:56.849766 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:56.850544 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.855046 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.856711 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.853123 15513 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:56.873384 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.880223 22024 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.882361 22024 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.882866 22096 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.197s
I20260709 13:07:56.883672 15547 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:56.890291 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:56.807011 22069 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:56.888739 14963 raft_consensus.cc:2468] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
I20260709 13:07:56.898682 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:56.900058 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:56.955644 15550 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:56.897571 15514 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:07:56.966436 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 281634us
W20260709 13:07:56.966558 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 69097.4us
I20260709 13:07:56.904943 22091 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.906672 22109 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:56.889586 22105 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:56.808043 22104 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:07:56.921725 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 68691.4us
I20260709 13:07:56.840870 21737 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.900053 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:56.959934 22093 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.328s	user 0.000s	sys 0.001s
W20260709 13:07:56.960669 22097 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 13:07:56.964758 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:57.014307 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:56.743029 22027 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:56.901403 21838 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:07:56.905411 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:57.024190 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:56.978006 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79407.1us
I20260709 13:07:56.978564 15042 raft_consensus.cc:1240] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:56.871496 22063 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:56.890466 22071 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:56.984310 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:57.010010 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 326393us
I20260709 13:07:57.014688 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:56.983626 22024 raft_consensus.cc:2804] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:57.012629 15513 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:56.882889 21719 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.022575 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.026038 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.028455 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:57.028949 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:57.033845 14969 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:07:56.896432 22069 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:57.022403 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:56.893606 21937 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:56.981395 22109 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:56.910898 21961 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.039958 15549 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:56.986485 22105 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:57.051744 15044 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:57.040546 15513 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:07:57.053982 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 349038us
I20260709 13:07:57.045774 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.058043 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:57.059168 14968 consensus_meta.cc:287] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.523s	user 0.007s	sys 0.000s
I20260709 13:07:57.059840 14968 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:07:57.060664 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:57.060871 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.061197 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.061992 15513 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:57.063213 14886 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:57.064613 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.065449 14969 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
W20260709 13:07:57.062227 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 360773us
I20260709 13:07:56.952913 22019 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.068053 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.072266 14968 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:57.068594 15547 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:57.068603 15549 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:57.052459 21679 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.053951 21737 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:57.053594 22024 raft_consensus.cc:697] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:57.035936 22018 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.082283 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.080137 14962 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:57.052626 22109 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:57.059924 22114 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.088409 22103 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:07:57.088794 22113 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:57.089180 22100 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:57.080190 21679 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.135782 21679 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.136060 22024 consensus_queue.cc:237] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.136758 21874 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:57.090024 22112 log.cc:927] Time spent T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:07:57.091337 21786 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:57.091809 22098 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:57.104274 22111 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:57.104508 22027 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:57.104586 21937 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:57.039131 21932 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 13:07:57.071636 21838 raft_consensus.cc:3060] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:57.043485 22022 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.055680 22105 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.072273 22071 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:07:57.068240 22045 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.117698 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.174629 14962 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:57.136082 21806 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:57.090574 21900 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.143293 22091 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:57.147694 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.151109 22111 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:57.077428 22106 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.155342 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:57.166405 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 113868us
I20260709 13:07:57.120829 22018 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.124818 22103 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.186254 14889 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:07:57.171653 21766 consensus_meta.cc:287] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.890s	user 0.012s	sys 0.000s
I20260709 13:07:57.184980 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:57.196354 14961 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:57.175874 22071 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:57.201642 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.154284 21786 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:57.189695 22088 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.575s	user 0.011s	sys 0.000s
I20260709 13:07:57.205742 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:57.183779 22111 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:57.188602 22103 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.171056 21937 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:07:57.188304 21874 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:57.217834 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.215557 14967 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 10 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:57.222568 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.224063 22121 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:57.224673 22121 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:57.225855 21937 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:07:57.225616 22121 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.226394 21937 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:57.228420 21900 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.229118 21937 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.230618 21937 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:57.204321 22071 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.256274 14962 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:07:57.257561 15514 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:57.258358 21937 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:57.258882 21937 raft_consensus.cc:697] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:57.259791 21937 consensus_queue.cc:237] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.264946 22018 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.265410 22074 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:07:57.265869 22074 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:57.266754 22074 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.267968 22074 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.271804 21806 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:57.264976 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.272400 21806 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.273352 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.274071 14962 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:57.274509 21806 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:57.274746 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.274842 22022 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:57.276276 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.276713 21786 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:57.277827 21881 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.583s	user 0.008s	sys 0.001s
I20260709 13:07:57.278308 21881 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.279975 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:57.281517 21728 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.203835 22113 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:07:57.281987 21728 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:57.282431 22113 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:57.265388 21838 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:07:57.284011 22116 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 13:07:57.285064 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 631743us
I20260709 13:07:57.288815 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:57.290304 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:57.276782 14962 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:07:57.292043 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:57.280509 14893 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:57.300123 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.303025 15550 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:07:57.216699 22091 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:07:57.293946 14859 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.662s (SENT) [suppressed 24 similar messages]
I20260709 13:07:57.312418 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.315850 15549 raft_consensus.cc:1275] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:07:57.317759 14961 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:57.317579 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:57.319612 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:57.197094 21766 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.292189 22081 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:57.324350 15036 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:57.280483 21881 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:57.328176 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.340071 14969 raft_consensus.cc:2393] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:57.342967 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.357414 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:57.309640 21806 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:07:57.326206 22026 consensus_meta.cc:287] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.637s	user 0.009s	sys 0.001s
I20260709 13:07:57.362771 14891 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:57.309360 21561 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 13:07:57.368826 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3740) took 1099 ms. Trace:
I20260709 13:07:57.216809 22088 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.369292 15549 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:07:57.378247 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.326824 22081 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.379258 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:57.380895 14962 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:57.384182 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:57.380826 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.386354 14969 raft_consensus.cc:2468] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:57.331061 21961 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:57.336001 22091 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:57.363984 22083 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:07:57.376214 21953 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.809s	user 0.014s	sys 0.004s
I20260709 13:07:57.391376 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.392261 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:57.375602 21987 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.397475 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.385587 22081 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.382352 22073 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.409368 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1790) took 1125 ms. Trace:
I20260709 13:07:57.399488 15039 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:57.409559 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3746) took 1079 ms. Trace:
I20260709 13:07:57.404870 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.385317 21881 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:57.409945 15543 rpcz_store.cc:276] 0709 13:07:56.285445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.298338 (+ 12893us) service_pool.cc:224] Handling call
0709 13:07:56.314185 (+ 15847us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.314448 (+   263us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:07:56.738438 (+423990us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.399891 (+661453us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.408870 (+  8979us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.409052 (+   182us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.409097 (+    45us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:07:57.409138 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.409205 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.409308 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14576,"raft.queue_time_us":37117,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5523,"spinlock_wait_cycles":12078976,"thread_start_us":539082,"threads_started":3,"wal-append.queue_time_us":382761}
I20260709 13:07:57.283396 22113 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.384486 21806 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:57.393366 22100 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:57.410686 15040 rpcz_store.cc:276] 0709 13:07:56.321618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.322535 (+   917us) service_pool.cc:224] Handling call
0709 13:07:57.400448 (+1077913us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400088ed4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:57.400580 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493500672}
I20260709 13:07:57.448845 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.449429 14961 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:07:57.405772 21953 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.014s	sys 0.005s
I20260709 13:07:57.415853 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1608) took 1407 ms. Trace:
W20260709 13:07:57.419152 21554 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.788s	user 0.006s	sys 0.002s
I20260709 13:07:57.421185 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4315) took 1075 ms. Trace:
I20260709 13:07:57.421705 22105 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.460731 14886 rpcz_store.cc:276] 0709 13:07:56.345856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.728937 (+383081us) service_pool.cc:224] Handling call
0709 13:07:56.729323 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.067995 (+338672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.420944 (+352949us) spinlock_profiling.cc:243] Waited 332 ms on lock 0x7b54002ec2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:57.421127 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":764368256}
I20260709 13:07:57.462499 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:57.422437 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:07:57.427244 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 112932us
I20260709 13:07:57.427825 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.380227 22026 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.463689 14968 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:57.432768 21881 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:57.434265 21845 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.837s	user 0.004s	sys 0.004s
I20260709 13:07:57.396908 21719 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.435514 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4319) took 1088 ms. Trace:
W20260709 13:07:57.436298 21926 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.706s	user 0.003s	sys 0.007s
I20260709 13:07:57.412717 22073 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:57.439327 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:57.445618 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:57.443030 22088 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:57.463259 14886 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:07:57.478739 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:57.464026 14969 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:07:57.486740 14963 raft_consensus.cc:2368] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19.
I20260709 13:07:57.452960 15037 rpcz_store.cc:276] 0709 13:07:56.008710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.008840 (+   130us) service_pool.cc:224] Handling call
0709 13:07:56.018963 (+ 10123us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.458534 (+439571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.415626 (+957092us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b540003f2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:57.415797 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975976064}
I20260709 13:07:57.439118 22071 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.412235 21830 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.470947 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:57.513447 15040 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:57.470984 14968 raft_consensus.cc:1240] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:57.473606 14892 rpcz_store.cc:276] 0709 13:07:56.347247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.846941 (+499694us) service_pool.cc:224] Handling call
0709 13:07:56.847369 (+   428us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:56.847920 (+   551us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.847962 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:56.849812 (+  1850us) log.cc:844] Serialized 52 byte log entry
0709 13:07:57.167941 (+318129us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:07:57.186137 (+ 18196us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.186324 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.186397 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.435210 (+248813us) raft_consensus.cc:1685] finished
0709 13:07:57.435232 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.435390 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20982,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":997,"raft.queue_time_us":14638,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":39010,"thread_start_us":212130,"threads_started":1,"wal-append.queue_time_us":414313}
I20260709 13:07:57.516024 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:57.466907 22060 consensus_meta.cc:287] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.772s	user 0.010s	sys 0.000s
I20260709 13:07:57.479691 15042 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:57.452893 21953 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:57.471160 22100 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:57.485412 14886 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.515005 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.525055 14961 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 12.
I20260709 13:07:57.485481 14890 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:57.479399 21926 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.568645 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:57.573396 14969 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:57.577549 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:57.578773 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:57.579521 15037 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:57.467911 21554 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.475474 22096 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 13:07:57.532410 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1868) took 1080 ms. Trace:
I20260709 13:07:57.508170 21806 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:57.587234 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 152443us
I20260709 13:07:57.478945 21845 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.525996 21719 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:57.572111 22111 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:57.668071 22133 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:07:57.668743 21728 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.594515 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.670323 14961 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
W20260709 13:07:57.614497 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:57.675045 15040 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:07:57.676676 14886 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:07:57.593254 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:57.530184 22060 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:57.684173 22134 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:07:57.684445 22060 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.685422 22033 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:57.685827 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1869) took 1228 ms. Trace:
I20260709 13:07:57.687719 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:57.583379 21766 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:57.584429 22130 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:57.507973 22091 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.686239 15541 rpcz_store.cc:276] 0709 13:07:56.457221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.268624 (+811403us) service_pool.cc:224] Handling call
0709 13:07:57.269028 (+   404us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.269456 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.269486 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.270073 (+   587us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.387103 (+117030us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:57.387163 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.387262 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.685545 (+298283us) raft_consensus.cc:1685] finished
0709 13:07:57.685575 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.685762 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1629,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":101,"thread_start_us":116309,"threads_started":1,"wal-append.queue_time_us":200727}
I20260709 13:07:57.783977 14969 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:57.694145 15040 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
W20260709 13:07:57.789929 22104 consensus_meta.cc:287] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.761s	user 0.005s	sys 0.005s
W20260709 13:07:57.689643 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 93518.5us
I20260709 13:07:57.864982 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:07:57.838769 15513 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.512s (SENT)
I20260709 13:07:57.865655 14888 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 24: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:57.585785 15544 rpcz_store.cc:276] 0709 13:07:56.452077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.089097 (+637020us) service_pool.cc:224] Handling call
0709 13:07:57.089414 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.150035 (+ 60621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.150085 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.153891 (+  3806us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.383999 (+230108us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:57.531585 (+147586us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.532112 (+   527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.532186 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.532226 (+    40us) raft_consensus.cc:1685] finished
0709 13:07:57.532238 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.532353 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43182,"prepare.queue_time_us":47196,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":57778,"raft.run_cpu_time_us":284,"raft.run_wall_time_us":15264,"thread_start_us":310984,"threads_started":2,"wal-append.queue_time_us":256920}
I20260709 13:07:57.593869 22024 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:07:57.848009 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:57.882455 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:57.837527 22136 log.cc:927] Time spent T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 13:07:57.677549 22111 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.923532 14969 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23. Ops: []
W20260709 13:07:57.927358 14893 consensus_meta.cc:287] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.000s
I20260709 13:07:57.928628 14893 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:07:57.884253 22121 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:57.936316 14968 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:57.917855 22024 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:57.763584 21719 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:57.817636 21953 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.956173 14968 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 11. Current term is 12. Ops: []
I20260709 13:07:57.968809 21728 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.969322 21845 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:57.970845 14889 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3437) took 1634 ms (client timeout 2142 ms). Trace:
I20260709 13:07:57.944465 21874 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:57.971235 14889 rpcz_store.cc:269] 0709 13:07:56.336228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.570070 (+233842us) service_pool.cc:224] Handling call
0709 13:07:57.970658 (+1400588us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b54003877d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:57.970790 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1320187648}
I20260709 13:07:57.971918 21874 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.973210 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1632) took 1266 ms. Trace:
I20260709 13:07:57.937973 22121 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:57.878609 22104 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.973567 15550 rpcz_store.cc:276] 0709 13:07:56.706350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.312019 (+605669us) service_pool.cc:224] Handling call
0709 13:07:57.381591 (+ 69572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.381832 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:57.499022 (+117190us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.878183 (+379161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.878251 (+    68us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:57.878313 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.878392 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.973053 (+ 94661us) spinlock_profiling.cc:243] Waited 50.1 ms on lock 0x7b54008b10d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:57.973156 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79891,"prepare.queue_time_us":49548,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":95245,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":32793,"spinlock_wait_cycles":115190528,"thread_start_us":315336,"threads_started":2,"wal-append.queue_time_us":413366}
I20260709 13:07:57.946262 22105 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.985442 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2908) took 1002 ms. Trace:
I20260709 13:07:58.011291 14963 rpcz_store.cc:276] 0709 13:07:56.982651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.008379 (+ 25728us) service_pool.cc:224] Handling call
0709 13:07:57.985268 (+976889us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54003e7954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:57.985388 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1022213888}
W20260709 13:07:57.986650 15036 consensus_meta.cc:287] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.505s	user 0.004s	sys 0.004s
I20260709 13:07:58.012459 15036 raft_consensus.cc:2468] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:57.946651 22071 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.933004 21881 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:57.884447 22130 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.818377 22100 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:57.944036 22096 raft_consensus.cc:2764] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
W20260709 13:07:57.992254 22103 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.002s
I20260709 13:07:58.033242 22103 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.034623 15546 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:58.041673 22081 consensus_meta.cc:287] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.618s	user 0.008s	sys 0.002s
I20260709 13:07:58.042153 22081 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:57.991144 22121 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:58.050017 15038 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 24. Current term is 25. Ops: [24.20-24.20]
I20260709 13:07:58.051893 14965 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:58.015038 21554 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:58.057662 22103 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.023311 14890 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:07:58.031630 22130 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.032219 21881 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:58.059906 21881 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.060937 15042 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:58.061017 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 2915) took 1028 ms. Trace:
I20260709 13:07:58.061581 14962 rpcz_store.cc:276] 0709 13:07:57.032444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.458866 (+426422us) service_pool.cc:224] Handling call
0709 13:07:57.466756 (+  7890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.472493 (+  5737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.472525 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.472998 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.836992 (+363994us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:57.837031 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.837093 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.060807 (+223714us) raft_consensus.cc:1685] finished
0709 13:07:58.060826 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.060954 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14814,"raft.queue_time_us":5358,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4337,"thread_start_us":264484,"threads_started":1,"wal-append.queue_time_us":415447}
W20260709 13:07:58.067607 22143 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
W20260709 13:07:58.067898 22108 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.189s	user 0.005s	sys 0.000s
W20260709 13:07:58.068107 22140 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:07:58.050905 21874 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.075062 22024 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:58.078099 22122 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.764s	user 0.003s	sys 0.000s
I20260709 13:07:58.079294 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3460) took 1358 ms. Trace:
I20260709 13:07:58.079703 14895 rpcz_store.cc:276] 0709 13:07:56.721270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.962351 (+241081us) service_pool.cc:224] Handling call
0709 13:07:56.962619 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.963129 (+   510us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.963156 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.963649 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.082246 (+118597us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:57.082289 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.082352 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.077576 (+995224us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:58.079015 (+  1439us) raft_consensus.cc:1685] finished
0709 13:07:58.079035 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.079237 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":76,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"spinlock_wait_cycles":14558080,"thread_start_us":115493,"threads_started":1,"wal-append.queue_time_us":238916}
W20260709 13:07:58.085562 22125 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.878s	user 0.000s	sys 0.010s
W20260709 13:07:58.088064 22109 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.959s	user 0.011s	sys 0.000s
I20260709 13:07:58.088546 22109 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.090601 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1797) took 1762 ms. Trace:
I20260709 13:07:58.090956 15547 rpcz_store.cc:276] 0709 13:07:56.328573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.042148 (+713575us) service_pool.cc:224] Handling call
0709 13:07:57.042443 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:57.077297 (+ 34854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.090404 (+1013107us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54005ff5d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:58.090548 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59697536}
W20260709 13:07:58.091977 21679 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.956s	user 0.011s	sys 0.000s
I20260709 13:07:58.092439 21679 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.096585 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3441) took 1759 ms. Trace:
W20260709 13:07:58.089224 15044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3748) took 1767 ms (client timeout 2018 ms). Trace:
W20260709 13:07:58.098882 15044 rpcz_store.cc:269] 0709 13:07:56.322279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.324297 (+  2018us) service_pool.cc:224] Handling call
0709 13:07:58.089043 (+1764746us) spinlock_profiling.cc:243] Waited 665 ms on lock 0x7b54001f45d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:58.089157 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1529356032}
I20260709 13:07:58.100001 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:58.103444 21679 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:58.104784 15036 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:57.373189 15035 rpcz_store.cc:276] 0709 13:07:56.269099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.269886 (+   787us) service_pool.cc:224] Handling call
0709 13:07:56.276142 (+  6256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:56.281342 (+  5200us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:07:56.440929 (+159587us) log.cc:844] Serialized 14 byte log entry
0709 13:07:57.368291 (+927362us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18004d1ac0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f553491623a
0709 13:07:57.368483 (+   192us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:57.368533 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:07:57.368582 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.368644 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:57.368772 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":208588,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":5969,"raft.queue_time_us":3631,"spinlock_wait_cycles":5124736,"thread_start_us":259559,"threads_started":2,"wal-append.queue_time_us":146449}
I20260709 13:07:58.111088 22020 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.111846 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3461) took 1312 ms. Trace:
I20260709 13:07:58.114048 14894 rpcz_store.cc:276] 0709 13:07:56.799929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.530611 (+730682us) service_pool.cc:224] Handling call
0709 13:07:57.583493 (+ 52882us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:57.641293 (+ 57800us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:57.641337 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:57.676047 (+ 34710us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.914680 (+238633us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:07:57.914718 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:57.914794 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.069907 (+155113us) raft_consensus.cc:1685] finished
0709 13:07:58.069927 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.111784 (+ 41857us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5313,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":23240,"thread_start_us":96188,"threads_started":1,"wal-append.queue_time_us":236459}
I20260709 13:07:58.114914 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.097064 14887 rpcz_store.cc:276] 0709 13:07:56.337293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.612476 (+275183us) service_pool.cc:224] Handling call
0709 13:07:56.612836 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.623593 (+ 10757us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.623631 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.624112 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:07:56.671978 (+ 47866us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:07:56.672027 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:56.672092 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:57.940425 (+1268333us) spinlock_profiling.cc:243] Waited 4.83 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:58.096246 (+155821us) raft_consensus.cc:1685] finished
0709 13:07:58.096275 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.096517 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":537,"raft.queue_time_us":38506,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":40021,"spinlock_wait_cycles":11120384,"thread_start_us":47490,"threads_started":1,"wal-append.queue_time_us":89485}
I20260709 13:07:58.100013 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:58.117666 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.118350 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:58.116354 15044 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:58.129769 15040 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:07:58.131803 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.132584 15035 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.133168 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.134950 14892 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:07:58.137387 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.138182 14962 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:07:58.139706 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.118124 21719 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.142521 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.118312 21881 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.142446 15040 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: []
I20260709 13:07:58.143344 14894 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:58.131733 21806 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:07:58.146117 22109 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.157421 21806 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:58.157563 22150 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:07:58.158507 21806 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.163147 22069 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.164467 22069 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:58.163041 15035 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:07:58.168727 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:58.142577 21706 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260709 13:07:58.173750 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.177812 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:58.161118 22121 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:58.190097 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 502466us
I20260709 13:07:58.192245 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:58.185859 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:58.195996 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.197041 14894 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:58.198611 14936 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:07:58.186143 22073 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.678s	user 0.009s	sys 0.000s
I20260709 13:07:58.196108 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:58.179792 21719 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:58.198927 22105 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:07:58.207962 22105 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:58.208484 22105 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:58.193017 22130 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:58.214293 22075 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:07:58.215247 22081 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:58.219024 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.221243 21629 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:58.221639 21629 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:58.222506 21629 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:58.224025 22158 log.cc:927] Time spent T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:07:58.202320 22104 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.193636 22020 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:07:58.199383 22042 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.229457 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3444) took 1891 ms. Trace:
I20260709 13:07:58.229995 14888 rpcz_store.cc:276] 0709 13:07:56.338086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.592679 (+254593us) service_pool.cc:224] Handling call
0709 13:07:58.229200 (+1636521us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54000cdd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:58.229379 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2854319488}
W20260709 13:07:58.233628 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.234447 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.236111 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.236785 15550 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:58.238091 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:07:58.238453 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.239022 15541 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.239609 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.240334 15549 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.240464 22026 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.240826 21719 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:58.241281 21719 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.242728 22117 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:07:58.243114 22117 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:58.243925 22117 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.244879 22117 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:07:58.248112 14891 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1576) took 2146 ms (client timeout 1512 ms). Trace:
W20260709 13:07:58.248538 14891 rpcz_store.cc:269] 0709 13:07:56.102108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.102279 (+   171us) service_pool.cc:224] Handling call
0709 13:07:58.247880 (+2145601us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000adcd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:58.248004 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2763165952}
I20260709 13:07:58.255991 22028 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:58.256531 22028 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:58.257613 22028 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.259727 22109 raft_consensus.cc:2764] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 13:07:58.260859 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 65333us
I20260709 13:07:58.262050 22083 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.262704 22083 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.264221 15007 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.265218 22104 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:58.268889 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:58.270884 15549 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:58.273468 15550 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
W20260709 13:07:58.275064 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 76559.2us
I20260709 13:07:58.277108 15549 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:58.278725 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:07:58.282948 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.259181 22028 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.291587 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:58.293072 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1622) took 1594 ms. Trace:
I20260709 13:07:58.297874 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:58.298950 14891 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:58.301915 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.303090 15549 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:58.293629 15038 rpcz_store.cc:276] 0709 13:07:56.698939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.853742 (+154803us) service_pool.cc:224] Handling call
0709 13:07:56.854105 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.050554 (+1196449us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.292807 (+242253us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400187754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:07:58.293012 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2749594496}
I20260709 13:07:58.304409 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:58.304816 14892 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:58.305191 14888 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:58.312969 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.313139 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:58.314570 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.315308 14891 raft_consensus.cc:2368] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:07:58.316042 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:58.265723 22104 raft_consensus.cc:697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:58.318427 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:58.318569 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.319097 14894 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.320660 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:58.325402 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.326126 14887 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.283231 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:58.329169 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46052.4us
I20260709 13:07:58.265692 22083 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.330926 15010 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:58.347818 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.328176 21679 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.352900 15007 leader_election.cc:400] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:07:58.359894 15007 leader_election.cc:403] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.354997 15550 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.333359 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:58.357764 14891 raft_consensus.cc:1240] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:58.314178 21629 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.362058 14891 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:58.300570 22153 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:07:58.372359 14891 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:58.373813 14891 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:58.300050 22026 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:07:58.378796 22026 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:58.379187 22026 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:07:58.300299 21845 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:58.382799 21845 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:58.383203 21845 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:58.383682 15513 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 2.225s (SENT)
I20260709 13:07:58.384148 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.363312 15541 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:07:58.388489 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:58.388794 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.389256 15040 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 24: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:58.389381 15035 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:07:58.389694 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 58906.9us
I20260709 13:07:58.366640 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:58.306200 22042 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:58.392185 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 71642.3us
I20260709 13:07:58.377014 15542 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:07:58.337349 22128 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:58.378278 15550 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:58.279637 22073 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.390515 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:58.390518 14893 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:58.370107 22121 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:58.397408 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.398844 15513 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.400002 14887 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:07:58.408962 15040 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:58.392069 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.331522 22081 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:58.353478 22075 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:58.415712 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.424296 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.416740 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.425240 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.421811 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.428656 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:58.429152 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:58.431491 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97565.8us
I20260709 13:07:58.391999 21881 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:07:58.422143 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.394135 22042 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:58.359333 22031 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.063s
W20260709 13:07:58.448036 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.435388 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.422065 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.449308 15044 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:58.449280 14893 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:58.410037 14894 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:07:58.441735 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:07:58.442382 14859 leader_election.cc:336] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.800s (SENT)
I20260709 13:07:58.450313 14859 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.433506 15042 raft_consensus.cc:2368] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21.
I20260709 13:07:58.443073 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:58.451382 14887 raft_consensus.cc:2368] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 23. Current term is 24.
I20260709 13:07:58.455637 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.456393 15038 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:58.458316 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:58.458498 22160 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:58.459059 15042 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:58.460300 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:58.460673 22029 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.421801 22071 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:58.471000 15035 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:58.473058 14887 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:07:58.473444 15040 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:58.432984 22109 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:58.475348 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 84871.3us
W20260709 13:07:58.481098 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49687.4us
I20260709 13:07:58.483144 14861 leader_election.cc:400] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21.
I20260709 13:07:58.483600 14861 leader_election.cc:403] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260709 13:07:58.484666 14859 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.819s (SENT)
W20260709 13:07:58.485792 14859 leader_election.cc:336] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.847s (SENT)
I20260709 13:07:58.487955 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.434028 22019 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:58.495252 14893 raft_consensus.cc:3055] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:07:58.495695 14893 raft_consensus.cc:740] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:58.491459 14936 connection.cc:256] RPC call timeout handler was delayed by -1.177640078999957s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19840000000000002s for a response
I20260709 13:07:58.492525 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:58.446779 22042 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.490624 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:58.498919 15044 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
W20260709 13:07:58.496870 14936 connection.cc:256] RPC call timeout handler was delayed by -1.1470400790000213s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
I20260709 13:07:58.453286 21926 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:07:58.465265 21806 raft_consensus.cc:2764] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 13:07:58.472141 21706 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.474022 22024 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.435060 22153 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:07:58.463758 22161 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.474632 22121 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:07:58.511296 14964 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:58.514276 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:58.523543 22124 log.cc:927] Time spent T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:07:58.523952 14967 raft_consensus.cc:2368] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19.
I20260709 13:07:58.511899 22130 consensus_queue.cc:1059] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 13:07:58.524793 22130 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21.
I20260709 13:07:58.525409 22130 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:58.528609 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1802) took 1829 ms. Trace:
I20260709 13:07:58.528975 15546 rpcz_store.cc:276] 0709 13:07:56.699028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.964510 (+265482us) service_pool.cc:224] Handling call
0709 13:07:58.528385 (+1563875us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b5400b4f354. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:58.528508 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2345076480}
I20260709 13:07:58.533197 15545 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: [13.11-13.11]
W20260709 13:07:58.534524 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:07:58.535719 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.537024 22020 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:58.537422 22020 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:58.512385 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:58.542169 14966 raft_consensus.cc:2368] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21.
I20260709 13:07:58.510812 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.517493 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:58.446168 22111 consensus_queue.cc:1059] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:07:58.538185 22020 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.511241 22096 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:58.550879 22020 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.550594 22096 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.551715 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.520663 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.553489 14969 raft_consensus.cc:2368] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:58.522002 22153 raft_consensus.cc:3055] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:58.554168 22153 raft_consensus.cc:740] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:58.522382 22161 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:58.555651 15039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1621) took 1857 ms (client timeout 2383 ms). Trace:
W20260709 13:07:58.556083 15039 rpcz_store.cc:269] 0709 13:07:56.698637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.789071 (+ 90434us) service_pool.cc:224] Handling call
0709 13:07:58.555483 (+1766412us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400187254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:58.555600 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276291968}
I20260709 13:07:58.513002 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.513034 21874 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:07:58.557842 21874 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:58.558651 21874 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.559749 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.559919 21874 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.543180 14961 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:07:58.563305 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3463) took 1372 ms. Trace:
I20260709 13:07:58.563717 14890 rpcz_store.cc:276] 0709 13:07:57.191310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.379023 (+187713us) service_pool.cc:224] Handling call
0709 13:07:58.563138 (+1184115us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54000cc954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:58.563235 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232340352}
W20260709 13:07:58.564899 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.565892 21830 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.566363 21830 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.471730 22128 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:07:58.568758 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:58.512602 14893 consensus_queue.cc:260] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.588406 14893 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:58.590176 15042 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:58.471899 22060 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 13:07:58.573448 14961 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:07:58.594986 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:58.591121 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 108103us
I20260709 13:07:58.596048 15038 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 24.
W20260709 13:07:58.592183 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 104322us
I20260709 13:07:58.443334 22075 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.558898 21845 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.498835 22150 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 13:07:58.459180 22160 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.600201 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:58.635076 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.620579 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:58.496412 22152 consensus_queue.cc:1048] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.107s
I20260709 13:07:58.598754 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:07:58.625837 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.589644 21937 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.693569 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:58.693773 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:07:58.699863 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 99719.7us
I20260709 13:07:58.699107 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:58.702404 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.709151 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.744479 14890 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:07:58.698424 21830 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:58.699093 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:58.726222 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1703) took 2359 ms. Trace:
I20260709 13:07:58.729692 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:58.745888 14962 raft_consensus.cc:2368] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:07:58.731838 21881 raft_consensus.cc:3055] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:58.733166 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:58.734388 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.751269 14963 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:07:58.735579 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:58.752295 14966 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:07:58.586982 22071 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.693259 15549 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:58.725142 22109 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:58.748358 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:58.740235 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 141554us
I20260709 13:07:58.467051 22104 consensus_queue.cc:237] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.744845 14890 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:58.747167 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49637.4us
I20260709 13:07:58.748939 15008 leader_election.cc:400] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:07:58.764109 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.764283 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:58.745306 14970 rpcz_store.cc:276] 0709 13:07:56.366755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:56.443257 (+ 76502us) service_pool.cc:224] Handling call
0709 13:07:56.464364 (+ 21107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:56.486876 (+ 22512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:56.486909 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:56.490492 (+  3583us) log.cc:844] Serialized 26 byte log entry
0709 13:07:57.992091 (+1501599us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b18004591c0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:07:58.395224 (+403133us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:07:58.395271 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.395333 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:58.699219 (+303886us) raft_consensus.cc:1685] finished
0709 13:07:58.699242 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:58.726112 (+ 26870us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14943,"raft.queue_time_us":27035,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":7502,"spinlock_wait_cycles":3591936,"thread_start_us":387889,"threads_started":1,"wal-append.queue_time_us":2035849}
I20260709 13:07:58.765146 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.766629 15513 leader_election.cc:400] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 23. Current term is 24.
I20260709 13:07:58.767093 15513 leader_election.cc:403] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:07:58.739465 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.770893 14966 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:58.772228 14861 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.773162 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.644573 21994 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:58.773859 14893 raft_consensus.cc:1275] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 13:07:58.774909 15542 raft_consensus.cc:2393] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:58.775553 14890 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.784962 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.773883 14964 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:07:58.785697 15549 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:07:58.643774 22111 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:07:58.644788 21838 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:58.782399 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:58.789783 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:58.786604 14893 pending_rounds.cc:85] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 13
I20260709 13:07:58.740424 22128 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:58.792411 14893 pending_rounds.cc:107] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 13:07:58.796276 14893 raft_consensus.cc:2889] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:58.644623 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:58.787581 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 224379us
I20260709 13:07:58.804306 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.594419 22100 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.188s
I20260709 13:07:58.805562 14963 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 20. Current term is 21. Ops: []
I20260709 13:07:58.555111 22153 consensus_queue.cc:260] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.519622 21706 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:58.757175 22031 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:58.823150 22031 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.516273 22105 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.825278 22031 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.750165 21881 raft_consensus.cc:740] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:58.825821 22105 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.541133 22024 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.826473 21881 consensus_queue.cc:260] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.827734 21881 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.828121 22024 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.772154 21830 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.057s
I20260709 13:07:58.828683 22024 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:58.829432 21830 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:07:58.808264 22111 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.756500 21937 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.806419 14890 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:07:58.809062 22128 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.841430 22128 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.841939 22128 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Stepping down as leader of term 22
W20260709 13:07:58.842090 21719 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.600s	user 0.007s	sys 0.000s
I20260709 13:07:58.842293 22128 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:58.842511 21719 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.832705 21937 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:58.844291 22178 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:07:58.787341 22071 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.818464 22180 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:58.794708 21994 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.836483 22179 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:07:58.858397 22179 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:58.859289 22179 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:07:58.859823 22069 consensus_meta.cc:287] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.695s	user 0.010s	sys 0.000s
I20260709 13:07:58.860015 21994 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.820663 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:58.834365 14961 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.861105 22100 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:07:58.861461 15542 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:07:58.861799 22100 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:58.862368 21838 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:07:58.862744 21838 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:07:58.837054 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 72846us
I20260709 13:07:58.863600 21838 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.836251 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.864809 21838 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:58.864867 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.866156 21728 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:07:58.866631 21728 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:58.867514 21728 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.857450 22130 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:07:58.857645 22180 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:58.863981 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:07:58.852756 14890 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:58.793474 22033 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:58.831692 22185 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:07:58.880774 15550 raft_consensus.cc:2376] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19. Re-sending same reply.
I20260709 13:07:58.891592 14961 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
W20260709 13:07:58.899391 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:58.806289 22177 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:58.833314 22073 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:58.832369 22174 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:07:58.833148 22103 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:58.831491 22176 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:07:58.918738 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 289975us
I20260709 13:07:58.792301 22026 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.931613 15549 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 24.
W20260709 13:07:58.930919 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66973.9us
W20260709 13:07:58.933048 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 135218us
I20260709 13:07:58.932826 22029 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 23. Current term is 24.
I20260709 13:07:58.935737 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:58.923996 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 158914us
I20260709 13:07:58.935400 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.880501 22033 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:58.843140 22128 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.909534 22178 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:07:58.976847 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 196113us
I20260709 13:07:58.982628 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:58.921697 22177 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:07:58.985913 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 51123.8us
I20260709 13:07:58.906445 22185 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:59.003813 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:07:59.008350 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 143552us
I20260709 13:07:58.923308 22105 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:59.001117 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:59.098100 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 97046.3us
I20260709 13:07:59.099023 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:58.862879 22100 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:58.984032 22069 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.089s
I20260709 13:07:59.025517 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:59.078186 22098 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:07:58.937929 22103 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.021682 21766 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:59.033381 22180 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.059620 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.071390 15035 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
W20260709 13:07:59.077756 15007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.058s	sys 0.102s
I20260709 13:07:59.059701 15040 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:07:59.166370 15007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.058s	sys 0.109s
I20260709 13:07:59.031701 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:59.167838 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 142400us
I20260709 13:07:59.060051 15042 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:07:59.094626 15038 raft_consensus.cc:2393] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:07:59.094730 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 326209us
I20260709 13:07:58.997555 22177 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:58.978338 22174 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:58.987290 22073 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 13:07:58.981580 22033 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.085832 15044 raft_consensus.cc:1275] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:07:59.146293 22105 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.023880 22099 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.074074 21679 consensus_meta.cc:287] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.708s	user 0.011s	sys 0.003s
W20260709 13:07:59.148581 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49635us
I20260709 13:07:59.149586 22130 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:07:59.151454 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 357524us
I20260709 13:07:59.208197 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1871) took 2741 ms. Trace:
I20260709 13:07:59.095890 22031 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 13:07:59.167879 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.171442 21766 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:07:59.177510 22020 consensus_meta.cc:287] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.626s	user 0.011s	sys 0.000s
I20260709 13:07:59.178426 22160 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.242585 22178 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:59.243069 22178 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:07:59.224083 22130 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:59.243721 22130 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:07:59.179924 22185 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.180806 22109 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.181185 22071 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:59.185182 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:59.252110 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 67057.2us
I20260709 13:07:59.253203 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.254315 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.170646 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.167812 21719 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.209745 22074 consensus_queue.cc:1059] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:07:59.256130 22150 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:07:59.256803 22150 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:59.257014 22074 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:07:59.222856 22199 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:07:59.223450 22098 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:07:59.209519 21994 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260709 13:07:59.226356 15040 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:59.207942 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.182065 21728 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:07:59.163273 22069 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:07:59.228148 21679 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:07:59.223672 22194 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:07:59.207793 22099 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.240357 22190 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.228341 21766 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:59.208559 15545 rpcz_store.cc:276] 0709 13:07:56.467061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.273891 (+806830us) service_pool.cc:224] Handling call
0709 13:07:58.532965 (+1259074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.533691 (+   726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:59.208000 (+674309us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400b4f350. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:59.208131 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2894895488}
I20260709 13:07:59.190578 22105 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.264086 22026 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:59.266744 22042 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.753s	user 0.011s	sys 0.001s
I20260709 13:07:59.258140 22098 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:59.255362 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.155174 22202 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:07:59.171744 22200 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 13:07:59.234129 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.161352 22207 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:07:59.277871 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48431us
I20260709 13:07:59.167488 21845 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:59.282207 22168 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.788s	user 0.005s	sys 0.000s
I20260709 13:07:59.160894 22191 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:07:59.280288 15007 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:07:59.286773 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.303184 15037 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
W20260709 13:07:59.296706 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53292.3us
W20260709 13:07:59.303884 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 48586.7us
I20260709 13:07:59.189558 21937 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.101s
I20260709 13:07:59.279232 22069 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:59.314872 15007 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:07:59.283187 21728 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:07:59.321516 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 148883us
I20260709 13:07:59.284454 21838 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.319769 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 260217us
I20260709 13:07:59.320787 21679 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:59.324429 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:59.330677 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.324532 14893 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:07:59.325898 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.296422 22207 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.328161 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:59.329594 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.335326 15036 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:07:59.330991 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.331817 14887 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:07:59.325912 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.299690 22020 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.335419 14895 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
W20260709 13:07:59.339411 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.339802 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:07:59.410027 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.339316 15035 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:07:59.337286 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:07:59.341830 21679 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:59.316812 22083 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:59.338263 21838 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.343442 22190 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:07:59.343461 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.345737 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.355024 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.364022 21561 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:07:59.367254 22167 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.860s	user 0.003s	sys 0.000s
W20260709 13:07:59.425307 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85624.2us
I20260709 13:07:59.312258 22109 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:59.429117 22109 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.429297 21561 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.429912 22096 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:59.413305 22117 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:07:59.369639 22069 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.315937 22026 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:59.373993 22033 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:59.377285 15043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1625) took 2172 ms (client timeout 1503 ms). Trace:
I20260709 13:07:59.378719 22074 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.380276 14968 raft_consensus.cc:1275] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:07:59.381281 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.381708 21706 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:59.382409 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.441247 14963 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 21: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:07:59.383546 22161 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.383591 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.384742 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.385910 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.387120 21737 consensus_queue.cc:1059] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:07:59.387526 22075 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:59.388140 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:07:59.389282 22172 consensus_queue.cc:1059] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:07:59.392181 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 105625us
W20260709 13:07:59.394555 22197 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260709 13:07:59.319720 22073 consensus_queue.cc:1048] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 13:07:59.463558 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.460601 21561 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:59.339779 22174 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.398842 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 3225) took 1010 ms. Trace:
I20260709 13:07:59.400913 21728 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.339522 22098 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:59.406311 22196 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.372s	user 0.000s	sys 0.003s
W20260709 13:07:59.407488 22168 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:07:59.312127 22176 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:59.427929 21679 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.433633 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:07:59.480301 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 46750.1us
I20260709 13:07:59.338994 22207 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:07:59.286458 22042 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.435890 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:07:59.438735 15043 rpcz_store.cc:269] 0709 13:07:57.204881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:57.288558 (+ 83677us) service_pool.cc:224] Handling call
0709 13:07:59.377084 (+2088526us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54001cbe54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:59.377216 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3658432896}
I20260709 13:07:59.446357 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.446564 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.447388 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:59.448833 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.450057 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:59.448278 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:59.426360 22083 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:59.469880 14964 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:07:59.443017 22117 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.438558 22128 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:59.508972 14964 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:07:59.476629 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 88580.6us
W20260709 13:07:59.510646 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.460994 22074 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.486987 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:59.488976 15549 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:07:59.426070 22020 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:07:59.490149 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:07:59.490800 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.467137 15036 rpcz_store.cc:276] 0709 13:07:58.388433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.400770 (+ 12337us) service_pool.cc:224] Handling call
0709 13:07:59.398634 (+997864us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b5400187c54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:07:59.398768 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1977957760}
I20260709 13:07:59.475046 22069 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:59.557116 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.555629 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:59.435309 22109 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.512135 15007 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:59.515545 14965 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:07:59.561625 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 50305.5us
I20260709 13:07:59.516184 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.562125 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.562673 14968 raft_consensus.cc:2410] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:07:59.477016 22099 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:59.565701 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.517865 14859 leader_election.cc:400] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:59.511301 22060 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:07:59.485997 21937 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:07:59.487461 22135 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:59.558372 15547 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:07:59.564973 15042 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:07:59.566952 14859 leader_election.cc:403] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:07:59.556540 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 66449.2us
I20260709 13:07:59.567888 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.569286 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.570596 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.507990 22075 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:59.590236 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.590466 14962 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:07:59.592355 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.593113 15035 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:59.582810 15044 raft_consensus.cc:2376] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15. Re-sending same reply.
I20260709 13:07:59.552759 22180 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.484447 22191 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.086s
I20260709 13:07:59.582244 15037 raft_consensus.cc:2376] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19. Re-sending same reply.
I20260709 13:07:59.594537 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.566125 21719 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:07:59.601452 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 83778.4us
I20260709 13:07:59.603132 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.571283 22100 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:07:59.575868 22060 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:59.607681 14859 leader_election.cc:400] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19.
I20260709 13:07:59.608946 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.609968 15541 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:07:59.606859 15545 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:07:59.614055 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.614195 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:59.616232 15035 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:07:59.481781 22176 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.598104 21561 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.615298 15548 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:59.598079 22073 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.619989 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:59.511473 22190 consensus_queue.cc:1048] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 13:07:59.595496 22026 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:59.628707 15544 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:59.572504 22130 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.608421 22109 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:07:59.601567 21937 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:07:59.609485 22179 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18.
I20260709 13:07:59.635334 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.617113 22060 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:07:59.608177 22100 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:59.643905 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.646409 22179 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:59.598316 22075 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.653944 15035 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:59.566201 22177 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:07:59.648216 14859 leader_election.cc:400] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21.
I20260709 13:07:59.619453 21719 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:59.657186 21719 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.646521 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:59.601065 22180 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.661914 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.662602 22180 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:07:59.663323 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:59.663573 22096 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:07:59.664549 22212 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:07:59.664829 22211 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:07:59.665788 22208 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:07:59.666287 22201 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:07:59.713598 22201 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:07:59.666632 22210 consensus_queue.cc:1048] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.115s
I20260709 13:07:59.714236 22130 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:07:59.668125 22213 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:07:59.717149 22105 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.663371 22180 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:07:59.719856 22180 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:59.719954 22202 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:07:59.720750 22180 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.721669 22176 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.722525 22191 consensus_queue.cc:1243] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 23.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 13:07:59.668885 14888 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:07:59.723897 14894 raft_consensus.cc:2410] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260709 13:07:59.724022 22074 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.636173 22109 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:07:59.623668 22209 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:07:59.674342 22042 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.620404 22083 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.726619 14887 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:59.647107 22026 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.728869 22026 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.729238 21838 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.635115 21561 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.675897 22033 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.635586 22073 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.676170 21937 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.679105 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.655169 22179 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:07:59.680127 22178 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.682132 22075 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:07:59.632675 22161 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260709 13:07:59.686748 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.689286 21766 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.764110 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:59.689642 15547 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:07:59.653486 22174 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.655351 22100 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:07:59.690578 22207 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.691747 15545 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
W20260709 13:07:59.696744 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.697988 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.707873 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.711459 22096 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:59.719237 22105 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:07:59.754812 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 140815us
I20260709 13:07:59.761021 15542 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 18. (term mismatch)
I20260709 13:07:59.639556 22020 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260709 13:07:59.762872 15541 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.776188 15542 pending_rounds.cc:85] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 17
I20260709 13:07:59.766909 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.769694 15546 raft_consensus.cc:2393] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:59.756443 22179 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:59.771996 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:07:59.773092 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 76573.5us
I20260709 13:07:59.775269 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:59.777863 15545 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:07:59.776580 15542 pending_rounds.cc:107] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:07:59.777959 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.778462 15542 raft_consensus.cc:2889] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:07:59.778685 15038 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:07:59.778612 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:07:59.777935 14859 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:59.782651 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.796978 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.800431 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:07:59.766970 22117 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:59.801064 15546 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.774012 22174 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:07:59.802536 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:07:59.804404 22165 log.cc:927] Time spent T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.604s	user 0.003s	sys 0.000s
W20260709 13:07:59.824590 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:07:59.828385 15035 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:07:59.826471 15545 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:07:59.828860 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:59.804607 22201 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:07:59.826656 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:59.826922 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.830334 15042 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:07:59.832471 14886 raft_consensus.cc:2410] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 22 because replica has last-logged OpId of term: 20 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260709 13:07:59.832357 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:07:59.827467 15044 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:07:59.813118 22091 raft_consensus.cc:3055] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Stepping down as leader of term 17
W20260709 13:07:59.826599 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48743.9us
I20260709 13:07:59.829772 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:07:59.830179 15541 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:07:59.834295 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.838542 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:07:59.839161 14886 raft_consensus.cc:2393] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:07:59.776193 22096 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:07:59.828117 22042 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:07:59.839895 15545 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:07:59.841209 22225 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:07:59.836946 14859 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:07:59.835759 21706 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:07:59.770427 22060 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:07:59.883750 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46893.2us
I20260709 13:07:59.874676 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4328) took 1760 ms. Trace:
I20260709 13:07:59.890086 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:07:59.835460 22075 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:07:59.836033 22091 raft_consensus.cc:740] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:07:59.889900 14889 rpcz_store.cc:276] 0709 13:07:58.114563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.114667 (+   104us) service_pool.cc:224] Handling call
0709 13:07:58.120198 (+  5531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:07:58.120394 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.120422 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:07:58.129899 (+  9477us) log.cc:844] Serialized 26 byte log entry
0709 13:07:58.336586 (+206687us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:58.336643 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:07:58.336727 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:07:59.770174 (+1433447us) spinlock_profiling.cc:243] Waited 981 us on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:07:59.842304 (+ 72130us) raft_consensus.cc:1685] finished
0709 13:07:59.842334 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:07:59.874603 (+ 32269us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2256768,"thread_start_us":187002,"threads_started":1,"wal-append.queue_time_us":57740}
I20260709 13:07:59.911398 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.912531 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:59.873507 22223 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:59.886529 21728 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:07:59.888806 22042 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:07:59.886401 21706 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:07:59.929802 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:07:59.916745 22222 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:07:59.895634 22075 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:07:59.937474 14889 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:07:59.907590 22111 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:07:59.906281 22201 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:07:59.924537 22223 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.004971 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:07:59.928948 21728 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.009748 22042 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.010847 22227 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.012272 22224 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:00.015928 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:07:59.939534 21706 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:07:59.939772 22130 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:07:59.943060 22075 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:00.020704 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:07:59.944263 21766 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.023629 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:07:59.890865 22180 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:00.028560 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.028980 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:00.007942 22174 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:00.035224 15037 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:00.018586 22177 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.039184 14889 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:00.068910 14970 raft_consensus.cc:1240] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:00.039985 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:00.084880 22161 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.085413 22161 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.087363 22161 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.037633 22029 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.050581 22130 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:00.092317 22229 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:08:00.093680 22130 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.091293 22029 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.096370 22029 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:00.031733 22178 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.078768 15546 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:00.038754 22227 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.036501 22172 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 13:08:00.098191 22060 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.098845 22172 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:00.099181 22172 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:00.099725 22227 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.100368 22172 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.101554 22172 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:00.017743 22091 consensus_queue.cc:260] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.103869 22091 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:00.112671 21706 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.114981 21706 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.032374 21728 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.032581 22223 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.124073 14886 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
W20260709 13:08:00.129339 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 100407us
I20260709 13:08:00.132159 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.098054 22179 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.201109 14964 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
W20260709 13:08:00.201468 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 173742us
W20260709 13:08:00.207652 22233 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:08:00.207969 22075 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.210316 22075 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:00.210376 14859 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.844s (SENT)
I20260709 13:08:00.210919 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:00.213408 22096 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.214864 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.217417 22223 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.219723 22231 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:00.195644 22100 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.221474 22179 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.194440 22177 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.195215 22224 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:00.196483 21766 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.232164 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.234925 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.237263 14886 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:00.238691 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1592) took 1925 ms. Trace:
I20260709 13:08:00.237980 21766 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.245656 22100 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.246061 21766 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.247771 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.236824 22177 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.239032 14892 rpcz_store.cc:276] 0709 13:07:58.313629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.333842 (+ 20213us) service_pool.cc:224] Handling call
0709 13:07:58.334233 (+   391us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:07:58.537347 (+203114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:58.537393 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:07:58.538185 (+   792us) log.cc:844] Serialized 52 byte log entry
0709 13:07:58.692519 (+154334us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:07:58.782366 (+ 89847us) log.cc:844] Serialized 14 byte log entry
0709 13:07:58.853988 (+ 71622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.238361 (+1384373us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540020f8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:00.238409 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.238451 (+    42us) raft_consensus.cc:1685] finished
0709 13:08:00.238525 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.238645 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":71385,"prepare.queue_time_us":113339,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":102082,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":19859,"spinlock_wait_cycles":466051328,"thread_start_us":153860,"threads_started":1,"wal-append.queue_time_us":298923,"wal-append.run_cpu_time_us":2084,"wal-append.run_wall_time_us":1004257}
I20260709 13:08:00.249410 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:00.249997 22177 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.250113 22073 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:00.250574 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.251780 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.252336 14964 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:00.252221 14933 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:00.254062 22152 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:08:00.250447 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.255205 14892 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:00.261538 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:00.261166 22223 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.254758 21728 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.267668 22073 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.272925 22152 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.274981 22152 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.276117 22096 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.277616 22152 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.278462 22073 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.278940 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.280068 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.281081 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.281677 14889 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:00.283718 21937 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:08:00.284106 21728 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.283838 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:00.285724 22209 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:00.285848 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:00.286659 22209 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:00.290786 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.290988 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:00.284008 15550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 1641) took 1664 ms (client timeout 1958 ms). Trace:
W20260709 13:08:00.292363 15550 rpcz_store.cc:269] 0709 13:07:58.619228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.619341 (+   113us) service_pool.cc:224] Handling call
0709 13:08:00.283847 (+1664506us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540036db54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:00.283955 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315240192}
I20260709 13:08:00.298048 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:08:00.300673 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:00.293391 22081 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.303918 22081 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.296919 22069 raft_consensus.cc:2764] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 13:08:00.296432 22152 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.309701 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.299896 22029 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.311951 22029 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.313311 22081 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.313889 22207 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.313989 22029 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.314981 21874 raft_consensus.cc:3055] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:00.317620 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:00.318274 14962 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.320534 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:00.321103 14967 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:00.323446 22073 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.324819 21561 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.317694 21874 raft_consensus.cc:740] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:00.327263 21874 consensus_queue.cc:260] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.327975 14962 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:08:00.328609 21874 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.330539 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.323369 22081 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:00.332408 22100 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.332866 22100 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.334750 22100 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.335805 21927 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.336359 21927 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.338481 21927 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.340764 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.341468 14893 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:00.342206 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:00.342844 14893 raft_consensus.cc:2393] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:00.311534 22152 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.343274 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.343703 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.343878 15039 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:08:00.344614 22202 consensus_queue.cc:1059] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:00.345367 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.346107 15044 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:00.348944 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.349519 14963 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:00.352155 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.346072 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:00.335196 22100 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.355206 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.356374 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:00.359073 15544 raft_consensus.cc:2410] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 21 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:08:00.359356 14963 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:00.359748 14962 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
W20260709 13:08:00.362272 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.362824 14970 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:00.363443 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.345212 22152 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.365357 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.368062 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.368637 14963 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:00.370307 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:00.372934 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:00.373494 14969 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:00.376053 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:00.376848 15545 raft_consensus.cc:2393] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:00.363698 21845 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:00.380720 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.380970 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:00.381616 14893 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:00.383701 14967 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
I20260709 13:08:00.384369 14964 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:00.384835 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:00.387928 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:00.356699 21728 raft_consensus.cc:3055] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:00.390542 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:00.391113 15542 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:08:00.391587 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.392726 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.393025 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.393316 15037 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:00.393510 15008 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:00.375267 21926 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:00.394201 15042 raft_consensus.cc:2410] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:08:00.398656 15542 raft_consensus.cc:1240] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:00.403822 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.375294 21927 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:00.406805 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:00.353993 22202 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 13:08:00.436406 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.407737 15550 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:00.412170 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:00.412729 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:00.413648 22099 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:00.413594 21679 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:00.442284 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.449414 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:00.373638 22100 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.390456 21845 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.440709 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:00.395268 21728 raft_consensus.cc:740] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:00.468096 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:00.464829 14969 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:00.399729 21961 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.477207 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 70482.4us
I20260709 13:08:00.470479 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:00.428792 22182 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.493713 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:00.441797 22099 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.523238 15543 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:00.527604 22099 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:00.529716 22232 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.695s	user 0.003s	sys 0.000s
I20260709 13:08:00.447386 22069 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:00.536613 22123 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:00.537094 22069 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:00.538168 22069 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.485800 22029 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:00.499172 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3482) took 1171 ms. Trace:
I20260709 13:08:00.499543 21766 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.477339 22209 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:00.500543 22179 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:00.551337 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 1.06996e+06us
I20260709 13:08:00.551976 15544 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:00.552161 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:00.495965 22182 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.499193 14889 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:08:00.502485 14969 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:00.516841 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:00.518239 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:00.556582 15541 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:00.520527 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1816) took 1074 ms. Trace:
I20260709 13:08:00.520291 21728 consensus_queue.cc:260] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.522774 22100 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.522852 22160 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.562770 22160 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.564224 22103 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:00.564920 21937 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:00.565263 22160 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.566078 14892 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:00.566464 14889 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:00.566669 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1610) took 1232 ms. Trace:
I20260709 13:08:00.567250 14892 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:00.469334 21845 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:00.486034 21961 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.532984 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3490) took 1203 ms. Trace:
I20260709 13:08:00.543725 22123 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.491480 21927 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:00.550930 22209 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.536065 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:00.545172 14894 rpcz_store.cc:276] 0709 13:07:59.327838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.327961 (+   123us) service_pool.cc:224] Handling call
0709 13:08:00.498975 (+1171014us) spinlock_profiling.cc:243] Waited 389 ms on lock 0x7b54000ae1d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:00.499112 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":893625088}
I20260709 13:08:00.579344 14892 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:00.580801 14894 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:00.558861 15547 rpcz_store.cc:276] 0709 13:07:59.445961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.446100 (+   139us) service_pool.cc:224] Handling call
0709 13:08:00.520286 (+1074186us) spinlock_profiling.cc:243] Waited 72.2 ms on lock 0x7b540071e654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:00.520453 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166069504}
I20260709 13:08:00.583144 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:00.583987 15543 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:00.560034 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:00.562110 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.448107 22161 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:00.567054 14887 rpcz_store.cc:276] 0709 13:07:59.333881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.345490 (+ 11609us) service_pool.cc:224] Handling call
0709 13:08:00.566495 (+1221005us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400147b54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:00.566616 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705689472}
I20260709 13:08:00.568774 14889 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:08:00.549526 21766 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:00.490175 22081 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:00.609776 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:00.571146 14888 rpcz_store.cc:276] 0709 13:07:59.329902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.426599 (+ 96697us) service_pool.cc:224] Handling call
0709 13:07:59.426916 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.723399 (+296483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.532685 (+809286us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000ce254. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:00.532908 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":525275520}
I20260709 13:08:00.572979 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:00.614319 15544 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:00.535580 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:00.600637 14861 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:00.561333 22194 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:00.630710 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 95197.3us
W20260709 13:08:00.626569 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47259.2us
I20260709 13:08:00.627894 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:00.632683 15541 raft_consensus.cc:2393] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:00.628168 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:00.629665 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.636003 14969 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:00.634991 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:00.652066 15544 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 23.
I20260709 13:08:00.654032 22182 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.654758 21766 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:00.608253 22209 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:00.559350 22179 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.578806 22123 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.641342 22178 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:00.641227 22174 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:08:00.708426 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.631042 22103 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.609102 22161 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.627228 22231 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.710438 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.699944 22019 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:00.662708 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:00.713632 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 51013.8us
I20260709 13:08:00.714893 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:00.663297 22042 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:00.608832 21728 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:00.639942 22160 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:00.636624 22100 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:00.667625 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.719800 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.644419 22194 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.668196 22073 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:00.644093 22088 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:00.669904 22153 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:00.671154 22024 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:00.671799 22099 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.644812 22152 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:08:00.677100 21874 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:08:00.681773 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 53671.7us
I20260709 13:08:00.709137 15040 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.575616 21927 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.660598 22081 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:00.711943 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:00.717254 15042 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:00.722416 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:00.725302 14964 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:00.725054 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.711205 22161 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:00.730587 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.711010 22178 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:00.725503 21561 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:00.727305 21994 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:00.769471 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:00.773059 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.773819 15042 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260709 13:08:00.774670 15042 pending_rounds.cc:85] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 11
I20260709 13:08:00.774976 15042 pending_rounds.cc:107] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:08:00.774309 15044 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:00.775256 15042 raft_consensus.cc:2889] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:00.728636 22024 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:00.716145 22103 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:00.777488 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 217443us
I20260709 13:08:00.777812 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:00.731371 22088 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:00.782872 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.785704 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.786511 15041 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:00.791965 15040 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:08:00.766487 21927 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:00.791386 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:00.716802 22231 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.770964 21561 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.808583 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.819787 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.821748 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.822026 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.822731 15040 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:00.828895 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:00.781410 22224 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:00.836441 21679 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:00.790431 22223 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:00.766130 22019 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:08:00.844676 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:00.821403 21561 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:00.848558 15040 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:08:00.847275 22224 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:00.845228 21766 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:00.847733 22069 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.868388 22152 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:00.868850 15035 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:00.842430 21679 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:00.881753 15044 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
W20260709 13:08:00.876354 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:00.917675 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:00.856715 22223 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.856967 22029 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:00.930049 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3486) took 1601 ms. Trace:
I20260709 13:08:00.935092 14891 rpcz_store.cc:276] 0709 13:07:59.328952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.335126 (+  6174us) service_pool.cc:224] Handling call
0709 13:07:59.335374 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:07:59.634624 (+299250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:07:59.634668 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:07:59.634726 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:07:59.634782 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.929829 (+1295047us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400148554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:00.929873 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:00.929995 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":687648512}
I20260709 13:08:00.941299 15035 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:00.910724 22152 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:00.909327 21766 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:00.846184 22088 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.930258 22060 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.908972 22069 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.954521 22152 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:00.931650 22223 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.953255 22179 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:00.856945 22024 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.957350 22259 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:00.862362 22178 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.858454 22081 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.955935 22194 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:00.967283 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 175965us
I20260709 13:08:00.989526 22259 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:00.990620 15037 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:08:00.960944 22042 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index 9 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:01.000540 15038 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:01.008064 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:01.004025 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 127038us
I20260709 13:08:01.014125 15039 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 23.
I20260709 13:08:01.015318 22019 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:01.017306 22019 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:08:01.021145 14965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2937) took 2510 ms (client timeout 1844 ms). Trace:
I20260709 13:08:01.021908 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:01.023545 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:01.023669 14966 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:01.025669 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3842) took 2261 ms. Trace:
I20260709 13:08:01.025974 14966 rpcz_store.cc:276] 0709 13:07:58.764333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.784363 (+ 20030us) service_pool.cc:224] Handling call
0709 13:08:01.023493 (+2239130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.024191 (+   698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.025495 (+  1304us) spinlock_profiling.cc:243] Waited 2.24 s on lock 0x7b54003e6050. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:01.025607 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5148858112}
I20260709 13:08:01.027241 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.027925 14891 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:01.028834 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.030243 14888 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:01.033342 22179 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:01.034685 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.036478 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.037217 15039 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:01.038602 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:01.021569 14965 rpcz_store.cc:269] 0709 13:07:58.510446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:58.510571 (+   125us) service_pool.cc:224] Handling call
0709 13:08:01.020935 (+2510364us) spinlock_profiling.cc:243] Waited 972 ms on lock 0x7b54003e6054. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:01.021066 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2236165504}
I20260709 13:08:01.054280 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.061363 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.067087 15038 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:01.067251 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.068672 14887 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:00.967108 22060 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.080585 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:01.081781 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 359437us
I20260709 13:08:01.083148 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:01.087433 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.089884 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:00.984488 22224 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.051734 22103 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.046327 22194 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:00.982381 21679 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.120483 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.043728 22019 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:08:01.111629 22075 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:01.077610 22231 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.126025 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.124616 15039 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 9 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:01.144289 15542 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:01.126825 15038 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 15. Current term is 16. Ops: [13.9-15.10]
I20260709 13:08:01.130095 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:01.132066 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.006762 22029 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.146363 15541 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:01.079198 22123 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.044435 22272 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 13:08:01.112164 22099 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.013137 21766 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.152980 15548 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:01.139321 22117 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260709 13:08:01.052678 22109 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:01.184773 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.144759 22075 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.181592 22274 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.167484 22271 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 13:08:01.195302 22274 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.195940 22060 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.157100 22231 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:01.180709 22270 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:01.180363 22261 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
W20260709 13:08:01.179822 22268 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:01.122629 21728 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
W20260709 13:08:01.157835 21845 consensus_meta.cc:287] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.581s	user 0.006s	sys 0.005s
I20260709 13:08:01.156499 22269 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.181816 22073 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:01.199169 22266 log.cc:927] Time spent T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:01.180254 22069 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.197973 22274 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.179581 22259 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.199102 22075 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:01.193341 22267 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:01.205413 22258 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:08:01.202126 22109 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:01.201166 22270 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:01.146731 22194 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.201710 22231 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:01.221216 14966 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:01.232472 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:01.233278 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.235520 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.236550 14966 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:01.238339 15548 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:01.239107 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.239835 15543 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:08:01.241645 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:01.243273 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.239740 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.248940 15547 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:08:01.249353 15547 pending_rounds.cc:85] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 11
W20260709 13:08:01.249154 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 178008us
I20260709 13:08:01.249589 15547 pending_rounds.cc:107] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:08:01.249842 15547 raft_consensus.cc:2889] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:01.214278 22179 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:01.254133 14888 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:01.254326 14894 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:01.256036 14894 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 13:08:01.256433 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.257062 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.257652 14891 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:01.258634 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.251080 15547 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:01.213140 21845 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.221210 22270 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:01.261086 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.228894 22265 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:01.214368 22269 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.250388 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:01.263914 14892 raft_consensus.cc:1240] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.264866 14886 raft_consensus.cc:1240] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:01.270071 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.275897 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.220952 22267 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.263923 22103 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:01.253204 22223 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.278180 14893 raft_consensus.cc:2368] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20.
I20260709 13:08:01.266477 22276 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.287257 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:01.288335 15547 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:01.290395 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.292337 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:01.293136 15547 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:01.285588 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 244710us
I20260709 13:08:01.300822 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:01.301353 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.303498 14888 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:01.281910 22274 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:01.284070 22103 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.312973 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.314781 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.315435 15548 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:01.316718 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.317477 14887 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:01.288916 22178 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.310277 22274 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:01.302994 22153 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.007s
I20260709 13:08:01.281750 22259 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:08:01.307261 22073 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:01.325932 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.321887 15548 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:01.274515 22265 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.299433 22081 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:01.340378 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.318967 21766 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:01.343391 15007 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:01.325325 21994 consensus_meta.cc:287] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.005s
I20260709 13:08:01.316296 22103 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:01.320722 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:01.321491 22274 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:01.394088 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 73437us
I20260709 13:08:01.355661 15547 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:01.395927 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.354991 15548 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:01.356667 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.357703 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.357429 14887 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:01.293213 22276 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.403102 15547 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:08:01.332985 22096 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.400061 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.292526 22231 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:01.410794 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97929us
I20260709 13:08:01.466163 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:01.341503 22273 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:01.319511 22178 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.341701 22288 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:01.469739 14894 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:01.425082 22120 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:01.470268 22120 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:01.470698 22120 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:01.472330 22024 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:01.472939 22096 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:01.474699 22291 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:08:01.354188 22153 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.332880 22284 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:01.357116 21987 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:08:01.397624 21994 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:01.423456 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1734) took 1056 ms. Trace:
I20260709 13:08:01.354504 22099 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260709 13:08:01.481909 14961 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 13:08:01.340281 22223 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.075s
I20260709 13:08:01.402884 21728 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:01.392618 22121 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 13:08:01.424798 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:01.484426 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 59706.3us
I20260709 13:08:01.485636 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.486519 22287 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:01.486946 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:01.425333 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 138158us
I20260709 13:08:01.321695 22179 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.487339 22287 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:01.397984 22281 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:01.488574 22287 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:01.488951 22152 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.505s	user 0.001s	sys 0.008s
I20260709 13:08:01.489018 22281 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.489362 22287 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:01.490062 22287 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:01.463512 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:01.492620 15548 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:01.447021 21927 consensus_meta.cc:287] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.627s	user 0.004s	sys 0.004s
I20260709 13:08:01.422412 22098 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:01.457456 22209 consensus_meta.cc:287] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.005s
W20260709 13:08:01.458559 22282 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 13:08:01.459136 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1644) took 1856 ms. Trace:
I20260709 13:08:01.354506 22073 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:01.377270 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:01.461880 14968 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:01.422111 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 78825.8us
I20260709 13:08:01.475553 14965 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:01.476225 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.476794 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.478046 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.512153 15547 raft_consensus.cc:2393] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:01.479166 14895 raft_consensus.cc:2410] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260709 13:08:01.481619 14962 rpcz_store.cc:276] 0709 13:08:00.367132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.367310 (+   178us) service_pool.cc:224] Handling call
0709 13:08:00.367809 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.368143 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.368172 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.380434 (+ 12262us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.992230 (+611796us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b18004a7520. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:01.208329 (+216099us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:08:01.208370 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.208446 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.419307 (+210861us) raft_consensus.cc:1685] finished
0709 13:08:01.419334 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.423362 (+  4028us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3058,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":1353,"spinlock_wait_cycles":36526976,"thread_start_us":215889,"threads_started":1,"wal-append.queue_time_us":883471}
I20260709 13:08:01.489470 22152 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.502907 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:01.521721 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54369.3us
I20260709 13:08:01.505132 15549 rpcz_store.cc:276] 0709 13:07:59.602423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.602543 (+   120us) service_pool.cc:224] Handling call
0709 13:08:00.285272 (+682729us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.285670 (+   398us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:00.285700 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.286155 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 13:08:00.364338 (+ 78183us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:08:00.679790 (+315452us) log.cc:844] Serialized 14 byte log entry
0709 13:08:00.680114 (+   324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:00.680215 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:00.680272 (+    57us) raft_consensus.cc:1685] finished
0709 13:08:00.680290 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.458879 (+778589us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b540036db50. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:01.459044 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":311235,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":934,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":5777,"spinlock_wait_cycles":1569585536,"thread_start_us":380074,"threads_started":2,"wal-append.queue_time_us":100397}
I20260709 13:08:01.522719 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.528589 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.529443 15547 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:01.530462 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.519995 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.532464 15545 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:01.534210 15547 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:01.536578 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:01.537103 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:01.493995 21845 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.478631 22297 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:01.496263 21728 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:01.543841 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.505650 22284 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:01.510255 22259 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.522415 22286 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.566661 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.537071 21937 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:01.547365 21561 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.684s	user 0.010s	sys 0.002s
I20260709 13:08:01.544253 21874 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:01.507212 21927 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.491637 22287 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.509979 22081 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.064s
I20260709 13:08:01.552718 22267 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.461216 21766 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.547140 22285 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:01.595075 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 94822.5us
I20260709 13:08:01.549427 22269 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.597469 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:01.598151 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 75538.4us
I20260709 13:08:01.600565 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:01.571246 22096 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.606848 15041 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 20. Ops: [18.13-18.13]
I20260709 13:08:01.511386 22209 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.565464 22194 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.567462 22071 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:01.591641 22296 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:01.613524 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62999us
I20260709 13:08:01.594798 22297 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:01.636929 15547 raft_consensus.cc:1240] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:01.590349 21937 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.595822 21561 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.642814 21561 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:01.648468 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 47982.4us
I20260709 13:08:01.638176 21728 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.676515 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.671149 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.674557 15548 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:01.632507 22287 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:01.572883 22286 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.661123 15040 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.661549 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.663251 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.682574 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.663502 22121 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:01.664002 22173 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:01.664358 21927 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:01.665637 22160 raft_consensus.cc:3055] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:01.666574 15039 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:01.603094 22099 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260709 13:08:01.695490 21961 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:01.634106 22284 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.696082 21766 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.611315 22073 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.697924 22286 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.613507 22265 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.669226 22152 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.678992 15044 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:01.654526 22274 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.679924 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.700110 15042 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:08:01.635910 22075 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.701061 22274 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:01.702718 22075 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.683080 15037 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
I20260709 13:08:01.643821 22303 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.067s
I20260709 13:08:01.705035 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.681079 21874 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 13:08:01.706192 22270 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.690145 22305 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
W20260709 13:08:01.707362 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.683220 15040 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:01.684414 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.708555 14968 raft_consensus.cc:1275] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:08:01.658937 22103 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.709537 22019 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:01.710083 14962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3866) took 1034 ms. Trace:
I20260709 13:08:01.710044 22019 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.710801 22103 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:01.711890 22209 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.689502 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:01.670178 22042 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:01.713515 15039 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:01.681798 22278 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 13:08:01.710580 14962 rpcz_store.cc:276] 0709 13:08:00.675591 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.527513 (+851922us) service_pool.cc:224] Handling call
0709 13:08:01.527858 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.528094 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:01.600980 (+ 72886us) log.cc:844] Serialized 14 byte log entry
0709 13:08:01.709759 (+108779us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:01.709809 (+    50us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:01.709850 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.709915 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.710019 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44429,"prepare.queue_time_us":139934,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":46249,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":123020,"threads_started":2,"wal-append.queue_time_us":44601}
I20260709 13:08:01.714264 15035 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:01.715709 22099 consensus_queue.cc:1243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 23.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:08:01.716147 21937 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.716228 22099 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:01.716917 22099 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:01.717221 22305 raft_consensus.cc:3055] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:01.717374 22297 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:01.717762 22099 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.720424 22270 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.717648 22305 raft_consensus.cc:740] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:08:01.692634 22309 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:08:01.745687 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:01.748258 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.753166 14962 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:01.754559 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.755226 14962 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:01.691243 22160 raft_consensus.cc:740] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:01.716042 22281 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:01.742303 22294 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 13:08:01.761735 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.762590 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.764917 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.762756 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:01.689908 22121 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:01.726970 22161 consensus_meta.cc:287] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.005s
I20260709 13:08:01.763720 22109 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.771683 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:01.792742 14888 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:01.726629 21927 consensus_queue.cc:1059] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 13:08:01.760644 22265 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:01.744808 22303 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 13:08:01.758061 22075 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 13:08:01.776993 22121 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:01.769951 22264 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:01.779296 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.735692 22120 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:07:59.766386 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:08:01.782147 14893 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4358) took 1472 ms. Trace:
I20260709 13:08:01.717121 22296 consensus_queue.cc:1059] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:08:01.744876 22286 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.723479 21994 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 13:08:01.784772 22178 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.726454 21987 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260709 13:08:01.756402 22231 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:01.727293 22153 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 13:08:01.736083 21706 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 13:08:01.804059 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 193683us
W20260709 13:08:01.816864 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 72820.1us
I20260709 13:08:01.814478 15036 raft_consensus.cc:2410] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:08:01.815647 14893 rpcz_store.cc:276] 0709 13:08:00.309306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.476607 (+167301us) service_pool.cc:224] Handling call
0709 13:08:01.781974 (+1305367us) spinlock_profiling.cc:243] Waited 783 ms on lock 0x7b54000da554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:01.782094 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1801604992}
I20260709 13:08:01.852499 14962 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:01.854123 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.855036 14966 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 13:08:01.855495 14933 leader_election.cc:400] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20.
I20260709 13:08:01.859462 14966 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260709 13:08:01.858680 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.860386 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:01.862936 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.863845 14966 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:01.866487 14966 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:08:01.867486 14888 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:01.868981 14933 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:01.870788 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:01.813735 22120 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:01.879694 14788 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 220) took 18450 ms (client timeout 15000 ms). Trace:
I20260709 13:08:01.879916 21994 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:01.880496 21994 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.821098 22286 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.870205 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.803387 22109 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.875917 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:01.883541 14963 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:01.805307 22161 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.856081 22152 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:01.856117 22155 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:01.877048 21706 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:01.878257 22273 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:01.878744 22153 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:01.879441 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3861) took 1241 ms. Trace:
I20260709 13:08:01.911128 14967 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:01.808612 22060 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:01.883980 15546 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 25 because replica has last-logged OpId of term: 24 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 20.
I20260709 13:08:01.827730 22231 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.911375 14970 rpcz_store.cc:276] 0709 13:08:00.638298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.732288 (+ 93990us) service_pool.cc:224] Handling call
0709 13:08:00.771960 (+ 39672us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:01.691586 (+919626us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b180044a9a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f5534d6e060 00007f5534d6ebfb 00007f5534d7964b
0709 13:08:01.691708 (+   122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:01.691732 (+    24us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:01.692257 (+   525us) log.cc:844] Serialized 52 byte log entry
0709 13:08:01.768071 (+ 75814us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:01.768125 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.768222 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.879122 (+110900us) raft_consensus.cc:1685] finished
0709 13:08:01.879143 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.879366 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":154517,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":10984,"spinlock_wait_cycles":4936960,"thread_start_us":215078,"threads_started":2,"wal-append.queue_time_us":106589}
I20260709 13:08:01.915678 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3868) took 1238 ms. Trace:
I20260709 13:08:01.916082 14968 rpcz_store.cc:276] 0709 13:08:00.677690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.536288 (+858598us) service_pool.cc:224] Handling call
0709 13:08:01.551724 (+ 15436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.708942 (+157218us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.915438 (+206496us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54003e7454. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:01.915614 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":359939328}
I20260709 13:08:01.898459 15543 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:01.884462 22096 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:01.868781 22019 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:01.880153 14788 rpcz_store.cc:269] 0709 13:07:43.429622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:43.429875 (+   253us) service_pool.cc:224] Handling call
0709 13:07:43.453313 (+ 23438us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534ce0090 00007f5534d7ef3a 00007f553ab351cc 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc 00007f55390f3392 00007f55330b148c 00007f55330b08c6
0709 13:08:01.879570 (+18426257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:07:55.807734 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:07:55.808409 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:07:55.808463 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:07:55.808482 (+    19us) tablet.cc:662] Decoding operations
0709 13:07:55.809631 (+  1149us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:07:55.809727 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 13:07:55.809762 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:07:55.811057 (+  1295us) tablet.cc:701] Row locks acquired
0709 13:07:55.811117 (+    60us) write_op.cc:260] PREPARE: finished
0709 13:07:55.811305 (+   188us) write_op.cc:270] Start()
0709 13:07:55.827098 (+ 15793us) write_op.cc:276] Timestamp: P: 1783602475811239 usec, L: 0
0709 13:07:55.829971 (+  2873us) op_driver.cc:348] REPLICATION: starting
0709 13:07:55.912790 (+ 82819us) log.cc:844] Serialized 4706 byte log entry
0709 13:07:56.564109 (+651319us) op_driver.cc:464] REPLICATION: finished
0709 13:07:57.012662 (+448553us) write_op.cc:301] APPLY: starting
0709 13:07:57.028510 (+ 15848us) tablet.cc:1367] starting BulkCheckPresence
0709 13:07:57.134023 (+105513us) tablet.cc:1370] finished BulkCheckPresence
0709 13:07:57.134151 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:07:57.884441 (+750290us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:07:57.963533 (+ 79092us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:07:57.963606 (+    73us) write_op.cc:312] APPLY: finished
0709 13:07:57.964098 (+   492us) log.cc:844] Serialized 113 byte log entry
0709 13:07:58.054336 (+ 90238us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.124828 (+ 70492us) write_op.cc:454] Released schema lock
0709 13:07:58.137169 (+ 12341us) write_op.cc:341] FINISH: Updating metrics
0709 13:07:58.172935 (+ 35766us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:07:58.173942 (+  1007us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77326,"reported_tablets":30,"spinlock_wait_cycles":3735296,"child_traces":[["op",{"apply.queue_time_us":327874,"apply.run_cpu_time_us":45588,"apply.run_wall_time_us":1185791,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54287,"num_ops":12,"prepare.queue_time_us":618404,"prepare.run_cpu_time_us":17264,"prepare.run_wall_time_us":241529,"raft.queue_time_us":349188,"raft.run_cpu_time_us":58341,"raft.run_wall_time_us":270268,"replication_time_us":661926,"thread_start_us":1023564,"threads_started":5,"wal-append.queue_time_us":329040,"wal-append.run_cpu_time_us":112305,"wal-append.run_wall_time_us":2424278}]]}
I20260709 13:08:01.908084 15541 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:01.909703 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:01.899498 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 222797us
W20260709 13:08:01.917927 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 252866us
I20260709 13:08:01.885881 22288 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:01.886217 22152 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:01.900954 21706 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:01.936203 21706 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:01.937145 22231 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.937863 21706 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:01.902083 22024 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:01.916091 22060 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:08:01.953464 14895 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3496) took 2020 ms (client timeout 1811 ms). Trace:
W20260709 13:08:01.954063 14895 rpcz_store.cc:269] 0709 13:07:59.956959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.028343 (+ 71384us) service_pool.cc:224] Handling call
0709 13:08:01.953156 (+1924813us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000f7654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:01.953366 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3225789696}
I20260709 13:08:01.959524 22265 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:01.960073 22265 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:01.961131 22265 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.964563 21961 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:01.965060 21961 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:01.966012 21961 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.939261 22161 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:01.911641 22155 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.976126 14964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3864) took 1337 ms. Trace:
I20260709 13:08:01.981328 14964 rpcz_store.cc:276] 0709 13:08:00.638984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.994082 (+355098us) service_pool.cc:224] Handling call
0709 13:08:00.994510 (+   428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:00.994918 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 13:08:00.994957 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:00.998196 (+  3239us) log.cc:844] Serialized 26 byte log entry
0709 13:08:01.810683 (+812487us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18003f9820. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:01.882619 (+ 71936us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:01.882676 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:01.885435 (+  2759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:01.966971 (+ 81536us) raft_consensus.cc:1685] finished
0709 13:08:01.967000 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:01.976044 (+  9044us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":48984,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":12185,"spinlock_wait_cycles":8691456,"thread_start_us":71755,"threads_started":1,"wal-append.queue_time_us":927646}
W20260709 13:08:01.976451 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:01.978825 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50240us
W20260709 13:08:01.979526 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 51610.5us
I20260709 13:08:01.917660 22153 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:01.979935 21961 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:01.988987 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:01.943356 22288 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:01.915722 22273 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.008093 21874 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:02.010294 22286 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.002892 22109 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:01.992815 22152 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.013444 22152 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:01.946053 22024 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.017781 22024 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:01.976210 22265 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:02.024973 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.032021 22100 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:02.032481 22100 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:02.033315 22100 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.031491 22060 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.035565 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.042227 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:02.045622 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:02.034025 22185 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:02.048277 15516 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.034528 21994 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.035540 22024 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:02.107089 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58875.6us
I20260709 13:08:02.044384 22060 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:02.046918 22100 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:02.044622 22287 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.044971 22029 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:02.048609 21874 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.054246 22278 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:02.119742 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.106643 21961 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.108647 22315 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:02.108294 22209 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.106396 21937 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:02.111451 22103 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:02.132591 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 143691us
W20260709 13:08:02.131361 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.119480 22029 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.134577 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.121178 22278 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:02.140372 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.140552 22314 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:02.118366 22062 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 13:08:02.141636 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:02.141747 15039 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:08:02.142926 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.055303 22288 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.116609 22024 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.133821 21937 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:02.133725 22103 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.137542 22272 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.150014 15010 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.147758 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.122531 21874 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.127454 22287 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.137858 22029 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:02.140383 22278 raft_consensus.cc:3060] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:02.147799 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.155856 14893 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 12.
I20260709 13:08:02.135794 22209 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.148378 22314 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.184473 22314 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:02.187021 22024 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:02.130089 21961 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.168148 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:02.170074 22274 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:02.206676 22274 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.207139 22274 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.207508 21961 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.207823 22303 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:02.208221 22303 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:08:02.208341 15036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3765) took 2648 ms (client timeout 2115 ms). Trace:
I20260709 13:08:02.208645 22303 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:02.208788 15036 rpcz_store.cc:269] 0709 13:07:59.559774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:59.565473 (+  5699us) service_pool.cc:224] Handling call
0709 13:08:02.208101 (+2642628us) spinlock_profiling.cc:243] Waited 2.25 s on lock 0x7b540014a0d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:02.208244 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5169478400}
I20260709 13:08:02.177618 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3865) took 1532 ms. Trace:
I20260709 13:08:02.209888 14961 rpcz_store.cc:276] 0709 13:08:00.645216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.212517 (+567301us) service_pool.cc:224] Handling call
0709 13:08:01.221298 (+  8781us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.482257 (+260959us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.177371 (+695114us) spinlock_profiling.cc:243] Waited 260 ms on lock 0x7b54003e5654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:02.177555 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":598637312}
I20260709 13:08:02.181066 22209 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.182904 22276 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.145390 22257 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 13:08:02.213102 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.213719 15036 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:02.214854 22274 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.216710 22024 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:02.217880 22024 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.218247 22276 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:02.218781 22276 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.220600 22024 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.220975 22276 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.222867 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.164763 14895 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:02.190507 14890 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:02.191110 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.229161 14889 raft_consensus.cc:2393] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:02.152437 22318 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:02.233238 22336 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 13:08:02.234294 22327 log.cc:927] Time spent T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 13:08:02.237236 22331 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 13:08:02.241473 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 3249) took 1443 ms. Trace:
I20260709 13:08:02.241600 22274 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.242172 22274 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.242666 22274 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:02.244197 22329 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:08:02.244699 22155 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.248488 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:02.249092 22075 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.249881 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:02.250548 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:02.250960 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:02.251133 14966 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:02.253958 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.254487 15035 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.257530 15036 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:02.258021 15544 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:02.258533 22111 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.258625 22270 consensus_queue.cc:1059] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:02.259104 22111 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.154778 22103 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:02.195729 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 45810.8us
I20260709 13:08:02.262974 15010 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:02.196635 22321 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:02.297557 14890 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:02.307127 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.308218 14890 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:02.197824 21766 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.199637 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.161046 22272 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.154454 21937 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:02.045483 22128 consensus_queue.cc:1175] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "eb4a5ac9f0c5425b92051187b939860f" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:08:02.206758 22160 consensus_queue.cc:260] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.328835 15547 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:08:02.329663 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.330716 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:02.331806 14889 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:02.249637 22075 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.193478 21874 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.263630 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 1886) took 1025 ms. Trace:
I20260709 13:08:02.342337 15546 rpcz_store.cc:276] 0709 13:08:01.238227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.238352 (+   125us) service_pool.cc:224] Handling call
0709 13:08:02.263466 (+1025114us) spinlock_profiling.cc:243] Waited 641 ms on lock 0x7b5400afc8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:02.263580 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1474795264}
I20260709 13:08:02.264032 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.264999 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:02.265391 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.344647 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.267345 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.268383 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:02.268950 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50298.5us
I20260709 13:08:02.269829 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.345868 15541 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:08:02.270423 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.280303 14966 raft_consensus.cc:2468] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:02.241920 15041 rpcz_store.cc:276] 0709 13:08:00.798480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.799018 (+   538us) service_pool.cc:224] Handling call
0709 13:08:00.799435 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:01.610292 (+810857us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.241202 (+630910us) spinlock_profiling.cc:243] Waited 807 ms on lock 0x7b54001f4ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:02.241416 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1856310528}
I20260709 13:08:02.347319 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.294478 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.295177 15035 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:02.311600 15039 raft_consensus.cc:1275] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 13:08:02.313297 15037 raft_consensus.cc:1240] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260709 13:08:02.348651 15039 pending_rounds.cc:85] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 15
I20260709 13:08:02.348899 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.318022 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:02.323465 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.349711 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:02.350005 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.300146 15542 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index 9 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:02.338203 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 232341us
I20260709 13:08:02.340780 15548 raft_consensus.cc:1240] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:02.340636 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.346333 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:02.348973 15039 pending_rounds.cc:107] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 13:08:02.352291 15039 raft_consensus.cc:2889] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.353624 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.351642 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:02.237269 22099 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:02.355911 15041 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:02.358503 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.356091 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.358444 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.359088 15041 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:02.360376 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:02.360908 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 93666.9us
I20260709 13:08:02.361263 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.297091 22153 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.293619 22274 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.316254 22155 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:02.363433 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.369426 14892 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:02.362346 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.373272 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:02.362274 15516 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.375240 15035 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 13:08:02.337468 21766 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.378021 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.368925 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:02.368216 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:02.381028 14936 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.380657 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:02.338320 22209 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.382747 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:02.304479 21728 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 13:08:02.385586 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:02.392961 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.384608 15514 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.368044 22202 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:02.388680 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.334717 22270 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:08:02.397411 15548 raft_consensus.cc:2376] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18. Re-sending same reply.
I20260709 13:08:02.370227 22273 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.391646 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.393328 15543 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 25 because replica has last-logged OpId of term: 24 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 20.
I20260709 13:08:02.331542 22321 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:02.360023 22231 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:08:02.394258 15546 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:02.316362 22100 consensus_queue.cc:1059] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.059s
I20260709 13:08:02.399590 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:02.402717 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:02.374090 22062 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:02.374209 22177 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:02.385385 22224 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:02.389545 22207 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:02.424409 14936 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.371236 22109 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:08:02.423112 15541 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.423902 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.386245 22179 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:02.390719 22274 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.403623 22227 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:02.414294 15041 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:02.374332 22024 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 13:08:02.387255 22155 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:08:02.433032 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.433140 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.397114 22202 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.425617 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.461598 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.422022 22270 consensus_queue.cc:1243] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 17.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260709 13:08:02.438953 22152 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:02.440038 22339 log.cc:927] Time spent T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:02.444662 21766 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.436239 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.445531 21706 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:02.451902 21728 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:02.422992 22062 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.449613 22177 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.403863 22267 consensus_queue.cc:1048] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.055s
I20260709 13:08:02.446898 22179 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:02.464273 22202 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:02.474308 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:02.460114 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57579.3us
I20260709 13:08:02.474521 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:02.474159 15541 raft_consensus.cc:2468] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:02.506198 22173 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:02.506785 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.395977 22209 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.475338 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:02.477303 14968 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:02.525610 14968 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:02.525983 15546 raft_consensus.cc:2410] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 24 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 17.
I20260709 13:08:02.526425 14968 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.527614 14968 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:02.528661 22209 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.421679 22176 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:02.530676 22176 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:02.531586 22176 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.478713 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:02.532764 22176 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:02.478727 14962 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260709 13:08:02.533941 14962 pending_rounds.cc:85] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 9
I20260709 13:08:02.534233 14962 pending_rounds.cc:107] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 15.10
W20260709 13:08:02.484637 22073 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.031s	sys 0.024s
I20260709 13:08:02.534479 14962 raft_consensus.cc:2889] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:02.476049 22270 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:02.464280 21987 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:02.468858 22264 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:02.500986 22179 raft_consensus.cc:3060] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.471808 22100 raft_consensus.cc:3055] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:02.596885 22100 raft_consensus.cc:740] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:02.598102 22100 consensus_queue.cc:260] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.517460 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:02.504963 15010 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:02.485663 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.485181 22062 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:02.602682 15008 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.596s (SENT) [suppressed 25 similar messages]
I20260709 13:08:02.483605 22177 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.482313 21728 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:02.604193 21728 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.605180 21728 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:02.542862 22287 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:02.540303 22073 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.031s	sys 0.024s
I20260709 13:08:02.447932 22224 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:02.607295 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 102418us
I20260709 13:08:02.607736 22224 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.608634 15010 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.608587 22029 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.548053 14968 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 13:08:02.564234 21766 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:02.567548 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.612481 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.571745 22155 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.484961 22152 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 13:08:02.614030 22318 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.614598 22318 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.616520 21927 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.616737 22088 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 13:08:02.617282 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.617038 21927 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.612535 21766 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:02.551720 22109 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:02.619136 21927 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.620244 21766 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.621289 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.623212 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.625141 22224 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.574256 22272 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.595956 22075 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.543673 22173 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:02.616998 22318 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.584017 22321 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.628667 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.636333 15040 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:02.649693 22029 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.611173 21987 raft_consensus.cc:2804] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:02.626935 22161 raft_consensus.cc:3055] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:02.607209 21874 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260709 13:08:02.667670 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.532721 22209 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:02.672256 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.669261 22075 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:02.679157 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3859) took 2045 ms. Trace:
I20260709 13:08:02.679608 14967 rpcz_store.cc:276] 0709 13:08:00.634232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:00.634802 (+   570us) service_pool.cc:224] Handling call
0709 13:08:00.635166 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:01.911576 (+1276410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.678901 (+767325us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54003e6554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:02.679095 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2934014208}
I20260709 13:08:02.680598 22224 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:02.662022 22100 raft_consensus.cc:3060] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:02.619262 22109 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:02.690167 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 307382us
I20260709 13:08:02.696939 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.668120 22173 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:02.655587 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 261195us
I20260709 13:08:02.685667 21987 raft_consensus.cc:697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:02.673745 22161 raft_consensus.cc:740] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:02.750304 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.703703 22314 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
W20260709 13:08:02.703975 22265 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.669s	user 0.011s	sys 0.000s
I20260709 13:08:02.757190 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:02.759557 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.755824 15514 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.706365 22207 raft_consensus.cc:697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:02.767763 15042 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 25: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:02.765082 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.769567 15039 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:02.684930 22209 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.770246 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.773092 15040 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:08:02.776173 14963 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:02.774809 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.779963 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.780748 15040 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 24.
I20260709 13:08:02.753798 22318 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.785300 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.761970 21766 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.652824 22202 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.789769 15514 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.789600 15040 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:08:02.799115 15040 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 13:08:02.784833 22278 consensus_meta.cc:287] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.608s	user 0.003s	sys 0.008s
I20260709 13:08:02.762475 22029 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:02.845779 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.848258 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:02.765904 22314 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.789134 22287 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:02.787650 22347 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:02.863766 15044 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:02.861492 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:02.852630 22267 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:02.803315 22318 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.855485 22024 raft_consensus.cc:2804] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:02.859557 22185 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:02.806325 21766 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.839121 22278 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.861855 22265 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:02.891667 15039 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:08:02.802500 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:02.868583 22103 consensus_meta.cc:287] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260709 13:08:02.903838 22103 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.906253 22103 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:02.870584 22344 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 13:08:02.871421 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:02.853124 22073 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.017s
I20260709 13:08:02.878556 22264 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:02.862843 22075 consensus_queue.cc:1059] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.025s
I20260709 13:08:02.870966 22267 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:02.908138 22267 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:02.909238 22278 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.909368 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.910074 15547 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 14.
I20260709 13:08:02.910894 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.885684 22185 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.915469 22185 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:02.916503 21937 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.560s	user 0.008s	sys 0.002s
I20260709 13:08:02.917012 21937 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.827875 22161 consensus_queue.cc:260] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.899435 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:02.900878 22096 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:02.902105 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1831) took 1774 ms. Trace:
I20260709 13:08:02.952965 15544 rpcz_store.cc:276] 0709 13:08:01.127709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.128977 (+  1268us) service_pool.cc:224] Handling call
0709 13:08:01.153565 (+ 24588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.258372 (+1104807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.901798 (+643426us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400692654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:02.902031 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2539343744}
I20260709 13:08:02.860108 22287 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:02.890298 22284 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.192s	user 0.029s	sys 0.042s
I20260709 13:08:02.859292 22351 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
W20260709 13:08:02.920010 22345 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 13:08:02.931746 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.889017 22024 raft_consensus.cc:697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:02.906584 15549 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:02.938036 15547 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:08:02.850093 21987 consensus_queue.cc:237] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.905921 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:02.955312 22284 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.257s	user 0.029s	sys 0.043s
I20260709 13:08:02.971700 15543 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:08:02.971836 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.972553 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.974339 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.976596 15544 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 25.
I20260709 13:08:02.971086 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.980301 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.919373 21937 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:02.983744 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:02.984346 15543 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:02.987236 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:02.951589 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52224.2us
I20260709 13:08:02.989243 15513 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:02.991094 15040 raft_consensus.cc:2468] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:08:02.864686 22207 consensus_queue.cc:237] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:02.994021 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:02.970407 22269 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260709 13:08:02.957657 22096 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:02.993134 15516 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:02.996557 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:02.985227 15547 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 12.
I20260709 13:08:02.996268 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:02.969409 22161 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:02.964067 22029 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:02.963395 22264 raft_consensus.cc:3055] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:03.006918 15513 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:03.012099 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.976114 22109 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.017915 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:02.955181 22177 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:02.993870 22173 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:02.993468 22098 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:03.026571 22128 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.039743 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:03.017513 22264 raft_consensus.cc:740] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:03.040094 22315 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:03.040815 22315 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:03.041077 22264 consensus_queue.cc:260] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.042487 22264 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:03.041025 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:02.997807 21874 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:03.066659 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.059535 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.013635 22103 raft_consensus.cc:2804] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:08:03.040045 22357 log.cc:927] Time spent T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:08:03.009539 21937 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:03.001366 22358 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:03.046712 22348 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 13:08:03.086180 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:03.088215 15044 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:03.089098 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:03.089926 15044 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:08:03.046051 22128 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:03.067003 21874 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.070832 22209 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:03.099345 15044 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:03.063443 22265 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:03.108420 15044 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:03.082734 22269 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.073580 22202 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:03.094519 22173 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.070133 22073 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:03.119652 22160 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:03.122658 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:03.100294 22355 log.cc:927] Time spent T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:08:03.133837 15546 raft_consensus.cc:2393] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:03.105149 21874 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.090337 22103 raft_consensus.cc:697] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:03.136718 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:03.069178 22098 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.110153 22314 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.131361 22269 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:03.145777 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:03.149147 21766 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.149878 22103 consensus_queue.cc:237] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.086827 22024 consensus_queue.cc:237] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.145033 22098 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.124190 22265 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.171895 22305 consensus_queue.cc:260] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.173072 22305 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.176206 22269 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:03.176757 22269 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.177213 22269 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.181865 22315 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.182511 22177 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:03.183060 22177 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:03.183554 22177 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.184122 15544 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:03.184274 15550 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:03.157887 22318 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:03.186221 22177 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.135234 22073 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:03.191077 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.192162 15544 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:03.192339 15550 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:08:03.195793 22073 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:03.197150 22111 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:03.202888 22062 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.601s	user 0.006s	sys 0.004s
I20260709 13:08:03.203346 22062 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.204466 15545 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 21. Ops: []
I20260709 13:08:03.205448 22062 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:03.205834 15549 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:03.135010 22173 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:03.208333 22173 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:03.211208 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.190176 22179 consensus_meta.cc:287] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.000s
I20260709 13:08:03.187111 22265 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.218713 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:03.174469 22267 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.237077 22267 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.227501 22179 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.238932 14886 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:03.239840 22179 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.212033 22287 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:03.211040 22303 consensus_meta.cc:287] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.002s	user 0.012s	sys 0.002s
W20260709 13:08:03.216637 22100 consensus_meta.cc:287] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.527s	user 0.010s	sys 0.001s
I20260709 13:08:03.251577 14961 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 24.
W20260709 13:08:03.253553 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 490635us
I20260709 13:08:03.254261 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:03.228184 15544 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:03.256094 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1628) took 1066 ms. Trace:
I20260709 13:08:03.256946 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:03.257392 14891 rpcz_store.cc:276] 0709 13:08:02.189644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.200089 (+ 10445us) service_pool.cc:224] Handling call
0709 13:08:02.200353 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:02.200540 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:08:02.364566 (+164026us) log.cc:844] Serialized 14 byte log entry
0709 13:08:02.795288 (+430722us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.246916 (+451628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:03.246997 (+    81us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:03.247078 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.247201 (+   123us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.256033 (+  8832us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":7905,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":148891,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":9847,"thread_start_us":1029187,"threads_started":3,"wal-append.queue_time_us":536074}
I20260709 13:08:03.260479 22099 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.266366 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:03.267170 15039 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:03.269464 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:03.270294 15037 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
W20260709 13:08:03.275380 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.272825 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:03.255118 22075 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.253134 22303 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:03.304062 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47213.7us
I20260709 13:08:03.307159 22314 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.307910 22314 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.310943 22314 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.311503 21874 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:03.274307 22361 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:08:03.265086 22179 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:03.317103 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.318260 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.320832 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.322456 14968 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 13:08:03.322818 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:03.323740 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.323788 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:03.324260 14962 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:03.307240 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:03.338788 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.365094 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.455689 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 148494us
I20260709 13:08:03.457052 14890 raft_consensus.cc:2410] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 19 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:08:03.457113 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:03.459443 14969 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:03.339937 14859 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:03.463860 14961 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:08:03.465178 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.466010 14961 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:03.467211 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.468709 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.353490 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:03.452982 14963 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:08:03.551964 14966 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:03.553023 14963 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:03.289961 22019 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:03.554802 22019 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:03.555868 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:03.557072 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:03.557410 22019 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:03.474889 22303 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.475673 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.558771 14966 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:03.558923 14970 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:08:03.477178 22269 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.477322 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1920) took 1075 ms. Trace:
I20260709 13:08:03.478839 21874 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.284663 22099 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.286664 22257 consensus_queue.cc:1048] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.181s
I20260709 13:08:03.339314 22109 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.492741 22351 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:03.493484 22374 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.538280 22332 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:03.504976 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.612900 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.613600 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.312121 22098 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.290258 22177 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:03.301359 22062 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:03.632190 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1917) took 1231 ms. Trace:
I20260709 13:08:03.632722 15541 rpcz_store.cc:276] 0709 13:08:02.400478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.508047 (+107569us) service_pool.cc:224] Handling call
0709 13:08:02.508428 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.872824 (+364396us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:02.872869 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.879500 (+  6631us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.109564 (+230064us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:03.109595 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.109665 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.631884 (+522219us) raft_consensus.cc:1685] finished
0709 13:08:03.631914 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.632111 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22993,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":259,"thread_start_us":522383,"threads_started":2,"wal-append.queue_time_us":455057}
I20260709 13:08:03.636706 15036 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:03.522420 14969 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
W20260709 13:08:03.523306 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 203649us
I20260709 13:08:03.634965 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:03.286402 22318 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.208s
I20260709 13:08:03.524932 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:03.526234 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:03.526664 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:03.531016 15039 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
W20260709 13:08:03.535640 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.340696 22315 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.511200 22267 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:03.641954 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:03.548135 22276 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:03.452904 22284 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.086s
I20260709 13:08:03.550082 22286 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:03.560058 15542 rpcz_store.cc:276] 0709 13:08:02.401439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.696967 (+295528us) service_pool.cc:224] Handling call
0709 13:08:02.697300 (+   333us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:02.745447 (+ 48147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.745476 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:02.765038 (+ 19562us) log.cc:844] Serialized 52 byte log entry
0709 13:08:03.016845 (+251807us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:03.016884 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.016946 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.477061 (+460115us) raft_consensus.cc:1685] finished
0709 13:08:03.477085 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.477256 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12574,"raft.queue_time_us":48586,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":12280,"thread_start_us":226548,"threads_started":1,"wal-append.queue_time_us":684042}
W20260709 13:08:03.576362 22321 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.040s	sys 0.062s
I20260709 13:08:03.320042 22075 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:03.503489 15543 consensus_meta.cc:287] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.001s
I20260709 13:08:03.624238 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:03.667934 15543 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:03.627696 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:03.668836 15546 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: [17.13-19.14]
I20260709 13:08:03.639600 15541 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:08:03.642094 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 115501us
I20260709 13:08:03.643512 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:03.670027 15549 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:03.644560 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:03.576344 22019 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:03.643834 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:03.624893 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:03.672638 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:03.673509 15544 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:03.641991 22062 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.678508 15547 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 18: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:03.629715 22319 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:03.636147 22332 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:03.657661 22128 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:03.706007 22346 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.948s	user 0.001s	sys 0.002s
I20260709 13:08:03.704133 22274 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:03.706020 22319 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.706713 22274 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.706310 22128 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:03.708439 22128 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.709467 22274 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:03.714223 22319 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.714577 21679 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:03.716656 22099 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.720759 22128 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.723256 21987 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:08:03.661222 22321 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.040s	sys 0.062s
I20260709 13:08:03.661716 22286 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:03.672835 22019 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:03.723331 22342 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.952s	user 0.000s	sys 0.002s
I20260709 13:08:03.700703 22287 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:03.618422 22109 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.624617 22374 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.724921 22062 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:03.750150 22075 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:03.736883 22207 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.018s	sys 0.059s
W20260709 13:08:03.739037 22024 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.002s	sys 0.009s
I20260709 13:08:03.662045 22276 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.737783 22286 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:03.662181 22267 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.741504 22019 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:03.755947 22207 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.018s	sys 0.059s
I20260709 13:08:03.761543 15550 raft_consensus.cc:1240] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:03.766029 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1913) took 1366 ms. Trace:
W20260709 13:08:03.757670 22024 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.002s	sys 0.010s
W20260709 13:08:03.760501 22176 consensus_meta.cc:287] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 1.227s	user 0.014s	sys 0.000s
I20260709 13:08:03.754482 22287 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:03.779474 22128 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:03.799723 22276 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.801352 22374 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.780452 22332 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:03.813696 22354 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.020s	sys 0.011s
I20260709 13:08:03.857625 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1631) took 1666 ms. Trace:
I20260709 13:08:03.979068 14887 rpcz_store.cc:276] 0709 13:08:02.190478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.262121 (+ 71643us) service_pool.cc:224] Handling call
0709 13:08:02.262414 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.332633 (+ 70219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.332680 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.333248 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 13:08:02.539978 (+206730us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:02.540570 (+   592us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:02.540660 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.705419 (+1164759us) spinlock_profiling.cc:243] Waited 12.4 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:03.856281 (+150862us) raft_consensus.cc:1685] finished
0709 13:08:03.856374 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.857103 (+   729us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72792,"raft.queue_time_us":71318,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":20443,"spinlock_wait_cycles":28595584,"thread_start_us":184248,"threads_started":1,"wal-append.queue_time_us":401928}
I20260709 13:08:03.987551 22264 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:03.988538 22264 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:03.990907 22269 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:03.992039 22269 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.995805 22098 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:03.477880 14886 raft_consensus.cc:1240] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:08:03.472478 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.016641 22265 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:04.017894 14894 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:08:04.017802 22265 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:03.524818 14895 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
W20260709 13:08:03.860159 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:03.879818 14934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.010s	sys 0.005s
I20260709 13:08:03.888108 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:03.494485 14964 raft_consensus.cc:2393] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:03.890255 14961 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:03.498809 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.055418 15040 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:08:04.056521 22123 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.057171 22123 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.057868 22128 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:03.998502 22276 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:03.477356 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.061936 14965 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:04.063113 22207 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.063894 22207 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.892083 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.896669 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:04.067193 14968 raft_consensus.cc:3060] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:04.068274 22207 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:04.068547 22354 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.020s	sys 0.012s
I20260709 13:08:04.068825 22276 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:03.896747 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:03.658028 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:03.644708 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:03.909192 15043 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.004s	sys 0.006s
W20260709 13:08:04.100081 15043 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.887s	user 0.004s	sys 0.007s
I20260709 13:08:04.101703 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 3262) took 1395 ms. Trace:
W20260709 13:08:03.909335 15041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.011s	sys 0.011s
W20260709 13:08:04.103696 15041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.011s	sys 0.011s
W20260709 13:08:04.105482 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.105712 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3807) took 1476 ms. Trace:
I20260709 13:08:04.102205 15043 rpcz_store.cc:276] 0709 13:08:02.706667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.725651 (+ 18984us) service_pool.cc:224] Handling call
0709 13:08:02.726137 (+   486us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:02.754547 (+ 28410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.754591 (+    44us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:02.760080 (+  5489us) log.cc:844] Serialized 52 byte log entry
0709 13:08:03.157450 (+397370us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:08:04.100687 (+943237us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.101190 (+   503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.101318 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.101405 (+    87us) raft_consensus.cc:1685] finished
0709 13:08:04.101419 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.101604 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27823,"prepare.queue_time_us":544744,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":28198,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3057,"spinlock_wait_cycles":985984,"thread_start_us":1251012,"threads_started":2,"wal-append.queue_time_us":777636}
I20260709 13:08:04.106495 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.058734 22128 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.107380 14894 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:08:04.108631 22103 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.022s	sys 0.000s
W20260709 13:08:04.109067 22103 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.023s	sys 0.000s
I20260709 13:08:04.110507 22128 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.111399 22399 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.002s
I20260709 13:08:04.106216 15041 rpcz_store.cc:276] 0709 13:08:02.629770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.629943 (+   173us) service_pool.cc:224] Handling call
0709 13:08:02.663149 (+ 33206us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.663582 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.663622 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.664205 (+   583us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.038052 (+373847us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b48002001d8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:08:03.180080 (+142028us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b180038d220. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:04.104523 (+924443us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:04.104596 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.104709 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.104773 (+    64us) raft_consensus.cc:1685] finished
0709 13:08:04.104786 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.105485 (+   699us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b540014a0d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:04.105642 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":3152,"raft.run_wall_time_us":371648,"spinlock_wait_cycles":88670080,"thread_start_us":923960,"threads_started":1,"wal-append.queue_time_us":1149822}
I20260709 13:08:04.112044 22265 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.112591 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.004298 22109 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:04.004776 15545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.008s	sys 0.009s
W20260709 13:08:04.005168 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.006198 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.013865 15546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d3b63f39d444317899acc30914f8801"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
mode: GRACEFUL
new_leader_uuid: "e4938453819c469599f515b22d92fe27"
 from {username='slave'} at 127.0.0.1:56808
W20260709 13:08:04.014731 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 557721us
W20260709 13:08:04.032193 14934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.011s	sys 0.005s
I20260709 13:08:04.038195 15541 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:08:03.995337 22269 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.067131 14966 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
W20260709 13:08:04.091238 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 396751us
W20260709 13:08:04.091879 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 100564us
I20260709 13:08:04.092460 22179 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.093518 22276 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.094928 22267 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:04.090416 14859 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.017s	sys 0.016s
I20260709 13:08:04.097517 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1846) took 1136 ms. Trace:
I20260709 13:08:03.805589 22287 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:04.123976 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 236479us
I20260709 13:08:04.127895 22269 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.128311 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 3272) took 1260 ms. Trace:
I20260709 13:08:04.132773 15546 raft_consensus.cc:606] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Received request to transfer leadership to TS e4938453819c469599f515b22d92fe27
W20260709 13:08:04.136572 14859 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.017s	sys 0.018s
I20260709 13:08:04.139137 14967 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 13: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:08:04.138561 15545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.009s	sys 0.009s
I20260709 13:08:04.130681 15550 rpcz_store.cc:276] 0709 13:08:02.960466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.193524 (+233058us) service_pool.cc:224] Handling call
0709 13:08:03.221056 (+ 27532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:03.761966 (+540910us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.096816 (+334850us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b54005f3cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:04.097210 (+   394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1242441472}
I20260709 13:08:04.144733 22161 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.146765 14970 raft_consensus.cc:1275] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 13:08:04.131568 15040 rpcz_store.cc:276] 0709 13:08:02.867693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.017657 (+149964us) service_pool.cc:224] Handling call
0709 13:08:04.128053 (+1110396us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540014c8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:04.128208 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379712896}
I20260709 13:08:04.152285 14965 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:04.152420 15546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
mode: GRACEFUL
new_leader_uuid: "eb4a5ac9f0c5425b92051187b939860f"
 from {username='slave'} at 127.0.0.1:56808
I20260709 13:08:04.158666 14968 raft_consensus.cc:2468] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:04.156190 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.162595 14886 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:08:04.165624 15546 raft_consensus.cc:606] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Received request to transfer leadership to TS eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.169199 15546 raft_consensus.cc:614] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:04.169626 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.149763 22161 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.171442 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1688) took 1034 ms. Trace:
I20260709 13:08:04.175766 15545 rpcz_store.cc:276] 0709 13:08:03.136993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.209270 (+ 72277us) service_pool.cc:224] Handling call
0709 13:08:03.209558 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.209942 (+   384us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:08:03.209973 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:03.210383 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.163877 (+953494us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:04.163980 (+   103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.166654 (+  2674us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.166738 (+    84us) raft_consensus.cc:1685] finished
0709 13:08:04.166761 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.171372 (+  4611us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3086,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":2062,"thread_start_us":932863,"threads_started":1,"wal-append.queue_time_us":607889}
I20260709 13:08:04.176939 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.178087 14893 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:08:04.178927 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:08:04.179203 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:04.185817 22161 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.186632 14967 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:04.187844 22075 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:04.172565 22265 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.188896 14933 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:04.190243 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:08:04.190819 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 850883us
I20260709 13:08:04.193122 14894 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 13.
I20260709 13:08:04.193316 22264 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.193760 22179 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.196326 22179 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.196348 15514 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.199447 15010 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:04.200160 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 88922.9us
I20260709 13:08:04.202179 22318 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:04.202689 22318 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.203107 22318 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:04.204670 22267 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:04.205453 22267 consensus_queue.cc:1243] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:04.203899 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:03.766609 15548 rpcz_store.cc:276] 0709 13:08:02.398807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.399764 (+   957us) service_pool.cc:224] Handling call
0709 13:08:02.400040 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.861923 (+461883us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.861959 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.864674 (+  2715us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.280643 (+415969us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:03.764125 (+483482us) log.cc:844] Serialized 14 byte log entry
0709 13:08:03.764373 (+   248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:03.764443 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:03.764492 (+    49us) raft_consensus.cc:1685] finished
0709 13:08:03.764505 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:03.764655 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":466130,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":42,"raft.queue_time_us":131517,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":433,"thread_start_us":1324073,"threads_started":3,"wal-append.queue_time_us":861600}
I20260709 13:08:04.207610 22269 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.204131 22396 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:04.209242 22303 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:04.209429 22396 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:04.209826 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.210407 22269 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.209995 22396 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:04.211199 22264 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:04.211813 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.212327 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.211999 22396 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.213883 22396 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:04.214869 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.189467 22265 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.171756 22128 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.215888 14893 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:04.220635 14890 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:08:04.222025 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.238824 14895 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260709 13:08:04.222329 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.239980 22365 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:04.240355 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.241160 22315 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:08:04.241643 22315 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:08:04.228008 15036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1666) took 1966 ms (client timeout 1685 ms). Trace:
W20260709 13:08:04.248153 15036 rpcz_store.cc:269] 0709 13:08:02.261735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.263809 (+  2074us) service_pool.cc:224] Handling call
0709 13:08:04.227630 (+1963821us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400332cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:04.227828 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2973464832}
W20260709 13:08:04.248970 14964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 2976) took 1775 ms (client timeout 2236 ms). Trace:
I20260709 13:08:04.249153 14963 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
W20260709 13:08:04.249396 14964 rpcz_store.cc:269] 0709 13:08:02.473598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.474304 (+   706us) service_pool.cc:224] Handling call
0709 13:08:04.248568 (+1774264us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b5400307ad4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:04.248784 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272976640}
I20260709 13:08:04.251037 14964 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:04.252417 22315 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.254504 22315 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.256942 21766 consensus_queue.cc:1059] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:04.257937 21766 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:08:04.258945 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.259073 22207 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:04.259805 22207 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.260358 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.246135 22103 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:04.261183 14892 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:04.261519 22368 raft_consensus.cc:3055] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:04.261960 22368 raft_consensus.cc:740] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:04.225386 22202 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260709 13:08:04.262459 22207 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.253516 14792 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 16, now has a pending config: VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1), VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2), VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 16 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:04.229954 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.225030 22265 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.230021 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:04.266121 14968 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:04.215372 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.225589 22179 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 13:08:04.262097 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.265165 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.269893 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.231848 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.266045 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:04.233615 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.262072 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:04.245985 15007 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.811s (SENT)
W20260709 13:08:04.229192 22096 consensus_meta.cc:287] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 1.208s	user 0.004s	sys 0.016s
I20260709 13:08:04.288476 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.286032 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.292119 14962 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
W20260709 13:08:04.292354 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 103571us
I20260709 13:08:04.236493 22123 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:04.316087 22408 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.100s	user 0.004s	sys 0.000s
W20260709 13:08:04.316848 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.330066 22062 consensus_meta.cc:287] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.542s	user 0.008s	sys 0.008s
I20260709 13:08:04.330214 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.330578 22062 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.333137 22062 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.289552 22265 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.337683 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.338292 14894 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 13.
I20260709 13:08:04.227635 22128 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.339771 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:04.343663 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.262984 22368 consensus_queue.cc:260] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.345256 14890 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:04.326596 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:04.351337 22177 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.006s
I20260709 13:08:04.322518 22096 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.352073 22177 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:04.353173 14889 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:04.353564 22096 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.352504 22062 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:04.355163 22062 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:04.356539 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.357702 15546 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:08:04.357121 22128 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.357343 22368 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:04.361949 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 91337.8us
W20260709 13:08:04.363638 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.356205 22062 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.347774 22075 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.368697 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:04.386157 14933 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:04.394099 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 178917us
I20260709 13:08:04.372728 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:04.397893 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.368755 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.404620 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.342677 22265 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.389102 22161 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:04.412948 14933 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:04.414531 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.415428 14894 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:04.418668 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:04.412360 15008 leader_election.cc:336] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Timed out: RequestConsensusVote RPC to 127.13.120.2:43345 timed out after 1.596s (SENT)
I20260709 13:08:04.425890 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.422816 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:04.429997 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 302245us
I20260709 13:08:04.409483 22265 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.411211 22161 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:04.408301 22267 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:04.432492 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.419921 22075 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.448674 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.450886 14889 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:04.408627 22318 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:04.454533 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 211502us
I20260709 13:08:04.433183 22376 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:04.457572 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.445611 22161 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.458786 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.446106 22267 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:08:04.457927 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 59860.9us
I20260709 13:08:04.461741 15036 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
I20260709 13:08:04.452442 22096 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:04.466454 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:04.470314 15010 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:04.472621 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:04.473372 22374 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:08:04.474170 22374 raft_consensus.cc:697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:04.475618 22374 consensus_queue.cc:237] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.473475 15038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1662) took 2244 ms. Trace:
I20260709 13:08:04.466774 22267 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:04.479485 22155 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:04.484341 22207 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:04.480438 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.480054 15038 rpcz_store.cc:276] 0709 13:08:02.211490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:02.212088 (+   598us) service_pool.cc:224] Handling call
0709 13:08:02.212454 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:02.261143 (+ 48689us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:02.261174 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:02.271575 (+ 10401us) log.cc:844] Serialized 26 byte log entry
0709 13:08:03.558022 (+1286447us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b18004d7e80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:04.098051 (+540029us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:04.098156 (+   105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.445195 (+347039us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b540029d1d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:04.445250 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.445290 (+    40us) raft_consensus.cc:1685] finished
0709 13:08:04.445301 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.455557 (+ 10256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8429,"raft.queue_time_us":32635,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":14294,"spinlock_wait_cycles":135943296,"thread_start_us":477430,"threads_started":1,"wal-append.queue_time_us":1775046}
I20260709 13:08:04.491228 14933 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.479547 22264 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:04.496232 14894 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
W20260709 13:08:04.497862 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 79292.1us
I20260709 13:08:04.505669 14961 raft_consensus.cc:1240] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:04.504034 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.489710 22207 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.501401 14966 raft_consensus.cc:2376] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20. Re-sending same reply.
W20260709 13:08:04.512962 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 117124us
I20260709 13:08:04.515071 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.501926 22376 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:04.494887 22354 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:04.520560 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.510931 22207 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:04.525441 22404 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:08:04.525745 22286 consensus_meta.cc:287] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.761s	user 0.017s	sys 0.001s
I20260709 13:08:04.525597 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.495714 22062 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.527727 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.528476 22098 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:08:04.529143 22098 raft_consensus.cc:697] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:04.530320 22098 consensus_queue.cc:237] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.534057 14966 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:04.537493 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.536674 15546 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:04.545077 14970 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:04.547150 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.547995 14965 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:04.549176 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.549911 14892 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:04.550266 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.550866 14964 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:04.521286 22376 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:04.552604 14890 raft_consensus.cc:2410] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:08:04.553831 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.518862 22155 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.551893 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:04.520552 22075 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.556641 14961 raft_consensus.cc:2410] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 17 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:08:04.557411 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.558718 14967 raft_consensus.cc:2393] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:04.558524 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:04.571529 22019 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.008s
I20260709 13:08:04.571697 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.572299 15038 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:04.571990 22019 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.577049 14895 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:04.578083 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.578354 22019 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.578768 14895 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:04.579222 14887 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 25: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:04.574493 14886 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:04.570391 15545 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:04.572882 14889 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:08:04.566576 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:04.583465 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:04.583560 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.584817 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.585657 15514 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.558838 22354 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.558588 22376 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:04.588202 15550 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:04.588335 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.592666 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.593961 14889 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:04.587476 22287 consensus_queue.cc:1048] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.007s
I20260709 13:08:04.594980 22354 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.595168 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.597481 14886 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.545176 22286 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.600698 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:04.602221 14893 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 15: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:04.602186 22111 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:08:04.602594 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:04.603072 22399 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:04.603228 15542 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:04.590364 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:04.611964 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56080.1us
I20260709 13:08:04.614596 14891 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:08:04.618364 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:04.622334 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.619915 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.624711 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.625551 14968 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:04.627713 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.627935 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:04.629710 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.629863 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.633332 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.635062 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.635291 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:04.614203 22286 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.636715 14889 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:08:04.639518 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.625432 22103 raft_consensus.cc:2804] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:04.625044 22075 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:04.640306 14968 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 23: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:04.637836 15545 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:04.637006 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.637632 15038 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:04.641721 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.645335 22399 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:04.672962 14890 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:04.665987 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:04.677727 15043 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:04.698426 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.699064 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.676021 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.665007 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.677186 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:04.703356 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 56512.1us
I20260709 13:08:04.701071 14964 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:08:04.699641 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:04.672302 22075 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.645565 14967 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:04.712955 15041 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:04.713066 14966 raft_consensus.cc:2393] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:04.708802 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:04.710073 15040 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:04.714273 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.715751 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.716604 15037 raft_consensus.cc:2410] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 13:08:04.717876 15037 pending_rounds.cc:85] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 11
I20260709 13:08:04.718101 15037 pending_rounds.cc:107] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260709 13:08:04.718401 15037 raft_consensus.cc:2889] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:04.719151 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.719893 15035 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:08:04.714406 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.723016 14968 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:04.724694 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:04.729452 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 63561.6us
I20260709 13:08:04.711598 22075 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:04.725968 15044 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:04.735316 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.738222 14967 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 13. Current term is 14. Ops: []
I20260709 13:08:04.741458 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.739856 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:04.743345 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.744175 14968 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
W20260709 13:08:04.744328 22419 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:08:04.745230 22427 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:04.745671 22427 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:04.746045 22427 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:04.727226 22096 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.751843 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.761919 15545 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:04.736366 22269 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:04.760432 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:04.782114 15542 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:04.742137 22062 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:04.799993 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:04.807997 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 69859.3us
I20260709 13:08:04.813705 22098 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:04.815016 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.816090 15549 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:04.817281 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.780108 22269 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.818027 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.822510 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43902 (request call id 1760) took 1185 ms. Trace:
W20260709 13:08:04.823303 22421 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 13:08:04.826300 22425 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:04.826965 22425 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.827772 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.828920 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:04.829252 22425 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:04.829751 22428 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:04.830400 22428 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.830552 22207 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.797585 22267 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.831530 21679 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:04.832574 22428 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.833411 22267 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.833571 22269 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:04.834195 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.835716 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.839439 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:04.839781 21987 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:04.840685 14886 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:04.840446 21987 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.842519 21987 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.767233 22096 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:04.844408 22423 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:08:04.845319 22096 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.845824 22267 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:04.846167 22155 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.846422 22267 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.848973 22267 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.852694 15548 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:04.845834 22396 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:04.853731 22207 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:04.839833 15549 raft_consensus.cc:1275] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:04.853729 22396 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:04.856057 22396 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.857403 22396 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:04.857740 15544 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 24. Current term is 25. Ops: []
W20260709 13:08:04.857554 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:04.858736 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:04.863090 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:08:04.864120 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:04.867542 22286 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:04.868281 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.868134 22286 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.870388 22286 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:04.821367 15545 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:08:04.830413 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:04.902551 15043 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:04.902987 14933 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:04.861375 22161 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:04.902264 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.907575 15550 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:08:04.916884 14895 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 13:08:04.917387 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:04.944965 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:04.945691 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 127205us
I20260709 13:08:04.939438 15548 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
I20260709 13:08:04.948132 14887 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 13:08:04.948084 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 117774us
I20260709 13:08:04.818214 22368 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:04.822953 14969 rpcz_store.cc:276] 0709 13:08:03.876243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:03.896081 (+ 19838us) service_pool.cc:224] Handling call
0709 13:08:03.896801 (+   720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:03.897649 (+   848us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:08:03.898279 (+   630us) log.cc:844] Serialized 14 byte log entry
0709 13:08:04.230392 (+332113us) spinlock_profiling.cc:243] Waited 2.62 ms on lock 0x7b180044f560. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:08:04.445282 (+214890us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b180044f560. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f553491e4bc 00007f5531c6c48b 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f553491623a
0709 13:08:04.453400 (+  8118us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:04.472153 (+ 18753us) log.cc:844] Serialized 26 byte log entry
0709 13:08:04.472290 (+   137us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:04.472322 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:04.472395 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:04.721917 (+249522us) raft_consensus.cc:1685] finished
0709 13:08:04.721936 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:04.722044 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30469,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":2815,"raft.queue_time_us":76236,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":3844,"spinlock_wait_cycles":129721600,"thread_start_us":75732,"threads_started":1,"wal-append.queue_time_us":489666}
I20260709 13:08:04.871624 22062 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:04.954999 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.958513 14963 raft_consensus.cc:1240] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:04.907424 21679 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:04.963160 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55115.1us
I20260709 13:08:04.918936 22264 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:04.972667 15514 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:04.978502 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.978860 14968 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:04.979929 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:04.981344 15550 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:04.981196 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:04.981958 14967 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:04.984236 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:04.956219 22368 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.973186 22264 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:04.987565 15010 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:04.944965 22098 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 13:08:04.998461 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:04.999222 15542 raft_consensus.cc:2393] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:05.005200 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 195544us
I20260709 13:08:05.008363 22286 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.008935 22286 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.011268 22286 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:04.820550 22399 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:04.998620 22368 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:04.998826 22264 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:05.004328 22265 consensus_meta.cc:287] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.552s	user 0.007s	sys 0.005s
W20260709 13:08:05.038870 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 131697us
I20260709 13:08:05.044826 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:05.045398 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:04.969053 22062 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:05.050407 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.051337 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:05.003881 22420 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:04.986152 22096 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260709 13:08:05.006486 22103 raft_consensus.cc:697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:05.060250 14968 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:05.021845 22428 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:05.070006 15547 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:05.080219 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:05.081151 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 118707us
I20260709 13:08:05.081634 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:05.082216 14966 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.081177 15548 raft_consensus.cc:2393] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:05.084635 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.087489 22019 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 13:08:05.089455 22123 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:08:05.124125 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:05.129016 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.131435 22430 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:05.131958 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:05.133594 22433 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:08:05.134011 22433 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:05.134367 22433 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:05.059603 22265 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.145375 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:05.148574 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 60180.7us
W20260709 13:08:05.178445 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 46571.5us
W20260709 13:08:05.183934 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 89970.9us
W20260709 13:08:05.186880 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57351.4us
I20260709 13:08:05.184182 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:05.086532 22098 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:08:05.193854 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49375.5us
W20260709 13:08:05.204010 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 105946us
I20260709 13:08:05.097545 22100 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:05.206424 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.210809 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:05.201395 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.211109 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:05.086750 22128 consensus_queue.cc:1059] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.109s
I20260709 13:08:05.176657 22019 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:08:05.224853 22427 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.211772 22286 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:05.210270 22100 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:05.211776 22161 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:05.289567 22075 consensus_meta.cc:287] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.537s	user 0.003s	sys 0.004s
I20260709 13:08:05.283917 22111 raft_consensus.cc:3055] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:05.284893 14894 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:05.326092 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:05.290061 22448 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:05.271922 22096 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:05.290313 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 79303.8us
W20260709 13:08:05.291337 22437 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:08:05.267762 22354 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.291750 22062 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:05.292680 22429 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
W20260709 13:08:05.297240 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 104354us
W20260709 13:08:05.305905 22376 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.684s	user 0.004s	sys 0.004s
I20260709 13:08:05.307476 22269 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.309751 22265 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:05.309958 22431 log.cc:927] Time spent T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.244s	user 0.000s	sys 0.000s
I20260709 13:08:05.201224 22103 consensus_queue.cc:237] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:05.296377 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 95070.8us
I20260709 13:08:05.343051 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:05.086386 22420 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:05.323554 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.268383 22098 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:05.278437 22286 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.338810 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:05.340767 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 349688us
I20260709 13:08:05.331898 22096 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.333853 22179 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:05.316295 22100 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.355912 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.332078 22425 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:05.326429 22111 raft_consensus.cc:740] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:05.363971 15010 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:05.331068 22075 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.373987 15042 raft_consensus.cc:1240] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:05.361724 22286 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:05.356144 22396 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:05.364534 22096 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.341071 22303 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 13:08:05.385376 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:05.389932 14961 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:05.364717 22179 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:05.396201 14968 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 25: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:05.385443 22098 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.391428 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:05.409986 14967 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
W20260709 13:08:05.391595 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 124435us
I20260709 13:08:05.341423 22376 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.342751 22354 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.400015 22396 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.400435 22318 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.401084 22111 consensus_queue.cc:260] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.405649 22453 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:08:05.405912 22443 log.cc:927] Time spent T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 13:08:05.371846 22427 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:05.408650 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:05.449815 14894 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 25
W20260709 13:08:05.411962 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 44486.6us
W20260709 13:08:05.435878 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 168758us
I20260709 13:08:05.363624 22368 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.432369 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:05.411099 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:05.439227 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:05.440697 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:05.435794 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:05.406574 22179 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:05.453025 14961 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:05.462410 15035 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:08:05.470479 14892 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 14: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:08:05.458052 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 47047.8us
I20260709 13:08:05.468355 14970 raft_consensus.cc:2368] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 24. Current term is 25.
W20260709 13:08:05.469375 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260709 13:08:05.468267 14965 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: [17.16-17.16]
I20260709 13:08:05.471728 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.474684 15008 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.436853 22448 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:08:05.480266 15043 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:05.486912 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:05.488432 14965 raft_consensus.cc:1240] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 12. Current term is 13. Ops: []
I20260709 13:08:05.452394 22447 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.489795 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:05.469673 22111 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:05.488210 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:05.470033 22019 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:05.452965 22453 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:05.493800 22458 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:05.473850 22103 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:05.493157 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:05.502102 14970 raft_consensus.cc:1240] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:05.506669 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:05.503782 15038 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260709 13:08:05.456672 22318 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 13:08:05.516615 14966 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:05.518158 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:05.518355 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:05.526599 22452 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:05.527181 22452 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:05.527560 22444 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
W20260709 13:08:05.528685 22440 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 13:08:05.531988 22439 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
W20260709 13:08:05.532507 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:05.533010 22453 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.540767 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:05.541731 14895 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 25: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:08:05.528712 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 186306us
W20260709 13:08:05.549218 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 56156.9us
I20260709 13:08:05.480185 22264 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.553691 22463 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.555378 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3890) took 1015 ms. Trace:
W20260709 13:08:05.559607 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58446.3us
W20260709 13:08:05.560143 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53676.5us
I20260709 13:08:05.560851 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:05.564744 22448 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:05.572248 14963 rpcz_store.cc:276] 0709 13:08:04.539827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.541515 (+  1688us) service_pool.cc:224] Handling call
0709 13:08:04.541891 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:04.967815 (+425924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:05.555149 (+587334us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54003e6f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:05.555321 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":957732096}
I20260709 13:08:05.565725 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:05.524920 22458 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:05.584771 22075 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:05.546705 22062 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:05.497247 22433 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.588491 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:05.551384 22019 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.570524 22103 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:05.508258 22447 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.605719 22459 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:05.608008 15542 raft_consensus.cc:3060] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:05.610846 15035 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:08:05.577569 22448 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:05.581748 22264 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.617298 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.636377 14894 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 25.
W20260709 13:08:05.643601 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 77980.2us
I20260709 13:08:05.646531 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:05.649930 22453 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:05.650421 22453 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.650831 22453 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:05.652634 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:05.654013 22476 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:05.654449 22476 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:05.654922 22476 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.657217 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.663765 22442 consensus_queue.cc:1059] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:08:05.664687 22442 consensus_queue.cc:1243] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:08:05.666316 22467 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:05.669682 22286 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.671911 22286 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:05.625283 22448 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.674674 15542 raft_consensus.cc:2468] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
W20260709 13:08:05.675345 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 49386.3us
I20260709 13:08:05.640739 22425 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:05.675568 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:05.686012 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 103719us
I20260709 13:08:05.681670 22458 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.687156 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.688210 22286 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:08:05.689002 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.603034 22103 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.655388 21987 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:05.656191 22396 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.694540 22286 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.713220 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.673484 22354 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:05.680039 22368 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.678254 22445 consensus_queue.cc:1048] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.103s
I20260709 13:08:05.682683 22433 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:05.729431 22447 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.673264 22019 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:05.739080 14894 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:05.737318 22460 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.736644 22318 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:05.739959 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:05.740767 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:05.741333 22123 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:05.716432 22100 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.742152 22452 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.748610 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:05.748634 22428 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:05.734660 22459 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:05.761492 22286 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:05.768074 22286 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.768188 22459 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.770179 22286 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:05.771550 22460 consensus_queue.cc:1059] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:05.772429 22019 raft_consensus.cc:3055] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:05.772995 22019 raft_consensus.cc:740] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:05.774092 22100 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:05.773785 22019 consensus_queue.cc:260] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.774989 22019 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:05.775478 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.765225 15041 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:05.772468 22428 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.767035 22426 raft_consensus.cc:3055] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:08:05.771823 22433 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:05.779265 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 122163us
I20260709 13:08:05.777202 14933 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:05.780189 15541 raft_consensus.cc:2468] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:08:05.780300 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.762058 22368 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.019s
I20260709 13:08:05.782516 22179 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.784835 22477 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:05.786288 22477 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:05.787959 22452 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:05.788682 22374 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:05.792958 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.793581 22286 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:05.794404 22286 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:05.795341 22286 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.761041 22096 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.795087 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:05.761803 22123 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:05.798027 22123 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:05.799767 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 124265us
I20260709 13:08:05.807147 14893 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 26 because replica has last-logged OpId of term: 24 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 20.
I20260709 13:08:05.808754 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:05.814143 22428 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.814594 22476 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.817499 22428 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:05.818828 22476 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.823436 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:05.824492 14891 raft_consensus.cc:2393] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:08:05.829322 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 49129.9us
I20260709 13:08:05.833751 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:05.765211 22318 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.826647 22303 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:05.809844 22096 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.798599 22426 raft_consensus.cc:740] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:05.853296 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.829742 22460 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:05.832259 22100 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.836033 22264 raft_consensus.cc:2804] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:05.862089 22376 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:05.862673 22441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.005s	sys 0.015s
W20260709 13:08:05.863046 22441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.005s	sys 0.015s
I20260709 13:08:05.854212 22478 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.010s
W20260709 13:08:05.863905 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 55219.4us
I20260709 13:08:05.864815 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:05.866132 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.866506 22315 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.867452 22315 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:05.868335 22458 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:05.868835 22458 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:05.869855 22458 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.863698 22448 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.874259 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.875531 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.876719 22075 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:05.849009 22436 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:05.884577 22179 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:05.835127 22368 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260709 13:08:05.854378 22161 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:05.861109 22303 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:05.837117 22433 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.904695 14936 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.892057 22075 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:05.911202 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 74563.3us
I20260709 13:08:05.912925 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.913028 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.914716 22075 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:05.956164 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 88871.1us
I20260709 13:08:05.956904 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:05.958032 22179 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.900856 22480 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:05.902410 22374 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:05.891700 22376 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:05.958447 22448 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:05.958490 22096 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:05.944046 22368 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:08:05.999089 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:05.975646 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:05.912011 22459 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:05.902405 22161 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.003706 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.004400 14968 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 13:08:06.004621 14967 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:05.995071 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.006291 14966 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 17
I20260709 13:08:05.995461 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:05.971267 22436 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:05.910272 22426 consensus_queue.cc:260] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:05.959201 22456 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:05.994858 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.009454 15037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3822) took 1342 ms. Trace:
I20260709 13:08:06.012293 15516 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:06.000680 22459 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:06.013266 14961 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:06.016873 15041 pending_rounds.cc:85] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 17
I20260709 13:08:06.020294 15041 pending_rounds.cc:107] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 22.18
I20260709 13:08:06.020633 15041 raft_consensus.cc:2889] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.012836 22456 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:06.022944 22456 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:06.023039 22459 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.011509 22480 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.024485 22459 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.024363 22480 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.026494 22480 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.027508 22160 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.027961 22160 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.029824 22160 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.030783 22424 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.031697 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.032426 15036 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:08:06.034080 22433 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.034680 22433 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:06.034974 22269 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.036070 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.037451 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.038208 15547 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 25: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:06.039608 14887 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:05.999007 22376 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.014827 22179 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 13:08:06.047112 22460 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:06.047760 22487 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:06.048764 22267 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:06.012650 22264 raft_consensus.cc:697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:06.035007 22433 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.022239 22436 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:06.013685 22100 consensus_queue.cc:1059] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 13:08:06.012614 15037 rpcz_store.cc:276] 0709 13:08:04.666780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.717167 (+ 50387us) service_pool.cc:224] Handling call
0709 13:08:04.717556 (+   389us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:04.722229 (+  4673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:04.722296 (+    67us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:04.728563 (+  6267us) log.cc:844] Serialized 52 byte log entry
0709 13:08:05.034966 (+306403us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:05.878497 (+843531us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b180039bc80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c86455 00007f553876e3c7 00007f5534d809a7 00007f5534d900bf 00007f5534d90038
0709 13:08:06.002576 (+124079us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.005867 (+  3291us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.005933 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:06.005970 (+    37us) raft_consensus.cc:1685] finished
0709 13:08:06.009039 (+  3069us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:06.009328 (+   289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2900,"prepare.queue_time_us":482865,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":3676,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":13413,"spinlock_wait_cycles":3615616,"thread_start_us":363334,"threads_started":2,"wal-append.queue_time_us":312709}
W20260709 13:08:06.078809 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 122090us
W20260709 13:08:06.079511 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 120190us
I20260709 13:08:06.070946 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:06.091625 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 116120us
I20260709 13:08:06.092583 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:06.089931 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:06.074263 22433 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.097112 14966 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:06.097647 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:06.078881 22487 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:06.077087 22318 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.102695 22480 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.086351 22179 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:06.104883 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.107416 14966 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:06.090138 22428 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:06.107949 14961 raft_consensus.cc:1240] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 13:08:06.073925 22267 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.109143 14970 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:06.079092 22436 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:06.109639 22491 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:08:06.115083 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.116395 14966 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:06.099990 22111 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.116815 14964 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:06.114535 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:06.119690 22103 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:06.119745 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.106389 22444 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:08:06.120926 22424 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:06.120857 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.121737 14961 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:06.184020 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.186556 22103 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.188696 22103 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.117431 22480 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:06.189689 14859 leader_election.cc:400] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 24. Current term is 25.
I20260709 13:08:06.190105 14859 leader_election.cc:403] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.189864 22019 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:06.190809 22019 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:06.190124 22480 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.183583 22368 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:06.193013 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.193810 14962 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:06.107844 22179 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:06.197203 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.183992 14965 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:06.122210 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.104341 22487 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.104574 22460 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:06.111173 22428 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.150089 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.200971 14970 raft_consensus.cc:2393] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:08:06.152395 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.111536 22303 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:06.210125 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 95879.6us
I20260709 13:08:06.199879 14964 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 14.
I20260709 13:08:06.184389 22265 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.218050 22265 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.220247 22265 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.220300 22155 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.220750 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.220966 22155 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.222067 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.222211 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:06.184767 22264 consensus_queue.cc:237] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.223184 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.223517 22494 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 24. Current term is 25.
I20260709 13:08:06.224246 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.224318 22155 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.224964 22155 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:06.225072 15040 raft_consensus.cc:2410] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 13:08:06.225101 15037 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:06.211542 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:06.228716 14892 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:06.222147 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.236140 15043 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 25.
W20260709 13:08:06.188719 22453 consensus_meta.cc:287] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.537s	user 0.012s	sys 0.000s
I20260709 13:08:06.200451 22111 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:06.249891 22111 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.251814 22267 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.254608 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:08:06.259505 22493 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:06.260309 22436 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.260617 22420 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.207602 22487 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.247826 22303 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:06.263882 22303 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:06.266513 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.266618 22303 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:06.267217 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:06.267603 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 78097us
I20260709 13:08:06.129479 22444 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:06.282953 22444 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:06.286381 22376 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.290369 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1855) took 1313 ms. Trace:
I20260709 13:08:06.290845 15548 rpcz_store.cc:276] 0709 13:08:04.977407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.983960 (+  6553us) service_pool.cc:224] Handling call
0709 13:08:06.290119 (+1306159us) spinlock_profiling.cc:243] Waited 91.9 ms on lock 0x7b54002e7a54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:06.290288 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":211280640}
W20260709 13:08:06.268316 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 57394.1us
W20260709 13:08:06.269800 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.274314 22458 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:06.274482 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:06.260735 22453 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.277705 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.279039 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.280572 22456 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.318667 14970 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:06.318908 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.281764 22457 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:06.217531 22428 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.316075 15546 raft_consensus.cc:1240] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:06.318977 15545 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:06.324282 14962 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:06.310595 14936 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:06.330638 14936 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:06.313622 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.322168 14964 raft_consensus.cc:2368] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:08:06.323061 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:06.319258 14961 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:08:06.332161 15541 raft_consensus.cc:3060] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:06.320892 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:06.340045 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:06.331152 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:06.341245 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:06.341823 15549 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:06.353873 22433 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.356555 22433 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.360020 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.360594 22442 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.360807 14965 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:06.361143 22442 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.368251 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.368284 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:06.370337 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.371145 15546 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:08:06.376432 15549 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:06.384040 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.384759 15546 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:08:06.385812 14966 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:06.322147 22161 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.324636 22457 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:06.388139 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.369426 14894 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:06.343062 22303 raft_consensus.cc:2804] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:06.317209 22448 consensus_queue.cc:1059] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 13:08:06.316823 22477 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.053s
W20260709 13:08:06.385418 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 110995us
I20260709 13:08:06.317441 22452 consensus_queue.cc:1059] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 13:08:06.351166 22315 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:06.366801 22460 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:06.388603 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:06.383615 22428 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:06.407974 15541 raft_consensus.cc:2468] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 25.
I20260709 13:08:06.412598 15514 leader_election.cc:400] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:08:06.414777 15514 leader_election.cc:403] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:08:06.366395 22490 raft_consensus.cc:2804] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:06.411656 22315 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:06.416051 22315 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:06.416127 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 23 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.417017 15542 raft_consensus.cc:2410] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 26 because replica has last-logged OpId of term: 24 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 20.
I20260709 13:08:06.418635 21987 raft_consensus.cc:3055] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 13:08:06.419041 22123 consensus_meta.cc:287] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.621s	user 0.010s	sys 0.001s
I20260709 13:08:06.419531 22460 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:06.419512 22123 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.420562 22460 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.421581 22123 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:06.422489 22019 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:06.376169 22496 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:06.424921 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:06.424983 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.405864 22075 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.457352 22075 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.388654 22179 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.414000 22303 raft_consensus.cc:697] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:06.459159 22303 consensus_queue.cc:237] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.427742 22490 raft_consensus.cc:697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:06.460577 22315 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.461295 22490 consensus_queue.cc:237] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.467263 15541 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:06.427557 22494 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:06.419075 21987 raft_consensus.cc:740] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:06.468569 22155 raft_consensus.cc:3055] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:06.496605 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.469817 22123 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:06.515002 22450 log.cc:927] Time spent T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.206s	user 0.013s	sys 0.004s
I20260709 13:08:06.516268 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.489267 22494 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:06.496765 22264 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.518702 22315 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:06.495005 22155 raft_consensus.cc:740] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:06.519114 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.531821 22075 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:06.516887 22453 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:06.559537 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 173227us
I20260709 13:08:06.563453 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:06.506448 22503 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:06.585371 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:06.589660 21987 consensus_queue.cc:260] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.591113 21987 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.596738 22487 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:06.562958 22459 consensus_meta.cc:287] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.003s
I20260709 13:08:06.601743 22497 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:06.602492 22315 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.474313 22457 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.604316 22444 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.605674 22494 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.606328 22179 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:06.587543 22503 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:06.607049 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 263362us
I20260709 13:08:06.599308 22456 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.614113 15550 raft_consensus.cc:1275] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:08:06.620978 15541 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:06.587235 22424 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
W20260709 13:08:06.627331 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 214861us
I20260709 13:08:06.630175 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:06.625586 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.558581 22123 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.630862 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:06.638965 15548 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 14.
I20260709 13:08:06.641382 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:06.635888 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:06.616101 22500 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:06.652115 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.581974 22264 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.652295 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.655301 14887 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.653869 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:06.636279 22494 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.619954 22503 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:06.607622 22075 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.666412 14967 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:06.667331 14887 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:06.638293 22496 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.668843 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.648684 22457 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:06.621904 22315 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.673584 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.685504 14961 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:06.653576 22155 consensus_queue.cc:260] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.658588 22487 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:06.697779 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.774088 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.776994 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.691273 22500 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:06.774343 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.788203 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.788411 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.791677 15044 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:06.788219 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:06.792726 14967 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:06.789129 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.790474 15035 raft_consensus.cc:1275] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:06.812436 14969 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:06.813405 15037 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:06.820245 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 192988us
I20260709 13:08:06.777086 22487 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:06.838755 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.839849 15036 raft_consensus.cc:2410] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 23 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260709 13:08:06.840337 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.685607 22496 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.842257 15035 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:06.853225 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.853892 14887 raft_consensus.cc:3060] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:06.827590 22155 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:06.893085 22286 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:06.893573 22286 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:06.894423 22286 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.895923 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.896680 15036 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 17: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:06.897818 15036 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:06.898792 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:06.899930 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.900646 15044 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 25: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:06.901383 14887 raft_consensus.cc:2468] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:06.916805 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.917626 14894 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:06.927983 22123 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:06.930804 22444 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:06.936355 22315 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.937089 22315 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:06.937819 22315 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:06.938253 22315 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:06.944314 22476 raft_consensus.cc:3055] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:06.944793 22476 raft_consensus.cc:740] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:06.945669 22476 consensus_queue.cc:260] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.847424 22510 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:06.948215 22510 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:06.949709 15042 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260709 13:08:06.950145 15042 pending_rounds.cc:85] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 14
I20260709 13:08:06.950404 15042 pending_rounds.cc:107] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260709 13:08:06.950634 22510 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:06.950670 15042 raft_consensus.cc:2889] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:06.906550 22515 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.102s
I20260709 13:08:06.851023 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:06.858654 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.862633 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.957991 15037 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:06.863246 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:06.867779 22506 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 13:08:06.868676 22075 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.868755 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.811728 22500 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.870625 22496 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:06.870776 15043 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 13:08:06.907214 22512 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:08:06.874862 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:06.876497 15038 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
I20260709 13:08:06.877759 22518 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:06.880288 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:06.882107 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.882791 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:06.883150 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:06.848690 22487 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:06.843219 22497 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
W20260709 13:08:06.960806 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 109846us
I20260709 13:08:06.972776 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:06.963376 14961 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
W20260709 13:08:06.905867 22507 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260709 13:08:06.871232 22519 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:08:06.967429 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 336600us
I20260709 13:08:06.966355 22515 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:06.975144 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:06.974722 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 338886us
W20260709 13:08:06.993299 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 339962us
I20260709 13:08:06.962379 22286 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:06.997287 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:06.939062 22315 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:07.000906 15548 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
W20260709 13:08:06.979033 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.993999 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:06.996750 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.002843 14894 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
I20260709 13:08:06.972107 22518 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.005035 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.975735 22519 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:07.043066 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:08:06.996169 22318 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.006s	sys 0.031s
I20260709 13:08:07.032367 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.032290 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:07.041896 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.050064 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:06.978263 22111 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.042255 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.042413 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.003469 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.046286 14890 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260709 13:08:07.008237 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.030774 22497 consensus_queue.cc:1243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 13:08:07.045931 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.055016 15549 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 13:08:07.055469 15544 raft_consensus.cc:2393] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:07.056361 15550 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:08:06.977385 22496 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:07.058701 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.060340 14894 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 25.
I20260709 13:08:07.062031 15548 raft_consensus.cc:2393] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 14: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:07.062983 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:07.046694 22318 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.033s
I20260709 13:08:07.064822 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.066237 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.068775 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.069711 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.070588 14895 raft_consensus.cc:2393] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:07.030457 22518 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:07.032114 22444 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:07.045562 22519 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.074467 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.076659 14890 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:07.074925 14891 raft_consensus.cc:2368] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:08:07.081411 14892 raft_consensus.cc:2410] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:08:07.097692 22528 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.099500 22526 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 13:08:07.100095 22477 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:07.100169 22503 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.100812 22477 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:07.101261 22477 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:07.101790 22485 log.cc:927] Time spent T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:07.102641 22503 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.103461 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.104184 14890 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:07.104941 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.105427 14890 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:07.106159 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.107786 22500 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.109241 22264 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.113659 22019 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:07.114084 22019 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:07.115612 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.088847 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.117434 15549 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:07.084070 22527 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.075093 22515 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.088673 22399 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:07.119176 22515 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.120919 15550 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:08:07.121975 22487 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.123828 22515 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.116638 14895 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.083470 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.137426 22399 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:07.144393 22458 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.001s
W20260709 13:08:07.115787 21987 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.524s	user 0.011s	sys 0.000s
I20260709 13:08:07.159377 15040 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:07.173166 22426 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:08:07.176261 22399 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.118877 22527 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.079487 22444 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.183717 22444 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:07.184128 22527 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.185976 22442 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.065709 22496 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:07.187650 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.183301 22508 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.589s	user 0.004s	sys 0.000s
I20260709 13:08:07.206099 14890 raft_consensus.cc:2410] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 13.
W20260709 13:08:07.210840 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 216958us
I20260709 13:08:07.220800 15037 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 25.
I20260709 13:08:07.228585 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.230798 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.234161 14891 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:07.233402 15010 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.234385 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.234959 15549 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:07.235678 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.189131 22496 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.131546 22515 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:07.241076 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 181499us
W20260709 13:08:07.241874 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 196010us
I20260709 13:08:07.247491 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.248517 14894 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 25.
I20260709 13:08:07.245216 15010 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.251065 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:07.257987 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:07.259836 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.115012 22019 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.252247 22527 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:07.237617 22477 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.269717 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:07.270538 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:07.271104 14969 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:07.258944 22538 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.272895 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.277022 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:07.277772 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.262208 21987 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.286033 15044 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
W20260709 13:08:07.289789 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 209610us
I20260709 13:08:07.254180 22515 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.265386 22534 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:07.299610 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.296114 15513 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.300379 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.273392 22536 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:07.302260 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.301793 22534 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:07.280499 22442 consensus_queue.cc:1048] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:08:07.307889 22534 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:07.310801 22515 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:07.307224 22526 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:07.298933 22019 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:07.311679 22527 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:07.316102 15044 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:07.317448 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.317730 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.318396 22526 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:07.318847 22526 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:07.319206 22526 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:07.319664 22515 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.285486 22538 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.324774 22538 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.328825 22515 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:07.328907 22526 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.328239 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.332084 15513 leader_election.cc:400] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 13 election: Vote denied by peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755) with higher term. Message: Invalid argument: T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 13. Current term is 14.
I20260709 13:08:07.332628 22515 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:07.332752 22477 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.334125 22477 raft_consensus.cc:2955] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Committing config change with OpId 14.12: config changed from index 10 to 12, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:07.335858 22518 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.337109 15037 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:08:07.293102 22457 consensus_queue.cc:1048] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.040s
I20260709 13:08:07.340673 22518 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.345278 15513 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.348755 15039 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:08:07.349674 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:07.353104 14966 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:07.292244 22520 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:07.350191 22536 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:07.355621 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.306329 22503 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:07.375487 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.378484 14966 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 25.
I20260709 13:08:07.301963 22062 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.066s
I20260709 13:08:07.357162 21987 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.382818 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:07.383054 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 184395us
W20260709 13:08:07.393885 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 115179us
I20260709 13:08:07.372735 22442 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:07.363783 22534 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:07.397149 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:07.397179 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.380666 22524 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.398417 15044 raft_consensus.cc:2393] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 25: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:07.382266 21987 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.401717 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:07.402484 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:07.399014 22428 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.010s	sys 0.009s
I20260709 13:08:07.408003 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.397729 22442 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.411434 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.413151 15044 raft_consensus.cc:2410] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 13:08:07.413638 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.414225 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:07.406028 22428 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.010s	sys 0.010s
I20260709 13:08:07.399708 22528 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:07.418962 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.410789 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.415670 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.404611 22494 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:07.398504 22543 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.414494 14887 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:07.404510 22532 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:07.419737 15008 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.422276 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.408800 22458 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:07.410298 22514 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:07.410524 22539 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:07.416266 22442 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:07.403396 22019 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:08:07.432889 14861 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:07.422946 22318 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:07.420958 22487 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.424074 22532 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:07.418431 22428 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:07.412369 22536 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.431806 22526 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.437299 22494 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:08:07.505371 15542 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:08:07.509426 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.505870 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.511977 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.513368 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.514621 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.515595 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.433864 22500 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 13:08:07.434118 22179 consensus_queue.cc:1059] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260709 13:08:07.517793 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:07.518337 14967 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:08:07.450284 15513 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.451318 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1950) took 1404 ms. Trace:
I20260709 13:08:07.518985 15545 rpcz_store.cc:276] 0709 13:08:06.029782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.040340 (+ 10558us) service_pool.cc:224] Handling call
0709 13:08:06.048848 (+  8508us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.329469 (+280621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.433866 (+1104397us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b54005546d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:07.434035 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520334592}
W20260709 13:08:07.519778 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69610.8us
I20260709 13:08:07.520468 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.521040 15545 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:08:07.520020 22526 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:07.522192 15545 raft_consensus.cc:1240] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 23. Current term is 24. Ops: []
I20260709 13:08:07.453773 14895 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 13:08:07.523574 14895 pending_rounds.cc:85] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 13
I20260709 13:08:07.523839 14895 pending_rounds.cc:107] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 13:08:07.524080 14895 raft_consensus.cc:2889] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.525022 22376 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.454856 14887 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:07.462253 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.527848 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.528378 22534 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:07.430524 22478 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:07.528827 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.530484 15041 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:08:07.536240 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.537519 22374 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.509557 22436 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:07.539045 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:07.539763 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 3006) took 1544 ms. Trace:
I20260709 13:08:07.540280 22374 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:07.540920 22374 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:07.541337 22374 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:07.535521 22376 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.544412 22376 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.540558 14936 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:07.546305 22376 raft_consensus.cc:2804] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:07.547991 22376 raft_consensus.cc:697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:07.462715 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.502319 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.549626 22374 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.461959 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.550647 22533 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:07.448622 22458 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:07.526253 22264 consensus_queue.cc:1059] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 13:08:07.551349 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.849s (SENT)
I20260709 13:08:07.551177 22533 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.551827 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.551894 22264 raft_consensus.cc:3055] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:07.552431 22264 raft_consensus.cc:740] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:07.553287 22264 consensus_queue.cc:260] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.553371 22444 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.554427 22264 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:07.554867 15541 raft_consensus.cc:2368] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 25. Current term is 26.
I20260709 13:08:07.556118 22374 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.556862 22444 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.557555 22444 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:08:07.515883 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.561319 15040 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:08:07.561558 14887 raft_consensus.cc:1275] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 13:08:07.547823 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:07.562584 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.563580 22374 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.563990 22374 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:07.564450 22374 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.539058 22436 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.423409 22516 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:07.566560 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.456311 22538 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.111s
I20260709 13:08:07.565919 22376 consensus_queue.cc:237] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.571033 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:07.454862 22318 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.573983 22318 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:07.574803 22096 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:07.530742 15037 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23. Ops: []
W20260709 13:08:07.575618 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 156081us
I20260709 13:08:07.528931 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.446545 14889 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:07.576670 15039 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:07.573149 22499 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 1.200s	user 0.004s	sys 0.000s
I20260709 13:08:07.549527 22519 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.593240 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.563170 14887 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:07.572546 22442 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.442209 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.460402 22532 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:07.597901 14892 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:07.534730 21987 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.575237 22096 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:07.590654 22490 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.997s	user 0.021s	sys 0.021s
I20260709 13:08:07.600139 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.600592 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.599239 14892 raft_consensus.cc:3060] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:07.605311 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.405499 22524 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.605726 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.540158 14963 rpcz_store.cc:276] 0709 13:08:05.995087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:05.995224 (+   137us) service_pool.cc:224] Handling call
0709 13:08:06.002946 (+  7722us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:06.607703 (+604757us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:08:06.610313 (+  2610us) log.cc:844] Serialized 14 byte log entry
0709 13:08:06.982963 (+372650us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:06.983033 (+    70us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:06.983111 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:07.539047 (+555936us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b1800378a00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c572a6 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419
0709 13:08:07.539536 (+   489us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b54003093d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:07.539580 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.539684 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2916,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":91,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":6846,"spinlock_wait_cycles":1414611456,"thread_start_us":372220,"threads_started":1,"wal-append.queue_time_us":478351}
I20260709 13:08:07.605471 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:07.607786 15547 raft_consensus.cc:1275] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:08:07.618849 15541 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:07.619812 14887 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:07.567350 22436 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.619961 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.601529 22544 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election won for term 25
W20260709 13:08:07.626619 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.615972 22490 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.022s	sys 0.022s
I20260709 13:08:07.631193 15544 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:07.608191 22096 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:07.630185 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.643906 15039 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:07.604930 22103 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:07.464596 22487 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.641840 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.618041 22315 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.659729 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:07.660567 14967 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:07.662309 14967 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:07.664453 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:07.665206 14967 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:07.596679 22075 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.031s
I20260709 13:08:07.655936 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.656010 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.623845 22458 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:07.665513 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.666615 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:07.623216 22500 raft_consensus.cc:3055] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Stepping down as leader of term 23
W20260709 13:08:07.665481 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:07.654922 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 75937.1us
I20260709 13:08:07.675561 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:07.675915 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.676738 14887 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:07.645731 22432 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:08:07.677019 14891 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 13:08:07.677932 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.643750 22544 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:07.462337 22428 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.645591 22496 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.698695 14891 pending_rounds.cc:85] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 15
I20260709 13:08:07.701074 14891 pending_rounds.cc:107] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 13:08:07.701510 14891 raft_consensus.cc:2889] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:07.693761 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.700330 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1949) took 1670 ms. Trace:
W20260709 13:08:07.705008 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97555us
I20260709 13:08:07.705466 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.706063 14887 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:07.707753 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.707297 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:07.704002 15543 rpcz_store.cc:276] 0709 13:08:06.029524 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.038763 (+  9239us) service_pool.cc:224] Handling call
0709 13:08:06.039077 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:06.039290 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:06.039315 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:06.039887 (+   572us) log.cc:844] Serialized 26 byte log entry
0709 13:08:06.093520 (+ 53633us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:06.093554 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:06.093623 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:07.572541 (+1478918us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:07.678959 (+106418us) raft_consensus.cc:1685] finished
0709 13:08:07.678983 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:07.700259 (+ 21276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15878400,"thread_start_us":53244,"threads_started":1,"wal-append.queue_time_us":189219}
W20260709 13:08:07.712859 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.714107 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:07.717199 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.709513 14889 pending_rounds.cc:85] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 12
I20260709 13:08:07.645994 22062 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260709 13:08:07.718708 14889 pending_rounds.cc:107] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:08:07.723609 14889 raft_consensus.cc:2889] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:08:07.720757 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 55311.8us
I20260709 13:08:07.720089 14963 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260709 13:08:07.677412 22500 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:07.726015 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.728006 14861 leader_election.cc:400] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 25. Current term is 26.
I20260709 13:08:07.728410 14861 leader_election.cc:403] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 13:08:07.722355 15007 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.729898 15007 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:07.727463 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.722970 14859 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.732193 14893 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:08:07.732709 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:07.675204 22538 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:08:07.743438 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:07.670581 22315 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.711782 22432 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:07.739478 22075 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:08:07.755534 22155 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 13:08:07.785723 14963 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
W20260709 13:08:07.786998 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62417.4us
I20260709 13:08:07.790869 14887 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 26.
I20260709 13:08:07.740018 22520 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:07.707556 22496 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:07.745054 22478 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:08:07.797161 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 103531us
I20260709 13:08:07.790354 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.763787 22528 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:07.802500 14969 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:07.735270 22514 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:08:07.755235 22179 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 13:08:07.733903 22436 consensus_queue.cc:1059] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.058s
I20260709 13:08:07.792719 22019 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 25. Current term is 26.
I20260709 13:08:07.789470 22567 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.791344 22075 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:07.815891 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 64887.4us
I20260709 13:08:07.803522 22528 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.802380 22520 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:07.845598 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:07.841812 22564 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:07.819103 22526 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.828022 22519 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.828214 22528 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:07.858824 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:07.805976 22458 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:07.851346 22564 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:07.829849 22075 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.814874 22544 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.839675 22374 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.824608 22567 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:07.887925 22562 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
W20260709 13:08:07.888686 22565 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 13:08:07.888990 22573 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:07.889629 22558 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 13:08:07.890363 22563 log.cc:927] Time spent T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:08:07.891788 22442 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:07.893959 22559 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 13:08:07.895682 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 89961.4us
I20260709 13:08:07.861053 22494 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:07.881256 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:07.855317 22527 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:08:07.866374 22478 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:07.857260 22526 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.953114 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:07.877151 22564 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:07.897025 22487 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:07.880062 22524 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:07.967168 14936 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.972844 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:07.982903 14887 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:07.983011 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:07.846902 22432 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:07.985255 14890 raft_consensus.cc:2410] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 13:08:07.979528 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:07.980270 14892 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:07.975899 14933 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:07.978675 22179 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.997529 15513 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:07.980058 22442 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:07.987908 22286 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.014178 22581 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.014750 22581 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.016952 22580 raft_consensus.cc:3055] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 13:08:08.017402 22580 raft_consensus.cc:740] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:08.018257 22580 consensus_queue.cc:260] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.005522 22425 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:08.020066 22425 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:08.020980 22425 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:08.021860 22571 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:08:08.023068 22576 log.cc:927] Time spent T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:08.028538 14887 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:08.024554 22582 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:08.000639 22315 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.001639 22524 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:08.000056 22572 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:08:08.036767 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:07.966229 22520 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.069476 22567 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.003765 22179 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.071797 22572 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.073309 22179 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.073912 22572 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.011961 22496 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.005746 22062 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
W20260709 13:08:08.081619 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 114570us
I20260709 13:08:08.082173 22582 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:08:08.085451 22318 consensus_meta.cc:287] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.511s	user 0.008s	sys 0.001s
I20260709 13:08:08.085893 22318 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.088462 22516 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.011270 22442 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.098462 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:08.104497 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:08.151371 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 52986.7us
I20260709 13:08:08.039558 22580 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.152835 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:08.151101 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 176103us
I20260709 13:08:08.158162 14933 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.035030 22286 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.164798 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.167318 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.167873 14892 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
W20260709 13:08:08.168773 14933 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.505s (SENT) [suppressed 17 similar messages]
I20260709 13:08:08.168576 22096 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.169960 22590 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.170908 22096 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.094182 22532 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.171729 14967 raft_consensus.cc:2368] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15.
I20260709 13:08:08.172379 22096 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.173187 22532 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.150278 22585 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:08.175154 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.176024 22096 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:08.175751 22585 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.177399 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:08.178108 22096 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:08.178676 22096 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:08.179035 22096 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.089927 22478 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.154572 22582 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:08.182365 22582 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.184419 22582 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.185235 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.150349 22374 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.189090 15546 raft_consensus.cc:1275] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:08:08.178155 22585 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.187166 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1869) took 1030 ms. Trace:
I20260709 13:08:08.190438 15548 rpcz_store.cc:276] 0709 13:08:07.156956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.157095 (+   139us) service_pool.cc:224] Handling call
0709 13:08:07.157377 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.315653 (+158276us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.315699 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:07.315758 (+    59us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:07.315811 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.183267 (+867456us) spinlock_profiling.cc:243] Waited 158 ms on lock 0x7b5400501754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:08.183317 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.187113 (+  3796us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":363431168}
I20260709 13:08:08.194085 22585 consensus_queue.cc:1059] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 13:08:08.196333 22587 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.118s
I20260709 13:08:08.197657 22581 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.197800 22062 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.198325 22062 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.199834 15542 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:08:08.198632 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1868) took 1150 ms. Trace:
I20260709 13:08:08.203770 15550 rpcz_store.cc:276] 0709 13:08:07.048475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.064498 (+ 16023us) service_pool.cc:224] Handling call
0709 13:08:07.078926 (+ 14428us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:07.121251 (+ 42325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.198396 (+1077145us) spinlock_profiling.cc:243] Waited 41.8 ms on lock 0x7b5400512cd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:08.198579 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":96027392}
I20260709 13:08:08.205005 22526 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:08.205510 22526 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.205919 22526 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.196367 22318 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:08.213186 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.222545 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.223178 15042 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:08.223727 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.223062 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.227620 15548 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.229290 21987 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.229738 22286 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.231428 22442 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.231608 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:08.232492 22584 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.251s	user 0.003s	sys 0.000s
I20260709 13:08:08.234869 14894 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51176 (request call id 1668) took 1194 ms. Trace:
I20260709 13:08:08.235976 22526 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:08.236565 15042 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 26.
I20260709 13:08:08.239979 15546 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:08.257738 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1709) took 1943 ms. Trace:
I20260709 13:08:08.258358 15547 rpcz_store.cc:276] 0709 13:08:06.314225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:06.321821 (+  7596us) service_pool.cc:224] Handling call
0709 13:08:06.373835 (+ 52014us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.617176 (+1243341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.257365 (+640189us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400b92b54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:08.257657 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2800857984}
I20260709 13:08:08.265189 22528 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.267359 15043 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:08.268381 22528 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.272707 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.235216 14894 rpcz_store.cc:276] 0709 13:08:07.040790 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.083151 (+ 42361us) service_pool.cc:224] Handling call
0709 13:08:08.234701 (+1151550us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b54000cdd54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:08.234790 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190654720}
I20260709 13:08:08.195694 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.307819 15010 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:08.313472 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 117854us
I20260709 13:08:08.322293 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.322467 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.323032 15544 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:08.323176 15036 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:08.326362 15010 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:08.327315 15039 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:08.327477 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.286159 22459 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.341423 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.341558 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.370839 14969 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:08.369997 14965 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:08.371922 14963 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:08.345906 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:08.300117 22592 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:08.347831 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.325039 22528 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.369747 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:08.377396 14962 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:08.378826 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.379398 14969 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:08.301465 22476 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:08.380905 22593 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.381428 22286 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:08.370553 22459 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.381937 22286 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.383769 22459 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.384258 22528 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.386315 22528 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:08.300194 22424 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.512s	user 0.016s	sys 0.011s
I20260709 13:08:08.345306 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:08.307137 22368 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:08.380726 22432 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
W20260709 13:08:08.399539 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 230772us
I20260709 13:08:08.334311 22511 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:08.380015 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:08.373755 22567 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:08.334095 22585 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:08.404152 14965 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:08.404244 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.334335 22539 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:08.345021 22515 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.054s
W20260709 13:08:08.399971 22424 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.622s	user 0.016s	sys 0.014s
I20260709 13:08:08.392532 22458 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.399770 22368 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:08.415068 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:08.417577 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.345443 22442 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 13:08:08.420310 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.391652 22286 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.402616 22477 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.407678 22503 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:08.428005 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.292516 22564 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.400895 22444 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.427471 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:08.397373 22452 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
W20260709 13:08:08.441192 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 61227.8us
I20260709 13:08:08.442233 15514 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:08.443492 14962 raft_consensus.cc:2468] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:08.444480 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.448441 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.418272 22528 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
W20260709 13:08:08.455483 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 45110.3us
I20260709 13:08:08.436131 22286 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:08.414554 22318 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 13:08:08.431841 22585 consensus_queue.cc:1048] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.015s
I20260709 13:08:08.463189 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:08.427073 22458 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.470429 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.456398 22587 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:08.380789 22568 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.103s
I20260709 13:08:08.436419 22459 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 13:08:08.435261 22477 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.445039 22444 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.462916 22286 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.480262 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.469569 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.489181 15548 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:08.462571 22075 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.489348 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.471264 22062 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:08.373891 22590 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
W20260709 13:08:08.493438 22599 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 13:08:08.493968 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.494867 22545 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:08.497959 15036 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 24: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:08.498636 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.410218 22511 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.499431 15044 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:08.504664 15544 raft_consensus.cc:2468] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:08.506807 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.472573 22496 consensus_queue.cc:1048] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:08.510382 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.381567 22593 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.490913 22286 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:08.507764 22591 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:08.471300 22368 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.507923 22096 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.518568 22444 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:08.520622 22477 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:08.491492 22549 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:08.523090 22111 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:08.532886 22549 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.532933 22111 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:08.533437 22549 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.533955 22111 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.534499 22096 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.534824 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1678) took 1460 ms. Trace:
I20260709 13:08:08.495954 22478 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:08.535197 14891 rpcz_store.cc:276] 0709 13:08:07.074871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.257611 (+182740us) service_pool.cc:224] Handling call
0709 13:08:07.443903 (+186292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.707523 (+263620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.533952 (+826429us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b54003d54d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:08.534628 (+   676us) spinlock_profiling.cc:243] Waited 186 ms on lock 0x7b54003d54d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:08.534751 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":962875648}
I20260709 13:08:08.535745 14964 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:08.527051 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.538282 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.535158 22111 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:08.551839 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.552603 15037 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:08.539842 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1679) took 1457 ms. Trace:
I20260709 13:08:08.541500 15548 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.541246 15036 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:08.555241 14895 rpcz_store.cc:276] 0709 13:08:07.081927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.261521 (+179594us) service_pool.cc:224] Handling call
0709 13:08:07.453355 (+191834us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.524491 (+ 71136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.539663 (+1015172us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b54003877d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:08.539788 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":422434688}
I20260709 13:08:08.563926 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.548364 22458 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.539691 22368 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:08.593127 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.603943 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.606462 15037 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:08.533062 22564 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.594627 15036 raft_consensus.cc:1240] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:08.550657 22593 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.549448 22511 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.603792 22096 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.647464 22096 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.649731 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.599378 22494 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.666930 14966 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:08.609297 22533 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.558979 22478 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.678293 22096 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.682689 22539 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:08.695554 22539 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:08.696444 22539 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.697621 22539 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.663800 22549 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.700029 15547 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:08.684012 22494 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.701120 22549 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.701872 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.706876 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.707191 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:08.708310 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:08.708590 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.709199 14965 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:08.710127 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.710665 14965 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:08.711706 22497 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.712126 22497 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.712466 22497 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.651181 22452 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.715731 22452 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.720608 14962 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:08.652815 22582 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:08.688659 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.691280 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.731249 14969 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:08.732846 14969 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:08:08.734190 14969 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:08.692932 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.738237 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 1796) took 1072 ms. Trace:
I20260709 13:08:08.738657 14967 rpcz_store.cc:276] 0709 13:08:07.666230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.666343 (+   113us) service_pool.cc:224] Handling call
0709 13:08:08.738064 (+1071721us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54003e6554. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:08.738184 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1143698816}
I20260709 13:08:08.748745 22494 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.752431 22452 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.757328 22500 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.762149 22497 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.762717 22100 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:08.763103 22100 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:08.763840 22100 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.764598 15548 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:08:08.764789 22100 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:08.769260 22478 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.769928 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.771489 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.772171 15037 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:08:08.776166 22286 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.777716 22500 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:08.786232 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.784436 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.787571 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.811417 14970 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:08.779026 22286 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.817920 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.818395 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.819026 15036 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:08.821259 15036 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:08:08.823485 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:08.824857 15044 raft_consensus.cc:1240] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24. Ops: [23.16-23.16]
W20260709 13:08:08.825770 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 185466us
I20260709 13:08:08.828485 14965 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:08.826669 15008 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:08.826090 15037 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:08:08.830272 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:08.833010 22570 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:08.833451 22459 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:08.834861 22510 raft_consensus.cc:2804] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:08.835388 22510 raft_consensus.cc:697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:08.836194 22510 consensus_queue.cc:237] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.840330 22478 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:08.840821 22478 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.842737 22478 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.806344 22585 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.844254 22585 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.846217 22585 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.830438 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:08.853617 15035 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:08:08.793460 22581 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:08.855317 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.858412 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.858457 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.858671 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:08.855593 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:08.857774 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:08.865561 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:08.827641 22519 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.833490 22570 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:08.869462 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:08.877488 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.878156 15544 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:08.878427 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.858819 22543 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:08.855319 22544 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:08.834024 22459 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.882207 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.858712 22494 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:08.829007 22539 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:08.871518 22575 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:08.883739 15547 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:08:08.871129 22286 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 13:08:08.887770 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.873680 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:08.890237 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 183113us
I20260709 13:08:08.854979 22578 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:08.878268 22497 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.858639 22425 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 13:08:08.858466 22111 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
I20260709 13:08:08.880189 22511 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:08.878067 22519 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.896345 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.897907 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:08.898649 14961 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.899591 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:08.900279 14970 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:08.902688 14967 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 13:08:08.883004 22543 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:08.906900 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:08.908439 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:08.912722 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:08.891939 22575 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.913884 22575 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:08.916808 14961 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:08.874665 22480 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.019s
I20260709 13:08:08.896543 22511 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.864163 22581 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.920321 14895 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 17. (term mismatch)
I20260709 13:08:08.920413 22511 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:08.920907 14895 pending_rounds.cc:85] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 16
I20260709 13:08:08.921178 14895 pending_rounds.cc:107] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 23.17
I20260709 13:08:08.921393 14895 raft_consensus.cc:2889] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:08.924309 14966 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:08:08.926083 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:08.932101 22581 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:08.932632 22581 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:08.937448 22459 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.938820 22570 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.939394 22519 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:08.880017 22545 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 13:08:08.920255 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1969) took 1272 ms. Trace:
I20260709 13:08:08.949673 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.942991 15547 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:08.950281 14888 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:08.891803 22286 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:08.944025 15541 rpcz_store.cc:276] 0709 13:08:07.648073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.784627 (+136554us) service_pool.cc:224] Handling call
0709 13:08:07.784970 (+   343us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:07.785396 (+   426us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.785426 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:07.793563 (+  8137us) log.cc:844] Serialized 52 byte log entry
0709 13:08:08.493444 (+699881us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b18000fc520. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:08.609727 (+116283us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:08.683681 (+ 73954us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.684022 (+   341us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.686200 (+  2178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.686279 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:08.846052 (+159773us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b18000fc520. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:08:08.920064 (+ 74012us) raft_consensus.cc:1685] finished
0709 13:08:08.920084 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:08.920203 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75575,"prepare.queue_time_us":81908,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":80,"raft.queue_time_us":27693,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":9908,"spinlock_wait_cycles":85267072,"thread_start_us":116106,"threads_started":1,"wal-append.queue_time_us":1054335}
I20260709 13:08:08.968372 14886 raft_consensus.cc:1240] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:08.969656 14888 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:08.968379 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:08.977414 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.942647 22543 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:08.885350 22544 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:08.979681 15541 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:08.890897 22494 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:08.981967 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:08.985847 14892 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:08.968446 22286 raft_consensus.cc:3060] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:08.984150 14888 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:09.001878 14888 raft_consensus.cc:1275] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:08:09.002353 14888 pending_rounds.cc:85] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 10
I20260709 13:08:09.002655 14888 pending_rounds.cc:107] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:08:09.002959 14888 raft_consensus.cc:2889] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.011299 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.006407 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.018910 22354 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:09.019364 22354 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:09.020208 22354 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.021123 22354 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:09.031834 14970 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
W20260709 13:08:09.034842 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 161223us
I20260709 13:08:09.038045 14861 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:09.005378 22376 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 13:08:09.010946 22478 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 13:08:09.048827 22497 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:09.044328 22621 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:09.050612 22111 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.072314 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:09.077143 14933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.024s	sys 0.023s
W20260709 13:08:09.077836 14933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.024s	sys 0.023s
W20260709 13:08:09.078478 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 616555us
I20260709 13:08:09.079108 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:09.115312 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:09.201723 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.205889 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 90689.2us
I20260709 13:08:09.054813 22459 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260709 13:08:09.068964 22497 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.245448 22497 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:09.070873 22621 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.257120 22621 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.261391 22494 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.219390 22519 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:09.264863 22626 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:09.265417 22626 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:09.217209 22582 consensus_queue.cc:1048] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:08:09.220084 22593 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:09.223659 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:09.229862 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.077595 22111 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:09.217532 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.285925 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 62355.6us
I20260709 13:08:09.294634 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:09.218169 22585 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:09.291462 22593 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:09.298074 22510 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.264300 22519 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.303491 22436 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:09.302486 22585 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.305756 22100 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.323395 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:09.324415 14970 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 15: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:09.288832 22494 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.024s
I20260709 13:08:09.266616 22626 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.334105 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.340962 14967 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:08:09.336549 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.341435 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.342265 14962 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 14.
I20260709 13:08:09.343214 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:09.348891 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.349133 14964 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:09.349619 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.325121 22436 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.328465 22585 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.330372 22425 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:09.347565 22619 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 13:08:09.344385 22533 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:09.355520 22436 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.385238 22455 raft_consensus.cc:3055] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:09.385757 22455 raft_consensus.cc:740] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:09.385365 22497 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.386611 22455 consensus_queue.cc:260] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.388029 22511 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.389995 22511 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.393947 22544 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:09.349668 14966 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:09.337503 22100 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.396664 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.324726 22510 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:09.375840 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.352274 22525 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:09.397567 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.379562 22539 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:09.407295 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:09.380247 22500 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.567s	user 0.010s	sys 0.002s
I20260709 13:08:09.411454 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:09.415249 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.417040 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.418354 14894 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
I20260709 13:08:09.395031 22543 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.429853 22543 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:09.367954 22533 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.396143 22621 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.416607 22538 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.437235 22538 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.437839 22621 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.439211 22497 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.417573 22539 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.447368 22436 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:09.454226 15008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.455696 22436 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.418993 14967 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:09.412348 22570 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:09.418781 22376 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:09.457705 22376 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.458089 22376 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:09.413955 22525 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.459609 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.425262 22510 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.460243 14962 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:09.461550 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.462124 14969 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
W20260709 13:08:09.462414 15035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3832) took 2054 ms (client timeout 2211 ms). Trace:
I20260709 13:08:09.411892 22455 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:09.462999 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.464186 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:09.465448 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 3311) took 1156 ms. Trace:
I20260709 13:08:09.361053 22425 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.448086 22096 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:09.468750 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:09.469071 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.469297 14967 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.450894 14893 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:09.480157 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1723) took 1257 ms. Trace:
I20260709 13:08:09.480645 15043 rpcz_store.cc:276] 0709 13:08:08.223046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.223494 (+   448us) service_pool.cc:224] Handling call
0709 13:08:09.479925 (+1256431us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54001b85d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:09.480092 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98316544}
W20260709 13:08:09.462803 15035 rpcz_store.cc:269] 0709 13:08:07.408226 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.418666 (+ 10440us) service_pool.cc:224] Handling call
0709 13:08:09.462270 (+2043604us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b540008a2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:09.462363 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3266181888}
I20260709 13:08:09.465778 15041 rpcz_store.cc:276] 0709 13:08:08.308650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.310050 (+  1400us) service_pool.cc:224] Handling call
0709 13:08:08.310313 (+   263us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.792234 (+481921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.792281 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.819633 (+ 27352us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.039918 (+220285us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:08:09.039982 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.465103 (+425121us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b540014c8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:09.465150 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.465191 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:09.465203 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.465393 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3534,"raft.queue_time_us":17140,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":9691,"spinlock_wait_cycles":1099165568,"thread_start_us":162267,"threads_started":1,"wal-append.queue_time_us":354043}
I20260709 13:08:09.410775 22622 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 13:08:09.447957 22627 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:08:09.501835 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:09.511724 15008 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:09.521658 15545 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.017s
I20260709 13:08:09.419376 22536 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:09.474822 22567 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:09.521756 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:09.522032 15545 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.008s	sys 0.017s
W20260709 13:08:09.524430 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 457478us
I20260709 13:08:09.451170 22539 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.529155 14966 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:09.530467 21987 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:09.530869 21987 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.531190 21987 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:09.492501 22497 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:09.534017 14966 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:09.535962 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.538630 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.533330 15545 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1972) took 1859 ms. Trace:
I20260709 13:08:09.542024 14895 raft_consensus.cc:1275] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:09.539016 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.545047 14967 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:09.532845 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.549618 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:09.550486 14970 raft_consensus.cc:2368] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15.
I20260709 13:08:09.540714 15545 rpcz_store.cc:276] 0709 13:08:07.674303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.902415 (+228112us) service_pool.cc:224] Handling call
0709 13:08:07.904056 (+  1641us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:07.904275 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 13:08:08.963240 (+1058965us) log.cc:844] Serialized 14 byte log entry
0709 13:08:09.533013 (+569773us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:09.533064 (+    51us) raft_consensus.cc:1645] Marking committed up to 16
0709 13:08:09.533114 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.533183 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.533280 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":743994,"prepare.queue_time_us":775689,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":5634,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":846944,"threads_started":2}
I20260709 13:08:09.552127 15008 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:09.535894 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.554323 14966 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:08:09.557837 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:09.521324 22500 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:09.561007 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.526746 22544 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:09.558923 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.561583 14886 raft_consensus.cc:1240] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:09.566607 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:09.567230 15545 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:09.568711 14962 raft_consensus.cc:2393] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:09.568958 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:09.569204 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.570019 14891 raft_consensus.cc:2393] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 20: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:09.533412 22524 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:09.570503 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:09.552346 22592 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.583766 22583 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.429s	user 0.006s	sys 0.000s
I20260709 13:08:09.583683 22592 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.542109 22111 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.586320 22592 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.586472 22111 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:09.587256 22111 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:09.588073 22621 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:09.591939 22632 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 13:08:09.592738 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:09.594317 15548 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:09.596328 14935 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.576924 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:09.596904 15545 raft_consensus.cc:3060] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:09.578047 22286 consensus_meta.cc:287] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.573s	user 0.012s	sys 0.000s
I20260709 13:08:09.581980 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
W20260709 13:08:09.576913 22579 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 1.603s	user 0.006s	sys 0.006s
I20260709 13:08:09.597892 14891 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.548040 22538 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.598506 14933 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:09.563714 22539 raft_consensus.cc:2804] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:09.599198 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.610775 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.629190 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.531831 22536 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.567001 22544 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:09.638072 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:09.557629 22510 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.054s
I20260709 13:08:09.548589 22497 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.612963 22444 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.662952 22123 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:09.569545 22368 consensus_queue.cc:1059] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.075s
I20260709 13:08:09.611804 22096 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:09.628319 22543 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.676508 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1874) took 2082 ms. Trace:
I20260709 13:08:09.679770 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.636612 22538 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:09.570345 22500 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.712857 22500 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.713423 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.714818 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.716596 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.637050 22436 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:09.651351 22478 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:09.583391 22376 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.611766 22286 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.704020 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.705255 22538 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:09.708567 22533 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.709314 15039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1717) took 1493 ms. Trace:
I20260709 13:08:09.710487 22519 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:09.649194 22575 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.000s
I20260709 13:08:09.652937 22539 raft_consensus.cc:697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:09.611960 22592 consensus_queue.cc:1048] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 13:08:09.693928 15549 rpcz_store.cc:276] 0709 13:08:07.594582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:07.594735 (+   153us) service_pool.cc:224] Handling call
0709 13:08:07.614745 (+ 20010us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:08:07.704302 (+ 89557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:07.704332 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:08:07.715673 (+ 11341us) log.cc:844] Serialized 78 byte log entry
0709 13:08:07.851393 (+135720us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:07.859266 (+  7873us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.644855 (+785589us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b180030ffa0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c03c0a 00007f553b343219 00007f5531c8ba40 00007f5531c864e4 00007f5531c86455 00007f553876e3c7 00007f5534d809a7 00007f5534d900bf 00007f5534d90038
0709 13:08:08.645056 (+   201us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.645262 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.655255 (+  9993us) spinlock_profiling.cc:243] Waited 84.3 ms on lock 0x7b54005d02d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:08.655306 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.568580 (+913274us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:09.676279 (+107699us) raft_consensus.cc:1685] finished
0709 13:08:09.676301 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.676447 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":787262,"prepare.queue_time_us":835896,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":66,"raft.queue_time_us":32986,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":11269,"spinlock_wait_cycles":230763648,"thread_start_us":89735,"threads_started":1,"wal-append.queue_time_us":146367}
I20260709 13:08:09.652235 22544 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:09.724103 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 651842us
I20260709 13:08:09.599877 22524 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.703250 22096 consensus_queue.cc:1059] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:09.758103 14891 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
W20260709 13:08:09.762494 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:09.764273 15542 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:09.697512 22458 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:09.700018 22354 consensus_meta.cc:287] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.006s
I20260709 13:08:09.771159 15039 rpcz_store.cc:276] 0709 13:08:08.216323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.216610 (+   287us) service_pool.cc:224] Handling call
0709 13:08:08.216946 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:08.327743 (+110797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.709073 (+1381330us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54003331d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:09.709251 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":253427456}
I20260709 13:08:09.682889 22123 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:09.805642 22123 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.806881 22123 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:09.804653 22096 raft_consensus.cc:3055] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:09.807847 22096 raft_consensus.cc:740] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:09.808632 22376 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.808667 22096 consensus_queue.cc:260] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:09.810644 22636 log.cc:927] Time spent T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:08:09.685667 22444 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.795209 22575 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.813161 22444 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.813777 22575 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:09.814178 15549 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 13:08:09.690829 22525 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.798179 14890 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:08:09.815325 22536 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.817523 14969 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 24: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:09.802537 14892 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:09.819890 22478 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:09.821370 22478 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.821828 22478 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:09.823395 22602 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.341s	user 0.004s	sys 0.012s
I20260709 13:08:09.718567 22100 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.801786 22425 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:09.824735 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44388 (request call id 1719) took 1602 ms. Trace:
I20260709 13:08:09.804698 15548 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260709 13:08:09.825417 15548 pending_rounds.cc:85] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 15
I20260709 13:08:09.825920 15548 pending_rounds.cc:107] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260709 13:08:09.826399 15548 raft_consensus.cc:2889] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.825074 15040 rpcz_store.cc:276] 0709 13:08:08.221948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.222067 (+   119us) service_pool.cc:224] Handling call
0709 13:08:08.222345 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.222687 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:08.222714 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.223173 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.327520 (+104347us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:08.327688 (+   168us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:08.327750 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:09.822885 (+1495135us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:09.824455 (+  1570us) raft_consensus.cc:1685] finished
0709 13:08:09.824483 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:09.824679 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1273,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"spinlock_wait_cycles":31517056,"thread_start_us":103456,"threads_started":1,"wal-append.queue_time_us":212179}
I20260709 13:08:09.828011 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.828634 22497 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.828787 14890 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
I20260709 13:08:09.829990 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:09.831877 22603 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 1.342s	user 0.015s	sys 0.026s
I20260709 13:08:09.831245 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.797835 14886 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:09.832823 14890 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:08:09.758301 22545 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:09.836138 14890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.810606 22096 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:09.841248 15545 raft_consensus.cc:2468] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:09.793618 22538 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.865051 22538 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:09.848615 14890 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 25.
I20260709 13:08:09.868727 14890 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
I20260709 13:08:09.869227 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:09.718853 22543 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.867741 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.870622 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:09.835500 22100 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:09.878989 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:09.879549 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 460091us
W20260709 13:08:09.886569 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 353784us
I20260709 13:08:09.877089 22444 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:09.835431 22458 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.890914 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.880537 22533 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.909085 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 1745) took 1023 ms. Trace:
I20260709 13:08:09.868184 22545 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.944060 15547 rpcz_store.cc:276] 0709 13:08:08.885744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.893781 (+  8037us) service_pool.cc:224] Handling call
0709 13:08:09.908922 (+1015141us) spinlock_profiling.cc:243] Waited 33.8 ms on lock 0x7b5400aae454. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:09.909028 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77718272}
I20260709 13:08:09.909461 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.831813 22539 consensus_queue.cc:237] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:09.921111 22601 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.457s	user 0.007s	sys 0.008s
I20260709 13:08:09.923840 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:09.876880 22354 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 13:08:09.929382 22543 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:09.882278 22519 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:08:09.931205 14894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38796 (request call id 4429) took 1527 ms (client timeout 1678 ms). Trace:
W20260709 13:08:09.951181 14894 rpcz_store.cc:269] 0709 13:08:08.403910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.404025 (+   115us) service_pool.cc:224] Handling call
0709 13:08:09.931011 (+1526986us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54002ebdd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:09.931136 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2322777984}
W20260709 13:08:09.893860 22585 consensus_meta.cc:287] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.003s
I20260709 13:08:09.893643 22444 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:09.940373 22286 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.892781 22515 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 13:08:09.880439 22100 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:09.947652 14891 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
W20260709 13:08:09.954239 14934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:09.962168 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 330605us
I20260709 13:08:09.965057 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:09.965893 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:09.966157 15040 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:09.965126 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:09.967370 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:09.967386 14933 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:09.969947 15544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.000s	sys 0.042s
I20260709 13:08:09.973064 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:09.946573 22455 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:09.973826 15044 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:09.982930 15040 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 13:08:09.983337 15040 pending_rounds.cc:85] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 12
I20260709 13:08:09.983616 15040 pending_rounds.cc:107] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 13:08:09.983850 15040 raft_consensus.cc:2889] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:09.983211 15039 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:09.952673 22519 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:09.993707 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:09.987918 15010 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:09.953320 22478 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:09.992456 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:09.953878 22444 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:09.987039 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:09.995675 14965 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:09.988626 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:09.945155 22533 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:09.962600 22622 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:10.010847 15010 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:10.013581 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:09.971824 22543 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:09.972651 22354 consensus_queue.cc:1243] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer e4938453819c469599f515b22d92fe27 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:10.042372 15040 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:10.042658 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:09.972429 22524 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.057024 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.057799 15043 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 25.
I20260709 13:08:10.055603 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:10.058861 15039 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:10.008853 22515 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:09.960851 22585 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.063136 15043 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:10.063946 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:10.008445 22436 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:10.008054 22519 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:10.010685 22368 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:10.010344 22510 raft_consensus.cc:2804] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:10.010766 22592 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:10.060489 22575 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:10.089962 14961 raft_consensus.cc:1240] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 13:08:10.076287 15550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1731) took 1618 ms. Trace:
I20260709 13:08:10.080255 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:10.011535 22374 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.094820 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.104308 15043 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:08:10.102650 15547 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:10.065842 22515 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:10.091001 15550 rpcz_store.cc:276] 0709 13:08:08.458163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:08.458280 (+   117us) service_pool.cc:224] Handling call
0709 13:08:08.470662 (+ 12382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:08.509106 (+ 38444us) raft_consensus.cc:1534] Early marking committed up to index 18
0709 13:08:08.681520 (+172414us) log.cc:844] Serialized 14 byte log entry
0709 13:08:08.963767 (+282247us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:08.976255 (+ 12488us) log.cc:844] Serialized 26 byte log entry
0709 13:08:08.976403 (+   148us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:08:08.976437 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.064731 (+1088294us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54004de9d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:10.064793 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.064853 (+    60us) raft_consensus.cc:1685] finished
0709 13:08:10.076049 (+ 11196us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.076219 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165364,"prepare.queue_time_us":156420,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":7649,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":21135,"spinlock_wait_cycles":70593408,"thread_start_us":281834,"threads_started":1,"wal-append.queue_time_us":376039}
I20260709 13:08:10.056371 22543 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.073813 22578 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.035s
I20260709 13:08:10.083858 22436 raft_consensus.cc:697] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:10.065001 22511 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 13:08:10.148416 15044 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 13:08:10.090600 22592 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:10.151719 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:10.158566 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.022s	sys 0.031s
I20260709 13:08:10.108839 22448 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:08:10.126171 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:10.109865 21987 consensus_meta.cc:287] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.555s	user 0.006s	sys 0.004s
I20260709 13:08:10.206317 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:10.206774 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 55149.9us
I20260709 13:08:10.112277 22123 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.109071 22374 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.137630 22510 raft_consensus.cc:697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:10.209259 22592 raft_consensus.cc:3060] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:10.216483 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.111989 22376 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.173702 22315 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:10.185657 22442 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 13:08:10.241163 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 437343us
I20260709 13:08:10.199311 22641 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.198669 15039 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
I20260709 13:08:10.228907 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 27 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.244637 15037 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 26.
W20260709 13:08:10.339509 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.273133 14859 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:10.349249 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.352923 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 109293us
I20260709 13:08:10.212270 22575 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:10.237942 15040 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
W20260709 13:08:10.210206 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.022s	sys 0.035s
I20260709 13:08:10.219964 22458 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.211548 21987 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.272567 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:10.243166 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.220046 22657 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260709 13:08:10.223815 22123 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.212690 22582 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:10.314787 22536 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:10.325690 22511 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:10.271238 22459 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:10.332684 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:10.321462 22533 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:10.366307 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 827287us
I20260709 13:08:10.320020 22585 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.272605 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:10.444032 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 198564us
I20260709 13:08:10.376765 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:10.446575 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69906.5us
I20260709 13:08:10.392244 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
W20260709 13:08:10.320081 22646 log.cc:927] Time spent T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 13:08:10.314957 22436 consensus_queue.cc:237] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.427151 22354 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.220115 22515 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.322854 22543 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.318527 22374 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.439209 15545 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:10.315084 22651 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:10.478410 22653 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 13:08:10.479645 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 1980) took 1082 ms. Trace:
W20260709 13:08:10.368139 22654 log.cc:927] Time spent T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:10.448877 22539 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:10.275185 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:10.480057 15543 rpcz_store.cc:276] 0709 13:08:09.396892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.593433 (+196541us) service_pool.cc:224] Handling call
0709 13:08:09.593796 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.594173 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.594211 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.594725 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:08:09.995838 (+401113us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.995890 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.995979 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.479376 (+483397us) raft_consensus.cc:1685] finished
0709 13:08:10.479398 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.479578 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5425,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":21778,"thread_start_us":400664,"threads_started":1,"wal-append.queue_time_us":632342}
I20260709 13:08:10.372223 22500 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:10.481906 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:10.482142 22500 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:10.483183 22500 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.484122 14968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3953) took 1027 ms. Trace:
I20260709 13:08:10.484513 14968 rpcz_store.cc:276] 0709 13:08:09.456560 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.456690 (+   130us) service_pool.cc:224] Handling call
0709 13:08:09.457077 (+   387us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:09.496312 (+ 39235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.496358 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:09.512114 (+ 15756us) log.cc:844] Serialized 52 byte log entry
0709 13:08:09.955041 (+442927us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:09.955096 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:09.955200 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.483926 (+528726us) raft_consensus.cc:1685] finished
0709 13:08:10.483944 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.484068 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11064,"raft.queue_time_us":26977,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6624,"thread_start_us":390310,"threads_started":1,"wal-append.queue_time_us":669130}
I20260709 13:08:10.371613 22581 raft_consensus.cc:3055] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:10.467238 22663 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.317350 22100 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:10.314817 22578 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:10.365545 22575 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:10.322026 22510 consensus_queue.cc:237] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.435750 22582 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.244155 22315 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.310405 22639 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.170s
W20260709 13:08:10.448493 22635 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:10.370267 22538 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.276409 22641 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.477891 22651 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.440953 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:10.483103 14894 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:10.238596 22545 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.451450 22655 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:10.525414 22655 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.526207 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.440740 22536 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.502426 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:10.527585 22655 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.242573 22376 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.527794 14889 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 25.
I20260709 13:08:10.528401 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.528978 14961 raft_consensus.cc:2468] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:10.529479 22376 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.443197 22511 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.474710 22585 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:10.488140 22581 raft_consensus.cc:740] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:10.531037 22585 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:10.500224 22544 consensus_meta.cc:287] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.665s	user 0.007s	sys 0.003s
I20260709 13:08:10.531391 22651 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:10.504467 22582 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:10.531759 22544 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.532362 22123 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:10.524657 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.534749 22585 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.537344 22641 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.538400 22649 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:10.538597 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 97721us
I20260709 13:08:10.479672 22676 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.539613 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:10.539716 22676 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.540916 14894 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:08:10.540985 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:10.541252 22511 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.541735 22533 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:10.541879 15514 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.542039 22649 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:08:10.542681 22649 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:10.531387 22581 consensus_queue.cc:260] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.543663 22581 raft_consensus.cc:3060] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:10.492659 22374 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:10.498586 22578 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.543119 22649 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:10.554492 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:10.554677 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:10.555213 14961 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:10.546005 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 302906us
I20260709 13:08:10.528918 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:10.542047 22676 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.467039 22354 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:10.549067 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 180829us
I20260709 13:08:10.565634 14889 raft_consensus.cc:2393] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 20: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:10.565585 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:10.526232 22096 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.662s	user 0.000s	sys 0.009s
I20260709 13:08:10.569392 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:10.566622 22533 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:10.565917 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:10.589955 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.592595 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:10.597338 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.592475 22621 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.092s
I20260709 13:08:10.688438 22458 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:10.688763 22354 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.688962 22458 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:10.689383 22458 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:10.691452 22650 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.358s	user 0.001s	sys 0.001s
W20260709 13:08:10.692018 22673 log.cc:927] Time spent T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:08:10.692986 14887 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4433) took 1155 ms. Trace:
W20260709 13:08:10.693997 22660 log.cc:927] Time spent T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:08:10.693468 14887 rpcz_store.cc:276] 0709 13:08:09.537455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.537748 (+   293us) service_pool.cc:224] Handling call
0709 13:08:09.538074 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.543298 (+  5224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.543339 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.558557 (+ 15218us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.010451 (+451894us) raft_consensus.cc:1645] Marking committed up to 18
0709 13:08:10.010492 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.010587 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.692730 (+682143us) raft_consensus.cc:1685] finished
0709 13:08:10.692755 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.692916 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4822,"raft.queue_time_us":5426,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":10188,"thread_start_us":416450,"threads_started":1,"wal-append.queue_time_us":651956}
I20260709 13:08:10.696171 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:10.696575 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:10.696735 22578 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.697496 14887 raft_consensus.cc:2410] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:08:10.691497 22639 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:10.699245 22639 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.701390 14891 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:10.701577 22639 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.704460 22538 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:10.705361 22659 log.cc:927] Time spent T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.219s	user 0.003s	sys 0.000s
I20260709 13:08:10.706095 22315 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:10.708930 22664 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
W20260709 13:08:10.711216 22622 consensus_meta.cc:287] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.666s	user 0.008s	sys 0.000s
I20260709 13:08:10.711652 22622 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:10.712369 22111 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:10.567185 22575 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.714118 22575 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:10.715170 22533 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:10.715873 22533 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:10.716420 22533 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.563666 22374 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.718473 22533 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:10.713466 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 144151us
I20260709 13:08:10.719314 22374 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.720243 22425 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:10.720780 14965 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:10.721042 15514 leader_election.cc:400] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15.
I20260709 13:08:10.722007 22425 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:10.723366 22111 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:10.724351 22111 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:10.724669 22111 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:10.725492 22111 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.726558 22111 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:10.726783 22444 consensus_meta.cc:287] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.681s	user 0.002s	sys 0.005s
I20260709 13:08:10.729365 22655 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:10.729832 22655 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.593170 22648 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.159s
I20260709 13:08:10.593837 22676 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:10.733237 22676 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.733572 22676 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:10.734488 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.722100 22525 consensus_queue.cc:1059] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:08:10.740970 22525 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:08:10.742501 22525 raft_consensus.cc:3055] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:10.742924 22525 raft_consensus.cc:740] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:10.707132 21987 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:10.696768 14893 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:08:10.721829 15514 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:10.752063 15514 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:10.731662 22655 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:10.754077 14891 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:10.765525 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.766166 14970 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:10.767434 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.768168 14966 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:10.768958 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.771237 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:10.772960 14964 raft_consensus.cc:2393] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:10.774722 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:10.727195 22444 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.760006 14968 raft_consensus.cc:1240] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260709 13:08:10.723237 22519 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.001s
I20260709 13:08:10.791970 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:10.794448 15514 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.809342 14966 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:08:10.795722 15008 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:10.796034 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.795850 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.810222 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.756845 14961 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:10.804395 14886 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:10.805593 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.768559 22648 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:10.808372 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.812021 15037 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:10.769851 22354 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:10.810737 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.815685 15039 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 16.
I20260709 13:08:10.821606 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.822466 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.823237 14970 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:10.831341 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.834250 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.838341 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.834877 14968 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:10.850018 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:10.850669 14970 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:10.813349 22648 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.840811 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:10.789809 22533 consensus_queue.cc:1059] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 13:08:10.852567 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:10.860195 14970 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:10.828868 22315 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:10.811697 22682 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:10.857337 15043 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:10.873785 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:10.820894 22519 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.857097 22648 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:10.891189 14970 raft_consensus.cc:2468] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 18.
I20260709 13:08:10.868652 22538 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:10.872479 22682 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.869400 22315 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:10.905786 15042 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 13:08:10.901614 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.909680 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:10.913980 15036 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 24: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:10.922017 15042 raft_consensus.cc:1240] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:10.859720 22525 consensus_queue.cc:260] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.907887 22538 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.929032 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.929351 22538 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:10.932673 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.933518 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.895426 22674 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:10.938771 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.927970 15043 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 23 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 13:08:10.935752 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:10.938256 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:10.898154 22663 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:10.909219 22592 consensus_meta.cc:287] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.003s
I20260709 13:08:10.924742 15544 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 26: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:10.938783 22500 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:10.943286 22658 log.cc:927] Time spent T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.462s	user 0.000s	sys 0.002s
I20260709 13:08:10.971987 22592 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:10.973413 22683 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:08:10.939601 15042 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:08:10.974617 14888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1693) took 1274 ms. Trace:
I20260709 13:08:10.975193 22444 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.975692 14963 raft_consensus.cc:2410] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260709 13:08:10.942629 22286 raft_consensus.cc:2804] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:10.956786 22459 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:10.974546 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:10.976343 22286 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:10.976869 22286 raft_consensus.cc:3060] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:10.979199 15008 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:10.912380 22682 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:10.980463 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.981637 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:10.982317 22672 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 13:08:10.985378 22545 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:10.985878 22545 raft_consensus.cc:697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:10.986133 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:10.986683 22545 consensus_queue.cc:237] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.987074 22286 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:10.989086 22425 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:10.989513 22286 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.975117 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:10.991510 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:10.956525 15007 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.018s	sys 0.026s
W20260709 13:08:10.992676 15007 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.018s	sys 0.026s
I20260709 13:08:10.953949 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.993695 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.918884 22354 raft_consensus.cc:3055] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:10.919358 22315 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
W20260709 13:08:10.993003 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 545007us
I20260709 13:08:11.044543 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.047209 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.048208 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.086968 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.053182 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.975102 14888 rpcz_store.cc:276] 0709 13:08:09.700318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.700429 (+   111us) service_pool.cc:224] Handling call
0709 13:08:09.700733 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.701046 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.701087 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.705304 (+  4217us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.078398 (+373094us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:10.078451 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.078553 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:10.763666 (+685113us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:10.974325 (+210659us) raft_consensus.cc:1685] finished
0709 13:08:10.974344 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:10.974558 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":12341,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":13256576,"thread_start_us":372747,"threads_started":1,"wal-append.queue_time_us":730098}
I20260709 13:08:11.054257 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.087168 15542 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:11.091574 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.091615 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.093284 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:11.086781 15547 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
I20260709 13:08:10.929059 22525 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:11.097779 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.115926 15548 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:11.115943 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:11.098129 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 103949us
W20260709 13:08:10.964087 22684 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:08:11.100991 14889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:11.120078 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.120385 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.125699 15549 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:08:11.120427 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:10.943136 22674 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:10.991199 22519 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:10.963815 22442 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:11.060547 22689 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 13:08:10.983132 22458 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.020489 22592 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.054160 22354 raft_consensus.cc:740] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:11.143105 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.167253 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.137038 22674 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:11.132997 15550 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:11.126653 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:11.147655 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.127866 15042 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 25.
W20260709 13:08:11.149020 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 206690us
I20260709 13:08:10.956862 22621 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.181s
I20260709 13:08:11.114944 22511 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.116477 22575 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:11.153553 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:11.147727 22519 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.144325 22442 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:11.177110 14859 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:11.053015 22663 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.129403 22425 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:11.135306 22510 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
W20260709 13:08:11.168496 22581 consensus_meta.cc:287] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.624s	user 0.001s	sys 0.009s
I20260709 13:08:11.051656 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.182336 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.183465 14893 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:11.136437 22676 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.192549 14886 raft_consensus.cc:1240] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:11.195114 14859 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.198194 14891 raft_consensus.cc:1275] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260709 13:08:11.198573 14891 pending_rounds.cc:85] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Aborting all ops after (but not including) 14
I20260709 13:08:11.198817 14891 pending_rounds.cc:107] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 13:08:11.199044 14891 raft_consensus.cc:2889] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:11.177263 22626 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:11.201388 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.212284 22676 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.201022 22354 consensus_queue.cc:260] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.218911 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.190315 22698 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:11.221900 22698 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.199931 22368 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:11.228174 14893 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 26: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:278: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
I20260709 13:08:11.240264 22621 raft_consensus.cc:2804] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
/apache/dev/git/kudu/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20260709 13:08:11.240826 22621 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.241291 22621 raft_consensus.cc:3060] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.241432 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
I20260709 13:08:11.241106 22682 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.226089 22626 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.243358 22682 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 27 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:11.246230 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 117744us
I20260709 13:08:11.249321 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.249930 15043 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:11.184348 22511 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.255931 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 85563us
I20260709 13:08:11.187950 22519 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.224186 22698 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.280629 22663 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.282749 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.283592 22444 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:08:11.284220 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.284320 22444 consensus_queue.cc:1243] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 23.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 13:08:11.285197 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:11.286123 22691 log.cc:927] Time spent T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:08:11.266279 15043 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 26.
W20260709 13:08:11.266911 22649 consensus_meta.cc:287] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.674s	user 0.000s	sys 0.010s
I20260709 13:08:11.287442 22649 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.288122 22698 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:11.289790 22649 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.289702 22648 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.291831 22649 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:11.291883 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.292634 15547 raft_consensus.cc:2468] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 15.
I20260709 13:08:11.292444 22649 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.293548 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.294059 15547 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.259016 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 27 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.258551 22699 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:11.268256 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 27 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.271962 22621 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:11.295657 15039 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:11.295817 22699 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.266196 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 139640us
I20260709 13:08:11.267604 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.283618 15541 raft_consensus.cc:2410] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 17 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
W20260709 13:08:11.300413 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.300907 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.267812 22458 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.301185 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.298498 15549 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:11.248333 22681 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:11.248513 22694 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:11.308139 15550 raft_consensus.cc:2393] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 19: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:11.248064 22368 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:11.310599 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.315267 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.311863 15546 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:11.253645 22286 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:11.248234 22497 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:11.321539 15039 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 27.
I20260709 13:08:11.322379 15035 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 26. Current term is 27. Ops: [24.20-26.21]
I20260709 13:08:11.322631 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.323261 15543 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 24: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:11.324092 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.325739 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:11.326721 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.307339 22444 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.305064 22663 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:11.332384 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:11.334698 14888 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
W20260709 13:08:11.323333 22582 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.001s
I20260709 13:08:11.338574 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.340368 14888 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27"
I20260709 13:08:11.328131 22458 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:11.331707 22698 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:11.356869 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.358036 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.329255 22656 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 13:08:11.326272 22497 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.317006 22694 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.323729 22286 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:11.388123 22649 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:11.384274 22703 log.cc:927] Time spent T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:08:11.379583 22707 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:11.350118 22648 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.395915 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:11.393524 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 61201.8us
I20260709 13:08:11.342892 22444 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.382398 22697 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 13:08:11.356338 22510 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:11.401270 14887 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "e4938453819c469599f515b22d92fe27" is_pre_election: true
I20260709 13:08:11.401387 22694 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:11.402175 22368 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.402734 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.342753 22663 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.343626 22582 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.406472 22527 consensus_queue.cc:1048] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:08:11.415513 14967 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 25: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:11.416352 22582 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.417126 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 27 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.417673 22663 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.417985 15542 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:08:11.418241 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:11.404500 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 99567us
I20260709 13:08:11.412601 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:11.356462 22458 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.419781 15541 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260709 13:08:11.422034 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:11.422713 15541 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
I20260709 13:08:11.422791 22458 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.423621 22510 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:11.424328 22510 raft_consensus.cc:2764] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
W20260709 13:08:11.425845 22111 consensus_meta.cc:287] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: Time spent flushing consensus metadata: real 0.634s	user 0.008s	sys 0.002s
I20260709 13:08:11.427454 22286 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.427747 22519 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.434347 14887 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 26. Current term is 27. Ops: [26.21-26.21]
W20260709 13:08:11.440653 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 111272us
W20260709 13:08:11.441864 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 62794.4us
I20260709 13:08:11.442608 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.452021 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.445210 15513 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.454267 15036 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:11.454944 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:11.455791 22704 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:11.455490 22478 consensus_queue.cc:1059] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:11.463306 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.462006 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:11.456295 22704 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:11.478601 15547 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:11.452888 22663 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.454370 22694 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:11.484911 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.457657 22425 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:11.472121 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:11.483601 22704 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.471553 22701 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:11.456571 22442 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.462936 22519 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 24.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.031s
I20260709 13:08:11.509231 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.488294 22663 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.531258 22442 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:11.537756 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 636161us
W20260709 13:08:11.540194 14962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34568 (request call id 3966) took 1554 ms (client timeout 2061 ms). Trace:
W20260709 13:08:11.540766 14962 rpcz_store.cc:269] 0709 13:08:09.986234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.986352 (+   118us) service_pool.cc:224] Handling call
0709 13:08:11.539988 (+1553636us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b54003e6f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:11.540121 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1945119488}
I20260709 13:08:11.516345 22701 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:11.561721 22701 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.569104 22662 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 1.091s	user 0.010s	sys 0.000s
I20260709 13:08:11.570297 14892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1703) took 1776 ms. Trace:
I20260709 13:08:11.571508 22712 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:11.570658 14892 rpcz_store.cc:276] 0709 13:08:09.793987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.821150 (+ 27163us) service_pool.cc:224] Handling call
0709 13:08:09.821507 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.821883 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.821921 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.822353 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.185317 (+362964us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:10.185358 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.185425 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.568599 (+1383174us) spinlock_profiling.cc:243] Waited 8.93 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:11.570019 (+  1420us) raft_consensus.cc:1685] finished
0709 13:08:11.570039 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.570231 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7336,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":20545920,"thread_start_us":362615,"threads_started":1,"wal-append.queue_time_us":571246}
I20260709 13:08:11.571954 22712 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:11.572808 22712 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.21, Last appended by leader: 21, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.573977 22712 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:11.585834 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:11.588428 22592 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:11.587975 22674 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.588951 22592 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.589363 22592 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:11.590229 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:11.590817 14970 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:08:11.591696 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:11.592370 14961 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 21: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:11.590878 22674 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.594837 22641 raft_consensus.cc:3055] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:11.595166 22567 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:11.595276 22641 raft_consensus.cc:740] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:11.595757 22567 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.596647 22645 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.597149 22645 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:11.597723 22567 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.598234 22567 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.599105 22645 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.588368 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:11.598630 22567 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.603309 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61037.1us
I20260709 13:08:11.620319 15546 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:11.620893 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:11.513581 22368 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:11.622001 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:11.603942 22544 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.605335 22678 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.606683 22436 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.605917 22657 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:11.609920 22497 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.587250 14933 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:11.611109 22592 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.618805 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 146789us
I20260709 13:08:11.641238 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.627169 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:11.600092 22455 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:11.636808 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49618.4us
I20260709 13:08:11.643960 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.643622 22657 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.648743 22657 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.627842 22096 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:11.651680 22096 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.652051 22096 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:11.653666 22455 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.655719 22455 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.656239 22622 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:11.656629 22622 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:11.657047 22622 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.618335 22704 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:11.658206 22315 consensus_meta.cc:287] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.533s	user 0.006s	sys 0.002s
I20260709 13:08:11.658604 22315 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.635033 22645 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:11.659577 22704 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:11.625418 22368 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:11.661156 22368 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.646245 22497 raft_consensus.cc:2804] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:11.664011 22497 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:11.664409 22497 raft_consensus.cc:3060] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.667665 22458 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:11.668072 22458 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.668428 22458 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:11.677239 15040 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
I20260709 13:08:11.681721 14969 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 23: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:11.682175 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:11.683806 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.644475 22585 raft_consensus.cc:2804] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:11.686610 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.691150 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:11.694386 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.695149 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:11.696636 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.696903 14962 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:11.697389 15035 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 21: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:11.680529 22704 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.698863 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.694983 15036 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:11.703153 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:11.703755 15543 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:11.703042 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.635730 22678 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.706768 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:11.708442 14970 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 15.
I20260709 13:08:11.705014 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.707753 14964 raft_consensus.cc:1240] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:11.709221 15038 raft_consensus.cc:3060] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:11.688071 22639 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:11.711598 14964 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:11.699162 22709 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:11.687475 22455 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.011s
I20260709 13:08:11.690163 22585 raft_consensus.cc:697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:11.710983 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.637948 22436 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.699306 22656 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:11.708369 22702 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:11.714882 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:11.702059 22719 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:11.725942 22567 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.727957 22436 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.728982 22681 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:11.729698 22681 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:11.729471 22585 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:11.734400 22626 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.747740 22575 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:11.747848 22096 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.748569 22575 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.754267 22442 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.754796 22442 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.756350 22622 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.757613 22511 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.758515 22622 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.760015 22592 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.708521 22704 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.761829 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.762645 22704 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:11.764400 22538 consensus_meta.cc:287] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.835s	user 0.014s	sys 0.000s
I20260709 13:08:11.764588 22096 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.764813 22538 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:11.766837 22538 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.757652 22442 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.768796 15041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45060 (request call id 3337) took 1563 ms. Trace:
I20260709 13:08:11.769207 15041 rpcz_store.cc:276] 0709 13:08:10.205952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.206090 (+   138us) service_pool.cc:224] Handling call
0709 13:08:11.768607 (+1562517us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54001b85d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:11.768739 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1283624832}
I20260709 13:08:11.763062 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.772053 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.772668 15549 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
W20260709 13:08:11.774693 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 129979us
I20260709 13:08:11.714579 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:11.777801 15514 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.778838 14964 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 22: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:11.781778 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:11.782488 22592 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:11.782889 22592 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.783243 22592 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:11.797243 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:11.798034 14970 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 18: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:11.799239 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:11.802570 22442 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:08:11.803215 14895 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38796 (request call id 4438) took 2223 ms. Trace:
I20260709 13:08:11.804818 22497 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.807305 22497 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.803790 14895 rpcz_store.cc:276] 0709 13:08:09.556109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:09.556287 (+   178us) service_pool.cc:224] Handling call
0709 13:08:09.556638 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:09.697538 (+140900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:09.697583 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:09.719267 (+ 21684us) log.cc:844] Serialized 26 byte log entry
0709 13:08:10.238635 (+519368us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:10.238680 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:10.708357 (+469677us) spinlock_profiling.cc:243] Waited 9.8 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f553491186e 00007f5534910bb6 00007f55349107d8 00007f553491a221 00007f553491a1d9 00007f553491a169
0709 13:08:11.778695 (+1070338us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54003f9154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:11.778746 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.778785 (+    39us) raft_consensus.cc:1685] finished
0709 13:08:11.778802 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:11.778918 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345877504,"thread_start_us":435620,"threads_started":1,"wal-append.queue_time_us":709613,"wal-append.run_cpu_time_us":3666,"wal-append.run_wall_time_us":1232411}
I20260709 13:08:11.811661 22442 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:11.812099 22442 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:11.812446 22442 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.814165 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:11.815073 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.727182 22678 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:11.821744 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:11.833797 22694 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:11.836583 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:11.838191 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:11.814230 22354 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:11.861032 15038 raft_consensus.cc:2468] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
W20260709 13:08:11.865658 14894 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38806 (request call id 3613) took 1468 ms (client timeout 1659 ms). Trace:
W20260709 13:08:11.866110 14894 rpcz_store.cc:269] 0709 13:08:10.396922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.482888 (+ 85966us) service_pool.cc:224] Handling call
0709 13:08:11.865492 (+1382604us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b540024e5d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:11.865604 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41471360}
W20260709 13:08:11.867798 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:11.868536 15544 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52838 (request call id 1993) took 1801 ms (client timeout 1629 ms). Trace:
I20260709 13:08:11.873111 22592 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:11.874505 14967 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:11.880864 22592 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.883996 22286 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.884508 22286 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:11.886521 22286 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:11.869064 15544 rpcz_store.cc:269] 0709 13:08:10.063627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.063743 (+   116us) service_pool.cc:224] Handling call
0709 13:08:11.864748 (+1801005us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54000ec754. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:11.864869 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1927843200}
I20260709 13:08:11.891573 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.893265 15544 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:08:11.858270 22315 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.895269 14886 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1713) took 1202 ms. Trace:
W20260709 13:08:11.899446 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 192973us
I20260709 13:08:11.900017 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.897771 14886 rpcz_store.cc:276] 0709 13:08:10.692671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.826894 (+134223us) service_pool.cc:224] Handling call
0709 13:08:10.827210 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.196824 (+369614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.895036 (+698212us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54000adcd4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:11.895206 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":839643904}
I20260709 13:08:11.900394 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:11.908090 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.908843 15036 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:08:11.909566 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:11.914657 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:11.922408 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:11.923425 15039 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
W20260709 13:08:11.931850 14792 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 323) took 27900 ms (client timeout 15000 ms). Trace:
I20260709 13:08:11.911900 22376 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:11.920190 22524 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 13:08:11.941553 22536 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.987876 15543 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 25.
I20260709 13:08:11.989234 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:11.957309 22376 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:11.989478 14936 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:11.993052 22585 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:11.992609 14791 catalog_manager.cc:5697] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.993599 22585 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 25 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:11.994408 14791 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:11.996018 22376 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:11.997946 22575 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:11.998363 22621 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:11.999899 22698 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:11.985033 22458 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.000450 22698 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.002010 22458 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.002656 14890 raft_consensus.cc:1240] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:12.003885 14890 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3605) took 1609 ms. Trace:
I20260709 13:08:12.004220 14890 rpcz_store.cc:276] 0709 13:08:10.394692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.718288 (+323596us) service_pool.cc:224] Handling call
0709 13:08:11.864609 (+1146321us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b5800010598. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c51a22 00007f553ab6ac09 00007f5539cc4ee0 00007f5539d8e0ab 00007f5539d8e131 00007f5539d4ffc0 00007f5539d3a929 00007f5539d3a3d2 00007f55332b1bd4
0709 13:08:11.864796 (+   187us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.003103 (+138307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.003667 (+   564us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b540024ead4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:12.003828 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402417408}
W20260709 13:08:11.987993 22705 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.600s	user 0.005s	sys 0.000s
I20260709 13:08:11.994500 22585 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.007028 22376 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.009514 14791 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 20. New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.010514 22376 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:11.990885 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:11.934121 14792 rpcz_store.cc:269] 0709 13:07:44.023858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:07:44.024213 (+   355us) service_pool.cc:224] Handling call
0709 13:08:11.924368 (+27900155us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:05.192937 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:05.304433 (+111496us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:05.304506 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:08:05.304540 (+    34us) tablet.cc:662] Decoding operations
0709 13:08:05.305160 (+   620us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:05.305264 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:05.305295 (+    31us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:08:05.305697 (+   402us) tablet.cc:701] Row locks acquired
0709 13:08:05.305743 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:08:05.305949 (+   206us) write_op.cc:270] Start()
0709 13:08:05.306116 (+   167us) write_op.cc:276] Timestamp: P: 1783602485305876 usec, L: 0
0709 13:08:05.306150 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:08:05.306913 (+   763us) log.cc:844] Serialized 1284 byte log entry
0709 13:08:05.729892 (+422979us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531bafc85 00007f5531bb06a2 00007f55349221db 00007f553491daaf 00007f5531c6c0ac 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b
0709 13:08:06.497210 (+767318us) op_driver.cc:464] REPLICATION: finished
0709 13:08:07.189565 (+692355us) write_op.cc:301] APPLY: starting
0709 13:08:07.189683 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:07.192081 (+  2398us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:07.192125 (+    44us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:07.193597 (+  1472us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:07.193863 (+   266us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 13:08:07.193909 (+    46us) write_op.cc:312] APPLY: finished
0709 13:08:07.194253 (+   344us) log.cc:844] Serialized 33 byte log entry
0709 13:08:07.194437 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.194525 (+    88us) write_op.cc:454] Released schema lock
0709 13:08:07.194593 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:07.195025 (+   432us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:07.195060 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2323,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":685807,"apply.run_cpu_time_us":5457,"apply.run_wall_time_us":5458,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12487,"num_ops":2,"prepare.queue_time_us":352232,"prepare.run_cpu_time_us":22063,"prepare.run_wall_time_us":775108,"raft.queue_time_us":405994,"raft.run_cpu_time_us":48039,"raft.run_wall_time_us":565166,"replication_time_us":1124055,"spinlock_wait_cycles":35831552,"thread_start_us":1447035,"threads_started":4,"wal-append.queue_time_us":551249,"wal-append.run_cpu_time_us":122190,"wal-append.run_wall_time_us":2405247}]]}
I20260709 13:08:12.011641 14791 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 19, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 19 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.015825 15040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44388 (request call id 1751) took 1062 ms. Trace:
I20260709 13:08:12.016237 15040 rpcz_store.cc:276] 0709 13:08:10.953843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.981395 (+ 27552us) service_pool.cc:224] Handling call
0709 13:08:12.015636 (+1034241us) spinlock_profiling.cc:243] Waited 695 ms on lock 0x7b540003f2d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.015742 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1598373632}
I20260709 13:08:12.015713 14791 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 19, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 19 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.018183 14791 catalog_manager.cc:5697] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 16 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.020164 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.020058 14791 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 18, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 18 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:08:12.022905 22536 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.023814 14791 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 15 to 17, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 17 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.026124 22511 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.025753 14791 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.026635 22511 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.033495 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:12.033973 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 143913us
I20260709 13:08:12.037736 15036 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:12.040179 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.040258 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.041177 15036 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:12.042505 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.043533 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.044564 14861 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:12.044726 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:12.027661 22724 log.cc:927] Time spent T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 13:08:12.046540 15035 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:12.042076 14791 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:12.048653 15042 raft_consensus.cc:2393] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
I20260709 13:08:12.048988 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.049093 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.051649 15039 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:12.047816 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:12.054136 14964 raft_consensus.cc:2393] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:12.053762 14791 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.027935 22699 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:12.056437 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.060139 15036 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:12.060732 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.061273 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.057875 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.065421 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.066177 15036 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:12.067481 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.068264 15040 raft_consensus.cc:2393] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 24: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:12.064908 14963 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 23.
I20260709 13:08:12.069857 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.070188 14968 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:12.070690 14859 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.048851 22500 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.079238 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:12.079869 14963 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.074374 22286 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:12.080854 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.082265 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.083376 14970 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:08:12.056006 22727 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.031890 22536 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.086480 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.087929 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.069082 22368 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.094525 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1884) took 1046 ms. Trace:
I20260709 13:08:12.088510 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.045529 22442 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.098021 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.098145 21987 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.099114 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.099541 22442 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:12.100204 15544 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
I20260709 13:08:12.088774 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.100606 15037 raft_consensus.cc:1275] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:12.101367 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.101790 15037 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:12.102393 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.102727 15042 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 15.
I20260709 13:08:12.094939 15542 rpcz_store.cc:276] 0709 13:08:11.048432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.091332 (+ 42900us) service_pool.cc:224] Handling call
0709 13:08:12.089418 (+998086us) spinlock_profiling.cc:243] Waited 325 ms on lock 0x7b54005d0f54. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.094463 (+  5045us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":748202368}
I20260709 13:08:12.092072 14859 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.091089 15548 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:12.103655 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.104444 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.104568 15010 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.093086 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.105099 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.095983 14791 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 13, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 13 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:12.105434 14968 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:12.105929 15543 raft_consensus.cc:2393] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:12.106549 15039 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 25.
I20260709 13:08:12.108196 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.109935 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.110525 15543 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.110219 14791 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.112768 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:12.113044 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 224553us
I20260709 13:08:12.113338 15542 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:12.114681 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.115499 14791 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 18 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:12.116781 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.117524 15044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 3336) took 1925 ms. Trace:
I20260709 13:08:12.121948 14791 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 15, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.118465 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:12.118502 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.103567 22538 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:12.123901 15040 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:12.126304 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.130055 15541 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:12.089480 22578 consensus_queue.cc:1059] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.033s
I20260709 13:08:12.135501 14859 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.120968 15044 rpcz_store.cc:276] 0709 13:08:10.192113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.192382 (+   269us) service_pool.cc:224] Handling call
0709 13:08:10.192780 (+   398us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:08:10.463786 (+271006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.463818 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:08:11.512979 (+1049161us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c0003d488. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:08:11.527080 (+ 14101us) log.cc:844] Serialized 52 byte log entry
0709 13:08:11.692566 (+165486us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:11.692601 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.117235 (+424634us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b540014c3d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:12.117293 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.117334 (+    41us) raft_consensus.cc:1685] finished
0709 13:08:12.117345 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.117471 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22608,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"spinlock_wait_cycles":594487808,"thread_start_us":108844,"threads_started":1,"wal-append.queue_time_us":221514}
I20260709 13:08:12.119354 22621 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.119455 22525 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.119617 22478 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:12.126274 22286 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:12.151096 15542 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:12.112401 22676 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260709 13:08:12.136032 22575 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:12.169315 14859 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:12.157321 15516 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.147609 14791 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:12.160070 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44425.4us
I20260709 13:08:12.142243 22494 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:12.171574 15541 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 17.
I20260709 13:08:12.142697 22544 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:12.175227 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.166558 15543 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 16.
I20260709 13:08:12.106272 22368 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.141078 22621 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.188158 14859 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:12.196458 15040 raft_consensus.cc:1240] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:12.199572 14791 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 21 to 23, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 23 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.159694 22458 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.167286 22719 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:12.160821 22536 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.170974 22639 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:12.223541 14791 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.226755 22719 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:12.151227 22525 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.181133 22575 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:12.177340 22656 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:12.143218 22681 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.197981 22702 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:12.231019 14791 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.222178 22538 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:12.179459 22581 consensus_queue.cc:1059] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 13:08:12.168355 22478 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.249909 14791 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:12.198860 22544 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.234118 22719 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.246829 22515 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:12.245316 22538 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.229171 22458 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:12.269397 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 154781us
I20260709 13:08:12.270128 14965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 3968) took 1542 ms. Trace:
W20260709 13:08:12.276121 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 103858us
I20260709 13:08:12.271338 14965 rpcz_store.cc:276] 0709 13:08:10.728174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.751817 (+ 23643us) service_pool.cc:224] Handling call
0709 13:08:10.808579 (+ 56762us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:10.823446 (+ 14867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:10.823491 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:10.824050 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 13:08:11.001712 (+177662us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:11.001765 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:11.001853 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:11.482913 (+481060us) raft_consensus.cc:1685] finished
0709 13:08:11.482944 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.261702 (+778758us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b54003084d0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.270044 (+  8342us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4545,"raft.queue_time_us":14560,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":21410,"spinlock_wait_cycles":82892544,"thread_start_us":125525,"threads_started":1,"wal-append.queue_time_us":339457}
I20260709 13:08:12.253319 14791 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:12.283777 22511 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.286623 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.290307 14963 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:12.271102 22538 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:12.312848 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.315631 15541 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:12.326090 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.302491 14791 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18, pending config changed. New cstate: current_term: 18 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } } pending_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:12.246068 22286 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:12.304142 22729 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.195s	user 0.001s	sys 0.001s
I20260709 13:08:12.320490 22621 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.339381 14791 catalog_manager.cc:5697] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 12 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 13 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:12.338181 15541 raft_consensus.cc:2410] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 13:08:12.295944 22581 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.304620 22676 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.344244 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.316316 22459 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.347697 15541 raft_consensus.cc:2368] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 24. Current term is 25.
I20260709 13:08:12.348834 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.349675 15541 raft_consensus.cc:2368] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23.
I20260709 13:08:12.350824 15541 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:12.353400 15541 raft_consensus.cc:1275] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:12.355010 15541 raft_consensus.cc:1275] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:12.358843 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.363580 15550 raft_consensus.cc:2393] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 22: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:12.303267 22511 consensus_queue.cc:1059] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
W20260709 13:08:12.365099 22734 log.cc:927] Time spent T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260709 13:08:12.358748 22578 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.383772 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.361011 22581 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.426807 22581 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:12.428161 22745 log.cc:927] Time spent T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:12.432060 22478 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.432683 22578 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:12.440912 22736 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 13:08:12.383159 21987 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.386097 22525 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.385070 22458 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.394888 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:12.471849 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.497803 15541 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:12.500010 15541 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:08:12.501469 15541 raft_consensus.cc:1240] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 24. Current term is 25. Ops: []
I20260709 13:08:12.562685 15541 raft_consensus.cc:1240] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:12.575886 15010 leader_election.cc:400] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 24. Current term is 25.
I20260709 13:08:12.576292 22639 raft_consensus.cc:3055] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:12.576805 22639 raft_consensus.cc:740] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:12.577741 22639 consensus_queue.cc:260] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.578805 22639 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:12.358759 22459 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.583936 22663 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.585428 22459 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.576308 15010 leader_election.cc:403] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.586643 15010 leader_election.cc:400] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23.
I20260709 13:08:12.586921 15010 leader_election.cc:403] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 13:08:12.587576 21987 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 24. Current term is 25.
I20260709 13:08:12.588217 21987 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 22. Current term is 23.
I20260709 13:08:12.588308 22674 consensus_queue.cc:1048] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:12.588982 22743 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:08:12.589232 15545 raft_consensus.cc:2410] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 19 because replica has last-logged OpId of term: 18 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
I20260709 13:08:12.589515 22739 raft_consensus.cc:3055] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:08:12.589943 22739 raft_consensus.cc:740] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:12.632014 14891 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38806 (request call id 3609) took 2236 ms. Trace:
I20260709 13:08:12.632997 22674 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.633248 22578 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.633563 22674 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.386633 22681 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:12.536228 22728 log.cc:927] Time spent T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.356s	user 0.001s	sys 0.000s
I20260709 13:08:12.635491 22511 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:12.636453 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.590979 22692 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.632588 14891 rpcz_store.cc:276] 0709 13:08:10.395913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.808325 (+412412us) service_pool.cc:224] Handling call
0709 13:08:10.834474 (+ 26149us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:11.199487 (+365013us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.631750 (+1432263us) spinlock_profiling.cc:243] Waited 363 ms on lock 0x7b54000cc954. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:12.631954 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":835534720}
I20260709 13:08:12.658743 15550 raft_consensus.cc:1240] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 15. Current term is 16. Ops: []
I20260709 13:08:12.639216 22538 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.679754 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.680962 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.655313 22692 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.685423 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.686794 22459 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.672729 22698 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:12.705610 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 159192us
I20260709 13:08:12.707130 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:12.696979 15543 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1760) took 1008 ms. Trace:
I20260709 13:08:12.703974 14889 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 13:08:12.671366 22674 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.709662 15546 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1887) took 1541 ms. Trace:
I20260709 13:08:12.710651 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.711869 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.712673 14889 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51176 (request call id 1714) took 2019 ms. Trace:
I20260709 13:08:12.710177 15546 rpcz_store.cc:276] 0709 13:08:11.167835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.168000 (+   165us) service_pool.cc:224] Handling call
0709 13:08:12.709497 (+1541497us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b5400bc7854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.709608 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271174016}
I20260709 13:08:12.715071 15541 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:12.713037 14889 rpcz_store.cc:276] 0709 13:08:10.692981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.145482 (+452501us) service_pool.cc:224] Handling call
0709 13:08:11.149212 (+  3730us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.703640 (+1554428us) spinlock_profiling.cc:243] Waited 39.1 ms on lock 0x7b5400037b20. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534ceddc0 00007f5534d781c0 00007f5534d79231 00007f5534d75d8f 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c
0709 13:08:12.712401 (+  8761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.712621 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":89863040}
I20260709 13:08:12.695478 22581 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:12.726874 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.727736 15546 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:12.714710 22459 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.722102 22698 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.715332 22676 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:12.721359 22663 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:12.742172 14969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 1836) took 1156 ms. Trace:
I20260709 13:08:12.744293 14969 rpcz_store.cc:276] 0709 13:08:11.585738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.588142 (+  2404us) service_pool.cc:224] Handling call
0709 13:08:12.741889 (+1153747us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54000b77d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.742095 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141502336}
I20260709 13:08:12.746882 22515 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.747582 22515 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:12.748306 15545 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52858 (request call id 1883) took 1700 ms (client timeout 1900 ms). Trace:
W20260709 13:08:12.748744 15545 rpcz_store.cc:269] 0709 13:08:11.048161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.055994 (+  7833us) service_pool.cc:224] Handling call
0709 13:08:12.748123 (+1692129us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540071e654. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.748254 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3451754368}
I20260709 13:08:12.750176 22515 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:12.750284 22641 consensus_queue.cc:260] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.751391 22641 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:12.752995 15547 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 13:08:12.753374 15547 pending_rounds.cc:85] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 15
I20260709 13:08:12.753611 15547 pending_rounds.cc:107] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 13:08:12.753831 15547 raft_consensus.cc:2889] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:12.754948 15547 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1903) took 1295 ms. Trace:
I20260709 13:08:12.722963 22478 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.755266 15547 rpcz_store.cc:276] 0709 13:08:11.459989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.527223 (+ 67234us) service_pool.cc:224] Handling call
0709 13:08:12.752672 (+1225449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.754215 (+  1543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.754775 (+   560us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540071e650. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.754895 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817568128}
I20260709 13:08:12.756227 22478 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.758947 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:12.757776 15513 leader_election.cc:336] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:12.765930 15513 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:12.771642 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.776060 14962 raft_consensus.cc:1275] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:12.776898 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.777616 15039 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:08:12.777812 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:12.758343 22746 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:08:12.786412 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.787019 14969 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:12.781383 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:12.781935 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:12.725425 22458 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 13:08:12.787945 15546 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:12.791332 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:12.792727 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.768946 22538 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.784018 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.799716 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43902 (request call id 1842) took 1001 ms. Trace:
I20260709 13:08:12.801703 14967 rpcz_store.cc:276] 0709 13:08:11.798476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.798623 (+   147us) service_pool.cc:224] Handling call
0709 13:08:12.799517 (+1000894us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b54001969d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.799659 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84656000}
I20260709 13:08:12.802517 22578 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:12.803062 22578 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:12.803527 22578 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:12.806630 15544 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52844 (request call id 1766) took 1030 ms. Trace:
I20260709 13:08:12.806986 15544 rpcz_store.cc:276] 0709 13:08:11.775998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.899781 (+123783us) service_pool.cc:224] Handling call
0709 13:08:12.806471 (+906690us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54006a1154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.806577 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458797952}
I20260709 13:08:12.808121 22511 consensus_queue.cc:1059] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:12.809006 21987 raft_consensus.cc:3055] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:12.809350 21987 raft_consensus.cc:740] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:12.810096 21987 consensus_queue.cc:260] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.813026 22536 raft_consensus.cc:3055] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:12.813537 22536 raft_consensus.cc:740] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:08:12.813637 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 500874us
I20260709 13:08:12.816237 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:12.817018 22675 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:12.819710 22478 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.819865 22723 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.820477 22723 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.772280 22442 consensus_queue.cc:1059] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 13:08:12.822407 22723 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.822872 22723 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.823186 15040 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 23 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260709 13:08:12.823378 22525 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:12.824256 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:12.824891 15044 raft_consensus.cc:2468] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:12.826030 15548 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1896) took 1557 ms. Trace:
I20260709 13:08:12.826520 15548 rpcz_store.cc:276] 0709 13:08:11.268433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.296241 (+ 27808us) service_pool.cc:224] Handling call
0709 13:08:12.090796 (+794555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.104226 (+ 13430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.825791 (+721565us) spinlock_profiling.cc:243] Waited 794 ms on lock 0x7b54005d0f50. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d758ad 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:12.825959 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1826641152}
I20260709 13:08:12.827283 15044 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:08:12.828258 22749 log.cc:927] Time spent T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:08:12.817091 22725 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:12.814553 22536 consensus_queue.cc:260] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.836130 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:12.788858 22712 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:12.758822 22698 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.850061 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:12.863394 15008 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.823290 22723 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.847702 22459 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.870595 15549 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52844 (request call id 1768) took 1073 ms. Trace:
I20260709 13:08:12.851142 22567 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:12.919631 22459 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.920397 22567 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:12.921573 22567 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:12.922588 22459 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.862500 22675 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:12.919518 15035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45060 (request call id 3357) took 1011 ms. Trace:
I20260709 13:08:12.847134 22712 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:12.925714 15035 rpcz_store.cc:276] 0709 13:08:11.907697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:11.910359 (+  2662us) service_pool.cc:224] Handling call
0709 13:08:11.910688 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.053333 (+142645us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.919207 (+865874us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540014c8d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:12.919442 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":311971072}
I20260709 13:08:12.867806 22536 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:12.870047 22436 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:12.869730 22315 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 13:08:12.934511 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 145939us
I20260709 13:08:12.860845 22744 consensus_queue.cc:1048] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.080s
I20260709 13:08:12.916127 15549 rpcz_store.cc:276] 0709 13:08:11.797518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.231231 (+433713us) service_pool.cc:224] Handling call
0709 13:08:12.231535 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.231834 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.231859 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:12.241525 (+  9666us) log.cc:844] Serialized 26 byte log entry
0709 13:08:12.381067 (+139542us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:12.381105 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.381171 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:12.870320 (+489149us) raft_consensus.cc:1685] finished
0709 13:08:12.870349 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.870522 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1535,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":4030,"thread_start_us":127041,"threads_started":1,"wal-append.queue_time_us":414807}
I20260709 13:08:12.869270 22444 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.913937 22286 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:12.937968 15516 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:12.846383 22725 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:12.957988 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:12.934188 22459 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:12.935871 22368 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:12.929925 22675 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:12.937906 22436 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:12.952162 22458 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:12.943535 22712 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:13.013680 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 255919us
I20260709 13:08:12.953095 22444 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:12.951481 22585 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:13.012598 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 141640us
W20260709 13:08:13.021648 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 153402us
I20260709 13:08:13.027206 15008 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:12.975617 22645 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:13.019552 22544 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.031935 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:13.029976 22442 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:13.037410 22750 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:08:13.037187 22442 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:13.038926 15513 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:13.039378 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:13.029289 22444 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.040217 22442 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.041365 22444 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.041966 22444 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:12.954012 22286 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.044448 22286 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.028798 22585 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.047447 22585 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:12.708922 15543 rpcz_store.cc:276] 0709 13:08:11.688072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.203162 (+515090us) service_pool.cc:224] Handling call
0709 13:08:12.203590 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:12.203869 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 19
0709 13:08:12.204232 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:08:12.696497 (+492265us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:08:12.696555 (+    58us) raft_consensus.cc:1645] Marking committed up to 19
0709 13:08:12.696628 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:12.696738 (+   110us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:12.696907 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8768,"prepare.queue_time_us":18043,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":117,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":1114,"thread_start_us":491785,"threads_started":1}
I20260709 13:08:13.018157 22459 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.028061 22757 raft_consensus.cc:2804] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:13.030977 22681 consensus_queue.cc:1048] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 13:08:13.067477 22754 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260709 13:08:13.069748 22675 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.021627 22458 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.067236 22760 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:13.051349 22761 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.085003 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:13.089432 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57574.3us
I20260709 13:08:13.088450 15010 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:13.070308 22698 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.036527 22645 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.048944 22578 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.094962 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.079579 22760 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.098136 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.105284 15035 raft_consensus.cc:2393] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 25: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:13.102208 14961 raft_consensus.cc:1240] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:13.104590 14963 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:08:13.098723 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.078249 22757 raft_consensus.cc:697] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:08:13.090418 22719 consensus_meta.cc:287] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.821s	user 0.008s	sys 0.003s
I20260709 13:08:13.120208 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.122346 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.123134 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.126677 14965 raft_consensus.cc:2410] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:08:13.117796 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.090961 22681 consensus_queue.cc:1059] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 13:08:13.128139 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:13.137771 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 49416.7us
I20260709 13:08:13.050268 22725 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.115871 22760 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:13.142171 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.138402 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:13.089232 22744 consensus_queue.cc:1059] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260709 13:08:13.116755 22286 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:13.155362 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.156327 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.162283 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.165402 14967 raft_consensus.cc:2410] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 21 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 13:08:13.093117 22544 consensus_queue.cc:1059] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 13:08:13.166591 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.167732 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.168823 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.169548 14968 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
I20260709 13:08:13.170605 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.173202 22645 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.174889 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:13.175812 22756 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:08:13.175854 22444 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:13.176403 22444 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.176771 22444 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.186540 22444 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:13.187896 22759 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 13:08:13.188632 22701 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:13.189167 22701 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.190231 22740 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.190711 22740 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.191167 22701 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.192414 15042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 3880) took 1160 ms. Trace:
I20260709 13:08:13.192796 15042 rpcz_store.cc:276] 0709 13:08:12.031774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.074696 (+ 42922us) service_pool.cc:224] Handling call
0709 13:08:13.192219 (+1117523us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b54004047d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:13.192348 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48705408}
I20260709 13:08:13.083125 22436 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:13.198457 15007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.134588 22723 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.171298 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:13.204051 22286 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.200656 22315 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:13.211923 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.212869 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.215071 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.220629 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:13.237468 14965 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:13.221426 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.223806 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:13.238565 15543 raft_consensus.cc:2376] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21. Re-sending same reply.
I20260709 13:08:13.226379 15548 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 26 index: 21. Preceding OpId from leader: term: 27 index: 21. (term mismatch)
I20260709 13:08:13.239670 15548 pending_rounds.cc:85] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 20
I20260709 13:08:13.240046 15548 pending_rounds.cc:107] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 26.21
I20260709 13:08:13.240381 15548 raft_consensus.cc:2889] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.227268 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:13.201601 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 167397us
I20260709 13:08:13.230698 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.241691 15544 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:13.241851 15547 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:13.241923 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.243280 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.243463 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.244076 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.245003 15543 raft_consensus.cc:2393] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 25: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:13.198319 22757 consensus_queue.cc:237] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.245668 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.246021 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.247552 15549 raft_consensus.cc:2393] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 19: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:13.249778 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 94506.4us
I20260709 13:08:13.256901 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.133482 22719 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.261489 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:13.261768 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.262656 15550 raft_consensus.cc:2410] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260709 13:08:13.262583 15546 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
W20260709 13:08:13.264590 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 46992.2us
I20260709 13:08:13.267057 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.267270 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.268133 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.260221 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:13.273066 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.274194 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.274845 15043 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:13.247828 22315 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.286146 22592 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:13.245184 22698 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.287446 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.217018 22712 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.239744 22645 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:13.289670 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.259886 22567 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:13.285339 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:13.293047 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 254139us
I20260709 13:08:13.294486 15043 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:13.258174 22754 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:13.303709 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.263257 22511 raft_consensus.cc:3055] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:13.312101 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.307767 22511 raft_consensus.cc:740] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
W20260709 13:08:13.317301 15513 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:13.318100 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.318985 15043 raft_consensus.cc:2468] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
W20260709 13:08:13.320107 15513 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 28 similar messages]
I20260709 13:08:13.292261 22315 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.352646 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.273787 22478 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.038s
W20260709 13:08:13.350443 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:13.350643 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 212301us
I20260709 13:08:13.355363 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.314312 22511 consensus_queue.cc:260] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:13.363318 15513 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:13.340608 15544 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:13.311177 22368 raft_consensus.cc:2804] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:13.349480 22729 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:08:13.319561 22592 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:13.319926 22444 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.348018 22723 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:13.364955 22478 consensus_queue.cc:1243] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer eb4a5ac9f0c5425b92051187b939860f log is divergent from this leader: its last log entry 23.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260709 13:08:13.389942 15541 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:13.348232 22497 consensus_queue.cc:1059] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 13:08:13.377682 22368 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.312405 22645 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.376493 22458 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.365087 22567 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260709 13:08:13.355250 22675 consensus_queue.cc:1048] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260709 13:08:13.348345 22500 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 13:08:13.312651 22754 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.388937 22511 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
W20260709 13:08:13.395287 22639 consensus_meta.cc:287] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.816s	user 0.014s	sys 0.000s
I20260709 13:08:13.400882 22770 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 13:08:13.401353 22770 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.401762 22770 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.402405 15044 raft_consensus.cc:2410] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 for term 23 because replica has last-logged OpId of term: 22 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 13:08:13.402714 22766 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:13.391077 22459 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.403429 22766 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.405300 22754 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.407778 22525 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:13.408473 22525 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:13.417032 22641 consensus_meta.cc:287] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.000s
I20260709 13:08:13.420620 22712 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.421758 22286 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.423477 22763 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:13.423913 22758 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:13.426739 14778 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 25b8f0cc46f748468395543b8b174bf4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:13.399354 22755 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.431131 22645 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.395152 22368 raft_consensus.cc:3060] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.432502 22771 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:13.449689 22730 log.cc:927] Time spent T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 1.333s	user 0.015s	sys 0.000s
I20260709 13:08:13.435287 22764 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.449208 22763 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:13.465974 22740 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:13.472419 22771 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:13.491976 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 128684us
W20260709 13:08:13.545380 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 224471us
I20260709 13:08:13.470574 22766 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:13.552518 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 229781us
I20260709 13:08:13.556927 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.563625 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:13.564502 15037 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:13.529686 22763 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:13.566941 15043 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Rejecting Update request from peer 58ee9fe38eb8453098f6d964e7675e79 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:13.574718 15037 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:08:13.579893 15516 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.583026 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.584241 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.586131 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.582134 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.588376 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.588454 15037 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:13.588688 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.589144 15039 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:13.589567 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 127697us
I20260709 13:08:13.546283 22719 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.592723 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:13.596938 15007 leader_election.cc:336] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:13.603816 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.589953 21987 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:13.610047 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:13.612907 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.596617 22755 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:13.616436 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.592001 22639 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:13.567615 22286 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:08:13.572425 22459 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260709 13:08:13.551440 22764 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.612813 22525 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:13.606913 22494 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.607379 22698 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:13.682576 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:13.688529 22761 consensus_meta.cc:287] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.595s	user 0.009s	sys 0.003s
I20260709 13:08:13.686698 22585 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:13.606768 22641 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.025s
I20260709 13:08:13.692066 15545 raft_consensus.cc:1240] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 14. Current term is 15. Ops: []
W20260709 13:08:13.676249 22774 log.cc:927] Time spent T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.075s	user 0.001s	sys 0.001s
I20260709 13:08:13.679872 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.675899 22444 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:13.601256 22478 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:08:13.669749 22494 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.631258 22458 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.039s
I20260709 13:08:13.658231 22739 consensus_queue.cc:260] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.685503 22782 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:08:13.614109 22719 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.764752 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.767915 14963 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:13.769157 22771 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:13.626281 22639 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.769835 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.770363 14964 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:13.771615 22639 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.613345 22578 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.739886 14965 raft_consensus.cc:3060] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.606683 22712 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
W20260709 13:08:13.740350 22791 log.cc:927] Time spent T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 13:08:13.780586 22764 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.781122 22701 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.781723 22701 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.782626 22354 raft_consensus.cc:3055] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:13.782986 22354 raft_consensus.cc:740] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:13.783514 14965 raft_consensus.cc:2468] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:08:13.783572 22497 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:13.753715 22444 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.783835 22354 consensus_queue.cc:260] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.784818 22354 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:13.784353 22497 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.786881 22497 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.788393 22744 raft_consensus.cc:3055] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:13.788735 22444 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.790524 22770 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.792549 22770 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.792956 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:13.731715 22772 log.cc:927] Time spent T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 13:08:13.794704 14970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 3065) took 1494 ms. Trace:
I20260709 13:08:13.795717 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.796340 22712 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:13.796770 22712 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:13.795047 14970 rpcz_store.cc:276] 0709 13:08:12.300772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:12.300916 (+   144us) service_pool.cc:224] Handling call
0709 13:08:12.331722 (+ 30806us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:12.817759 (+486037us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:12.817789 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.194792 (+377003us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b2c00010828. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:08:13.195199 (+   407us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.449750 (+254551us) raft_consensus.cc:1645] Marking committed up to 15
0709 13:08:13.449801 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.449889 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:13.794424 (+344535us) raft_consensus.cc:1685] finished
0709 13:08:13.794443 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:13.794649 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":485559,"raft.queue_time_us":485905,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"spinlock_wait_cycles":25762560,"thread_start_us":199231,"threads_started":1,"wal-append.queue_time_us":341445}
I20260709 13:08:13.797626 22712 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.798789 22712 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:13.798914 22769 raft_consensus.cc:3055] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:08:13.799320 22769 raft_consensus.cc:740] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:13.761348 22739 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.800132 22769 consensus_queue.cc:260] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.801316 22769 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:13.788440 22315 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.806206 22315 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.806945 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.769284 22692 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:13.808456 22701 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:13.811549 22692 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.812597 15541 raft_consensus.cc:1240] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:13.812242 22692 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.814895 22692 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.759243 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:13.816095 15546 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 16: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:13.817713 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.819692 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 28 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.819743 22459 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.820408 15035 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 27.
I20260709 13:08:13.820535 22459 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.821372 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:13.822793 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 202479us
I20260709 13:08:13.822922 22709 consensus_queue.cc:1048] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:13.824899 22459 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:13.825019 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 107197us
I20260709 13:08:13.827865 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.828593 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:13.829121 15545 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:13.829952 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:13.830505 15544 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.831815 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.832299 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.832669 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.832860 15543 raft_consensus.cc:2468] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 13.
I20260709 13:08:13.833889 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.834745 15543 raft_consensus.cc:2393] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 15: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:13.823822 15007 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:13.837539 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:13.838416 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:13.846633 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.731323 22698 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.828272 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:13.852043 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.879938 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:13.881913 14859 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:13.854043 15547 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260709 13:08:13.883826 15547 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:13.854452 22567 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:08:13.845028 22497 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.788921 22744 raft_consensus.cc:740] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:13.859624 15543 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:13.888798 22780 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.889021 22701 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:13.854836 22719 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:13.889437 22096 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:08:13.888082 22538 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:13.890025 22376 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:13.891497 22497 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.893493 22497 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:13.893743 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69943us
I20260709 13:08:13.894430 22744 consensus_queue.cc:260] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.895579 22744 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:13.899617 22771 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.859694 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.861754 22442 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:13.845490 22692 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.906256 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:13.867717 22639 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.869252 15041 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:13.788877 22663 raft_consensus.cc:3055] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:13.748090 22478 consensus_queue.cc:1243] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:08:13.872383 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 53014.1us
I20260709 13:08:13.874408 15546 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:13.924693 14970 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:13.927111 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.889467 22701 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:13.934162 15008 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:13.935776 15044 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:08:13.911247 22663 raft_consensus.cc:740] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:13.942260 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:13.942436 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:13.943287 14962 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.878176 15545 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 25.
I20260709 13:08:13.945881 15548 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:08:13.917596 22497 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 13:08:13.905815 22436 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 13:08:13.901014 22763 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:13.910682 22442 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.949352 14968 raft_consensus.cc:2368] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24.
I20260709 13:08:13.887032 15544 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
W20260709 13:08:13.906504 15009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:13.871080 22494 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:13.907066 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:13.908183 15039 pending_rounds.cc:85] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Aborting all ops after (but not including) 19
I20260709 13:08:13.960788 15039 pending_rounds.cc:107] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: Aborting uncommitted NO_OP operation due to leader change: 23.20
I20260709 13:08:13.961098 15039 raft_consensus.cc:2889] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:13.960114 15546 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:13.909593 15040 raft_consensus.cc:2393] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
W20260709 13:08:13.910099 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 82665.7us
I20260709 13:08:13.943385 14965 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:08:13.967454 15035 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:13.743502 22761 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:13.950999 22442 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:13.935370 22701 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:13.922858 22784 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:13.976699 15035 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260709 13:08:13.917577 22639 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:13.985034 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:13.940017 22681 raft_consensus.cc:2804] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:13.913182 22692 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.001291 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.003733 15010 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:08:14.005065 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 322958us
I20260709 13:08:14.006349 15514 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:13.973510 22760 consensus_meta.cc:287] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Time spent flushing consensus metadata: real 0.773s	user 0.010s	sys 0.002s
I20260709 13:08:14.016347 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.016593 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.016892 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.016929 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:14.018378 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.023892 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:14.024437 15044 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:14.036327 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:14.037665 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.039381 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.039557 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:14.039155 15546 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:14.040375 15043 raft_consensus.cc:2410] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:08:14.041348 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:14.043795 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.044523 15036 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:08:14.044997 15037 raft_consensus.cc:1240] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:14.009298 22678 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:14.025141 22761 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 13:08:14.047847 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:14.056059 14967 raft_consensus.cc:2393] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 16: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:14.048485 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.012068 22712 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.054584 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.060770 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.013545 22442 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:13.979535 22675 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 13:08:14.043906 22368 consensus_meta.cc:287] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.000s
I20260709 13:08:14.018883 22681 raft_consensus.cc:697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:14.026618 22777 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:14.055783 22678 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.085103 22777 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.085647 22777 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:14.019114 22760 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.085536 22678 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:14.087805 14961 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 19: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:14.088050 22760 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.022876 22758 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:14.057367 15007 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:14.090631 15007 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.091137 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.027984 22763 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:14.100507 15007 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.101164 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.073087 22567 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:14.079034 15549 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:14.082882 15044 raft_consensus.cc:2468] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 24.
I20260709 13:08:14.083990 22698 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.084367 22368 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:14.085510 22681 consensus_queue.cc:237] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.062647 22442 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.092509 15041 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:14.092706 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.089659 22538 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.123831 14933 consensus_peers.cc:597] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.124357 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 103276us
I20260709 13:08:14.124660 22368 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.105088 22780 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:13.998700 22096 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.047s
W20260709 13:08:14.109952 15007 leader_election.cc:336] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.118887 15036 raft_consensus.cc:2410] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 13:08:14.099912 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.065970 22761 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:14.123632 22538 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:14.107869 14859 leader_election.cc:400] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24.
W20260709 13:08:14.128119 14933 leader_election.cc:336] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.021759 22663 consensus_queue.cc:260] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:14.130574 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.105309 22497 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:14.066381 22712 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.108819 22709 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:14.116001 22744 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:14.141651 14859 leader_election.cc:403] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 13:08:14.104588 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:14.145190 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.139678 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.109125 22500 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:08:14.119153 22771 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.119573 22442 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Advancing to term 28
W20260709 13:08:14.160876 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 64034.3us
W20260709 13:08:14.161787 14933 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.188597 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.198850 14969 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:14.199884 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:14.181110 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 147687us
W20260709 13:08:14.196573 14933 consensus_peers.cc:597] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.202881 14933 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.236174 14933 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:14.237825 14933 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:14.238919 14933 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.239389 14933 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:14.243440 14933 consensus_peers.cc:597] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.250511 14962 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:14.351316 14966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34568 (request call id 4005) took 1140 ms. Trace:
W20260709 13:08:14.182371 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 77907.9us
I20260709 13:08:14.198138 22286 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:14.180675 22368 raft_consensus.cc:3060] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:14.391069 14966 rpcz_store.cc:276] 0709 13:08:13.210264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.472596 (+262332us) service_pool.cc:224] Handling call
0709 13:08:13.472949 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.551100 (+ 78151us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:13.551130 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:13.551622 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:08:13.813099 (+261477us) spinlock_profiling.cc:243] Waited 8.69 ms on lock 0x7b18001b6b80. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:13.992331 (+179232us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:08:13.992389 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:13.992476 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.350212 (+357736us) raft_consensus.cc:1685] finished
0709 13:08:14.350291 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.351020 (+   729us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":744,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":18260,"spinlock_wait_cycles":19980544,"thread_start_us":179021,"threads_started":1,"wal-append.queue_time_us":623840}
W20260709 13:08:14.397609 22802 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.113s	user 0.002s	sys 0.000s
I20260709 13:08:14.160455 22497 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.399590 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:14.401098 22286 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:14.401566 22286 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.401916 22286 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:14.402341 22497 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.305822 22701 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.243880 22645 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.180812 22663 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.292912 22692 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.306625 22712 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.181747 22760 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:14.282990 22761 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.159449 22763 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 13:08:14.415783 22763 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:14.373178 22782 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:14.237221 22771 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.129113 22780 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.160316 22725 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.098s
W20260709 13:08:14.293417 22797 log.cc:927] Time spent T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 13:08:14.420923 22780 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.422307 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:14.292974 22794 log.cc:927] Time spent T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 13:08:14.377318 22777 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.378994 22678 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:14.383805 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 113593us
I20260709 13:08:14.381125 15542 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52858 (request call id 1924) took 1152 ms. Trace:
I20260709 13:08:14.385121 22639 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.390576 14961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34584 (request call id 3074) took 1274 ms. Trace:
I20260709 13:08:14.430200 14961 rpcz_store.cc:276] 0709 13:08:13.116321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.117478 (+  1157us) service_pool.cc:224] Handling call
0709 13:08:14.390069 (+1272591us) spinlock_profiling.cc:243] Waited 956 ms on lock 0x7b540016d854. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7a2fa 00007f5539d3bb17 00007f55332b66d4 00007f55332b6662 00007f55332b6591 00007f55332b650c 00007f55332b57c2 00007f55330b148c 00007f55330b08c6 00007f55330b026f
0709 13:08:14.390341 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2199303424}
I20260709 13:08:14.428732 15542 rpcz_store.cc:276] 0709 13:08:13.228240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.228390 (+   150us) service_pool.cc:224] Handling call
0709 13:08:13.228767 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:13.246836 (+ 18069us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 13:08:13.611172 (+364336us) log.cc:844] Serialized 14 byte log entry
0709 13:08:14.167856 (+556684us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:14.180764 (+ 12908us) log.cc:844] Serialized 26 byte log entry
0709 13:08:14.180937 (+   173us) raft_consensus.cc:1645] Marking committed up to 17
0709 13:08:14.180973 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:14.181044 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:14.379824 (+198780us) raft_consensus.cc:1685] finished
0709 13:08:14.379866 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:14.380207 (+   341us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":184400,"prepare.queue_time_us":398274,"prepare.run_cpu_time_us":174,"prepare.run_wall_time_us":19847,"raft.queue_time_us":4801,"raft.run_cpu_time_us":650,"raft.run_wall_time_us":218501,"thread_start_us":757213,"threads_started":2,"wal-append.queue_time_us":655231}
I20260709 13:08:14.392897 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:14.371613 22538 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.424865 15008 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.432468 22536 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.433421 22536 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.437287 22678 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.437458 22536 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.440874 22777 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:14.437312 22763 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.444267 22763 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Advancing to term 25
I20260709 13:08:14.445433 22701 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.447065 22771 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.454056 22538 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:14.454571 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62151us
W20260709 13:08:14.456895 22799 log.cc:927] Time spent T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.419s	user 0.002s	sys 0.000s
W20260709 13:08:14.458276 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.458556 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
W20260709 13:08:14.458794 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 317335us
I20260709 13:08:14.460300 22478 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:14.460883 22478 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:14.461040 22368 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345) with higher term. Message: Invalid argument: T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 for earlier term 23. Current term is 24.
I20260709 13:08:14.461462 22478 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:14.484031 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.461794 14861 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:14.465572 22123 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:14.469722 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.471566 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.473976 22500 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:14.488379 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.493157 15040 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
W20260709 13:08:14.493459 15007 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.494411 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.495390 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.495641 22123 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:14.497133 22123 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.499876 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:14.495167 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.501786 15007 leader_election.cc:336] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.502310 15007 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.503919 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:14.503968 22536 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.504722 15549 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
W20260709 13:08:14.504743 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.511806 15039 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 15.
W20260709 13:08:14.513301 15513 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.519687 22500 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:14.523222 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61580.5us
I20260709 13:08:14.533329 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.534736 22712 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:14.535181 22712 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.535567 22712 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:14.539917 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.540966 22444 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:08:14.541288 22639 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:14.541493 22444 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.542032 22444 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:14.542070 22639 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:08:14.543735 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.545559 15513 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.546101 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:14.547226 22354 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 13:08:14.555789 22780 consensus_queue.cc:1059] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:14.557307 15007 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.564893 22442 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.557405 22701 raft_consensus.cc:3055] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:14.558427 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:14.566109 22701 raft_consensus.cc:740] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:14.564093 22500 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.561663 22538 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:14.567263 15547 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 27. Current term is 28. Ops: [27.21-27.21]
I20260709 13:08:14.587754 22442 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.588232 22478 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.592841 22286 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.570148 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.570353 22639 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.570556 22701 consensus_queue.cc:260] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.577934 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.600155 22701 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:14.600960 22286 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:14.578608 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.582542 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:14.583189 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.593250 15007 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:14.566684 14933 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.620182 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 53549.3us
I20260709 13:08:14.607519 15514 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:14.610911 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 80636.3us
I20260709 13:08:14.616778 22538 raft_consensus.cc:2804] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:08:14.618216 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 59929.5us
I20260709 13:08:14.577793 22444 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:14.621018 14933 consensus_peers.cc:597] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.627478 14933 consensus_peers.cc:597] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.622159 22538 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:14.648311 15550 raft_consensus.cc:2393] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 19: Already voted for candidate e4938453819c469599f515b22d92fe27 in this term.
W20260709 13:08:14.637532 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:14.654857 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 90414.2us
W20260709 13:08:14.652022 14933 consensus_peers.cc:597] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.658154 15513 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.652748 22538 raft_consensus.cc:3060] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:08:14.641239 22478 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.665195 22777 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:14.671733 14933 consensus_peers.cc:597] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.673420 22444 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.674261 14861 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:14.675504 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48206.8us
I20260709 13:08:14.675678 22712 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.678063 22442 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.678244 15038 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:08:14.686627 14933 leader_election.cc:336] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.695084 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:14.697081 14933 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:14.684969 22286 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:14.696687 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:14.697769 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 28 candidate_status { last_received { term: 24 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:14.706382 21987 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.706692 22678 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 13:08:14.707995 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 150773us
W20260709 13:08:14.708909 15007 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.709373 15007 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.705549 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:14.713868 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.716522 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:14.717139 15044 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:08:14.719899 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 78781.4us
I20260709 13:08:14.720783 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:14.721537 22478 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:14.722180 22478 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.722904 22368 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:14.723287 22368 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:14.723663 22368 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:14.724391 22478 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.727120 22771 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.698624 22701 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:14.731276 22286 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:14.737737 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 54807.3us
I20260709 13:08:14.738250 22286 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:14.738934 14933 consensus_peers.cc:597] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:14.739583 14933 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.740082 14933 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:14.731180 15513 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.754588 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:14.763167 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57667.9us
I20260709 13:08:14.768275 22709 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:14.768798 22709 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.769196 22709 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:14.769560 22725 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:14.770151 22725 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.771673 22674 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:14.775314 22782 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:14.775910 22782 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.778028 22782 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.780879 22675 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:14.780908 22645 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:14.781723 22675 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.782545 22645 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.784317 22675 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.785574 14936 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.786649 22645 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.787345 22645 raft_consensus.cc:2804] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:14.787878 22645 raft_consensus.cc:697] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:14.788981 22645 consensus_queue.cc:237] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:14.793071 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:14.793689 15038 raft_consensus.cc:3060] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:14.796278 22740 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.796449 15039 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:08:14.796909 22740 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.799038 22740 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.799818 22674 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:14.800484 22674 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:14.801564 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 92733.8us
W20260709 13:08:14.802388 15007 leader_election.cc:336] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.802806 22674 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.803808 22725 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:14.805049 22712 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:14.806233 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:14.806872 15545 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 25.
I20260709 13:08:14.807143 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:14.807796 15039 raft_consensus.cc:3060] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:14.808492 14968 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:08:14.809136 15010 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.808518 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.810935 22761 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:14.811327 22761 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.811371 22771 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:14.811808 22761 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:14.811808 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:14.815832 15039 raft_consensus.cc:2468] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:14.816380 22286 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:14.816843 22286 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:14.817199 22286 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:14.819586 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 63428.5us
I20260709 13:08:14.802809 15007 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:14.787694 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 180470us
I20260709 13:08:14.826735 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:14.823567 15516 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.829850 22286 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.830883 22675 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:14.831189 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 91633.8us
W20260709 13:08:14.832293 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 101186us
I20260709 13:08:14.833755 22442 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:14.834247 22777 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:08:14.842386 22678 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:14.844995 22807 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:14.851903 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:14.848912 22712 raft_consensus.cc:2804] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:08:14.857481 14933 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.819183 22368 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.856058 22674 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:14.867612 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:14.867187 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.876106 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:14.860904 22782 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:14.891145 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:14.870275 22712 raft_consensus.cc:697] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:14.899289 15044 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
W20260709 13:08:14.900246 15007 leader_election.cc:336] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:14.907202 15550 raft_consensus.cc:1275] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 13:08:14.907627 15550 pending_rounds.cc:85] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 12
I20260709 13:08:14.907845 15550 pending_rounds.cc:107] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 13:08:14.918835 15550 raft_consensus.cc:2889] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:14.910293 22442 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:14.929721 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:14.929823 15516 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:14.933534 22789 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:14.935691 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 78234.4us
I20260709 13:08:14.921803 22497 raft_consensus.cc:2804] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:14.939548 14933 leader_election.cc:336] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:14.945649 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 88209.8us
I20260709 13:08:14.924437 22478 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:14.948743 14933 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:14.952864 22515 raft_consensus.cc:2804] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:08:14.953047 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:14.953493 22515 raft_consensus.cc:697] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:08:14.958762 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:14.941126 22497 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:08:14.974090 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 111819us
I20260709 13:08:14.972764 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:14.936453 22538 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.972047 22497 raft_consensus.cc:3060] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:14.975098 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:14.998104 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.010079 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:15.016404 14962 raft_consensus.cc:2393] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:15.024655 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:15.024886 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 141221us
I20260709 13:08:15.025625 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:14.979231 22478 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:14.972232 22515 consensus_queue.cc:237] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.013036 22701 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:15.030659 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 94280.6us
W20260709 13:08:15.031452 15007 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.046319 15007 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:15.032639 22376 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:14.984428 22712 consensus_queue.cc:237] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:15.045820 14933 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.043358 22478 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.045018 14970 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:15.047219 15513 leader_election.cc:336] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.014420 22286 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.055963 14933 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:15.079710 22828 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260709 13:08:15.081761 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 69256.4us
I20260709 13:08:15.084319 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:15.085624 22813 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:15.087652 14964 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:15.087747 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:15.089118 22769 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:15.089129 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:15.083119 22497 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.093532 22497 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.106626 22368 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.115191 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:15.115973 14965 raft_consensus.cc:2468] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:15.118464 22709 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:15.123339 22835 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:08:15.125557 22444 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.126353 22444 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.128021 22286 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:15.128661 22286 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.129035 22701 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:15.130316 22777 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.130837 22286 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.130900 22777 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:15.131939 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 86149.4us
I20260709 13:08:15.132277 14965 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260709 13:08:15.132634 14965 pending_rounds.cc:85] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Aborting all ops after (but not including) 16
I20260709 13:08:15.132894 14965 pending_rounds.cc:107] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260709 13:08:15.133128 14965 raft_consensus.cc:2889] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:15.133571 22777 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:15.132645 14933 leader_election.cc:336] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:15.141814 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 182174us
I20260709 13:08:15.141995 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:15.158623 15038 raft_consensus.cc:2468] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:15.162331 14933 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.162583 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:15.158223 22368 raft_consensus.cc:2804] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:08:15.165807 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:15.191466 22744 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:15.166157 22761 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.195768 22761 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.196249 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:15.198336 15544 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
W20260709 13:08:15.205765 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73134.2us
W20260709 13:08:15.206770 14933 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.212664 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.214085 22354 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:15.214424 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.216166 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.227038 22754 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:15.227854 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:15.228165 22831 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:08:15.228648 22725 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:15.229060 22725 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.229321 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.229436 22725 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:15.229895 22709 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.230448 22645 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:15.231096 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 205250us
W20260709 13:08:15.237689 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 65454.3us
I20260709 13:08:15.239003 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:15.247648 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:15.248395 15039 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:08:15.248066 22725 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.250356 22725 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.213006 22444 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:15.262351 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:15.263185 15547 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:15.264947 14861 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.167589 22368 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:15.269286 22497 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:15.169673 22782 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:15.270977 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.274703 22807 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.272550 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:15.268572 22368 raft_consensus.cc:3060] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:15.278088 22807 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:15.280419 22538 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.283195 22444 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:15.281512 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 204750us
I20260709 13:08:15.306643 22444 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:15.307763 22813 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:15.309366 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44542.4us
I20260709 13:08:15.313124 15547 raft_consensus.cc:2468] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:15.287683 22807 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:15.323810 15547 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260709 13:08:15.324435 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 92626.3us
I20260709 13:08:15.330238 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:15.330868 15541 raft_consensus.cc:3060] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:15.333770 15547 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:15.336391 14936 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:15.321096 22444 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:15.355641 14936 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:15.357499 15541 raft_consensus.cc:2468] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 26.
W20260709 13:08:15.327659 15007 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.363305 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:15.363955 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:15.365792 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:15.366580 15544 raft_consensus.cc:3060] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 24
I20260709 13:08:15.365012 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:15.379798 14933 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.380293 14933 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:15.381263 14968 raft_consensus.cc:3060] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:15.361131 22376 raft_consensus.cc:2804] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:15.392529 22776 consensus_queue.cc:1048] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 13:08:15.402300 22847 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260709 13:08:15.401398 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 73784.4us
W20260709 13:08:15.408031 15007 leader_election.cc:336] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.390923 14966 raft_consensus.cc:3060] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:08:15.378868 22763 raft_consensus.cc:2804] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:15.406728 22368 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.419960 15039 raft_consensus.cc:1275] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260709 13:08:15.420959 14970 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:15.389746 22789 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:15.432163 15010 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:15.442926 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:15.420644 22376 raft_consensus.cc:697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:15.450748 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 70970.8us
I20260709 13:08:15.439668 22678 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.437525 22763 raft_consensus.cc:697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:15.510115 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 102118us
I20260709 13:08:15.537874 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:15.563900 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.706008 22536 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:15.707732 15544 raft_consensus.cc:2468] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:15.728855 15041 raft_consensus.cc:2393] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 18: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:15.729512 22763 consensus_queue.cc:237] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.438235 22771 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 13:08:15.426021 22497 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:08:15.717561 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.721715 14966 raft_consensus.cc:2468] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:08:15.439283 21987 raft_consensus.cc:2804] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader election won for term 26
W20260709 13:08:15.728226 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 285869us
W20260709 13:08:15.711400 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 259706us
W20260709 13:08:15.723268 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:15.739010 22286 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:15.740167 14968 raft_consensus.cc:2468] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:15.741911 22444 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.743777 22536 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.759558 22286 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:15.727556 22761 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.730826 22769 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:15.734440 22777 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.762599 22776 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.779927 22709 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.779747 22782 consensus_queue.cc:1048] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 13:08:15.791890 22376 consensus_queue.cc:237] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:15.737996 22789 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.794003 22368 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.795126 22536 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.795388 22500 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:15.802044 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84618.7us
W20260709 13:08:15.800035 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84610.1us
I20260709 13:08:15.772962 21987 raft_consensus.cc:697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 26 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:15.816392 22286 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:15.831635 22777 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.832561 22776 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.835428 22776 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.836640 22709 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:15.832134 22855 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:08:15.838829 22709 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:15.841177 14861 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.842018 22368 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:15.843740 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.844771 22368 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:15.846122 14861 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:15.846223 21987 consensus_queue.cc:237] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.828034 22789 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.868183 22789 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.827538 15010 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:15.808740 22771 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:15.871018 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 43600.8us
I20260709 13:08:15.850700 14859 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:15.862214 22776 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:15.824671 22769 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.802479 22761 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:15.860138 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 99115.1us
W20260709 13:08:15.884086 14933 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.886554 15037 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:15.876648 22500 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:15.875782 22789 raft_consensus.cc:2804] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election won for term 24
W20260709 13:08:15.889525 15007 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.887560 22776 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:15.900025 15007 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.885927 22771 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:15.895828 22789 raft_consensus.cc:697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:15.910846 15514 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:15.922950 14968 raft_consensus.cc:1275] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:08:15.922988 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:15.915767 22852 log.cc:927] Time spent T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260709 13:08:15.930410 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45191.1us
I20260709 13:08:15.913443 22869 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:15.937927 22866 raft_consensus.cc:2804] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:15.938519 22776 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.943755 22769 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:15.946048 22771 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:15.938562 22866 raft_consensus.cc:697] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:15.948926 22444 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:15.949369 22866 consensus_queue.cc:237] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:15.936599 15007 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:15.951649 22867 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 13:08:15.968751 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:15.969409 14965 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 17.
I20260709 13:08:15.969007 22789 consensus_queue.cc:237] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:15.970912 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:15.971645 15548 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 17.
I20260709 13:08:15.929448 22500 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:15.981509 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:15.980886 22858 log.cc:927] Time spent T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 13:08:15.994298 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:15.999651 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:15.997318 22761 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:16.091984 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.092902 15550 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 28: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:16.093693 22862 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.188s	user 0.001s	sys 0.001s
I20260709 13:08:16.103171 15543 raft_consensus.cc:2393] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 21: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:16.091039 22863 log.cc:927] Time spent T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:08:16.105661 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.116241 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.116920 15044 raft_consensus.cc:3060] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.121407 22761 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.121963 22761 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.124210 22761 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:16.129909 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.131366 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.109855 15550 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 26.
I20260709 13:08:16.139683 15043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45052 (request call id 3916) took 1068 ms. Trace:
I20260709 13:08:16.140681 15038 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:16.142549 22874 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.143214 22874 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.145435 22874 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.002868 15041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56542
I20260709 13:08:16.147760 15041 raft_consensus.cc:606] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Received request to transfer leadership
I20260709 13:08:16.148109 15041 raft_consensus.cc:614] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:08:16.154740 15010 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:16.158828 21987 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:16.159262 21987 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:16.159658 21987 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:16.140301 15043 rpcz_store.cc:276] 0709 13:08:15.033337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.036903 (+  3566us) service_pool.cc:224] Handling call
0709 13:08:15.037275 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.315693 (+278418us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.315728 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.354579 (+ 38851us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.622197 (+267618us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:08:15.715939 (+ 93742us) log.cc:844] Serialized 14 byte log entry
0709 13:08:15.764173 (+ 48234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.764267 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:15.841811 (+ 77544us) spinlock_profiling.cc:243] Waited 7.3 ms on lock 0x7b48002001d8. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5539c9faa1 00007f5539c96b37 00007f5539c969ca 00007f5539d8e26f 00007f5539d8df37 00007f5539da255c 00007f5539da2508 00007f5539da2488 00007f5539da2443 00007f5539da16ec 00007f5538ccba96
0709 13:08:16.097756 (+255945us) raft_consensus.cc:1685] finished
0709 13:08:16.101358 (+  3602us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.101506 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49113,"prepare.queue_time_us":93109,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":46084,"raft.run_cpu_time_us":2293,"raft.run_wall_time_us":69134,"spinlock_wait_cycles":16798080,"thread_start_us":502536,"threads_started":2,"wal-append.queue_time_us":488277}
I20260709 13:08:16.164220 14963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 3108) took 1023 ms. Trace:
I20260709 13:08:16.164775 15044 raft_consensus.cc:2468] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:16.164669 14963 rpcz_store.cc:276] 0709 13:08:15.140452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.140571 (+   119us) service_pool.cc:224] Handling call
0709 13:08:15.164268 (+ 23697us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.199655 (+ 35387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.199703 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:15.200374 (+   671us) log.cc:844] Serialized 26 byte log entry
0709 13:08:15.317815 (+117441us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b1800459a00. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c6be07 00007f553aac6ab9 00007f5531c8869b 00007f5531c8693f 00007f5531c88c02 00007f553491020b 00007f5534915d23 00007f55349160d1 00007f5534d31a0f
0709 13:08:15.407684 (+ 89869us) raft_consensus.cc:1645] Marking committed up to 14
0709 13:08:15.407725 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:15.407799 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.155485 (+747686us) raft_consensus.cc:1685] finished
0709 13:08:16.155504 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.164006 (+  8502us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11964,"raft.queue_time_us":14224,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":115,"spinlock_wait_cycles":118238080,"thread_start_us":89652,"threads_started":1,"wal-append.queue_time_us":553534}
I20260709 13:08:16.166487 15516 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:16.168360 22444 raft_consensus.cc:2804] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
W20260709 13:08:16.168839 14933 leader_election.cc:336] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.174671 15036 raft_consensus.cc:1275] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:16.177290 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.182669 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:16.184074 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.106066 22500 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.174301 22866 consensus_queue.cc:1048] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
W20260709 13:08:16.193167 14933 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.191931 15040 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
I20260709 13:08:16.192631 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.202880 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.203657 15044 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:16.205380 14963 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 13:08:16.207021 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.207818 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.209586 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.210053 22872 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.210613 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.212679 14966 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:16.185192 22725 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.191121 22761 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:16.217293 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.218580 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.185516 22444 raft_consensus.cc:697] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:16.189599 22368 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:16.222169 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.227967 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.228466 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:16.228806 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 55071us
I20260709 13:08:16.231317 15547 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 21. Current term is 22. Ops: [19.14-21.15]
W20260709 13:08:16.229638 15007 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.234297 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:16.234330 15007 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.235342 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.236163 15550 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:16.245673 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.197278 21987 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.221745 22761 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:16.257953 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.258260 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.258802 15548 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.260396 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.220966 22872 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.271257 15548 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:16.274796 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.262145 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:16.274773 15007 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.255975 22761 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:16.279198 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.276012 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.281937 15008 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.278609 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.283354 15041 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.250435 22368 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.303018 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.310932 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.311795 15042 raft_consensus.cc:2393] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e4938453819c469599f515b22d92fe27 in current term 20: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:16.312563 22872 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.290601 22444 consensus_queue.cc:237] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.319088 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.319782 15035 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:16.319823 22761 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.271986 22848 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
I20260709 13:08:16.299535 22846 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.326828 22807 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:16.327433 22807 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.327706 22681 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.296540 22740 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:16.333318 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.334029 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.341419 15550 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:16.344162 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.369670 15041 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:16.370434 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.331511 22873 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.374817 15550 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 18.
I20260709 13:08:16.340548 22740 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:16.380899 22497 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:16.383904 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.385113 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.385322 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.350704 22883 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.393836 15544 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 20.
I20260709 13:08:16.386008 22873 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.396391 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.398298 22873 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.398970 22865 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:16.408633 22368 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.398834 22497 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.407169 22846 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:16.399646 22883 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:16.404189 22881 log.cc:927] Time spent T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 13:08:16.386435 22740 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:16.430035 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 173369us
I20260709 13:08:16.432659 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:16.446278 22368 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.425835 22865 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.447559 22873 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:16.463536 22884 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:16.479159 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:16.470443 22888 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.472911 22873 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:16.488271 22884 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.470065 22368 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.486860 22873 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.498740 22807 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.487011 22888 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.564214 22777 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.571945 22883 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.591878 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.593297 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.593987 15547 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:16.594031 22884 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.582034 22497 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.599354 22865 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.600633 22807 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.601374 22888 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.601171 22807 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:16.603520 22898 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:08:16.605950 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.603546 22882 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:16.607626 22880 log.cc:927] Time spent T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.400s	user 0.003s	sys 0.002s
I20260709 13:08:16.608268 22882 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.610373 22882 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.618991 22368 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.620713 22807 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.621886 22368 consensus_queue.cc:1059] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.20, Next index: 21, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:08:16.632025 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.633311 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.634294 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.635241 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.638842 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.639732 22885 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:16.640138 15541 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52838 (request call id 2053) took 1206 ms. Trace:
I20260709 13:08:16.640316 22885 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.640551 15541 rpcz_store.cc:276] 0709 13:08:15.434027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.434250 (+   223us) service_pool.cc:224] Handling call
0709 13:08:15.722414 (+288164us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:08:15.876443 (+154029us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:08:15.876472 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:08:16.295988 (+419516us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b2c00047618. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553366fa11 00007f553367f372 00007f5534db1a01 00007f5534d7643a 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2
0709 13:08:16.296363 (+   375us) log.cc:844] Serialized 26 byte log entry
0709 13:08:16.473470 (+177107us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:08:16.571559 (+ 98089us) log.cc:844] Serialized 14 byte log entry
0709 13:08:16.572558 (+   999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.572643 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:08:16.633787 (+ 61144us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b18004362a0. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f553ab51de1 00007f553ab5e5b1 00007f5531c893f3 00007f5531c8b7c1 00007f5531c8b779 00007f5531c8b709 00007f5531c8b6d1 00007f5531c8a9cd 000000000038f354 000000000038f199 00007f5531c6c83a
0709 13:08:16.639906 (+  6119us) raft_consensus.cc:1685] finished
0709 13:08:16.639930 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:08:16.640080 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6193,"prepare.queue_time_us":18173,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":23389,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":15598,"spinlock_wait_cycles":20311808,"thread_start_us":363088,"threads_started":3,"wal-append.queue_time_us":183381}
I20260709 13:08:16.642475 22885 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.640966 22368 consensus_queue.cc:1059] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:16.644449 22368 consensus_queue.cc:1243] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260709 13:08:16.644706 15007 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:16.645118 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 363609us
W20260709 13:08:16.645663 15007 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:16.646907 15007 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.647289 15007 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.649873 22872 raft_consensus.cc:3055] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:16.650291 22872 raft_consensus.cc:740] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:16.650795 22771 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:16.651093 22872 consensus_queue.cc:260] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.656461 22761 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.659045 22885 raft_consensus.cc:493] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.659827 22885 raft_consensus.cc:515] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.661907 22885 leader_election.cc:290] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.665531 22740 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.677624 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.670075 21987 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.622750 22873 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.674906 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:16.675523 22864 consensus_queue.cc:1048] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:08:16.685058 22873 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.685680 22771 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 13:08:16.686139 22865 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:16.686625 22865 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:08:16.686901 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 57083.1us
I20260709 13:08:16.688845 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.689277 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:16.689998 15549 raft_consensus.cc:2368] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:08:16.687108 22865 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.692163 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:16.693117 22096 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:16.693507 22096 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:16.693877 22096 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:16.694044 15513 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.583s (SENT)
I20260709 13:08:16.694567 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.697460 14967 raft_consensus.cc:1240] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:16.699591 22864 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:16.700327 14933 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.665548 22872 raft_consensus.cc:3060] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:16.702373 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:16.708475 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.710996 15543 raft_consensus.cc:1275] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:08:16.700713 14967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34584 (request call id 3110) took 1275 ms. Trace:
I20260709 13:08:16.711532 14967 rpcz_store.cc:276] 0709 13:08:15.425539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:15.436615 (+ 11076us) service_pool.cc:224] Handling call
0709 13:08:15.436992 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:08:16.697879 (+1260887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:08:16.700480 (+  2601us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54002175d4. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d76e01 00007f5534d7583e 00007f5539d3a419 00007f55332b1bd4 00007f55332b1b62 00007f55332b1a91 00007f55332b1a0c 00007f55332b0cc2 00007f55330b148c 00007f55330b08c6
0709 13:08:16.700638 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2898115328}
I20260709 13:08:16.677716 22740 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:16.714094 14933 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.715082 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:16.722771 22857 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:16.725292 15513 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.614s (SENT)
I20260709 13:08:16.725804 15513 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:16.728714 15010 leader_election.cc:400] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:08:16.729203 22874 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:16.732663 14933 consensus_peers.cc:597] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:16.733031 15010 leader_election.cc:403] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 13:08:16.736121 22789 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473) with higher term. Message: Invalid argument: T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f for earlier term 17. Current term is 18.
I20260709 13:08:16.737648 22789 consensus_queue.cc:1048] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:16.738336 22096 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.769249 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:16.769321 22096 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.773576 22874 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.773521 22857 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:16.741693 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:16.756558 13792 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 14920)
I20260709 13:08:16.780236 15043 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 18.
W20260709 13:08:16.733954 14933 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:16.782032 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48109.7us
I20260709 13:08:16.663188 14861 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:16.784307 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 121188us
I20260709 13:08:16.786164 14861 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:16.764961 15007 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.786799 15007 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.778344 22777 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:16.786875 22885 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.787523 22777 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.785032 14965 raft_consensus.cc:1275] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:16.784384 22873 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:16.789995 22777 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:16.790800 22769 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:16.791554 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:16.791946 15007 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.792090 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.796108 14961 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.795938 22874 consensus_queue.cc:1048] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:16.798460 15037 raft_consensus.cc:1275] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:16.799993 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.740016 22865 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.809731 22865 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:16.776777 14791 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 323) took 15492 ms (client timeout 15000 ms). Trace:
I20260709 13:08:16.810776 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.811868 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
W20260709 13:08:16.812053 14933 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.812674 15543 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:16.813077 14933 consensus_peers.cc:597] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:16.813850 14933 leader_election.cc:336] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.814282 14933 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.815281 14961 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:16.816540 22789 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:16.826159 22789 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.820259 14793 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 11 to 17. New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:16.828259 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:16.829124 22096 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:16.829514 22096 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:16.828752 14793 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 10 to 12, term changed from 18 to 20, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1), VOTER 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2), VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3), VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:16.829880 22096 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.830240 22675 consensus_queue.cc:1048] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:16.822345 15543 raft_consensus.cc:2468] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:08:16.832837 22789 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:16.831243 14793 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 22, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 22 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:16.835136 14936 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:16.836748 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.848798 22857 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:16.823472 22869 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.013s	sys 0.013s
W20260709 13:08:16.849376 22869 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.013s	sys 0.014s
W20260709 13:08:16.824805 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.837371 22763 raft_consensus.cc:2804] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:16.850956 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.839860 14793 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:16.852653 15007 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.852799 22740 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:16.853247 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:16.842785 22873 raft_consensus.cc:493] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:16.822527 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 77751.4us
I20260709 13:08:16.845531 15543 raft_consensus.cc:1275] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260709 13:08:16.851090 22763 raft_consensus.cc:697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:16.854041 22740 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:16.858494 22873 raft_consensus.cc:515] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:16.860607 15513 leader_election.cc:336] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.684s (SENT)
W20260709 13:08:16.861860 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Timed out: RequestConsensusVote RPC to 127.13.120.1:46755 timed out after 1.691s (SENT)
I20260709 13:08:16.862074 22873 leader_election.cc:290] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.863474 22763 consensus_queue.cc:237] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.854239 14793 catalog_manager.cc:5697] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:16.865407 14793 catalog_manager.cc:5697] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 18 to 20, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:16.867161 22444 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.005s	sys 0.023s
W20260709 13:08:16.867532 22444 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.005s	sys 0.023s
I20260709 13:08:16.869747 22096 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:16.810881 14791 rpcz_store.cc:269] 0709 13:08:01.328209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:01.355654 (+ 27445us) service_pool.cc:224] Handling call
0709 13:08:01.776689 (+421035us) spinlock_profiling.cc:243] Waited 14.6 ms on lock 0x7b54002b0110. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5531b11db1 00007f5531c51b71 00007f5531c520b2 00007f553abcba89 00007f553ab63da6 00007f553ab35088 00007f553ac3337e 00007f55390f42a4 00007f55390f4232 00007f55390f4161 00007f55390f40dc
0709 13:08:16.776540 (+14999851us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:13.019420 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:13.067451 (+ 48031us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:13.067494 (+    43us) write_op.cc:435] Acquired schema lock
0709 13:08:13.067514 (+    20us) tablet.cc:662] Decoding operations
0709 13:08:13.069182 (+  1668us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:13.069262 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:13.069288 (+    26us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:08:13.216361 (+147073us) tablet.cc:701] Row locks acquired
0709 13:08:13.216381 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:13.216525 (+   144us) write_op.cc:270] Start()
0709 13:08:13.216655 (+   130us) write_op.cc:276] Timestamp: P: 1783602493216475 usec, L: 0
0709 13:08:13.216677 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:08:13.300408 (+ 83731us) log.cc:844] Serialized 9352 byte log entry
0709 13:08:14.245464 (+945056us) op_driver.cc:464] REPLICATION: finished
0709 13:08:14.313147 (+ 67683us) write_op.cc:301] APPLY: starting
0709 13:08:14.313267 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:14.423019 (+109752us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54003c2154. stack: 00007f5531c57343 00007f5531c57240 00007f55315e61d4 00007f553b324304 00007f553b324299 00007f5534cdf571 00007f5534d7332a 00007f5534cf8f14 00007f5534cf8ec3 00007f5534cf8e38 00007f5534cf8df3 00007f5534cf80dc 00007f5534d21e16 00007f5534d09cbb 00007f5534cf439d 00007f5534cf7d75
0709 13:08:14.617954 (+194935us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:14.618001 (+    47us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:15.259878 (+641877us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:15.260511 (+   633us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:08:15.260595 (+    84us) write_op.cc:312] APPLY: finished
0709 13:08:15.261478 (+   883us) log.cc:844] Serialized 204 byte log entry
0709 13:08:15.384453 (+122975us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.743511 (+359058us) write_op.cc:454] Released schema lock
0709 13:08:15.743609 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:15.744550 (+   941us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:15.744620 (+    70us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":155440,"reported_tablets":43,"spinlock_wait_cycles":33593600,"child_traces":[["op",{"apply.queue_time_us":56735,"apply.run_cpu_time_us":61433,"apply.run_wall_time_us":1431246,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100267,"num_ops":23,"prepare.queue_time_us":262297,"prepare.run_cpu_time_us":25799,"prepare.run_wall_time_us":566970,"raft.queue_time_us":353538,"raft.run_cpu_time_us":16171,"raft.run_wall_time_us":338676,"replication_time_us":942329,"spinlock_wait_cycles":116673920,"thread_start_us":689819,"threads_started":5,"wal-append.queue_time_us":483901,"wal-append.run_cpu_time_us":54914,"wal-append.run_wall_time_us":2390721}]]}
I20260709 13:08:16.866881 14793 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.879171 14793 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 16, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 16 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:16.889271 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.889400 22869 raft_consensus.cc:3055] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 LEADER]: Stepping down as leader of term 27
I20260709 13:08:16.788161 14861 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.889878 22869 raft_consensus.cc:740] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:08:16.890657 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 102587us
I20260709 13:08:16.890774 22869 consensus_queue.cc:260] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.892489 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.894435 22771 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.892850 22769 consensus_queue.cc:1048] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:16.891281 14793 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 19 to 22, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 22 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:16.893234 22885 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:16.894311 22869 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:16.898828 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.899451 15037 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:16.897269 14861 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.900605 14861 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:16.901356 22873 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:16.902011 22873 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:16.902628 22873 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:08:16.888403 14859 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 44512.8us
I20260709 13:08:16.903499 22873 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.905275 15547 raft_consensus.cc:1275] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:16.905414 14859 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:16.906823 22872 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:16.907159 22096 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:16.907308 22872 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:16.907732 22096 consensus_queue.cc:1048] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:16.908291 22096 consensus_queue.cc:1243] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 13:08:16.908211 22872 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.909075 15037 raft_consensus.cc:2468] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:16.910197 14793 catalog_manager.cc:5697] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:16.912644 15549 pending_rounds.cc:85] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Aborting all ops after (but not including) 13
I20260709 13:08:16.917232 15549 pending_rounds.cc:107] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 13:08:16.917089 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:16.918216 15549 raft_consensus.cc:2889] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:08:16.914677 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:16.919050 15037 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:16.919991 14861 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:16.923830 22885 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:16.924311 22885 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:16.925316 22885 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:16.919857 14793 catalog_manager.cc:5697] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 18, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 18 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:16.927778 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.929230 14861 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.930431 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:16.935793 15037 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:16.938892 22286 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:08:16.947788 14793 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:16.937143 14936 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:16.949883 15516 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:16.951565 15037 raft_consensus.cc:1240] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 26. Current term is 27. Ops: []
I20260709 13:08:16.955219 22096 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:16.955536 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.955888 22096 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:16.958264 15043 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 13:08:16.936437 22500 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 13:08:16.958951 15513 leader_election.cc:336] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.959375 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:16.960427 15513 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.943223 22368 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:16.960884 15513 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:16.961541 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.962417 15044 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 27. Current term is 28. Ops: []
I20260709 13:08:16.962725 14793 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 18 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:16.945935 14933 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:16.967777 15037 raft_consensus.cc:1240] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:16.967398 22096 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:16.972015 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.973170 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.976333 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.976557 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.978159 15548 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:16.978179 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.983548 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:16.986714 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.989032 15548 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:16.989380 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.991863 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e466470834d346b8a99b98e620844e85" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:16.994392 15548 raft_consensus.cc:1240] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 27. Current term is 28. Ops: [27.21-27.21]
I20260709 13:08:16.996292 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b0b2aff5c14c50aac568802fb9aa6c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:17.003926 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:17.003811 14793 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:17.004737 15513 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.005270 15513 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.005777 14793 catalog_manager.cc:5697] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:17.006789 15513 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.007171 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:17.012835 14961 raft_consensus.cc:1240] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 18. Current term is 19. Ops: []
I20260709 13:08:16.969857 22777 raft_consensus.cc:2804] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:17.014462 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:17.018705 15043 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:17.018818 14933 consensus_peers.cc:597] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:17.011739 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.015947 14964 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260709 13:08:17.021405 15007 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:17.022284 15007 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.013680 14793 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 19 to 20, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 20 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:17.022703 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:17.030359 22681 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 13:08:17.027110 22500 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260709 13:08:17.024621 22873 consensus_queue.cc:1059] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:08:17.027170 22777 raft_consensus.cc:697] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
W20260709 13:08:17.036628 15515 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.036679 22867 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:17.037079 22777 consensus_queue.cc:237] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:17.029814 14793 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:17.043462 22872 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:17.044610 22873 consensus_queue.cc:1243] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:08:17.045089 22873 raft_consensus.cc:3055] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:08:17.045463 22873 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:17.046280 22873 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:17.049059 15043 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 19.
I20260709 13:08:17.022812 22444 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:17.052284 14793 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:17.028342 14841 auto_rebalancer.cc:893] Removing replace marker failed: Replica eb4a5ac9f0c5425b92051187b939860f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 21 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:17.057209 14841 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 13:08:17.058827 14793 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 16 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 20 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.063607 14793 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 13 to 14, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 14 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.064625 22873 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Advancing to term 19
W20260709 13:08:17.069355 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 57675.4us
W20260709 13:08:17.072135 14933 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:17.057523 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 13:08:17.073694 14861 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:17.050504 22712 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:17.092063 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.091216 14793 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 17 to 19, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 19 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.095486 14793 catalog_manager.cc:5697] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 16 to 19, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:17.100672 14861 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:17.101205 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 71956.6us
W20260709 13:08:17.102710 15007 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.102787 22885 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:17.103638 22885 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.105541 14861 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:17.106084 22921 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:08:17.106547 22869 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.109939 14793 catalog_manager.cc:5697] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 21 to 24, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 24 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:17.113255 14793 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:17.095242 22701 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:17.116377 22701 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:17.116753 22701 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:17.126019 14793 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 reported cstate change: config changed from index 7 to 8, term changed from 9 to 13, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to <none>, VOTER eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) evicted. New cstate: current_term: 13 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:17.127689 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.103171 15007 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:17.142226 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:17.144182 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:17.148753 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:17.139585 22789 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 13:08:17.152715 14861 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.143151 22701 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:17.141376 22368 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:08:17.169955 22286 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:17.150220 22500 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:17.150390 22885 consensus_queue.cc:1059] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.038s
W20260709 13:08:17.205973 22924 log.cc:927] Time spent T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:08:17.202715 22869 consensus_queue.cc:1059] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260709 13:08:17.250679 22873 raft_consensus.cc:3055] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:17.251139 22873 raft_consensus.cc:740] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:17.251874 22701 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:17.252046 22873 consensus_queue.cc:260] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:17.254443 22872 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.254997 22872 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:17.257308 22872 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:17.269685 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 85458us
I20260709 13:08:17.270608 14861 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.272553 14861 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:17.268704 22926 log.cc:927] Time spent T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
W20260709 13:08:17.282095 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 275306us
I20260709 13:08:17.282354 14861 leader_election.cc:304] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.282949 22286 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:17.284348 14861 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.285104 22701 raft_consensus.cc:2749] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:17.279510 22927 log.cc:927] Time spent T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:17.303929 22368 raft_consensus.cc:3055] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 LEADER]: Stepping down as leader of term 26
I20260709 13:08:17.311870 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:17.278682 22885 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:17.360102 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:17.364598 14964 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:17.369393 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 58722.2us
W20260709 13:08:17.370146 15513 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.370560 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:17.373095 22701 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.377561 22867 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.365087 22368 raft_consensus.cc:740] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
W20260709 13:08:17.387574 15513 leader_election.cc:336] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.388033 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.393476 22873 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:17.394273 22368 consensus_queue.cc:260] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:17.398200 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 120495us
I20260709 13:08:17.400259 22368 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:17.416765 14964 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:17.424464 15541 raft_consensus.cc:1275] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 13:08:17.390053 22867 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:17.434547 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 47003.3us
W20260709 13:08:17.435292 15513 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:17.435461 14859 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.435742 15513 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:17.436260 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 151976us
I20260709 13:08:17.444182 14859 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:17.445338 22286 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:17.445799 22286 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:17.446977 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:17.447592 15044 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:17.434280 22725 consensus_queue.cc:1048] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:08:17.456823 15549 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:17.458581 15545 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:17.442721 22866 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:17.463100 15513 leader_election.cc:336] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.463528 22286 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:17.477425 15513 leader_election.cc:336] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:17.477619 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:17.480935 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:17.482833 15043 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:17.491264 22946 raft_consensus.cc:493] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:17.491848 22946 raft_consensus.cc:515] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:17.485659 22939 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.476749 22869 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:17.507576 15044 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:17.481922 22885 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:17.519176 22938 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:17.550243 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 72711.5us
W20260709 13:08:17.552086 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 61005.9us
I20260709 13:08:17.517315 22869 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:17.515470 22939 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:17.580108 22286 consensus_queue.cc:1059] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:17.593726 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 131430us
I20260709 13:08:17.553845 22885 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:17.613521 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62422.9us
I20260709 13:08:17.644384 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.609716 22942 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:17.681285 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:17.701783 22942 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:17.702435 22872 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:17.700850 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 56528.4us
I20260709 13:08:17.710970 14861 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.724578 22286 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:17.726337 22286 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:17.728878 15037 raft_consensus.cc:1275] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:17.644125 22701 raft_consensus.cc:3055] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 13:08:17.740906 14861 leader_election.cc:304] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.723013 22869 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:17.748900 14861 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:17.736166 22701 raft_consensus.cc:740] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:17.768865 22286 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:17.769657 22286 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:08:17.771508 22286 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 13:08:17.780023 13792 thread.cc:527] Waited for 2000ms trying to join with heartbeat (tid 14920)
I20260709 13:08:17.754791 22872 raft_consensus.cc:2749] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:17.746492 22874 consensus_queue.cc:1048] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 13:08:17.772476 22946 leader_election.cc:290] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:17.784709 22873 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:17.809283 14961 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:17.819100 15044 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:08:17.840893 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:17.810410 22873 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:17.852712 14933 consensus_peers.cc:597] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:17.857580 22947 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:08:17.871754 22885 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:17.842672 22701 consensus_queue.cc:260] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:17.873603 22701 raft_consensus.cc:3060] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:17.876830 15542 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:17.877446 22873 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:17.879328 22956 log.cc:927] Time spent T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:08:17.882810 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:17.883946 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:17.885434 15040 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:08:17.886201 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:17.891659 14861 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:17.895293 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d3b63f39d444317899acc30914f8801" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:17.901633 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:17.919580 14965 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:17.886761 15042 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:17.926891 22885 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:17.929309 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44457.4us
I20260709 13:08:17.931486 22645 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:08:17.936497 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:17.937814 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:17.938884 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:17.939765 15547 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:17.941059 22962 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:17.971690 22368 consensus_meta.cc:287] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: Time spent flushing consensus metadata: real 0.570s	user 0.003s	sys 0.008s
I20260709 13:08:17.978385 22938 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:17.862110 22939 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:18.021919 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 85717.3us
W20260709 13:08:18.028970 15007 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.032063 15007 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:18.038888 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:18.043143 15513 leader_election.cc:336] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:18.044462 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.044917 15513 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.047224 14861 leader_election.cc:304] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.070932 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:18.072353 15513 leader_election.cc:336] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:18.073589 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.074061 15513 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.063290 22885 raft_consensus.cc:2749] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:18.060329 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
W20260709 13:08:18.104625 14861 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 44409.3us
I20260709 13:08:18.068925 22681 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:08:18.114850 22368 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:18.076651 22444 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260709 13:08:18.054069 22932 consensus_queue.cc:1059] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 13:08:18.116114 14933 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.103902 22874 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:18.112118 22885 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 13:08:18.138631 14861 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.124238 22962 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.138293 22932 consensus_queue.cc:1243] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [LEADER]: Peer 58ee9fe38eb8453098f6d964e7675e79 log is divergent from this leader: its last log entry 21.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 13:08:18.183357 14860 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:18.138125 22885 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.170866 22946 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:18.240998 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 210308us
I20260709 13:08:18.208698 22885 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:18.244618 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 171077us
I20260709 13:08:18.246053 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:18.248381 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:18.250582 15513 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.171880 22962 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.261322 15042 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260709 13:08:18.257617 15513 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:18.269184 15513 leader_election.cc:336] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.270637 14963 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
W20260709 13:08:18.271052 22966 log.cc:927] Time spent T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 13:08:18.271723 15513 leader_election.cc:336] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.243083 22946 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.271574 22950 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:08:18.272684 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:18.276060 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.276446 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:18.272375 22933 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:18.281631 15513 leader_election.cc:336] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.293359 22962 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.294042 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:18.297224 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:18.300374 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:18.311344 22946 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.312758 15549 raft_consensus.cc:1240] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 19. Current term is 20. Ops: []
I20260709 13:08:18.313721 15038 raft_consensus.cc:1240] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Rejecting Update request from peer e4938453819c469599f515b22d92fe27 for earlier term 20. Current term is 21. Ops: []
I20260709 13:08:18.316325 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:18.317093 15036 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 28.
I20260709 13:08:18.318480 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:18.320086 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.320815 15545 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 28.
I20260709 13:08:18.321803 22701 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:08:18.299048 22885 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:18.326815 15513 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 185 similar messages]
I20260709 13:08:18.340878 22942 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.328176 22701 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.345853 22885 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.346477 22874 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.350582 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:18.351197 15037 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.352054 14859 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.353472 22953 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:18.357070 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 124871us
I20260709 13:08:18.361474 22939 raft_consensus.cc:3055] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:18.361899 22939 raft_consensus.cc:740] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:18.362197 14859 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.342815 22960 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:18.365723 22960 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:18.366782 22885 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:18.371294 15037 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:18.363336 14859 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.379783 14859 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.362740 22939 consensus_queue.cc:260] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.384604 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:18.385212 15542 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.386646 22962 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:18.391598 22885 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:08:18.393559 15542 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:18.383488 22953 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:18.382634 14861 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:18.411145 22946 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:18.411705 22946 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:18.411796 22939 raft_consensus.cc:3060] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:18.412631 22946 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.375137 22701 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:08:18.426496 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:18.464340 14933 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.466635 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:18.469048 15044 raft_consensus.cc:2393] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 21: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:18.454919 22960 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:18.512609 22701 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.527230 22701 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 29 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.513074 22885 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.531880 22885 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.557994 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:18.558840 15545 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:18.566712 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:18.567579 15042 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:08:18.572283 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:18.576236 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.595357 22885 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.607156 15042 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 29.
I20260709 13:08:18.607237 15545 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 29.
W20260709 13:08:18.621228 22978 log.cc:927] Time spent T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.284s	user 0.009s	sys 0.000s
I20260709 13:08:18.637424 14861 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:18.610688 22885 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:18.643163 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:18.651046 14933 consensus_peers.cc:597] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.658787 22368 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 29 FOLLOWER]: Leader election won for term 29
I20260709 13:08:18.664139 22885 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.664522 22368 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 29 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:18.665740 22368 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.666590 22885 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.670408 22949 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.670961 22949 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.672922 22949 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.676584 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:18.685463 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.691659 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.694500 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.655763 22950 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.696054 22950 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:18.696514 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.698173 22950 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:18.702917 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:18.706734 22964 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:18.707324 22964 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.712400 22964 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:18.714330 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 241274us
I20260709 13:08:18.715965 14861 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.723112 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:18.726809 14933 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.742166 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:18.742834 14933 consensus_peers.cc:597] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.743824 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:18.747584 14936 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.747925 14861 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:18.749003 14933 consensus_peers.cc:597] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:18.750172 15007 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:18.722644 22962 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:18.752701 14933 consensus_peers.cc:597] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.752249 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:18.767344 22964 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.770125 22977 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:18.768297 22769 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:08:18.780825 13792 thread.cc:527] Waited for 3000ms trying to join with heartbeat (tid 14920)
W20260709 13:08:18.784049 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.789258 22885 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.789814 22885 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:18.791882 22885 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:18.793026 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:18.801473 14859 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.802218 22962 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.803656 14859 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.804350 22962 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:18.809880 14933 consensus_peers.cc:597] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.814520 22962 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:18.815145 22962 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.817386 22962 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:18.817709 14933 consensus_peers.cc:597] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.819109 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.838944 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:18.840440 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5af46e976c54b8ba2b6e09ce06690af" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:18.841710 22962 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.842267 22962 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:18.844293 22962 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:18.845486 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:18.845692 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.846093 15040 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:18.848472 14861 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:18.849758 22962 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:18.850167 22962 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.850554 22962 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.815186 22977 raft_consensus.cc:2749] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.858104 22962 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:18.866608 14859 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:18.877810 14859 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.878443 22368 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.879438 22368 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:18.867676 22964 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.880402 22964 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.882566 22964 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.884582 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:18.886281 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.889200 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:18.891059 15040 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.901189 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:18.904062 14964 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 21.
I20260709 13:08:18.901790 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:18.905229 14963 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:18.902161 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:18.902948 15543 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:18.909953 22964 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:18.917157 14963 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:18.900873 22962 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:18.919567 14859 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.898152 15040 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 22.
I20260709 13:08:18.920648 14859 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:18.921617 22964 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:18.922327 22964 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 13:08:18.922807 22964 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:18.923621 22964 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:18.934139 15042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56542
I20260709 13:08:18.935057 15042 raft_consensus.cc:606] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Received request to transfer leadership
I20260709 13:08:18.936285 22964 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.936810 22964 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.938902 22964 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.940187 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.942411 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:18.943042 15042 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 27.
I20260709 13:08:18.943991 15040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56542
I20260709 13:08:18.944587 15040 raft_consensus.cc:606] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Received request to transfer leadership
I20260709 13:08:18.946324 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.947695 22964 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 13:08:18.948061 22964 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:18.948396 22964 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:18.962090 22885 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:18.962827 22885 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.965103 22885 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:18.966151 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:18.972612 14933 consensus_peers.cc:597] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:18.973377 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:18.974851 14861 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:18.975788 22885 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:18.985778 15040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:56542
I20260709 13:08:18.986353 15040 raft_consensus.cc:606] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Received request to transfer leadership
I20260709 13:08:18.989243 15042 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 13:08:18.986986 22964 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:18.992138 22962 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:18.995851 14841 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 13:08:18.996284 14841 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for f85c193fa13b46d9bceea2295f514c29 already in progress
W20260709 13:08:18.996578 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for f85c193fa13b46d9bceea2295f514c29 already in progress
I20260709 13:08:19.000999 22964 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 28 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:19.002758 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:19.003427 15044 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Advancing to term 28
I20260709 13:08:19.007853 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:19.008463 15543 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Advancing to term 28
I20260709 13:08:19.022540 15543 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 28.
I20260709 13:08:19.023540 14861 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27; no voters: 
I20260709 13:08:19.026037 22962 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 13:08:19.026592 22962 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 28 LEADER]: Becoming Leader. State: Replica: e4938453819c469599f515b22d92fe27, State: Running, Role: LEADER
I20260709 13:08:19.027426 22962 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.030584 14788 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 13 to 12, leader changed from <none> to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 12 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.032392 14788 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 20 to 23, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 23 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.037189 14788 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 20 to 23, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 23 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.038445 14788 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 20 to 21, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 21 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.042320 14788 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.024231 15044 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e4938453819c469599f515b22d92fe27 in term 28.
I20260709 13:08:19.045217 22964 raft_consensus.cc:493] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.057497 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet c8fa9dae6116418f8b520fc591ae5757 with delete_type TABLET_DATA_TOMBSTONED (TS eb4a5ac9f0c5425b92051187b939860f not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:56542
I20260709 13:08:19.057543 14793 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47184 (request call id 324) took 8148 ms. Trace:
I20260709 13:08:19.062417 14793 rpcz_store.cc:276] 0709 13:08:10.918695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:10.938441 (+ 19746us) service_pool.cc:224] Handling call
0709 13:08:19.057464 (+8119023us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:17.409356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:17.410170 (+   814us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:17.410241 (+    71us) write_op.cc:435] Acquired schema lock
0709 13:08:17.410269 (+    28us) tablet.cc:662] Decoding operations
0709 13:08:17.516960 (+106691us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:17.550015 (+ 33055us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:17.552175 (+  2160us) tablet.cc:685] Acquiring locks for 25 operations
0709 13:08:17.952900 (+400725us) tablet.cc:701] Row locks acquired
0709 13:08:17.952958 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:08:17.953144 (+   186us) write_op.cc:270] Start()
0709 13:08:17.953298 (+   154us) write_op.cc:276] Timestamp: P: 1783602497953076 usec, L: 0
0709 13:08:17.953319 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:17.954201 (+   882us) log.cc:844] Serialized 9723 byte log entry
0709 13:08:18.471390 (+517189us) op_driver.cc:464] REPLICATION: finished
0709 13:08:18.617541 (+146151us) write_op.cc:301] APPLY: starting
0709 13:08:18.617640 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:18.780568 (+162928us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:18.780658 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:18.882829 (+102171us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:18.883193 (+   364us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=50,key_file_lookups=50,delta_file_lookups=50,mrs_lookups=0
0709 13:08:18.883236 (+    43us) write_op.cc:312] APPLY: finished
0709 13:08:18.883771 (+   535us) log.cc:844] Serialized 220 byte log entry
0709 13:08:18.883945 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.884139 (+   194us) write_op.cc:454] Released schema lock
0709 13:08:18.884199 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:18.921789 (+ 37590us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:18.921820 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":251603,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":141704,"apply.run_cpu_time_us":33151,"apply.run_wall_time_us":304216,"cfile_cache_hit":102,"cfile_cache_hit_bytes":108627,"num_ops":25,"prepare.queue_time_us":109397,"prepare.run_cpu_time_us":108790,"prepare.run_wall_time_us":755983,"raft.queue_time_us":144060,"raft.run_cpu_time_us":15938,"raft.run_wall_time_us":158860,"replication_time_us":496895,"thread_start_us":358478,"threads_started":4,"wal-append.queue_time_us":289393}]]}
I20260709 13:08:19.065452 22964 raft_consensus.cc:515] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.083343 22964 leader_election.cc:290] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:19.093050 22769 raft_consensus.cc:993] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: : Instructing follower 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:08:19.093740 22942 raft_consensus.cc:1081] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Signalling peer 58ee9fe38eb8453098f6d964e7675e79 to start an election
I20260709 13:08:19.104660 15542 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29"
dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
 from {username='slave'} at 127.0.0.1:52838
I20260709 13:08:19.105466 15542 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:08:19.105906 15542 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
W20260709 13:08:19.110026 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.121399 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:19.132493 15549 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 13:08:19.133309 22885 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.133894 22885 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.138352 22885 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:19.138418 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:19.140177 22964 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 13:08:19.148037 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80a1bdc86202444db87b94ea818eedd5" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:19.156978 23004 log.cc:927] Time spent T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:08:19.157923 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:19.162540 14861 leader_election.cc:304] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:19.162865 15040 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260709 13:08:19.163834 14861 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:19.146904 15542 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.163983 22964 raft_consensus.cc:2749] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:19.173374 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:19.174005 14961 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:19.176934 15542 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:19.179647 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: true dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:19.180207 15040 raft_consensus.cc:3055] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:08:19.180446 15040 raft_consensus.cc:740] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:19.182281 15040 consensus_queue.cc:260] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.183671 15040 raft_consensus.cc:3060] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:19.179498 22945 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:19.171700 22950 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 19, Time since last communication: 0.008s
W20260709 13:08:19.186630 14933 consensus_peers.cc:597] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.196149 15040 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
W20260709 13:08:19.209949 15513 leader_election.cc:336] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:19.210291 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:19.229423 14961 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:19.230790 15514 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:19.226725 23007 tablet_replica.cc:333] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:19.264118 23007 raft_consensus.cc:2243] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.255328 22865 raft_consensus.cc:2804] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election won for term 21
W20260709 13:08:19.266374 14933 consensus_peers.cc:597] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.270015 23007 pending_rounds.cc:70] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Trying to abort 1 pending ops.
I20260709 13:08:19.270341 23007 pending_rounds.cc:77] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Aborting op as it isn't in flight: id { term: 10 index: 8 } timestamp: 7305635699127123968 op_type: NO_OP noop_request { }
I20260709 13:08:19.270794 23007 raft_consensus.cc:2889] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:19.268687 22865 raft_consensus.cc:697] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:19.271376 23007 raft_consensus.cc:2272] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.275923 22950 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.276605 22950 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:19.283747 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:19.295390 13792 tablet_replica.cc:333] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.272524 22865 consensus_queue.cc:237] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.303232 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:19.301452 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.305538 14861 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:19.306340 22945 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:19.309415 13792 raft_consensus.cc:2243] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.310041 13792 pending_rounds.cc:70] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Trying to abort 2 pending ops.
I20260709 13:08:19.310294 13792 pending_rounds.cc:77] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 20 index: 15 } timestamp: 7305635827459739648 op_type: NO_OP noop_request { }
I20260709 13:08:19.310681 13792 raft_consensus.cc:2889] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:19.315521 13792 pending_rounds.cc:77] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305635784538615808 op_type: NO_OP noop_request { }
I20260709 13:08:19.315914 13792 raft_consensus.cc:2889] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:19.316318 13792 raft_consensus.cc:2272] T 156c010162bf4cb99b535677eccb2740 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.315718 23007 ts_tablet_manager.cc:1916] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:08:19.315428 22950 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:19.334546 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.335800 22950 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:19.333325 13792 tablet_replica.cc:333] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.336755 22950 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.344296 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:19.351816 13792 raft_consensus.cc:2243] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.352819 13792 pending_rounds.cc:70] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Trying to abort 1 pending ops.
I20260709 13:08:19.352950 22950 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:19.353112 13792 pending_rounds.cc:77] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 22 index: 13 } timestamp: 7305635835599220736 op_type: NO_OP noop_request { }
I20260709 13:08:19.353530 13792 raft_consensus.cc:2889] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:19.353901 13792 raft_consensus.cc:2272] T 96fa5275273743d0973b36e2f0c784cb P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.366694 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:19.368443 13792 tablet_replica.cc:333] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.369484 13792 raft_consensus.cc:2243] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Raft consensus shutting down.
W20260709 13:08:19.370208 14788 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47190 (request call id 332) took 14821 ms (client timeout 15000 ms). Trace:
W20260709 13:08:19.371542 14788 rpcz_store.cc:269] 0709 13:08:04.548877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:04.550792 (+  1915us) service_pool.cc:224] Handling call
0709 13:08:19.370152 (+14819360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:19.182756 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:19.188830 (+  6074us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:19.188861 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:08:19.188874 (+    13us) tablet.cc:662] Decoding operations
0709 13:08:19.189549 (+   675us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:19.189589 (+    40us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:19.189611 (+    22us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:08:19.190179 (+   568us) tablet.cc:701] Row locks acquired
0709 13:08:19.190192 (+    13us) write_op.cc:260] PREPARE: finished
0709 13:08:19.190302 (+   110us) write_op.cc:270] Start()
0709 13:08:19.190387 (+    85us) write_op.cc:276] Timestamp: P: 1783602499190268 usec, L: 0
0709 13:08:19.190401 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:08:19.190939 (+   538us) log.cc:844] Serialized 2054 byte log entry
0709 13:08:19.302959 (+112020us) op_driver.cc:464] REPLICATION: finished
0709 13:08:19.303329 (+   370us) write_op.cc:301] APPLY: starting
0709 13:08:19.303444 (+   115us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:19.306264 (+  2820us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:19.306354 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:19.309345 (+  2991us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:19.309554 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:08:19.309604 (+    50us) write_op.cc:312] APPLY: finished
0709 13:08:19.309839 (+   235us) log.cc:844] Serialized 57 byte log entry
0709 13:08:19.310591 (+   752us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.310689 (+    98us) write_op.cc:454] Released schema lock
0709 13:08:19.310735 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":30981,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":98,"apply.run_cpu_time_us":7163,"apply.run_wall_time_us":7743,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20900,"num_ops":5,"prepare.queue_time_us":114747,"prepare.run_cpu_time_us":3071,"prepare.run_wall_time_us":11369,"replication_time_us":112374,"thread_start_us":96297,"threads_started":1}]]}
I20260709 13:08:19.374752 14792 catalog_manager.cc:5697] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 19 to 21, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.378059 14861 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:19.378798 13792 raft_consensus.cc:2272] T 290e1d2493f34d57807c1a358aa0f71e P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.381803 22950 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:19.385722 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 9 to 12, term changed from 18 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to <none>, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.390002 14792 catalog_manager.cc:5697] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.392903 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 20 to 26. New cstate: current_term: 26 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.394353 14792 catalog_manager.cc:5697] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 10 to 14, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 14 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.399659 13792 tablet_replica.cc:333] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.400666 13792 raft_consensus.cc:2243] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.401280 13792 raft_consensus.cc:2272] T c5af46e976c54b8ba2b6e09ce06690af P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.405546 23007 ts_tablet_manager.cc:1929] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 13:08:19.406148 23007 log.cc:1199] T c8fa9dae6116418f8b520fc591ae5757 P eb4a5ac9f0c5425b92051187b939860f: Deleting WAL directory at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/wals/c8fa9dae6116418f8b520fc591ae5757
I20260709 13:08:19.411794 14792 catalog_manager.cc:5697] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.414353 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 16 to 20, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 20 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.413544 13792 tablet_replica.cc:333] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.416289 13792 raft_consensus.cc:2243] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 29 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.416589 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet c8fa9dae6116418f8b520fc591ae5757 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:08:19.417375 13792 raft_consensus.cc:2272] T f7a1be4a55754b9baba160c70df7dc21 P e4938453819c469599f515b22d92fe27 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.419302 14792 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 19 to 20, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.422171 14792 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 19 to 21, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.425920 13792 tablet_replica.cc:333] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.426777 13792 raft_consensus.cc:2243] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.427757 13792 raft_consensus.cc:2272] T 8de39bcda9f4437d8538be04713851b1 P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.434651 14792 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:19.435494 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.439047 14792 catalog_manager.cc:5697] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 15 to 17, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.441327 14792 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 23 to 24, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 24 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:19.464692 14933 consensus_peers.cc:597] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.474244 13792 tablet_replica.cc:333] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.475258 13792 raft_consensus.cc:2243] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.479374 15549 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260709 13:08:19.488085 15007 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.492023 22873 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:19.504603 14791 catalog_manager.cc:5697] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 20, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.513103 13792 raft_consensus.cc:2272] T 7933f8a0325b4bf7a8bafc99c9284091 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.515517 14791 catalog_manager.cc:5697] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.517186 14791 catalog_manager.cc:5697] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 21 to 23, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 23 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.518808 14791 catalog_manager.cc:5697] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 21 to 24, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 24 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.520345 14791 catalog_manager.cc:5697] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 22 to 23, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 23 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.524982 14792 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:60458 (request call id 221) took 6133 ms. Trace:
I20260709 13:08:19.527158 14792 rpcz_store.cc:276] 0709 13:08:13.391515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:13.395030 (+  3515us) service_pool.cc:224] Handling call
0709 13:08:19.475790 (+6080760us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.475816 (+    26us) write_op.cc:454] Released schema lock
0709 13:08:19.524901 (+ 49085us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:19.449793 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:19.450340 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:19.450378 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:08:19.450397 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:19.451509 (+  1112us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:19.451575 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:19.451606 (+    31us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:08:19.452736 (+  1130us) tablet.cc:701] Row locks acquired
0709 13:08:19.452759 (+    23us) write_op.cc:260] PREPARE: finished
0709 13:08:19.452921 (+   162us) write_op.cc:270] Start()
0709 13:08:19.453041 (+   120us) write_op.cc:276] Timestamp: P: 1783602499452873 usec, L: 0
0709 13:08:19.453065 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:08:19.453744 (+   679us) log.cc:844] Serialized 4742 byte log entry
0709 13:08:19.456388 (+  2644us) op_driver.cc:464] REPLICATION: finished
0709 13:08:19.456875 (+   487us) write_op.cc:301] APPLY: starting
0709 13:08:19.456959 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:19.463820 (+  6861us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:19.463947 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:19.471483 (+  7536us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:19.471743 (+   260us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 13:08:19.471797 (+    54us) write_op.cc:312] APPLY: finished
0709 13:08:19.472145 (+   348us) log.cc:844] Serialized 113 byte log entry
0709 13:08:19.472985 (+   840us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.473142 (+   157us) write_op.cc:454] Released schema lock
0709 13:08:19.473201 (+    59us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":10305,"reported_tablets":41,"child_traces":[["op",{"apply.queue_time_us":279,"apply.run_cpu_time_us":15717,"apply.run_wall_time_us":16622,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50160,"num_ops":12,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":4252,"prepare.run_wall_time_us":13754,"replication_time_us":3186}]]}
I20260709 13:08:19.526082 14791 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.531949 14791 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.533538 14791 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 22 to 25. New cstate: current_term: 25 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.539376 13792 tablet_replica.cc:333] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.540387 13792 raft_consensus.cc:2243] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.541306 13792 raft_consensus.cc:2272] T 410c57dd04b546f3be0269aecdb13719 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.546747 14791 catalog_manager.cc:5697] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 17 to 19, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 19 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.548666 14791 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 22, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 22 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.553562 14791 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 21, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 21 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.550022 15040 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Refusing update from remote peer e4938453819c469599f515b22d92fe27: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
I20260709 13:08:19.560370 22950 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:19.563083 14791 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 24 to 25, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 25 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.570127 14791 catalog_manager.cc:5697] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 20, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 20 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:19.571803 14791 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 24, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 24 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:19.573419 14791 catalog_manager.cc:5697] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 20, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.579331 14791 catalog_manager.cc:5697] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.583849 22950 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.584419 22950 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:19.586480 22950 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:19.588102 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:19.591158 14791 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 20 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:19.594894 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:19.596748 13792 tablet_replica.cc:333] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.595713 14791 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 15 to 17, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 17 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.596410 14859 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:19.612864 22962 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:19.613629 14791 catalog_manager.cc:5697] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 22 to 26. New cstate: current_term: 26 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:19.609186 13792 raft_consensus.cc:2243] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.616562 13792 raft_consensus.cc:2272] T 5cbe935ec59f4f31a383418c80f8823b P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.615604 14791 catalog_manager.cc:5697] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 16, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 16 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.618470 14791 catalog_manager.cc:5697] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:19.623006 14791 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 23 to 25. New cstate: current_term: 25 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.628713 13792 tablet_replica.cc:333] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.632616 13792 raft_consensus.cc:2243] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.633188 13792 raft_consensus.cc:2272] T 80a1bdc86202444db87b94ea818eedd5 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.635926 14791 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 21, leader changed from <none> to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 21 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.648795 13792 tablet_replica.cc:333] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.650066 13792 raft_consensus.cc:2243] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.651152 13792 raft_consensus.cc:2272] T b7dd8999b5f24b039d0adbe5c24edbc3 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.654121 13792 tablet_replica.cc:333] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.654876 13792 raft_consensus.cc:2243] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 28 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.657631 13792 raft_consensus.cc:2272] T 060cd1347c834f27a9abc4cf6d5584a9 P e4938453819c469599f515b22d92fe27 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.661047 13792 tablet_replica.cc:333] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.666076 22962 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.666603 22962 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:19.669003 22962 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:19.670583 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:19.673883 13792 raft_consensus.cc:2243] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.674958 13792 raft_consensus.cc:2272] T 73ceb2cea7314e0cadb64aa9ccbad8de P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.675834 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 26 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:19.677558 13792 tablet_replica.cc:333] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.677476 14861 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:19.678611 22962 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:19.678737 13792 raft_consensus.cc:2243] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.679510 13792 raft_consensus.cc:2272] T e466470834d346b8a99b98e620844e85 P e4938453819c469599f515b22d92fe27 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.681895 13792 tablet_replica.cc:333] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.682657 13792 raft_consensus.cc:2243] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.683204 13792 raft_consensus.cc:2272] T 599606a370ab4d629b9cac083be835da P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.686014 13792 tablet_replica.cc:333] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.686707 13792 raft_consensus.cc:2243] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.687392 13792 raft_consensus.cc:2272] T 754b0ca0f8c0459c8b6f122a5ff76b39 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.689944 13792 tablet_replica.cc:333] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.690655 13792 raft_consensus.cc:2243] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.691188 13792 raft_consensus.cc:2272] T 7b35154b94cb40bc8e8f780311834ad6 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.693853 13792 tablet_replica.cc:333] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.694512 13792 raft_consensus.cc:2243] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.695012 13792 raft_consensus.cc:2272] T 146ff3031af843e3a501710c2301a015 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:19.704993 14933 consensus_peers.cc:597] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:19.721765 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:19.722401 13792 tablet_replica.cc:333] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.723249 13792 raft_consensus.cc:2243] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.723850 13792 raft_consensus.cc:2272] T 6eec3351a3e94e158c79a8784e2c6574 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.726610 13792 tablet_replica.cc:333] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.727355 13792 raft_consensus.cc:2243] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.728039 13792 raft_consensus.cc:2272] T f85c193fa13b46d9bceea2295f514c29 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.730521 13792 tablet_replica.cc:333] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.731241 13792 raft_consensus.cc:2243] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.820453 13792 raft_consensus.cc:2272] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.838351 14963 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:19.843384 22973 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:19.845516 13792 tablet_replica.cc:333] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.852092 13792 raft_consensus.cc:2243] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.857005 13792 raft_consensus.cc:2272] T 8b1d51e80f4e47638e5c23566e217993 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.867312 15040 raft_consensus.cc:1275] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 13:08:19.868893 22865 consensus_queue.cc:1048] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:19.875576 13792 tablet_replica.cc:333] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.876863 13792 raft_consensus.cc:2243] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.877553 13792 raft_consensus.cc:2272] T ebef2badb7124b9fa530c8877d638abe P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:19.883607 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:19.906075 14788 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.907859 14788 catalog_manager.cc:5697] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 15 to 16, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 16 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.909657 14788 catalog_manager.cc:5697] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 12 to 13, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 13 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.911206 14788 catalog_manager.cc:5697] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 18 to 21, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.912654 14788 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:19.914211 13792 tablet_replica.cc:333] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.915155 13792 raft_consensus.cc:2243] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:19.916275 13792 raft_consensus.cc:2272] T 6ab3877f8e9e4155a67e7a196ed5eb60 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.918982 13792 tablet_replica.cc:333] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.922897 14791 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47196 (request call id 324) took 3036 ms. Trace:
I20260709 13:08:19.923197 15025 tablet_service.cc:1558] Processing DeleteTablet for tablet c8fa9dae6116418f8b520fc591ae5757 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 7 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:56542
I20260709 13:08:19.924402 14788 catalog_manager.cc:5697] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.926193 14788 catalog_manager.cc:5697] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 17 to 21. New cstate: current_term: 21 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.928855 14791 rpcz_store.cc:276] 0709 13:08:16.886667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:16.914988 (+ 28321us) service_pool.cc:224] Handling call
0709 13:08:19.922797 (+3007809us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:08:19.689671 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:08:19.690248 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:08:19.690289 (+    41us) write_op.cc:435] Acquired schema lock
0709 13:08:19.690308 (+    19us) tablet.cc:662] Decoding operations
0709 13:08:19.692212 (+  1904us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:08:19.692275 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 13:08:19.692315 (+    40us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:08:19.694108 (+  1793us) tablet.cc:701] Row locks acquired
0709 13:08:19.694128 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:08:19.694264 (+   136us) write_op.cc:270] Start()
0709 13:08:19.694381 (+   117us) write_op.cc:276] Timestamp: P: 1783602499694224 usec, L: 0
0709 13:08:19.694402 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:08:19.695122 (+   720us) log.cc:844] Serialized 9048 byte log entry
0709 13:08:19.697786 (+  2664us) op_driver.cc:464] REPLICATION: finished
0709 13:08:19.698233 (+   447us) write_op.cc:301] APPLY: starting
0709 13:08:19.698308 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:08:19.716070 (+ 17762us) tablet.cc:1370] finished BulkCheckPresence
0709 13:08:19.716186 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:08:19.863638 (+147452us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:08:19.863935 (+   297us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0709 13:08:19.863982 (+    47us) write_op.cc:312] APPLY: finished
0709 13:08:19.864371 (+   389us) log.cc:844] Serialized 204 byte log entry
0709 13:08:19.864539 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.864724 (+   185us) write_op.cc:454] Released schema lock
0709 13:08:19.864785 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 13:08:19.889594 (+ 24809us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:08:19.889629 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7362,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":246,"apply.run_cpu_time_us":28552,"apply.run_wall_time_us":191311,"cfile_cache_hit":92,"cfile_cache_hit_bytes":96140,"num_ops":23,"prepare.queue_time_us":44146,"prepare.run_cpu_time_us":5733,"prepare.run_wall_time_us":5734,"replication_time_us":3278}]]}
I20260709 13:08:19.927515 14788 catalog_manager.cc:5697] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 16 to 21, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 21 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.937556 14788 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 16 to 19, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.939165 14788 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } }
I20260709 13:08:19.941036 14788 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 17 to 19, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 19 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:19.942597 14780 catalog_manager.cc:5028] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): tablet c8fa9dae6116418f8b520fc591ae5757 (table test-workload [id=06e5a638f129436f84e3070b4f75281b]) successfully deleted
I20260709 13:08:19.930423 13792 raft_consensus.cc:2243] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.944554 13792 raft_consensus.cc:2272] T b1b0b2aff5c14c50aac568802fb9aa6c P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.944285 14788 catalog_manager.cc:5697] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 20 to 22, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 22 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:19.945725 22950 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:19.946238 22950 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:19.948349 22950 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:19.949669 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:19.952165 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:19.953861 14861 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:19.954979 22950 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:19.976724 13792 tablet_replica.cc:333] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:19.983567 13792 raft_consensus.cc:2243] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:19.984181 13792 raft_consensus.cc:2272] T 83edd178ff3943b58ccf199ddc331aec P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:19.986606 13792 tablet_replica.cc:333] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.002030 13792 raft_consensus.cc:2243] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:20.010006 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.013186 14791 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 26 to 29, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 29 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.015578 14791 catalog_manager.cc:5697] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 14 to 17, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.017081 14791 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 21 to 28, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 28 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.018770 14791 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.020328 14791 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 16 to 18, leader changed from 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) to e4938453819c469599f515b22d92fe27 (127.13.120.1). New cstate: current_term: 18 leader_uuid: "e4938453819c469599f515b22d92fe27" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.021716 14791 catalog_manager.cc:5697] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 18 to 21, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.023856 14791 catalog_manager.cc:5697] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 21, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 21 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:20.027375 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.029488 22950 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:20.030838 22950 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.033614 22950 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:20.005173 13792 raft_consensus.cc:2272] T 1ecb36ffe5e640f88b50155fa361883d P e4938453819c469599f515b22d92fe27 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.034485 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:20.036132 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:20.036748 13792 tablet_replica.cc:333] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.039554 13792 raft_consensus.cc:2243] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.040184 13792 raft_consensus.cc:2272] T b9511e929bc448349baf940df42e2a22 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.044917 14859 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:20.046568 22962 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:20.048769 13792 tablet_replica.cc:333] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27: stopping tablet replica
W20260709 13:08:20.066272 14933 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.068374 22950 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:20.068974 22950 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:20.073179 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:20.075814 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:20.077317 14859 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:20.078101 22962 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:20.078130 22950 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.079933 13792 raft_consensus.cc:2243] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:20.081400 13792 raft_consensus.cc:2272] T 770c4e1c2abb48cba0a9b362f6be74f5 P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.100244 13792 tablet_replica.cc:333] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.101084 13792 raft_consensus.cc:2243] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.101686 13792 raft_consensus.cc:2272] T c8fa9dae6116418f8b520fc591ae5757 P e4938453819c469599f515b22d92fe27 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.114331 15040 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.132294 13792 tablet_replica.cc:333] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.133401 13792 raft_consensus.cc:2243] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:20.134495 13792 raft_consensus.cc:2272] T 3ac8b7ea8eec4d01847e30ae2626afd0 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:20.144032 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.156030 22950 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:20.156725 22950 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.159150 22950 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:20.160780 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:20.163720 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "e4938453819c469599f515b22d92fe27" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:20.188555 14963 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:20.190506 22943 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:20.197747 15549 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 13:08:20.200277 22943 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:20.185828 14861 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e4938453819c469599f515b22d92fe27; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:20.204334 22950 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:20.215574 22949 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 12 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.217126 14963 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.226581 14780 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 754b0ca0f8c0459c8b6f122a5ff76b39 with cas_config_opid_index 12: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:20.234611 14792 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index 12 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 21 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:20.251732 13792 tablet_replica.cc:333] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.252910 13792 raft_consensus.cc:2243] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.264226 13792 raft_consensus.cc:2272] T be840274e2c843b9b2b9f24277dca78d P e4938453819c469599f515b22d92fe27 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:20.296562 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 754b0ca0f8c0459c8b6f122a5ff76b39: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 13:08:20.311585 13792 tablet_replica.cc:333] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.318311 13792 raft_consensus.cc:2243] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.323254 14963 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:20.337289 15549 raft_consensus.cc:2955] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 12 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:20.342006 13792 raft_consensus.cc:2272] T 77cfe8a6078741239e2d788a50d260dc P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.350883 15040 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 13:08:20.352470 22997 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 13:08:20.354568 14933 consensus_peers.cc:597] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.360901 13792 tablet_replica.cc:333] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.362681 13792 raft_consensus.cc:2243] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.363329 13792 raft_consensus.cc:2272] T 376f02b12a354291b7600c9c176e3885 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.369192 13792 tablet_replica.cc:333] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.370430 22997 raft_consensus.cc:2955] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Committing config change with OpId 24.18: config changed from index -1 to 18, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:08:20.371879 14936 consensus_peers.cc:597] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b4b44d3457824f63aaf8c5cafbd75ea0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.371650 13792 raft_consensus.cc:2243] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.377756 13792 raft_consensus.cc:2272] T 46876532b5b6444ba4fbaa536a316857 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.380704 13792 tablet_replica.cc:333] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.381630 15040 raft_consensus.cc:2955] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Committing config change with OpId 24.18: config changed from index -1 to 18, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
W20260709 13:08:20.404693 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.404994 13792 raft_consensus.cc:2243] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.406081 13792 raft_consensus.cc:2272] T 5ae8a41be2704a038fb65d4e543a826c P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.416275 14963 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:20.420863 13792 tablet_replica.cc:333] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.421708 13792 raft_consensus.cc:2243] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.425613 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 18, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 24 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:08:20.445346 13792 raft_consensus.cc:2272] T cbe1d22f90c742fd86d8bd93e5d59e59 P e4938453819c469599f515b22d92fe27 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.448086 13792 tablet_replica.cc:333] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.448800 13792 raft_consensus.cc:2243] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.449304 13792 raft_consensus.cc:2272] T 0d3b63f39d444317899acc30914f8801 P e4938453819c469599f515b22d92fe27 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:20.466019 14933 consensus_peers.cc:597] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.469970 22951 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.470865 22951 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:20.476536 22951 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.482206 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:20.477353 13792 tablet_replica.cc:333] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.485841 13792 raft_consensus.cc:2243] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:20.486819 13792 raft_consensus.cc:2272] T 4db89b17bfcd40e0a2e2d53f7cf21079 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.489166 13792 tablet_replica.cc:333] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.489845 13792 raft_consensus.cc:2243] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.490350 13792 pending_rounds.cc:70] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Trying to abort 1 pending ops.
I20260709 13:08:20.490571 13792 pending_rounds.cc:77] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 23 index: 16 } timestamp: 7305635765375574016 op_type: NO_OP noop_request { }
I20260709 13:08:20.490906 13792 raft_consensus.cc:2889] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
W20260709 13:08:20.501302 14933 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:20.507682 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.511111 14933 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:20.491238 13792 raft_consensus.cc:2272] T b4b44d3457824f63aaf8c5cafbd75ea0 P e4938453819c469599f515b22d92fe27 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.513443 22997 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:20.514379 13792 tablet_replica.cc:333] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.515339 13792 raft_consensus.cc:2243] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:20.518541 14936 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 -> Peer 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473): Couldn't send request to peer 58ee9fe38eb8453098f6d964e7675e79. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b1d51e80f4e47638e5c23566e217993. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:20.522856 14933 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:20.524338 15040 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 13:08:20.525851 22977 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:08:20.551476 13792 raft_consensus.cc:2272] T 205008a787ca45349273b1e8daaebdf5 P e4938453819c469599f515b22d92fe27 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.554251 13792 tablet_replica.cc:333] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.554970 13792 raft_consensus.cc:2243] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:20.566130 22949 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.566890 22949 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.570433 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:20.571645 22951 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:08:20.576084 15040 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index -1 to 13, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:08:20.578598 22949 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:20.583732 15007 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:20.584071 14858 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:20.584192 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:20.585549 23024 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:20.601698 14792 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: config changed from index -1 to 13, NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) added. New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } }
I20260709 13:08:20.603120 13792 raft_consensus.cc:2272] T 338c720b04aa4c14b53937055c254e24 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.619652 13792 tablet_replica.cc:333] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.620373 13792 raft_consensus.cc:2243] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.625829 13792 pending_rounds.cc:70] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Trying to abort 1 pending ops.
I20260709 13:08:20.626091 13792 pending_rounds.cc:77] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 19 index: 15 } timestamp: 7305635779058225152 op_type: NO_OP noop_request { }
I20260709 13:08:20.626466 13792 raft_consensus.cc:2889] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:20.626824 13792 raft_consensus.cc:2272] T 7d441a969a644366b3cb4d386d7273e1 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.637061 22865 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.637670 22865 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.639701 13792 tablet_replica.cc:333] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.639837 22865 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.641706 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:20.642403 15040 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:08:20.643961 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:20.644701 22865 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:20.645140 15513 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:20.645157 22865 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.645951 22865 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.653959 13792 raft_consensus.cc:2243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.654888 13792 raft_consensus.cc:2272] T 7d87ff4cfb034c7eb5e9fdb522974b90 P e4938453819c469599f515b22d92fe27 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.657308 22865 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:20.664026 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:20.665387 13792 tablet_replica.cc:333] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: stopping tablet replica
I20260709 13:08:20.680227 13792 raft_consensus.cc:2243] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.680900 13792 pending_rounds.cc:70] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Trying to abort 1 pending ops.
I20260709 13:08:20.681178 13792 pending_rounds.cc:77] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 18 index: 11 } timestamp: 7305635753917571072 op_type: NO_OP noop_request { }
I20260709 13:08:20.681520 13792 raft_consensus.cc:2889] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:20.681850 13792 raft_consensus.cc:2272] T 37a7135d72784bd590fd05aeda0ea3b6 P e4938453819c469599f515b22d92fe27 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.684578 13792 tablet_replica.cc:333] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: stopping tablet replica
W20260709 13:08:20.684752 15513 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:20.685300 13792 raft_consensus.cc:2243] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:20.685853 13792 pending_rounds.cc:70] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Trying to abort 1 pending ops.
I20260709 13:08:20.686072 13792 pending_rounds.cc:77] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27: Aborting op as it isn't in flight: id { term: 16 index: 15 } timestamp: 7305635785082613760 op_type: NO_OP noop_request { }
I20260709 13:08:20.686836 22865 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.693910 22949 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.694545 22949 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.686988 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:20.699868 15040 raft_consensus.cc:3060] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:20.704697 22949 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:20.706132 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:20.707695 15040 raft_consensus.cc:2468] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:20.710115 15516 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:20.710912 22865 raft_consensus.cc:2804] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:08:20.715812 15007 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:20.716369 15007 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:20.717391 22865 raft_consensus.cc:697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:20.717592 22949 raft_consensus.cc:2749] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:20.718987 22865 consensus_queue.cc:237] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.686419 13792 raft_consensus.cc:2889] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:20.739367 13792 raft_consensus.cc:2272] T cf48bf0f29ee4f8fabd84185b8cc6a88 P e4938453819c469599f515b22d92fe27 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:20.753648 23024 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.754371 23024 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:20.757169 23024 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:20.789546 22865 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.790129 22865 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.794064 22865 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.794850 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:20.795589 15040 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
W20260709 13:08:20.796134 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:20.798393 15513 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:20.807331 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:20.812263 15007 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:20.813799 23017 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:08:20.814304 23017 raft_consensus.cc:493] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.814697 23017 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:20.837993 23017 raft_consensus.cc:515] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.845299 23017 leader_election.cc:290] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.858460 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:20.864785 23024 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.865465 23024 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.859180 14963 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 19.
I20260709 13:08:20.870267 23024 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:20.870219 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:20.873673 23024 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:20.874128 23024 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.874594 23024 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:08:20.875144 15007 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:20.876217 23030 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.876812 23030 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.878865 23030 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:20.880015 15513 leader_election.cc:336] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:20.883203 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:20.897755 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:20.898094 23024 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:20.921705 14933 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:20.925736 23024 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:20.928505 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:20.929230 14963 raft_consensus.cc:3060] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:20.930894 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "410c57dd04b546f3be0269aecdb13719" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:20.932385 15040 raft_consensus.cc:3060] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:08:20.934031 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 30 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:20.934612 15042 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 29.
I20260709 13:08:20.941824 22951 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.942314 22951 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:20.944607 22951 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:20.945218 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 30 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:20.945819 15541 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 29.
I20260709 13:08:20.949530 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:20.950603 23030 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:08:20.951021 23030 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.951180 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:20.951419 23030 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:08:20.952484 14792 catalog_manager.cc:5697] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 22 to 23, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 23 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:20.977959 23030 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:20.980247 15040 raft_consensus.cc:2468] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:20.989353 15010 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:20.990794 22943 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:08:20.991201 22943 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:20.991578 22943 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:08:21.006108 14963 raft_consensus.cc:2468] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 20.
I20260709 13:08:21.028369 22943 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:21.033392 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 82655us
I20260709 13:08:21.039228 15516 leader_election.cc:304] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:21.039590 14933 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.039228 15008 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:21.043749 15007 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.036134 22949 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:21.042769 23034 ts_tablet_manager.cc:933] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.065935 23036 ts_tablet_manager.cc:933] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.074604 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:21.042460 23017 raft_consensus.cc:2804] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:08:21.082283 23036 tablet_copy_client.cc:323] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:08:21.095896 23030 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:21.097029 23037 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:21.101843 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:21.103629 15007 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.081205 22943 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:21.090303 22997 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:21.105736 23032 raft_consensus.cc:2804] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:21.073246 22949 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:21.110430 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.111088 23024 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.110105 23044 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.127975 14979 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet b4b44d3457824f63aaf8c5cafbd75ea0 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:08:21.117281 23032 raft_consensus.cc:697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:21.123023 23024 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.106590 23037 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.143673 23044 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.188627 23035 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.189496 23035 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.191087 22943 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.192250 22949 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.191967 22943 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.192879 23038 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.193477 23038 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.194765 22943 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:21.199527 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.200735 23038 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:21.201874 23032 consensus_queue.cc:237] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.204305 23024 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:21.206424 14979 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet b4b44d3457824f63aaf8c5cafbd75ea0 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-b4b44d3457824f63aaf8c5cafbd75ea0
I20260709 13:08:21.207140 23035 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:21.209278 14933 consensus_peers.cc:597] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.209393 23037 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:21.243693 23037 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.244211 23037 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:21.245126 14933 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.246804 23037 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:21.232982 23044 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:21.234193 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:21.235723 23033 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:21.249462 14933 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.247917 23033 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.259728 23034 tablet_copy_client.cc:323] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Beginning tablet copy session from remote peer at address 127.13.120.2:43345
I20260709 13:08:21.260165 23017 raft_consensus.cc:697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:21.268679 23017 consensus_queue.cc:237] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.263720 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 30 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:21.271947 23033 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:21.272141 15549 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 30: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:21.227602 15007 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:21.279860 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 52288.4us
W20260709 13:08:21.280213 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 234327us
W20260709 13:08:21.280638 15007 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:21.282823 15007 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.286454 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.287082 14961 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:21.288775 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.289361 14963 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 25.
W20260709 13:08:21.292338 15513 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.292496 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:21.293135 15541 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:21.296469 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:21.297269 15549 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 28.
I20260709 13:08:21.303242 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 30 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:21.304275 15040 raft_consensus.cc:2393] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 30: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:21.307631 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:21.307952 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:21.308197 15042 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:21.308517 15036 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 28.
I20260709 13:08:21.309333 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.309900 14961 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:21.309979 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.310575 14964 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
W20260709 13:08:21.314107 14933 consensus_peers.cc:597] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.315085 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:21.315650 15036 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:21.316628 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:21.316820 15010 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.317391 15039 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:21.333829 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:21.334662 23051 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:08:21.336337 23041 raft_consensus.cc:2749] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 13:08:21.354633 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:21.355089 15007 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.359311 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.359977 14963 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:21.357518 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.373245 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.377128 22949 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:08:21.377586 22949 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.377954 22949 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 28 FOLLOWER]: Advancing to term 29
I20260709 13:08:21.378358 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:21.378962 15543 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:21.383373 14979 tablet_copy_source_session.cc:215] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.385160 23037 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:21.385567 23037 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.385802 23037 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:21.386526 14933 consensus_peers.cc:597] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.387796 14980 tablet_copy_service.cc:140] P 25b8f0cc46f748468395543b8b174bf4: Received BeginTabletCopySession request for tablet 8b1d51e80f4e47638e5c23566e217993 from peer 58ee9fe38eb8453098f6d964e7675e79 ({username='slave'} at 127.0.0.1:43902)
I20260709 13:08:21.388279 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.389149 23042 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:21.389523 23042 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.389902 23042 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:21.388347 14980 tablet_copy_service.cc:161] P 25b8f0cc46f748468395543b8b174bf4: Beginning new tablet copy session on tablet 8b1d51e80f4e47638e5c23566e217993 from peer 58ee9fe38eb8453098f6d964e7675e79 at {username='slave'} at 127.0.0.1:43902: session id = 58ee9fe38eb8453098f6d964e7675e79-8b1d51e80f4e47638e5c23566e217993
I20260709 13:08:21.394586 23049 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260709 13:08:21.395038 23049 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.395440 23049 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 28 FOLLOWER]: Advancing to term 29
W20260709 13:08:21.402469 14933 consensus_peers.cc:597] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.405300 14792 catalog_manager.cc:5697] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 18 to 19, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 19 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.414644 22949 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:21.417164 15007 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.413975 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:21.419358 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 85827.4us
I20260709 13:08:21.428527 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.425796 23052 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:21.429932 23052 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.430305 23052 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:21.427659 14788 catalog_manager.cc:5697] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 19 to 20, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 20 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
W20260709 13:08:21.433849 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.436880 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.446476 23038 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.446882 23033 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:21.457005 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.453608 14980 tablet_copy_source_session.cc:215] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:08:21.454288 23036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b44d3457824f63aaf8c5cafbd75ea0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.460533 23053 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:21.460953 23053 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.461299 23053 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:21.456784 23033 raft_consensus.cc:493] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:21.463778 23033 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:21.466284 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.459225 23038 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.470674 23038 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.458961 23035 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:21.471591 23050 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
W20260709 13:08:21.472210 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.472468 23050 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.449805 23047 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.471904 23035 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.474466 23035 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:21.474445 23047 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.478564 23053 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.482229 23035 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.483464 23050 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:21.484912 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:21.490191 14777 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 48262.8us
I20260709 13:08:21.501863 23047 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.502820 22949 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 29 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:21.511986 15007 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:21.516386 15007 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.516989 23042 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.518532 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:21.519835 23035 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.496268 23037 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.523926 23036 tablet_copy_client.cc:806] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:21.524652 23036 tablet_copy_client.cc:670] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:21.529248 23049 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.530511 15549 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 29: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:21.533365 15010 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:21.534386 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.534564 23035 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:08:21.535954 23033 raft_consensus.cc:515] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:21.538334 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 754b0ca0f8c0459c8b6f122a5ff76b39: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
W20260709 13:08:21.541103 15007 leader_election.cc:336] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.539829 23033 leader_election.cc:290] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.543437 23053 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:21.493152 15008 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:21.556577 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 63506.7us
W20260709 13:08:21.494179 14933 consensus_peers.cc:597] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:21.492750 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 50281.9us
W20260709 13:08:21.546218 15007 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:21.559348 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 65201us
I20260709 13:08:21.565372 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:21.566002 15549 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:21.568612 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.569087 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:21.569206 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:21.559639 23035 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:21.569734 14968 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:21.570084 23035 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.570528 23050 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:21.571020 23050 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.571465 23050 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:21.572521 23034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b1d51e80f4e47638e5c23566e217993. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:08:21.570537 23035 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:21.577999 15039 raft_consensus.cc:1275] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 13:08:21.544750 23033 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.590118 23033 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.554675 23052 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.560644 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:21.597361 14961 raft_consensus.cc:3060] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:21.600682 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 29 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:21.601468 15040 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 29: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:21.604521 14961 raft_consensus.cc:2468] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 26.
I20260709 13:08:21.605393 23035 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.608254 23035 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:21.610211 14933 consensus_peers.cc:597] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:21.610749 14933 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.612116 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96fa5275273743d0973b36e2f0c784cb" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:21.612679 15513 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.614255 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:21.615355 14961 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 23: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:21.616698 23052 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:21.612701 14963 raft_consensus.cc:3060] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:21.628000 23033 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:21.610668 15007 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.628484 23036 tablet_copy_client.cc:538] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:08:21.630362 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:21.631096 15543 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 22: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:21.636945 23017 consensus_queue.cc:1048] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:08:21.637423 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:21.638217 23047 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 13:08:21.639160 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:21.639953 14967 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 22: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:21.640997 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:21.641820 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.643867 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
W20260709 13:08:21.644061 14933 consensus_peers.cc:597] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.644562 14967 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 22: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:21.643602 15010 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.629051 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.629506 23050 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.650924 23050 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:21.653501 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:21.653955 14933 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.654096 23052 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:21.654969 23039 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:21.658072 23039 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.658531 23039 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:21.658182 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.659148 23036 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:08:21.661448 23047 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:21.666896 23033 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:21.667639 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:21.668038 23039 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:21.669159 15549 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 20: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:21.670356 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.671357 23050 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 13:08:21.678529 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:21.679673 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.680542 23039 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:21.680830 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45579.6us
I20260709 13:08:21.681779 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:21.686009 14961 raft_consensus.cc:2393] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 20: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
I20260709 13:08:21.549120 23049 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 29 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:21.687124 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.687965 23034 tablet_copy_client.cc:806] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 0 data blocks...
I20260709 13:08:21.688544 23039 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 13:08:21.691133 23034 tablet_copy_client.cc:670] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Starting download of 1 WAL segments...
I20260709 13:08:21.701340 15008 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.702073 14963 raft_consensus.cc:2468] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:21.702740 23034 tablet_copy_client.cc:538] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 13:08:21.707494 14933 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.706689 23037 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:21.709872 14933 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:08:21.712149 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:21.712904 15042 raft_consensus.cc:2393] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 23: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:21.714219 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:21.714928 23037 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:21.715685 23032 raft_consensus.cc:2804] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:21.716277 23032 raft_consensus.cc:697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 26 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:21.717154 23032 consensus_queue.cc:237] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.721038 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.721863 23053 raft_consensus.cc:2749] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 13:08:21.723800 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.724947 23035 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:21.727140 14933 consensus_peers.cc:597] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.731154 15008 leader_election.cc:304] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:21.726646 23034 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap starting.
I20260709 13:08:21.736019 23042 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:21.739614 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:21.742285 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:21.742929 15042 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:21.744199 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:21.744935 15549 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 in current term 22: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
I20260709 13:08:21.748252 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:21.749439 23037 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:21.751221 23033 raft_consensus.cc:2804] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:21.751806 23033 raft_consensus.cc:697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:21.752681 23033 consensus_queue.cc:237] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.757306 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:21.758059 15039 raft_consensus.cc:2393] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 22: Already voted for candidate eb4a5ac9f0c5425b92051187b939860f in this term.
I20260709 13:08:21.763329 15036 raft_consensus.cc:1275] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 13:08:21.763401 14963 raft_consensus.cc:1275] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 13:08:21.785391 23049 consensus_queue.cc:1048] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
W20260709 13:08:21.808465 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.781736 22949 consensus_queue.cc:1048] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
W20260709 13:08:21.839335 15007 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:21.869045 14792 catalog_manager.cc:5697] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 25 to 26, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 26 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.888482 14792 catalog_manager.cc:5697] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 20 to 23, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 23 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:21.924301 22951 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.924913 22951 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:21.929881 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:21.930600 15040 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
W20260709 13:08:21.936419 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.932252 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:21.940210 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:21.946532 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc520 after lost signal to thread 13795
W20260709 13:08:21.947654 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08002dde80 after lost signal to thread 14827
W20260709 13:08:21.948185 14991 debug-util.cc:398] Leaking SignalData structure 0x7b0800392080 after lost signal to thread 14919
W20260709 13:08:21.949254 14991 debug-util.cc:398] Leaking SignalData structure 0x7b080026cd00 after lost signal to thread 14994
W20260709 13:08:21.950317 14991 debug-util.cc:398] Leaking SignalData structure 0x7b08003acbe0 after lost signal to thread 15068
W20260709 13:08:21.951568 14991 debug-util.cc:398] Leaking SignalData structure 0x7b080031c060 after lost signal to thread 15574
I20260709 13:08:21.936964 22951 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:21.991386 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:21.979815 23037 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:21.940811 23042 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 13:08:22.003624 14933 consensus_peers.cc:597] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:22.006045 14933 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:08:22.034754 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:22.002489 23042 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:22.037364 23042 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:22.010927 23037 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:22.066380 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:22.067129 15543 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 19.
I20260709 13:08:22.068495 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:22.072479 22951 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:22.072906 22951 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e4938453819c469599f515b22d92fe27)
I20260709 13:08:22.073307 22951 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:22.065609 23037 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:22.112378 14933 connection.cc:769] client connection to 127.13.120.1:46755 send error: Network error: sendmsg error: Broken pipe (error 32)
I20260709 13:08:22.122092 22951 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:22.154592 14967 raft_consensus.cc:1275] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 25 index: 16. Preceding OpId from leader: term: 26 index: 17. (index mismatch)
I20260709 13:08:22.164021 22943 consensus_queue.cc:1048] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.027s
I20260709 13:08:22.210234 22951 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:22.212741 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:22.213416 15543 raft_consensus.cc:3060] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:22.232941 15543 raft_consensus.cc:2468] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
I20260709 13:08:22.241236 14936 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:22.253985 14963 raft_consensus.cc:1275] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260709 13:08:22.164682 23042 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:22.268296 23034 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.081s	user 0.000s	sys 0.003s
I20260709 13:08:22.245294 22951 raft_consensus.cc:2804] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:22.292204 23042 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:22.285889 22951 raft_consensus.cc:697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:22.294054 22951 consensus_queue.cc:237] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:22.296290 23036 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:22.297452 23036 tablet_bootstrap.cc:492] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:08:22.303027 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:22.303848 15036 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:22.301023 23036 ts_tablet_manager.cc:1403] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 0.642s	user 0.061s	sys 0.014s
I20260709 13:08:22.285559 23041 consensus_queue.cc:1048] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.201s
W20260709 13:08:23.268078 13792 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14916)
W20260709 13:08:23.054248 15036 consensus_meta.cc:287] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.005s
I20260709 13:08:23.500154 23084 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.604142 15036 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:23.604390 23084 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.606666 23084 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:23.519090 23082 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.607389 23082 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.608985 23093 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.609393 23093 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.610258 23082 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.520627 23083 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:23.533393 15513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111) [suppressed 301 similar messages]
I20260709 13:08:23.610770 23093 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.577509 23088 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.611032 23083 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.611692 23088 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.613539 23083 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:23.529525 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 1.2196e+06us
I20260709 13:08:23.614142 23088 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.410467 23036 raft_consensus.cc:359] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:23.514449 23039 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.732129 23039 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.734474 23039 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.536136 23042 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.735823 23042 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.738102 23042 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.738621 23042 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.536618 23047 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.740227 23047 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.742729 23047 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.578244 23074 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.744014 23074 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.746129 23074 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.535115 23076 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:08:23.589452 14933 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:23.747442 23076 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:23.747918 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 158480us
W20260709 13:08:23.604818 15036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45052 (request call id 4061) took 1302 ms (client timeout 1612 ms). Trace:
W20260709 13:08:23.611333 14777 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 49903.8us
I20260709 13:08:23.578807 23037 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.765736 23037 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.765051 23097 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.767114 23097 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:23.616432 15008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.000s	sys 0.034s
W20260709 13:08:23.775702 15008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.295s	user 0.001s	sys 0.034s
I20260709 13:08:23.776249 23078 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.776865 23078 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:23.617123 15009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.136s	user 0.013s	sys 0.021s
W20260709 13:08:23.778985 15009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.014s	sys 0.021s
I20260709 13:08:23.779013 23097 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.644474 23087 raft_consensus.cc:493] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.646339 23088 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.780028 23087 raft_consensus.cc:515] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:23.780097 23088 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.782256 23087 leader_election.cc:290] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.647557 23093 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
W20260709 13:08:23.650195 15515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.040s	sys 0.070s
W20260709 13:08:23.783232 15515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.041s	sys 0.071s
I20260709 13:08:23.782954 23093 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:23.660389 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 127014us
W20260709 13:08:23.682329 15007 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.384s	user 0.006s	sys 0.024s
W20260709 13:08:23.785771 15007 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.488s	user 0.006s	sys 0.024s
I20260709 13:08:23.686357 23031 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:08:23.697233 15516 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.134s	user 0.015s	sys 0.026s
W20260709 13:08:23.787025 15516 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.016s	sys 0.026s
I20260709 13:08:23.709465 23066 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.710520 22951 raft_consensus.cc:493] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.724395 23036 raft_consensus.cc:740] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
W20260709 13:08:23.725904 15514 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.014s	sys 0.018s
W20260709 13:08:23.750025 15036 rpcz_store.cc:269] 0709 13:08:22.302649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:22.302778 (+   129us) service_pool.cc:224] Handling call
0709 13:08:23.604727 (+1301949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:08:23.749626 23076 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.739082 23042 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:23.755692 23074 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
W20260709 13:08:23.762948 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 754b0ca0f8c0459c8b6f122a5ff76b39: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:23.436646 23034 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=1 applied=13 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:08:23.790107 23031 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:23.772338 23037 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.635313 23089 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.779028 23078 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.782788 23088 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:23.792069 15514 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.014s	sys 0.018s
I20260709 13:08:23.816004 23089 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.787715 23047 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.789458 23039 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.834945 23039 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.837734 23039 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:23.838240 23039 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.816470 23031 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.842396 23034 tablet_bootstrap.cc:492] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Bootstrap complete.
I20260709 13:08:23.791766 23030 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.792102 23051 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.847707 23051 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.850020 23051 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.795297 23079 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.851313 23079 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.854168 23079 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.796767 23083 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.854806 23083 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.797876 23084 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.855775 23084 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.856731 23083 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.798032 23082 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.857390 23082 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.858217 23084 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.800957 23033 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.859230 23082 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:23.794600 23066 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.859133 23033 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.861232 23066 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.811764 23042 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.809437 23036 consensus_queue.cc:260] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:23.862064 23033 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.863766 23036 ts_tablet_manager.cc:1434] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.772s	user 0.008s	sys 0.005s
W20260709 13:08:23.864102 23036 ts_tablet_manager.cc:1467] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Tablet startup took 805ms
W20260709 13:08:23.864439 23036 ts_tablet_manager.cc:1469] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Trace:
0709 13:08:20.918179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:08:20.990314 (+ 72135us) service_pool.cc:224] Handling call
0709 13:08:21.066346 (+ 76032us) ts_tablet_manager.cc:934] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: Initiating tablet copy from peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
0709 13:08:21.425226 (+358880us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:08:21.469970 (+ 44744us) tablet_metadata.cc:665] Metadata flushed
0709 13:08:21.470083 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:08:21.522966 (+ 52883us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:08:21.523184 (+   218us) tablet_replica.cc:206] Creating consensus instance
0709 13:08:21.523481 (+   297us) ts_tablet_manager.cc:989] Replica registered.
0709 13:08:21.523546 (+    65us) inbound_call.cc:177] Queueing success response
0709 13:08:21.657915 (+134369us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:08:23.307363 (+1649448us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:08:23.403010 (+ 95647us) tablet_replica.cc:261] Starting instrumentation
0709 13:08:23.403788 (+   778us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":320,"tablet-copy.queue_time_us":75079,"tablet-download-pool.queue_time_us":116,"tablet-download-pool.run_cpu_time_us":1239,"tablet-download-pool.run_wall_time_us":103048,"thread_start_us":62437,"threads_started":2}
I20260709 13:08:23.812518 22949 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.867254 22949 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.832806 23047 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.869134 22949 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.794948 22951 raft_consensus.cc:515] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:23.812943 22943 raft_consensus.cc:493] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.869892 23047 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.869911 22943 raft_consensus.cc:515] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.870986 22951 leader_election.cc:290] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.801146 23032 raft_consensus.cc:493] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.871236 23034 ts_tablet_manager.cc:1403] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Time spent bootstrapping tablet: real 2.150s	user 0.052s	sys 0.023s
I20260709 13:08:23.871675 23032 raft_consensus.cc:515] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.872605 22943 leader_election.cc:290] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.873749 23032 leader_election.cc:290] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.838768 23039 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.874663 23034 raft_consensus.cc:359] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:23.805261 22865 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.883646 22865 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.885840 22865 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.886440 23034 raft_consensus.cc:740] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Initialized, Role: LEARNER
I20260709 13:08:23.887269 23034 consensus_queue.cc:260] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:23.890233 23034 ts_tablet_manager.cc:1434] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:08:23.830098 23102 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.807204 23017 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.832290 23089 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.833616 23052 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.802914 23074 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:23.906275 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 113731us
I20260709 13:08:23.802094 23044 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.910619 23044 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.912516 23044 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.810968 23081 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.913172 23081 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.787429 23093 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.875840 23039 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.907256 23089 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.907998 23074 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.847524 23030 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.900746 23017 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.908954 23052 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.922998 15543 raft_consensus.cc:1217] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.12->[19.13-19.13]   Dedup: 19.13->[]
I20260709 13:08:23.926927 15545 raft_consensus.cc:1217] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEARNER]: Deduplicated request from leader. Original: 24.17->[24.18-24.18]   Dedup: 24.18->[]
I20260709 13:08:23.929193 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:23.930516 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:23.920625 23097 raft_consensus.cc:493] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.900617 23102 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.937479 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:23.937825 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:23.936626 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:23.915158 23081 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.924969 22951 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.920785 22865 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.933295 23089 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.943677 23039 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.935438 23093 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:23.921980 23044 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.950850 14964 raft_consensus.cc:2468] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:23.935258 23080 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:23.968369 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:23.975384 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:23.958137 23097 raft_consensus.cc:515] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.996460 15040 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:08:23.997593 23109 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.998073 23097 leader_election.cc:290] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.998517 23089 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:23.998203 23109 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.998670 23111 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:23.999223 23111 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.000383 23109 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.000872 23109 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.001276 23109 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:24.002099 23111 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.002660 23111 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:23.992894 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:23.994747 23044 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.013648 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "599606a370ab4d629b9cac083be835da" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.015166 15042 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:24.010037 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b35154b94cb40bc8e8f780311834ad6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.016036 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.018265 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.018836 15038 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:08:24.003067 23109 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:24.016425 14933 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:23.981370 23082 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.025782 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c487d6b8fcd4ff280fa6c3c4a5ac8ab" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:24.175737 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 159323us
I20260709 13:08:24.016641 15549 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 25.
I20260709 13:08:24.027500 23044 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.032869 23102 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.034682 23033 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.034796 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.035328 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.036794 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 31 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.180358 15548 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 16.
I20260709 13:08:24.180478 15544 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 30.
I20260709 13:08:24.036892 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.040723 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.047902 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:23.991892 23093 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:23.987798 22865 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.182969 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8de39bcda9f4437d8538be04713851b1" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.003137 23111 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } }
I20260709 13:08:24.038180 23030 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:23.991602 23039 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:23.981741 22951 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.024658 23080 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.170065 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.198137 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.170397 15550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.174180 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 31 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.170094 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.178659 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.198802 15044 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 30.
I20260709 13:08:24.179186 15543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.181797 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.181792 15042 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 16.
I20260709 13:08:24.186159 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.186414 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.186985 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be840274e2c843b9b2b9f24277dca78d" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.007507 23081 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.192335 23115 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.210602 23115 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.211722 15040 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
I20260709 13:08:24.213675 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8fa9dae6116418f8b520fc591ae5757" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.215233 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.212733 23115 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.174983 22949 raft_consensus.cc:493] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:24.216039 22949 raft_consensus.cc:515] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.216838 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46876532b5b6444ba4fbaa536a316857" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.217991 22949 leader_election.cc:290] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.169199 22943 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.193631 15541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156c010162bf4cb99b535677eccb2740" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.218237 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.194828 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.220717 23111 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.191056 15547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.198752 15550 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 20.
W20260709 13:08:24.201489 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:24.198633 15542 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:24.203910 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:24.222502 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:24.181051 23082 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:24.223024 15513 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.223587 15513 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.224081 15513 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.224097 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebef2badb7124b9fa530c8877d638abe" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:24.224769 15513 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.225378 23108 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.225870 23108 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.204774 22865 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.227375 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.228135 23108 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.206123 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.229283 23108 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:24.229169 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1ecb36ffe5e640f88b50155fa361883d" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.229753 23108 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.191164 23035 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.208760 15548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7933f8a0325b4bf7a8bafc99c9284091" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.210029 23093 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.221572 22943 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:24.233933 23032 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.235930 23032 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.236882 22943 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:24.226831 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:24.182816 23033 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:24.230970 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:24.239727 22951 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.240358 23033 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.240630 14967 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 22.
I20260709 13:08:24.233258 23035 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:24.242672 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:24.230695 15546 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 25.
I20260709 13:08:24.243811 23035 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.244390 23080 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.224691 23082 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.245455 23076 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:08:24.245910 23076 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.234829 23081 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.246335 23076 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:24.247093 15544 raft_consensus.cc:1275] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:24.248072 23052 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.248572 23032 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.251613 23081 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.261848 15542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.262714 15542 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:24.234067 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.265023 14969 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 21.
I20260709 13:08:24.283238 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:24.240304 22951 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260709 13:08:24.289227 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 96712.1us
I20260709 13:08:24.288415 14980 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-b4b44d3457824f63aaf8c5cafbd75ea0 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:08:24.304607 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.290294 23089 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:24.291353 23112 consensus_queue.cc:1048] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:24.293766 15513 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.310670 15513 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.311503 15513 leader_election.cc:336] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.312062 15513 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.312601 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:24.313063 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.295969 15516 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:24.300001 14969 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.301111 14970 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "146ff3031af843e3a501710c2301a015" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.301669 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.300899 23076 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.302035 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b9511e929bc448349baf940df42e2a22" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.302268 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf48bf0f29ee4f8fabd84185b8cc6a88" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.302701 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.302990 14966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.303645 14961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.318128 14980 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-b4b44d3457824f63aaf8c5cafbd75ea0 on tablet b4b44d3457824f63aaf8c5cafbd75ea0 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:24.303766 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
W20260709 13:08:24.308651 13792 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14916)
W20260709 13:08:24.303126 14933 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.320051 23082 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:08:24.320626 14933 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.322119 14979 tablet_copy_service.cc:342] P 25b8f0cc46f748468395543b8b174bf4: Request end of tablet copy session 58ee9fe38eb8453098f6d964e7675e79-8b1d51e80f4e47638e5c23566e217993 received from {username='slave'} at 127.0.0.1:43902
I20260709 13:08:24.322592 14979 tablet_copy_service.cc:434] P 25b8f0cc46f748468395543b8b174bf4: ending tablet copy session 58ee9fe38eb8453098f6d964e7675e79-8b1d51e80f4e47638e5c23566e217993 on tablet 8b1d51e80f4e47638e5c23566e217993 with peer 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:24.314651 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.325178 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.326628 15514 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:24.315587 15513 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.327632 15513 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.327986 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.328771 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4db89b17bfcd40e0a2e2d53f7cf21079" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.329842 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.332064 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.283545 23017 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.333443 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cfe8a6078741239e2d788a50d260dc" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.333949 15516 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:24.333176 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.309996 22951 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:24.310456 23089 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:24.337993 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.338549 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "205008a787ca45349273b1e8daaebdf5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.339900 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.344482 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:24.342743 15513 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.345360 15513 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.345861 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.346483 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.336364 23107 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:24.334641 23052 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:24.320652 23082 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.332975 23102 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:24.347856 23082 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:08:24.347157 14933 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.350342 14933 leader_election.cc:336] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.350703 23039 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.343101 23089 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:24.336287 23106 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:24.350721 14933 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.352950 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.353483 15516 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.353948 23017 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:24.354355 23017 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.354641 23097 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:24.355615 23030 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:24.355671 23049 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:24.356719 14933 leader_election.cc:336] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.355043 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:24.357208 14933 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:24.359230 14933 consensus_peers.cc:597] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:24.354699 23017 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:24.359802 14933 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.360419 14933 leader_election.cc:336] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.360971 14933 leader_election.cc:336] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.361699 14933 leader_election.cc:336] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.362059 14933 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.363122 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.367112 15516 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:24.367161 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.342933 22951 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:24.343436 23076 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.359669 23097 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:24.374361 15514 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.374194 15516 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:24.363967 23107 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:24.379792 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.366254 23093 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:24.381784 15516 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.370776 23081 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 13:08:24.386421 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.386788 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.387279 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.387890 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.387909 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d87ff4cfb034c7eb5e9fdb522974b90" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.388518 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66e4432ba29a43668db5483ebef3b522" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.388516 22865 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:24.390515 15042 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 29.
I20260709 13:08:24.380787 23102 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:08:24.381006 23039 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:24.382369 23030 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:24.383597 23052 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:24.389861 23081 raft_consensus.cc:493] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.388840 23047 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:24.409945 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.397764 23102 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.420536 23102 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.408315 23030 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting leader election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:24.423697 23030 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:24.414382 23081 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Advancing to term 31
I20260709 13:08:24.429910 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.433099 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.408048 23106 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:24.434513 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.409756 23052 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:24.435038 23039 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:24.436753 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.439126 23052 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:24.443653 23047 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:24.445834 15516 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.444239 23084 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:24.449400 23089 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.452910 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.454900 23047 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:24.453655 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ac8b7ea8eec4d01847e30ae2626afd0" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:24.455715 15546 raft_consensus.cc:3060] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:08:24.455778 23047 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:24.457037 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.459297 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:24.460341 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.463619 23106 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:24.464200 23084 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 13:08:24.465315 15546 raft_consensus.cc:2468] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21.
I20260709 13:08:24.483227 14792 catalog_manager.cc:5697] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 19 to 20, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 20 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:24.480844 14936 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
I20260709 13:08:24.497670 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.486029 23084 raft_consensus.cc:493] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.515760 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:24.517855 15546 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:24.492894 23089 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.525188 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eec3351a3e94e158c79a8784e2c6574" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.497289 23093 raft_consensus.cc:2804] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:24.496491 23039 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:24.517002 23084 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:08:24.546118 15546 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 26.
I20260709 13:08:24.552942 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5cbe935ec59f4f31a383418c80f8823b" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.555122 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.508802 23125 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:24.527957 23108 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.554141 23093 raft_consensus.cc:697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:24.563715 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.574826 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.578043 23093 consensus_queue.cc:237] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.578336 23017 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.579439 15542 raft_consensus.cc:1240] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:24.580391 23017 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.581281 23076 raft_consensus.cc:1064] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:08:24.589794 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:24.591054 15571 debug-util.cc:398] Leaking SignalData structure 0x7b0800409c60 after lost signal to thread 13795
W20260709 13:08:24.592118 15571 debug-util.cc:398] Leaking SignalData structure 0x7b080039d800 after lost signal to thread 14827
I20260709 13:08:24.560545 23125 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:24.593361 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08003087c0 after lost signal to thread 14994
W20260709 13:08:24.594429 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac5e0 after lost signal to thread 15068
I20260709 13:08:24.594873 23125 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:24.599136 23052 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.603013 15037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.603473 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.616604 15037 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
I20260709 13:08:24.617262 15038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:24.617713 23052 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.605007 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:24.605067 23081 raft_consensus.cc:515] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.605602 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.606122 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.606329 15035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.607054 15040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.605139 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290e1d2493f34d57807c1a358aa0f71e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:24.619249 15513 leader_election.cc:336] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.623338 15513 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.623683 15035 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
I20260709 13:08:24.624454 23052 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:24.607753 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:24.625519 23102 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.619313 15041 raft_consensus.cc:2376] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 21. Re-sending same reply.
I20260709 13:08:24.628034 23082 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.628702 22951 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.630723 22951 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 election: Requested vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:24.608278 23084 raft_consensus.cc:515] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.610301 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.622826 23081 leader_election.cc:290] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 31 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.611114 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "83edd178ff3943b58ccf199ddc331aec" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:24.632164 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:24.595593 23030 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.632828 23084 leader_election.cc:290] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.634415 23030 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:24.613204 15571 debug-util.cc:398] Leaking SignalData structure 0x7b08002df800 after lost signal to thread 15574
I20260709 13:08:24.637019 23082 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:24.634616 23076 consensus_queue.cc:237] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 16, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.638960 23102 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:24.614341 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 63355us
I20260709 13:08:24.685443 14964 raft_consensus.cc:1240] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 25. Current term is 26. Ops: []
W20260709 13:08:24.700520 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 162538us
W20260709 13:08:24.703745 15007 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.734246 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:24.736464 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7a1be4a55754b9baba160c70df7dc21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 31 candidate_status { last_received { term: 29 index: 22 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:24.737115 14933 leader_election.cc:336] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.737469 15041 raft_consensus.cc:3060] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Advancing to term 31
W20260709 13:08:24.738449 14933 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.740309 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
W20260709 13:08:24.740768 14933 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.741421 15044 raft_consensus.cc:3060] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 29 FOLLOWER]: Advancing to term 30
I20260709 13:08:24.751063 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:24.753412 15042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:24.754065 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:24.757905 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.759240 15545 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:24.759987 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "060cd1347c834f27a9abc4cf6d5584a9" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 30 candidate_status { last_received { term: 28 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:24.772066 15546 raft_consensus.cc:2393] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 30: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:24.786176 15513 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 31 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.791837 23117 consensus_queue.cc:1059] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 13:08:24.794559 23109 raft_consensus.cc:3055] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:24.795145 23109 raft_consensus.cc:740] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:24.796841 23109 consensus_queue.cc:260] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.798436 15546 raft_consensus.cc:1240] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 17. Current term is 18. Ops: []
I20260709 13:08:24.798889 15545 raft_consensus.cc:1240] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23. Ops: []
I20260709 13:08:24.799230 23109 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:24.801827 15041 raft_consensus.cc:2468] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 31.
I20260709 13:08:24.814085 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:24.815189 14967 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:24.816224 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:24.819015 15545 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:08:24.824007 15544 raft_consensus.cc:1240] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 16. Current term is 17. Ops: []
I20260709 13:08:24.824154 14936 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: 
W20260709 13:08:24.825141 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 69043.2us
I20260709 13:08:24.825723 23042 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:24.826442 23042 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 26 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:24.827220 23089 consensus_queue.cc:1059] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:24.827822 23112 consensus_queue.cc:1059] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:08:24.829303 23076 raft_consensus.cc:3055] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:24.829442 23135 raft_consensus.cc:3055] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:08:24.829748 23076 raft_consensus.cc:740] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:24.830022 23135 raft_consensus.cc:740] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:24.831161 23076 consensus_queue.cc:260] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.832068 23042 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.837374 23076 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:08:24.824028 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 84643.8us
W20260709 13:08:24.840094 14933 leader_election.cc:336] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.840406 15010 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:08:24.788166 15513 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.843617 23112 consensus_queue.cc:1059] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 13:08:24.857829 23097 raft_consensus.cc:3055] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 13:08:24.858374 23097 raft_consensus.cc:740] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
W20260709 13:08:24.863588 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 75577us
I20260709 13:08:24.859776 23097 consensus_queue.cc:260] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:24.840742 14933 leader_election.cc:336] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:24.872133 14933 leader_election.cc:336] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.872682 14933 leader_election.cc:304] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.873580 23112 raft_consensus.cc:2749] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:24.873819 15044 raft_consensus.cc:2468] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 30.
W20260709 13:08:24.875484 14933 consensus_peers.cc:597] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:24.876276 23097 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:24.887717 23093 consensus_queue.cc:1059] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:08:24.876171 23135 consensus_queue.cc:260] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.884389 23112 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:08:24.894934 15516 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:24.902936 23135 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:24.903218 22951 raft_consensus.cc:3055] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:08:24.903744 22951 raft_consensus.cc:740] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:24.904881 22951 consensus_queue.cc:260] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:24.906270 22951 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:24.907959 23129 raft_consensus.cc:2804] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 13:08:24.908646 23129 raft_consensus.cc:697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 31 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:24.909876 23129 consensus_queue.cc:237] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 29.22, Last appended by leader: 22, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:24.916045 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:24.928407 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:24.930256 23117 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 13:08:24.930667 23117 raft_consensus.cc:493] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:24.931025 23117 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:24.940398 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:24.958928 23089 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:24.956701 15007 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:24.962682 15007 leader_election.cc:336] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:24.965817 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:24.967949 14933 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 75646.8us
I20260709 13:08:24.980468 14962 raft_consensus.cc:1240] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 26 LEADER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 25. Current term is 26. Ops: []
I20260709 13:08:24.985035 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:24.986980 15010 leader_election.cc:304] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:24.988808 23078 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:08:24.990625 14933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:08:25.020368 23078 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:25.020874 23078 raft_consensus.cc:3060] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.021039 15010 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:24.993724 23117 raft_consensus.cc:515] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:25.022780 23124 raft_consensus.cc:2764] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 31 FOLLOWER]: Leader pre-election decision vote started in defunct term 30: won
I20260709 13:08:25.023512 23124 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:24.998385 22943 consensus_queue.cc:1059] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:08:25.024655 23117 leader_election.cc:290] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:25.024854 22943 consensus_queue.cc:1243] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer 25b8f0cc46f748468395543b8b174bf4 log is divergent from this leader: its last log entry 26.19 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 18
I20260709 13:08:25.026059 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.027285 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73ceb2cea7314e0cadb64aa9ccbad8de" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.027379 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.027959 14968 raft_consensus.cc:3060] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Advancing to term 24
I20260709 13:08:25.029980 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.032661 14963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.009174 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.009440 23097 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.035763 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.039193 15516 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:25.040248 23082 raft_consensus.cc:2804] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 13:08:25.040804 23082 raft_consensus.cc:697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:25.041905 23082 consensus_queue.cc:237] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 28.19, Last appended by leader: 19, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.044719 14963 raft_consensus.cc:2468] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 18.
I20260709 13:08:25.046927 15010 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:25.048316 14936 leader_election.cc:304] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:25.037922 15007 leader_election.cc:336] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.051633 23135 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:25.054878 23117 raft_consensus.cc:3055] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 13:08:25.058885 15514 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.071571 14968 raft_consensus.cc:2468] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:25.070851 14964 raft_consensus.cc:2468] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
I20260709 13:08:25.074327 14967 raft_consensus.cc:2468] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:25.077903 15008 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:25.082818 15514 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.082844 23052 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:25.073230 23117 raft_consensus.cc:740] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:25.085541 23117 consensus_queue.cc:260] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.086937 23117 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:25.091388 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.092279 23135 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:25.096318 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 91192.2us
W20260709 13:08:25.096964 15007 leader_election.cc:336] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:25.097544 15007 leader_election.cc:336] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.099921 15007 leader_election.cc:304] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
W20260709 13:08:25.106962 14933 consensus_peers.cc:597] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.109161 14962 raft_consensus.cc:2468] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 17.
W20260709 13:08:25.109635 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 62891.5us
I20260709 13:08:25.112919 15010 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:25.111837 22943 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.075320 23097 raft_consensus.cc:2749] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:25.133498 23125 raft_consensus.cc:2749] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:25.123054 23109 raft_consensus.cc:2804] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 13:08:25.144340 15010 leader_election.cc:304] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.126076 23129 raft_consensus.cc:2804] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:08:25.163807 15010 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:25.167832 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 70307.2us
I20260709 13:08:25.146387 22943 raft_consensus.cc:2749] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:25.163276 15514 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.160638 23109 raft_consensus.cc:697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:25.139760 23124 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:25.173200 15007 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:25.178073 15007 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.179796 15007 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.185894 23095 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:25.186290 23095 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.186615 23095 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:25.193041 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 45976.5us
I20260709 13:08:25.193845 15514 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.193881 23030 raft_consensus.cc:2804] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:25.194650 23030 raft_consensus.cc:697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:25.195672 23081 raft_consensus.cc:2804] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:25.195842 23125 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:25.196270 23081 raft_consensus.cc:697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:25.163595 23129 raft_consensus.cc:697] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:25.197439 23081 consensus_queue.cc:237] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.198159 23129 consensus_queue.cc:237] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.202315 15514 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79; no voters: eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.204442 23052 raft_consensus.cc:2804] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:08:25.205011 23052 raft_consensus.cc:697] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:25.205147 23076 raft_consensus.cc:1064] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: attempting to promote NON_VOTER 58ee9fe38eb8453098f6d964e7675e79 to VOTER
I20260709 13:08:25.206079 23052 consensus_queue.cc:237] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.209227 23078 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.216241 23109 consensus_queue.cc:237] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:25.226275 23030 consensus_queue.cc:237] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.247679 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.248512 14967 raft_consensus.cc:2393] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate eb4a5ac9f0c5425b92051187b939860f in current term 17: Already voted for candidate 58ee9fe38eb8453098f6d964e7675e79 in this term.
W20260709 13:08:25.262076 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 116009us
W20260709 13:08:25.268146 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:25.274067 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:25.274708 23078 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:25.274709 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:25.286866 23076 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 11, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.294394 14792 catalog_manager.cc:5697] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 29 to 31, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 31 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.296269 14792 catalog_manager.cc:5697] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 28 to 30, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 30 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:25.299579 15010 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
W20260709 13:08:25.308598 14933 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:25.309182 14933 consensus_peers.cc:597] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:25.313205 23095 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.317849 15542 raft_consensus.cc:1275] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 13:08:25.319897 15544 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 13:08:25.327663 23135 consensus_queue.cc:1048] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260709 13:08:25.394608 14964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.396337 14964 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:25.387087 23117 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 13:08:25.390269 23146 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:08:25.408838 23095 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:25.409650 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 110243us
I20260709 13:08:25.410744 15010 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:25.386857 22951 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.018s
W20260709 13:08:25.422605 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 244555us
W20260709 13:08:25.426100 14933 consensus_peers.cc:597] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.416854 23095 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:25.426872 14933 consensus_peers.cc:597] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:25.431452 14964 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
I20260709 13:08:25.456235 15036 raft_consensus.cc:1275] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 31 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 29 index: 22. Preceding OpId from leader: term: 31 index: 23. (index mismatch)
W20260709 13:08:25.481086 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 51913.9us
I20260709 13:08:25.482015 14936 leader_election.cc:304] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:25.484516 23066 raft_consensus.cc:2764] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260709 13:08:25.492324 15036 raft_consensus.cc:1275] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 28 index: 19. Preceding OpId from leader: term: 30 index: 20. (index mismatch)
I20260709 13:08:25.492198 23082 consensus_queue.cc:1048] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260709 13:08:25.495641 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:25.497426 15542 raft_consensus.cc:1240] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Rejecting Update request from peer eb4a5ac9f0c5425b92051187b939860f for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:25.498086 15544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:25.498591 15546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:25.499347 15546 raft_consensus.cc:3060] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:25.501497 15513 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.506194 23102 consensus_queue.cc:1048] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260709 13:08:25.512605 15041 raft_consensus.cc:1275] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260709 13:08:25.518474 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.519603 23076 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:25.519912 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
W20260709 13:08:25.504195 15007 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 51315.4us
I20260709 13:08:25.521987 15546 raft_consensus.cc:2468] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 23.
W20260709 13:08:25.524912 14933 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.532665 23076 raft_consensus.cc:2764] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
W20260709 13:08:25.537554 15513 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:25.544437 15036 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 26.
I20260709 13:08:25.556344 15041 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
W20260709 13:08:25.566823 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 47004.3us
I20260709 13:08:25.568183 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.569782 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:25.565892 14933 consensus_peers.cc:597] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:25.572690 23066 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.574070 14936 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.570358 23076 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:25.576146 23076 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:25.577764 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:25.595075 23149 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:25.595679 23149 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:25.597716 23149 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:25.598678 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:25.599375 14962 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 21.
I20260709 13:08:25.601289 15010 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:25.601431 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:25.602995 15010 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:25.604209 23095 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:08:25.603758 23076 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:08:25.607759 23076 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:25.608737 23076 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:25.615808 23149 consensus_queue.cc:1059] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
W20260709 13:08:25.616920 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:25.618932 14936 leader_election.cc:304] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.619777 23066 raft_consensus.cc:2749] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:25.621649 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:25.624526 23095 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 13:08:25.625005 23095 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:25.625375 23095 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
I20260709 13:08:25.626997 23149 raft_consensus.cc:3055] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:25.627465 23149 raft_consensus.cc:740] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:25.624534 23109 raft_consensus.cc:2804] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:25.628752 23109 raft_consensus.cc:697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:25.628499 23149 consensus_queue.cc:260] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.629783 23109 consensus_queue.cc:237] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:25.630930 23149 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:25.640805 15007 leader_election.cc:336] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.641537 15007 leader_election.cc:304] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.642302 23078 raft_consensus.cc:2749] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:08:25.643707 15007 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.644341 15007 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.646775 23093 raft_consensus.cc:2749] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:08:25.653270 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50317.2us
W20260709 13:08:25.664496 15007 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.665268 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:25.670557 15007 leader_election.cc:336] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.671105 15007 leader_election.cc:304] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.672093 23144 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:25.673058 23144 raft_consensus.cc:2749] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 13:08:25.674448 15007 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.674969 15007 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:25.675778 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 54277.8us
I20260709 13:08:25.676818 23066 consensus_queue.cc:1048] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 13:08:25.679826 23078 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:25.681385 15007 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.681973 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.682925 23078 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:25.685081 15007 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.682991 23066 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.008s
I20260709 13:08:25.686851 23149 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:25.699118 14936 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:25.706727 14962 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:25.709455 23102 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:25.710632 15042 raft_consensus.cc:3060] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:08:25.706808 23095 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:25.717092 14967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:25.724750 23066 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:25.728533 15042 raft_consensus.cc:1275] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:08:25.739238 14967 raft_consensus.cc:1275] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260709 13:08:25.725536 23066 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 26 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:25.722337 23095 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:25.759897 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 61022.7us
I20260709 13:08:25.758477 23149 consensus_queue.cc:1048] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 13:08:25.748397 23102 consensus_queue.cc:1048] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:08:25.766467 15044 raft_consensus.cc:3060] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:08:25.766588 15036 raft_consensus.cc:3060] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:25.769294 15007 leader_election.cc:336] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.770617 14962 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:08:25.771365 15007 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:25.775267 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.781183 15036 raft_consensus.cc:1275] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:25.783727 15044 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:25.784022 15043 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:25.794916 15546 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEARNER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:08:25.791632 23052 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.013s
W20260709 13:08:25.803933 15007 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:25.804440 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:25.804806 15007 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:25.811201 23149 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 13:08:25.824467 23093 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.005s
I20260709 13:08:25.829424 23049 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.014s
I20260709 13:08:25.829769 14968 raft_consensus.cc:1275] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:08:25.807696 23129 consensus_queue.cc:1048] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:08:25.870443 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:08:25.812175 23066 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:25.886519 23162 log.cc:927] Time spent T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:08:25.913166 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 90476.7us
I20260709 13:08:25.964375 23164 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:08:25.965076 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:25.965620 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:25.988049 23102 consensus_queue.cc:1048] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:25.989238 14968 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 13:08:25.999641 23163 log.cc:927] Time spent T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260709 13:08:25.999693 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 50710.6us
I20260709 13:08:25.984664 23109 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:26.011011 23109 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:26.011098 23066 raft_consensus.cc:2955] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Committing config change with OpId 24.19: config changed from index 18 to 19, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:26.028403 15039 raft_consensus.cc:1275] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:08:26.029780 15044 raft_consensus.cc:2955] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:26.038287 14933 consensus_peers.cc:597] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:26.046037 14791 catalog_manager.cc:5697] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 22 to 24, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 24 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.048276 14788 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 25 to 26, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 26 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:26.045102 14933 consensus_peers.cc:597] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:26.050637 14788 catalog_manager.cc:5697] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 19 to 21, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 21 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:26.087668 14933 consensus_peers.cc:597] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.088572 14933 consensus_peers.cc:597] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.092108 15007 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:26.094084 23109 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:26.121081 15044 raft_consensus.cc:1240] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Rejecting Update request from peer 25b8f0cc46f748468395543b8b174bf4 for earlier term 21. Current term is 22. Ops: []
I20260709 13:08:26.123472 23076 consensus_queue.cc:1059] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:26.124483 23170 raft_consensus.cc:3055] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 13:08:26.124841 23170 raft_consensus.cc:740] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:26.125799 23170 consensus_queue.cc:260] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:26.127142 23170 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 22
W20260709 13:08:26.127810 14933 consensus_peers.cc:597] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.191762 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 169602us
W20260709 13:08:26.232350 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 209507us
W20260709 13:08:26.242003 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 180009us
I20260709 13:08:26.244153 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:26.257184 15549 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:26.257685 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:26.241518 23052 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:26.265568 23180 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
W20260709 13:08:26.344658 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 88059.2us
I20260709 13:08:26.291774 23052 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:26.365056 14968 raft_consensus.cc:1275] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
W20260709 13:08:26.379488 14777 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 284009us
I20260709 13:08:26.381295 23102 consensus_queue.cc:1048] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:08:26.383945 23178 log.cc:927] Time spent T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260709 13:08:26.387269 23193 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 13:08:26.411339 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 50145.1us
I20260709 13:08:26.384219 23052 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:26.444793 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:26.445706 15036 raft_consensus.cc:2393] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 58ee9fe38eb8453098f6d964e7675e79 in current term 26: Already voted for candidate 25b8f0cc46f748468395543b8b174bf4 in this term.
W20260709 13:08:26.415308 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 754b0ca0f8c0459c8b6f122a5ff76b39: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:26.504058 15549 raft_consensus.cc:2955] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Committing config change with OpId 24.19: config changed from index 18 to 19, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:26.515767 14962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:26.557211 14788 catalog_manager.cc:5697] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 16 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.558983 14788 catalog_manager.cc:5697] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 17 to 18, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 18 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.562263 14788 catalog_manager.cc:5697] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 16 to 17, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 17 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.564802 14788 catalog_manager.cc:5697] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 22 to 23, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 23 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:26.577790 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:26.582185 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 45467.7us
W20260709 13:08:26.588649 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 60556us
W20260709 13:08:26.610296 14933 consensus_peers.cc:597] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:26.630131 15514 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:26.649434 23207 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:26.654420 23175 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:26.655023 23175 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:26.658022 23175 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:26.662340 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:26.662976 15039 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 22.
W20260709 13:08:26.664299 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:26.671607 15516 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:26.669067 14792 catalog_manager.cc:5697] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 18 to 19, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:26.682013 14792 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 25 to 26, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 26 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.685760 15039 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260709 13:08:26.692229 14965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4" is_pre_election: true
I20260709 13:08:26.697594 23175 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 13:08:26.698083 23175 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:26.698439 23175 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:26.707864 23196 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:26.736864 15036 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:26.742965 14933 consensus_peers.cc:597] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:26.746935 23207 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:26.773627 15010 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:26.779886 23149 consensus_queue.cc:1048] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:26.780745 14788 catalog_manager.cc:5697] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 21 to 23, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 23 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:08:26.780779 23199 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:26.786907 23206 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 13:08:26.823526 23175 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:26.825600 23175 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:26.831612 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:26.832237 15036 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
I20260709 13:08:26.831975 15546 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Committing config change with OpId 19.14: config changed from index 13 to 14, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:26.843580 14968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "25b8f0cc46f748468395543b8b174bf4"
I20260709 13:08:26.848031 15545 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
W20260709 13:08:26.900149 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.909137 14933 consensus_peers.cc:597] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.912678 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:26.922168 15036 raft_consensus.cc:2468] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 23.
I20260709 13:08:26.923887 15516 leader_election.cc:304] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:26.899776 23135 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260709 13:08:26.930315 23185 raft_consensus.cc:2804] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader election won for term 23
W20260709 13:08:26.951155 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:26.961104 23185 raft_consensus.cc:697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:26.975080 14791 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: config changed from index 13 to 14, 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } attrs { replace: true } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:26.997995 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.998558 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:26.998980 15007 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:26.971577 23185 consensus_queue.cc:237] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:27.051105 15513 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 97281.2us
W20260709 13:08:27.051769 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:27.086228 23220 log.cc:927] Time spent T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: Append to log took a long time: real 0.124s	user 0.006s	sys 0.000s
W20260709 13:08:27.088634 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:27.102842 23219 log.cc:927] Time spent T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: Append to log took a long time: real 0.149s	user 0.000s	sys 0.005s
W20260709 13:08:27.115978 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:27.132285 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 64902.1us
I20260709 13:08:27.146422 14791 catalog_manager.cc:5697] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 21 to 23, leader changed from eb4a5ac9f0c5425b92051187b939860f (127.13.120.3) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 23 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:27.201942 14965 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:27.204327 23206 raft_consensus.cc:493] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:27.204954 23206 raft_consensus.cc:515] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:27.207710 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:27.208422 15036 raft_consensus.cc:2368] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23.
I20260709 13:08:27.209739 14936 leader_election.cc:400] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23.
I20260709 13:08:27.210060 14936 leader_election.cc:403] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:08:27.210737 23093 raft_consensus.cc:3060] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Advancing to term 23
I20260709 13:08:27.216727 15549 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:27.217411 15036 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:08:27.221153 22951 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:27.222770 23170 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:08:27.225272 23206 leader_election.cc:290] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:27.228300 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "754b0ca0f8c0459c8b6f122a5ff76b39" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:27.232564 23206 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:27.252169 14933 consensus_peers.cc:597] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:27.254065 23093 raft_consensus.cc:2749] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) with higher term. Message: Invalid argument: T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 25b8f0cc46f748468395543b8b174bf4 for earlier term 22. Current term is 23.
I20260709 13:08:27.254514 15545 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:27.257344 14778 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8b1d51e80f4e47638e5c23566e217993 with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:08:27.261368 15036 raft_consensus.cc:2955] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Committing config change with OpId 19.15: config changed from index 14 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
I20260709 13:08:27.281530 14792 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: config changed from index 14 to 15, VOTER e4938453819c469599f515b22d92fe27 (127.13.120.1) evicted. New cstate: current_term: 19 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:27.311276 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:27.344156 14933 consensus_peers.cc:597] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:27.405153 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:27.436590 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:27.444293 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8b1d51e80f4e47638e5c23566e217993: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:27.578454 14933 consensus_peers.cc:597] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:27.598910 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:27.610496 14962 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:27.618825 23129 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 13:08:27.624104 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
W20260709 13:08:27.656482 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:27.670869 15041 raft_consensus.cc:1275] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260709 13:08:27.680763 23135 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:08:27.692778 23135 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:27.695004 23135 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:27.696095 23129 consensus_queue.cc:1048] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:27.702527 14933 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:27.685307 15007 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:27.662536 15514 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.711089 15514 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 48746.8us
I20260709 13:08:27.721056 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:27.721769 15036 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 22.
W20260709 13:08:27.771524 15008 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.800781 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:27.843127 23135 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260709 13:08:27.845397 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 44742.9us
W20260709 13:08:27.891932 15514 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:27.851095 23135 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:08:27.894325 23135 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:27.951036 15514 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.951875 15514 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.952502 15514 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:27.956410 15010 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 63238.2us
I20260709 13:08:27.966461 23135 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:27.977231 23135 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Requested vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:28.007923 23228 log.cc:927] Time spent T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 13:08:28.009562 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:28.021910 15513 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:28.029475 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:28.030838 14933 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:28.029881 15514 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.032374 15514 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.034739 15514 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.035524 14936 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:39473, user_credentials={real_user=slave}} blocked reactor thread for 85399.7us
I20260709 13:08:28.047698 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "338c720b04aa4c14b53937055c254e24" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:28.048282 15041 raft_consensus.cc:3060] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 22 FOLLOWER]: Advancing to term 23
W20260709 13:08:28.043079 15514 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.056945 15514 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:28.084829 15041 raft_consensus.cc:2468] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 25b8f0cc46f748468395543b8b174bf4 in term 23.
W20260709 13:08:28.086076 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:28.088469 14936 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f; no voters: e4938453819c469599f515b22d92fe27
I20260709 13:08:28.093142 23239 raft_consensus.cc:2804] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 13:08:28.103888 23239 raft_consensus.cc:697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Becoming Leader. State: Replica: 25b8f0cc46f748468395543b8b174bf4, State: Running, Role: LEADER
I20260709 13:08:28.110064 23239 consensus_queue.cc:237] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:28.144691 15514 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.180893 15513 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:28.212103 14933 consensus_peers.cc:597] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.212607 14933 consensus_peers.cc:597] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:28.221921 15514 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.226716 14933 consensus_peers.cc:597] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:28.226116 14792 catalog_manager.cc:5697] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 reported cstate change: term changed from 20 to 23, leader changed from e4938453819c469599f515b22d92fe27 (127.13.120.1) to 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2). New cstate: current_term: 23 leader_uuid: "25b8f0cc46f748468395543b8b174bf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:28.262990 14933 consensus_peers.cc:597] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.263856 15514 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.278927 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 58824.4us
W20260709 13:08:28.291904 15008 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.296700 15008 consensus_peers.cc:597] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.297384 15008 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.298041 15008 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.298652 15008 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.299396 15008 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.314707 15008 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.319535 15008 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.326877 15008 consensus_peers.cc:597] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.327596 15008 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.328231 15008 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.336289 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:28.350404 14933 consensus_peers.cc:597] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.378717 14933 consensus_peers.cc:597] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.399608 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.401252 15516 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:46271, user_credentials={real_user=slave}} blocked reactor thread for 84988.6us
W20260709 13:08:28.460135 14933 consensus_peers.cc:597] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.536573 15514 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 447 similar messages]
W20260709 13:08:28.537693 14933 consensus_peers.cc:597] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:28.607231 15007 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:28.624599 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:28.627462 13792 tablet_replica.cc:333] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.628515 13792 raft_consensus.cc:2243] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.629281 13792 raft_consensus.cc:2272] T 96fa5275273743d0973b36e2f0c784cb P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.633029 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:28.636384 13792 tablet_replica.cc:333] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.644315 13792 raft_consensus.cc:2243] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.648175 13792 raft_consensus.cc:2272] T c5af46e976c54b8ba2b6e09ce06690af P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.657582 13792 tablet_replica.cc:333] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
W20260709 13:08:28.654234 14933 consensus_peers.cc:597] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:28.658727 13792 raft_consensus.cc:2243] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.659564 13792 raft_consensus.cc:2272] T 290e1d2493f34d57807c1a358aa0f71e P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.663316 13792 tablet_replica.cc:333] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.667098 13792 raft_consensus.cc:2243] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.667906 23234 raft_consensus.cc:493] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.668354 23232 raft_consensus.cc:493] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.668974 23232 raft_consensus.cc:515] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.668938 23234 raft_consensus.cc:515] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:28.694033 23135 raft_consensus.cc:670] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
W20260709 13:08:28.676863 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8b1d51e80f4e47638e5c23566e217993: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:28.671569 23234 leader_election.cc:290] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.696156 13792 raft_consensus.cc:2272] T 7933f8a0325b4bf7a8bafc99c9284091 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.704207 13792 tablet_replica.cc:333] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.705325 13792 raft_consensus.cc:2243] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.681716 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.671547 23232 leader_election.cc:290] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.707690 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.719940 13792 raft_consensus.cc:2272] T 73ceb2cea7314e0cadb64aa9ccbad8de P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.724817 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2287a0d46a894be29150ebdc058fcfb6" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.728513 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9648bab22a13442a81e0775163508e93" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.743886 23232 raft_consensus.cc:493] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.744589 23232 raft_consensus.cc:515] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.747013 23232 leader_election.cc:290] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.754410 23093 raft_consensus.cc:493] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.754911 23093 raft_consensus.cc:515] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.756873 23093 leader_election.cc:290] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.760115 15041 raft_consensus.cc:1275] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Refusing update from remote peer 25b8f0cc46f748468395543b8b174bf4: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 13:08:28.764277 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.765631 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:28.771129 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:28.779589 15007 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:28.780166 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:28.781675 13792 tablet_replica.cc:333] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.790133 13792 raft_consensus.cc:2243] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.790832 13792 raft_consensus.cc:2272] T e466470834d346b8a99b98e620844e85 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:28.783931 14933 consensus_peers.cc:597] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:28.784768 23255 consensus_queue.cc:1048] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:08:28.796444 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3da3e723e874330b684997f3ab5385e" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.804365 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9af86494f14821b5b88018dbe4a1c2" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.806586 13792 tablet_replica.cc:333] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.807453 23255 raft_consensus.cc:493] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.807633 14936 leader_election.cc:304] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:28.808025 23255 raft_consensus.cc:515] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.808851 14936 leader_election.cc:304] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:28.809600 23093 raft_consensus.cc:2749] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:28.810231 23255 leader_election.cc:290] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.810297 23093 raft_consensus.cc:2749] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:28.812232 13792 raft_consensus.cc:2243] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.816481 13792 pending_rounds.cc:70] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Trying to abort 1 pending ops.
I20260709 13:08:28.818526 13792 pending_rounds.cc:77] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4: Aborting op as it isn't in flight: id { term: 23 index: 16 } timestamp: 7305635868954808320 op_type: NO_OP noop_request { }
I20260709 13:08:28.819928 13792 raft_consensus.cc:2889] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:08:28.820381 13792 raft_consensus.cc:2272] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.831992 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.841909 13792 tablet_replica.cc:333] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.845533 23135 raft_consensus.cc:493] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.846179 23135 raft_consensus.cc:515] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.849635 23135 leader_election.cc:290] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.859982 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13ff541fc966499ea2706d34cfb2c964" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.866223 13792 raft_consensus.cc:2243] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:28.871922 23135 raft_consensus.cc:493] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.872628 23255 raft_consensus.cc:493] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.883054 23255 raft_consensus.cc:515] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.885218 23255 leader_election.cc:290] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.882258 23135 raft_consensus.cc:515] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.888278 23135 leader_election.cc:290] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.890045 13792 raft_consensus.cc:2272] T 5cbe935ec59f4f31a383418c80f8823b P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.898974 23232 raft_consensus.cc:493] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:28.899621 23232 raft_consensus.cc:515] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:28.902112 23232 leader_election.cc:290] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:28.895869 14936 leader_election.cc:304] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:28.903568 23232 raft_consensus.cc:2749] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:28.908154 14933 leader_election.cc:336] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:28.909886 23232 raft_consensus.cc:493] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:28.910496 23232 raft_consensus.cc:515] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.913538 23232 leader_election.cc:290] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.915273 23232 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:28.916381 14936 leader_election.cc:304] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:28.918088 14933 leader_election.cc:336] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:28.915798 23232 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.924383 23232 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:28.924942 23135 raft_consensus.cc:2749] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:28.926262 13792 tablet_replica.cc:333] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.937914 23255 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:28.944144 23255 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:28.947255 23255 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:28.952956 14933 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:28.957121 13792 raft_consensus.cc:2243] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:08:28.964526 13792 raft_consensus.cc:2272] T 146ff3031af843e3a501710c2301a015 P 25b8f0cc46f748468395543b8b174bf4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:28.937434 14936 leader_election.cc:304] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:28.971365 23255 raft_consensus.cc:2749] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:28.974939 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.975595 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.977222 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "022fa149e13b44eeae0eb2555eb6eb80" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.978402 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67571e95c6f547b989f85aa109da10a9" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.986848 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.989151 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.990406 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a698f3a4fb348b4a13de15324682404" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.990993 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.993583 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:28.994781 13792 tablet_replica.cc:333] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:28.997131 15041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85c193fa13b46d9bceea2295f514c29" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.994663 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ab3877f8e9e4155a67e7a196ed5eb60" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 27 candidate_status { last_received { term: 26 index: 17 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:28.996390 15036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a86ee695370844fcbe0c2c00edd26e73" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:29.004067 13792 raft_consensus.cc:2243] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.018896 13792 raft_consensus.cc:2272] T 66e4432ba29a43668db5483ebef3b522 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.024406 23232 raft_consensus.cc:493] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:29.025096 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "770c4e1c2abb48cba0a9b362f6be74f5" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:29.027773 23232 raft_consensus.cc:515] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:29.030006 23232 leader_election.cc:290] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:29.032500 14936 leader_election.cc:304] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.038385 13792 tablet_replica.cc:333] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.043867 23232 raft_consensus.cc:493] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:29.045953 23232 raft_consensus.cc:515] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:29.049316 23232 leader_election.cc:290] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:29.050638 14936 leader_election.cc:304] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:29.051891 15007 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:29.056511 23255 raft_consensus.cc:2749] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:29.066308 13792 raft_consensus.cc:2243] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.066601 23255 raft_consensus.cc:2749] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.067328 14936 leader_election.cc:304] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:29.078380 14936 leader_election.cc:304] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.081816 23206 raft_consensus.cc:2749] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:29.083683 23243 raft_consensus.cc:493] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:29.084245 23243 raft_consensus.cc:515] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:29.086562 23243 leader_election.cc:290] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:29.088075 14936 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:29.090914 23135 raft_consensus.cc:2749] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:29.095286 14933 leader_election.cc:336] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:29.095660 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbe1d22f90c742fd86d8bd93e5d59e59" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:29.107062 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7dd8999b5f24b039d0adbe5c24edbc3" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:29.112233 23135 raft_consensus.cc:493] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:29.112747 23135 raft_consensus.cc:515] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:29.113462 13792 raft_consensus.cc:2272] T ebef2badb7124b9fa530c8877d638abe P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.102963 23243 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:29.119339 14933 leader_election.cc:336] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:29.121104 15044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "376f02b12a354291b7600c9c176e3885" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:29.122558 23135 leader_election.cc:290] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:29.125849 13792 tablet_replica.cc:333] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.125726 23232 raft_consensus.cc:493] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 58ee9fe38eb8453098f6d964e7675e79)
I20260709 13:08:29.126487 23232 raft_consensus.cc:515] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:29.128800 23232 leader_election.cc:290] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:29.129737 13792 raft_consensus.cc:2243] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.130463 13792 raft_consensus.cc:2272] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:29.124100 14933 leader_election.cc:336] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:29.132431 14933 leader_election.cc:336] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:29.133399 13792 tablet_replica.cc:333] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.134260 13792 raft_consensus.cc:2243] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.135262 13792 raft_consensus.cc:2272] T 8b1d51e80f4e47638e5c23566e217993 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.137959 13792 tablet_replica.cc:333] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.138744 13792 raft_consensus.cc:2243] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.139313 13792 raft_consensus.cc:2272] T f85c193fa13b46d9bceea2295f514c29 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:29.141083 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:29.143951 14936 leader_election.cc:304] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.144425 13792 tablet_replica.cc:333] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
W20260709 13:08:29.144731 14936 raft_consensus.cc:2686] T 6ab3877f8e9e4155a67e7a196ed5eb60 P 25b8f0cc46f748468395543b8b174bf4: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:08:29.145287 13792 raft_consensus.cc:2243] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 22 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.145578 14936 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.147336 23135 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.151005 14936 leader_election.cc:304] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.146196 13792 raft_consensus.cc:2272] T 1ecb36ffe5e640f88b50155fa361883d P 25b8f0cc46f748468395543b8b174bf4 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.152202 14936 leader_election.cc:304] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.153151 23232 raft_consensus.cc:2749] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:29.153991 23135 raft_consensus.cc:2749] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:08:29.155120 14936 leader_election.cc:304] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:29.155941 23135 raft_consensus.cc:2749] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:08:29.159961 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d441a969a644366b3cb4d386d7273e1" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:29.162154 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ae8a41be2704a038fb65d4e543a826c" candidate_uuid: "25b8f0cc46f748468395543b8b174bf4" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:29.166944 14933 leader_election.cc:336] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:29.166889 14936 leader_election.cc:304] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:29.171743 23135 raft_consensus.cc:2749] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:29.173044 14936 leader_election.cc:304] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 25b8f0cc46f748468395543b8b174bf4; no voters: 58ee9fe38eb8453098f6d964e7675e79, e4938453819c469599f515b22d92fe27
I20260709 13:08:29.174341 13792 tablet_replica.cc:333] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.175364 13792 raft_consensus.cc:2243] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.179100 13792 raft_consensus.cc:2272] T 67571e95c6f547b989f85aa109da10a9 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.176070 23135 raft_consensus.cc:2749] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:08:29.182581 13792 tablet_replica.cc:333] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.183348 13792 raft_consensus.cc:2243] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.193110 13792 raft_consensus.cc:2272] T 8b9af86494f14821b5b88018dbe4a1c2 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.196172 13792 tablet_replica.cc:333] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.197082 13792 raft_consensus.cc:2243] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.198096 13792 raft_consensus.cc:2272] T cfa2777cd48541b3b2bcf2ed038ac645 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.207329 13792 tablet_replica.cc:333] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.212818 13792 raft_consensus.cc:2243] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.213912 13792 raft_consensus.cc:2272] T c8fa9dae6116418f8b520fc591ae5757 P 25b8f0cc46f748468395543b8b174bf4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.216743 13792 tablet_replica.cc:333] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.217796 13792 raft_consensus.cc:2243] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.218845 13792 raft_consensus.cc:2272] T 1040e321bc7c46f79cd0ad55259aba21 P 25b8f0cc46f748468395543b8b174bf4 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.221789 13792 tablet_replica.cc:333] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.222733 13792 raft_consensus.cc:2243] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.223366 13792 raft_consensus.cc:2272] T 5ae8a41be2704a038fb65d4e543a826c P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.226740 13792 tablet_replica.cc:333] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.227538 13792 raft_consensus.cc:2243] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.228127 13792 raft_consensus.cc:2272] T 9648bab22a13442a81e0775163508e93 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.230906 13792 tablet_replica.cc:333] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.231761 13792 raft_consensus.cc:2243] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.232328 13792 raft_consensus.cc:2272] T a3da3e723e874330b684997f3ab5385e P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.234903 13792 tablet_replica.cc:333] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.242712 13792 raft_consensus.cc:2243] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.243449 13792 raft_consensus.cc:2272] T b7dd8999b5f24b039d0adbe5c24edbc3 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.246191 13792 tablet_replica.cc:333] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.247025 13792 raft_consensus.cc:2243] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.248093 13792 raft_consensus.cc:2272] T da044c14437c4be087d871f129926239 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.251072 13792 tablet_replica.cc:333] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.251843 13792 raft_consensus.cc:2243] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.252923 13792 raft_consensus.cc:2272] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.261580 13792 tablet_replica.cc:333] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.262442 13792 raft_consensus.cc:2243] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.263608 13792 raft_consensus.cc:2272] T be840274e2c843b9b2b9f24277dca78d P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.266291 13792 tablet_replica.cc:333] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.267138 13792 raft_consensus.cc:2243] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.268244 13792 raft_consensus.cc:2272] T 77cfe8a6078741239e2d788a50d260dc P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.271006 13792 tablet_replica.cc:333] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.271852 13792 raft_consensus.cc:2243] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.272482 13792 raft_consensus.cc:2272] T 376f02b12a354291b7600c9c176e3885 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.275024 13792 tablet_replica.cc:333] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.275882 13792 raft_consensus.cc:2243] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.276510 13792 raft_consensus.cc:2272] T 022fa149e13b44eeae0eb2555eb6eb80 P 25b8f0cc46f748468395543b8b174bf4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.279428 13792 tablet_replica.cc:333] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.280141 13792 raft_consensus.cc:2243] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.284009 13792 raft_consensus.cc:2272] T 46876532b5b6444ba4fbaa536a316857 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.286813 13792 tablet_replica.cc:333] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.287662 13792 raft_consensus.cc:2243] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.288813 13792 raft_consensus.cc:2272] T b9511e929bc448349baf940df42e2a22 P 25b8f0cc46f748468395543b8b174bf4 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.291359 13792 tablet_replica.cc:333] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.292243 13792 raft_consensus.cc:2243] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.293133 13792 raft_consensus.cc:2272] T 13ff541fc966499ea2706d34cfb2c964 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.295869 13792 tablet_replica.cc:333] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.296792 13792 raft_consensus.cc:2243] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.297398 13792 raft_consensus.cc:2272] T 770c4e1c2abb48cba0a9b362f6be74f5 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.299894 13792 tablet_replica.cc:333] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.300650 13792 raft_consensus.cc:2243] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.301196 13792 raft_consensus.cc:2272] T cbe1d22f90c742fd86d8bd93e5d59e59 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.303720 13792 tablet_replica.cc:333] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.304478 13792 raft_consensus.cc:2243] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.305647 13792 raft_consensus.cc:2272] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 25b8f0cc46f748468395543b8b174bf4 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.308339 13792 tablet_replica.cc:333] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.309064 13792 raft_consensus.cc:2243] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.310528 13792 raft_consensus.cc:2272] T b4b44d3457824f63aaf8c5cafbd75ea0 P 25b8f0cc46f748468395543b8b174bf4 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.313069 13792 tablet_replica.cc:333] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.313836 13792 raft_consensus.cc:2243] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.314910 13792 raft_consensus.cc:2272] T 205008a787ca45349273b1e8daaebdf5 P 25b8f0cc46f748468395543b8b174bf4 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.317667 13792 tablet_replica.cc:333] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.318495 13792 raft_consensus.cc:2243] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.319500 13792 raft_consensus.cc:2272] T 338c720b04aa4c14b53937055c254e24 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.323606 13792 tablet_replica.cc:333] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.324293 13792 raft_consensus.cc:2243] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.325412 13792 raft_consensus.cc:2272] T 37a7135d72784bd590fd05aeda0ea3b6 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.327942 13792 tablet_replica.cc:333] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.328619 13792 raft_consensus.cc:2243] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.329350 13792 raft_consensus.cc:2272] T a86ee695370844fcbe0c2c00edd26e73 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.331955 13792 tablet_replica.cc:333] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.332706 13792 raft_consensus.cc:2243] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.333355 13792 raft_consensus.cc:2272] T 6a698f3a4fb348b4a13de15324682404 P 25b8f0cc46f748468395543b8b174bf4 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.335954 13792 tablet_replica.cc:333] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.336720 13792 raft_consensus.cc:2243] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:29.337745 13792 raft_consensus.cc:2272] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 25b8f0cc46f748468395543b8b174bf4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.340265 13792 tablet_replica.cc:333] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.340889 13792 raft_consensus.cc:2243] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.341410 13792 raft_consensus.cc:2272] T 2287a0d46a894be29150ebdc058fcfb6 P 25b8f0cc46f748468395543b8b174bf4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:29.346635 13792 tablet_replica.cc:333] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4: stopping tablet replica
I20260709 13:08:29.347306 13792 raft_consensus.cc:2243] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:29.347920 13792 raft_consensus.cc:2272] T 7d441a969a644366b3cb4d386d7273e1 P 25b8f0cc46f748468395543b8b174bf4 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:29.359100 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:29.372406 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:29.397354 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:29.445272 15007 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:29.629813 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:29.810168 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8b1d51e80f4e47638e5c23566e217993: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:29.865417 14780 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 770c4e1c2abb48cba0a9b362f6be74f5 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER failed with leader eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271) due to error UNKNOWN_ERROR; will retry: Invalid argument: Cannot remove peer eb4a5ac9f0c5425b92051187b939860f from the config because it is the leader. Force another leader to be elected to remove this peer. Consensus state: current_term: 23 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } } }
W20260709 13:08:29.866654 15514 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:29.972199 23238 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:29.972779 23238 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:29.974875 23238 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:29.984325 15514 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.002909 15008 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.040601 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:30.080595 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:30.205302 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:30.213549 15513 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.214071 15513 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.214866 23263 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:30.218168 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:30.243400 23263 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.244032 23263 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.246390 23263 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.252641 15514 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.262253 15514 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.264585 15007 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:30.264937 15513 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:30.270851 15514 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.271332 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.275007 23238 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.277684 23246 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:30.277513 23238 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:30.278254 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:30.278365 23246 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.279029 23246 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.279863 23238 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:30.281001 23246 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:30.274587 23263 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.282413 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:30.282675 23263 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.285418 23263 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:30.287002 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:30.290551 15008 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.292317 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.300427 23263 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.300979 23263 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.303109 23263 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.306543 15514 leader_election.cc:336] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.307106 15514 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:30.307674 23265 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.309275 23265 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:30.308758 15514 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.310729 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.310689 23263 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 13:08:30.312472 23263 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.312976 23246 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:30.313158 23263 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:30.314284 15514 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.314698 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:30.315639 23263 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:30.317466 23265 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:30.318173 23246 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:30.327499 23263 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:30.328467 15514 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.329984 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:30.328969 23263 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.332896 23263 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.333609 15514 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.334353 15514 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.338071 15513 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.338711 15513 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.339140 23264 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.339457 23246 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:30.339656 23264 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:30.340975 15514 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.341845 23264 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:30.343258 15513 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.343688 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.344329 23246 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:30.344717 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
W20260709 13:08:30.345455 15513 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.345904 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.346534 23246 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:30.346693 15513 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.347131 15513 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.347816 23246 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:30.351751 15008 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.352198 15008 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:30.353359 23241 raft_consensus.cc:2749] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:30.368422 15514 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.388725 15008 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.403705 15514 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.424918 15514 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.431282 15514 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.484117 23265 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.484655 23265 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.486726 23265 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.494379 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:30.495185 15514 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.495609 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.496802 23265 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:30.498865 13792 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 14991)
W20260709 13:08:30.512737 15514 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.515969 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:30.516711 15514 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.517864 23265 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.518446 23265 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.521895 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:30.522535 15039 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 19.
I20260709 13:08:30.523775 15516 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:30.524467 23238 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:08:30.524886 23238 raft_consensus.cc:493] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.525262 23238 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.528188 23265 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:30.535949 23241 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.536550 23241 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:30.540243 15514 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.544193 23238 raft_consensus.cc:515] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:30.551589 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.538810 23241 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.555706 15008 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.557723 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:30.565330 15514 leader_election.cc:336] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.567173 23264 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:30.568301 15008 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.577116 15514 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.577821 23238 leader_election.cc:290] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:30.580906 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b1d51e80f4e47638e5c23566e217993" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:30.581530 15039 raft_consensus.cc:3060] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:08:30.592305 15039 raft_consensus.cc:2468] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 20.
W20260709 13:08:30.596299 15008 consensus_peers.cc:597] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.605135 15516 leader_election.cc:304] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:30.605865 23238 raft_consensus.cc:2804] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:08:30.606346 23238 raft_consensus.cc:697] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:30.607170 23238 consensus_queue.cc:237] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.607645 23264 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.608229 23264 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.611289 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:30.616456 23246 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.616979 23246 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.619074 23246 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.626294 15514 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.628908 15513 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.629297 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.630198 23263 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:30.617255 23264 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:30.630963 15514 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.637338 15514 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.659672 23264 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.660306 23264 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.665277 23241 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.665869 23241 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.667121 14791 catalog_manager.cc:5697] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 19 to 20, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 20 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:08:30.668021 23241 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
I20260709 13:08:30.670126 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:30.670739 15549 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 26.
I20260709 13:08:30.671857 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:30.673017 23236 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:30.673413 23236 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.673786 23236 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:30.680960 23238 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.681612 23238 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.682288 23236 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.684588 23238 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:30.684870 23241 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.685691 23238 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.685479 23241 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:30.686174 23238 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.687760 23241 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.691036 15513 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.690862 23238 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:30.696445 15007 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.698405 23263 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.699071 23263 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.707651 23241 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.719498 23241 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:30.708931 23264 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:30.711781 15513 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.702579 23263 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:30.733526 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:30.734341 15039 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 26.
I20260709 13:08:30.734478 15043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
W20260709 13:08:30.727977 15514 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.737408 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:30.738230 15549 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 25.
I20260709 13:08:30.739017 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:30.739820 15514 leader_election.cc:336] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.739717 15010 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
W20260709 13:08:30.745016 15008 leader_election.cc:336] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.746124 23271 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.746721 23271 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:30.747356 23264 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 13:08:30.747795 23264 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.748864 23264 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 25 FOLLOWER]: Advancing to term 26
I20260709 13:08:30.749516 23271 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:30.743899 23246 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:30.751438 23236 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:30.753569 15514 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.753988 15514 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.754400 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfa2777cd48541b3b2bcf2ed038ac645" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:30.755259 15549 raft_consensus.cc:3060] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:30.756179 15008 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, 58ee9fe38eb8453098f6d964e7675e79
I20260709 13:08:30.759676 23246 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:30.764649 23264 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.766036 15549 raft_consensus.cc:2468] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 27.
W20260709 13:08:30.766340 15008 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.767567 15010 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:30.768788 23271 raft_consensus.cc:2804] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:30.769265 23271 raft_consensus.cc:697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 27 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:30.770123 23271 consensus_queue.cc:237] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.772120 23241 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:30.766564 23236 raft_consensus.cc:2749] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:30.793577 23264 leader_election.cc:290] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:30.794274 15513 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:30.794734 15549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da044c14437c4be087d871f129926239" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79"
I20260709 13:08:30.795986 15549 raft_consensus.cc:3060] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Advancing to term 26
W20260709 13:08:30.802960 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:30.802973 15549 raft_consensus.cc:2468] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 26.
I20260709 13:08:30.804251 15010 leader_election.cc:304] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 
I20260709 13:08:30.805140 23271 raft_consensus.cc:2804] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 13:08:30.805634 23271 raft_consensus.cc:697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 26 LEADER]: Becoming Leader. State: Replica: eb4a5ac9f0c5425b92051187b939860f, State: Running, Role: LEADER
I20260709 13:08:30.806565 23271 consensus_queue.cc:237] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.812275 23272 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.812777 23272 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.816769 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:30.817369 15545 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
I20260709 13:08:30.817644 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:30.819279 23246 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 13:08:30.819768 23246 raft_consensus.cc:493] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:30.820210 23246 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:30.815335 23272 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:30.831157 15007 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.833559 23272 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
W20260709 13:08:30.843500 15008 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.843698 23272 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:30.844354 15008 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.844769 15008 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.845139 15008 leader_election.cc:336] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.840878 15514 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:08:30.845688 23272 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:30.846547 15007 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:30.852587 15007 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:30.852994 23246 raft_consensus.cc:515] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:30.850719 14792 catalog_manager.cc:5697] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 26 to 27, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 27 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:30.864885 15514 leader_election.cc:336] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.866199 23246 leader_election.cc:290] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 election: Requested vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:30.872170 15007 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:30.845742 15008 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.880069 15008 consensus_peers.cc:597] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.880781 15008 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.881296 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.887252 23271 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:30.883455 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:30.894004 15008 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.894536 15008 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.899374 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:30.900683 15008 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.901036 23272 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:30.898984 14792 catalog_manager.cc:5697] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f reported cstate change: term changed from 25 to 26, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to eb4a5ac9f0c5425b92051187b939860f (127.13.120.3). New cstate: current_term: 26 leader_uuid: "eb4a5ac9f0c5425b92051187b939860f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:08:30.910763 15008 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.911271 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.912024 23272 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:30.912968 15008 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:30.913427 15008 leader_election.cc:336] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:30.914466 15008 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.917251 15008 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:30.917985 23272 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:30.927220 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1040e321bc7c46f79cd0ad55259aba21" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f"
I20260709 13:08:30.927775 15039 raft_consensus.cc:3060] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Advancing to term 27
I20260709 13:08:30.940562 15039 raft_consensus.cc:2468] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 27.
W20260709 13:08:30.944968 15008 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:30.945533 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:30.951021 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:30.951224 23272 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:30.953451 15516 leader_election.cc:304] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4
I20260709 13:08:30.955857 23246 raft_consensus.cc:2804] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 13:08:30.956367 23246 raft_consensus.cc:697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 LEADER]: Becoming Leader. State: Replica: 58ee9fe38eb8453098f6d964e7675e79, State: Running, Role: LEADER
I20260709 13:08:30.957252 23246 consensus_queue.cc:237] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:30.960228 15007 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:30.996889 14792 catalog_manager.cc:5697] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 reported cstate change: term changed from 26 to 27, leader changed from 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2) to 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4). New cstate: current_term: 27 leader_uuid: "58ee9fe38eb8453098f6d964e7675e79" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:08:31.075517 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:31.084465 15039 raft_consensus.cc:1275] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:08:31.085956 23263 consensus_queue.cc:1048] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 13:08:31.108675 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:31.163025 15514 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.212700 15549 raft_consensus.cc:1275] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 13:08:31.214246 23272 consensus_queue.cc:1048] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260709 13:08:31.274529 15008 consensus_peers.cc:597] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:31.278139 15545 raft_consensus.cc:1275] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Refusing update from remote peer eb4a5ac9f0c5425b92051187b939860f: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 26 index: 21. (index mismatch)
I20260709 13:08:31.280654 23264 consensus_queue.cc:1048] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [LEADER]: Connected to new peer: Peer: permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260709 13:08:31.326640 15008 consensus_peers.cc:597] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.356071 15007 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:31.378262 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:31.399782 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:31.400381 15513 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:31.466151 15039 raft_consensus.cc:1275] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Refusing update from remote peer 58ee9fe38eb8453098f6d964e7675e79: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260709 13:08:31.468727 23238 consensus_queue.cc:1048] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 13:08:31.499993 13792 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 14991)
W20260709 13:08:31.523586 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:31.541252 15514 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:31.578172 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:31.607566 15007 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:31.717062 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:31.744534 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:31.836417 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:31.924556 23238 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:31.925071 23238 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:31.927073 23238 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:31.947590 15513 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:31.953634 15514 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:31.954166 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:31.955700 23246 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:31.964691 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:32.041563 23263 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.042217 23263 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.044392 23263 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:32.048810 23246 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.061250 23246 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.063621 23246 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.052062 15513 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.094131 15513 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.111577 15514 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.113489 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:32.114147 14777 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.13.120.1:46755, user_credentials={real_user=slave}} blocked reactor thread for 104767us
W20260709 13:08:32.127810 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8b1d51e80f4e47638e5c23566e217993: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:32.114849 23246 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.129063 23246 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.133384 23246 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:32.154873 23238 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:32.158010 15514 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.158545 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.196424 23246 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:32.176844 15513 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:32.231709 23271 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.232292 23271 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:32.234458 23271 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.250007 15514 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.254498 23246 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.258087 23246 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.260439 23246 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:32.261322 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.272457 23263 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:08:32.277158 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.305776 15513 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.309167 15008 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:32.308589 15007 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:32.322476 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.323280 23264 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:32.324862 15514 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.327230 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:32.326006 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:32.336177 23263 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.336748 23263 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.338819 23263 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:32.339433 23246 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:32.361925 23263 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.362640 23263 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.365649 23263 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:32.380654 23263 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.381702 23263 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.384343 23263 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.401791 15513 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.403859 15514 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.405669 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.409655 23263 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:32.415946 15039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "58ee9fe38eb8453098f6d964e7675e79" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "eb4a5ac9f0c5425b92051187b939860f" is_pre_election: true
I20260709 13:08:32.416612 15039 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 58ee9fe38eb8453098f6d964e7675e79 in term 24.
W20260709 13:08:32.425858 15513 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.436805 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.436008 15008 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.444319 15514 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.447321 15514 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:32.460316 15514 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.463606 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.460902 23263 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:32.479028 23263 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:32.485925 23246 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.486457 23246 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.488626 23246 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.500490 13792 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 14991)
W20260709 13:08:32.513139 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:32.537130 15514 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.540606 15513 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.545516 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:32.567245 15514 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.567797 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.573689 23263 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:08:32.580546 23263 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.581421 23263 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.583449 23263 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.598269 15513 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.604068 15514 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.605525 15514 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.607018 23263 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:32.606560 15514 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.620807 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:32.663486 14782 maintenance_manager.cc:419] P d930a2d37e98496a8994b1d260968086: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033371
W20260709 13:08:32.688647 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:32.738679 23263 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.739570 23263 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:32.746259 23263 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.740861 15514 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.758155 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:32.758754 14781 maintenance_manager.cc:643] P d930a2d37e98496a8994b1d260968086: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.094s	user 0.044s	sys 0.005s Metrics: {"bytes_written":9741,"delete_count":0,"lbm_write_time_us":979,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":16621,"threads_started":1,"update_count":387,"wal-append.queue_time_us":16316}
I20260709 13:08:32.772595 14782 maintenance_manager.cc:419] P d930a2d37e98496a8994b1d260968086: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.447717
W20260709 13:08:32.776073 15514 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.777844 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.778643 23238 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:32.800081 23264 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.802227 23264 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:32.807086 23264 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.831297 15008 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.843036 15007 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:32.846531 15514 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.857914 15008 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:32.861795 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:32.862949 23264 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:32.882436 15007 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:32.898599 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:32.908396 15008 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.927284 15514 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.929553 15008 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:32.952092 15514 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:32.978482 23264 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:32.979193 23264 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:32.989531 23264 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:32.994304 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:33.003597 15008 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:33.004534 15007 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:33.008656 15007 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:33.025113 23264 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:33.060791 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:33.065713 15514 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.061687 15008 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.071262 15514 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.073293 14781 maintenance_manager.cc:643] P d930a2d37e98496a8994b1d260968086: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.300s	user 0.122s	sys 0.010s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":30417,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":14811,"dirs.run_cpu_time_us":602,"dirs.run_wall_time_us":1478,"lbm_read_time_us":2018,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1649,"lbm_writes_lt_1ms":12,"peak_mem_usage":603364,"reinsert_count":0,"thread_start_us":18508,"threads_started":2,"update_count":390}
W20260709 13:08:33.075946 15008 consensus_peers.cc:597] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.083547 23264 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:33.084219 23264 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:33.089996 14782 maintenance_manager.cc:419] P d930a2d37e98496a8994b1d260968086: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
W20260709 13:08:33.090714 15007 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:33.090832 14781 maintenance_manager.cc:643] P d930a2d37e98496a8994b1d260968086: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260709 13:08:33.091437 23264 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:33.106796 15514 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:33.130681 23264 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:33.131338 23264 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:33.133279 23264 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:33.163278 15007 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:33.167603 15008 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:33.168102 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:33.168823 23264 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:33.195549 15514 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.175779 15008 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:33.204473 15008 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:33.230731 23264 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:33.231460 15514 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.232883 15008 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:43345, user_credentials={real_user=slave}} blocked reactor thread for 57128.3us
W20260709 13:08:33.258198 15008 consensus_peers.cc:597] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.287655 15008 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.292538 15008 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.299585 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:33.323104 15008 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.340952 15008 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.364817 15514 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.409027 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:33.434850 15008 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.438553 15514 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:33.455854 15008 consensus_peers.cc:597] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.501057 13792 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 14991)
W20260709 13:08:33.521852 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:33.545488 15514 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111) [suppressed 640 similar messages]
W20260709 13:08:33.558566 15007 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:33.614634 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:08:33.622567 15513 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:33.673642 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:33.705386 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:33.759285 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:33.775161 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:33.813400 15007 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:33.904865 15008 consensus_peers.cc:597] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.916483 15514 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:33.996775 15513 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:34.216342 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:34.229988 15007 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:34.320037 15007 consensus_peers.cc:597] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:34.321286 23263 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:34.321800 23263 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:34.323634 23263 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:34.330467 15513 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:34.335336 15514 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:34.335786 15514 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:34.337627 23296 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:34.345197 15514 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:34.345938 15007 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:34.352967 15007 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:34.438104 23264 raft_consensus.cc:493] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:34.438625 23264 raft_consensus.cc:515] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:34.441848 23264 leader_election.cc:290] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:34.446957 15007 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:34.453150 15008 leader_election.cc:336] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:34.453636 15008 leader_election.cc:304] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:34.454566 23264 raft_consensus.cc:2749] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 13:08:34.578137 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:34.582388 23264 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:34.582923 23264 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:34.586558 15545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b44d3457824f63aaf8c5cafbd75ea0" candidate_uuid: "eb4a5ac9f0c5425b92051187b939860f" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "58ee9fe38eb8453098f6d964e7675e79" is_pre_election: true
I20260709 13:08:34.587126 15545 raft_consensus.cc:2468] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4a5ac9f0c5425b92051187b939860f in term 24.
W20260709 13:08:34.589902 15008 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:34.593504 23264 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), 58ee9fe38eb8453098f6d964e7675e79 (127.13.120.4:39473)
W20260709 13:08:34.595793 15007 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:34.596288 15007 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79, eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:34.598361 23271 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:34.656883 15007 consensus_peers.cc:597] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:34.679979 15007 consensus_peers.cc:597] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:34.885728 23297 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:34.887207 23297 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:34.890306 23297 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:34.963621 15513 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:34.964576 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:34.981777 23300 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:34.983898 23300 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:34.993225 15513 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:34.995241 23300 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:35.017143 23298 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.018328 23298 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:35.028419 23298 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:35.029124 23296 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.029891 23296 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:35.032969 15513 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:35.046850 23296 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:35.049875 15514 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.050083 23296 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.050520 15514 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:35.051290 15513 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:35.051208 23296 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:35.055614 23300 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:35.056699 23296 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:35.057636 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:35.067385 15514 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.068150 15514 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.068653 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.069528 23296 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:35.070459 15514 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.070958 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.071861 23300 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:35.086232 15514 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.086776 15514 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.087172 23300 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.087690 23302 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:35.088795 23300 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:35.091214 23300 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:35.096264 15513 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:35.097184 15514 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.097682 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.099419 23300 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:35.100111 15007 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:35.104192 15514 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.104730 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.105934 23300 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:35.118302 15514 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.134943 15008 consensus_peers.cc:597] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.152607 15007 consensus_peers.cc:597] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:35.164129 23300 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.165119 23300 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:35.178161 15514 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:35.179570 15513 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:35.180008 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.181037 23296 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:35.182663 23300 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:35.249445 23308 raft_consensus.cc:493] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.250425 23308 raft_consensus.cc:515] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:35.262244 15514 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.265488 15007 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:35.276237 15008 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:35.299054 15007 leader_election.cc:336] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:35.301456 15007 leader_election.cc:304] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.302054 23308 leader_election.cc:290] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
I20260709 13:08:35.305558 23271 raft_consensus.cc:2749] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:35.321704 15007 consensus_peers.cc:597] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:35.357333 15514 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:35.379707 23300 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.380517 23300 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:35.382787 23300 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:35.389879 15513 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:35.396111 15514 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.396611 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.397363 23300 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:35.400301 15514 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.439704 15008 consensus_peers.cc:597] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.520015 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:35.538111 15008 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:35.549914 23302 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.550765 23302 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:35.552995 23302 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:35.541400 15007 consensus_peers.cc:597] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:35.568442 15514 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.600651 15008 consensus_peers.cc:597] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.605947 15514 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.606890 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:35.609722 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
W20260709 13:08:35.611028 15514 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.615693 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:35.629347 23302 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:35.626832 15008 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.651386 15514 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.658532 15008 consensus_peers.cc:597] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.661976 15514 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.693759 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:35.696616 15008 consensus_peers.cc:597] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.718641 15514 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:35.752130 23308 raft_consensus.cc:493] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:35.752957 23308 raft_consensus.cc:515] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
W20260709 13:08:35.763661 15007 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:35.764171 23308 leader_election.cc:290] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:35.773391 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08001c8640 after lost signal to thread 13795
W20260709 13:08:35.774646 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800192be0 after lost signal to thread 14827
W20260709 13:08:35.780431 14824 debug-util.cc:398] Leaking SignalData structure 0x7b080035a3c0 after lost signal to thread 15068
W20260709 13:08:35.781924 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800313420 after lost signal to thread 15574
W20260709 13:08:35.803056 15008 leader_election.cc:336] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:35.804805 15008 leader_election.cc:304] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
W20260709 13:08:35.804311 15514 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:35.807478 23308 raft_consensus.cc:2749] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:35.818468 15514 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:35.874182 15008 consensus_peers.cc:597] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:35.885819 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
W20260709 13:08:35.971487 15516 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:35.980180 15516 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:35.984910 15516 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.014473 15007 consensus_peers.cc:597] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:36.054276 15008 consensus_peers.cc:597] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.060020 15516 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.061218 15516 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.069433 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:08:36.070940 15516 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.072386 13792 tablet_replica.cc:333] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.073426 13792 raft_consensus.cc:2243] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.074321 13792 raft_consensus.cc:2272] T 156c010162bf4cb99b535677eccb2740 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.076953 15516 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.077371 13792 tablet_replica.cc:333] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.078418 13792 raft_consensus.cc:2243] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Raft consensus shutting down.
W20260709 13:08:36.080205 15516 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.080772 15516 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.082636 15516 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.101873 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:36.122255 13792 raft_consensus.cc:2272] T 96fa5275273743d0973b36e2f0c784cb P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.134764 13792 tablet_replica.cc:333] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.158069 13792 raft_consensus.cc:2243] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.161602 13792 raft_consensus.cc:2272] T 290e1d2493f34d57807c1a358aa0f71e P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.141212 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:36.160137 15008 consensus_peers.cc:597] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:08:36.156566 15516 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.175694 15514 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.182499 15516 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.185986 15516 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:08:36.186612 15516 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.244011 13792 tablet_replica.cc:333] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.245092 13792 raft_consensus.cc:2243] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.246277 13792 raft_consensus.cc:2272] T f7a1be4a55754b9baba160c70df7dc21 P eb4a5ac9f0c5425b92051187b939860f [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.251930 13792 tablet_replica.cc:333] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.252871 13792 raft_consensus.cc:2243] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.254585 13792 raft_consensus.cc:2272] T 8de39bcda9f4437d8538be04713851b1 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.257637 13792 tablet_replica.cc:333] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.258595 13792 raft_consensus.cc:2243] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.261163 13792 raft_consensus.cc:2272] T 83edd178ff3943b58ccf199ddc331aec P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.264204 13792 tablet_replica.cc:333] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
W20260709 13:08:36.264277 15516 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.265147 13792 raft_consensus.cc:2243] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.269876 13792 raft_consensus.cc:2272] T 80a1bdc86202444db87b94ea818eedd5 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.273227 13792 tablet_replica.cc:333] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
W20260709 13:08:36.272701 15516 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.274766 13792 raft_consensus.cc:2243] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.276964 13792 raft_consensus.cc:2272] T da044c14437c4be087d871f129926239 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.279855 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8b1d51e80f4e47638e5c23566e217993: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:36.282176 13792 tablet_replica.cc:333] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.284260 13792 raft_consensus.cc:2243] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.285470 13792 raft_consensus.cc:2272] T b7dd8999b5f24b039d0adbe5c24edbc3 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.294286 15007 consensus_peers.cc:597] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:36.297283 13792 tablet_replica.cc:333] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.298312 13792 raft_consensus.cc:2243] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.301685 13792 raft_consensus.cc:2272] T 060cd1347c834f27a9abc4cf6d5584a9 P eb4a5ac9f0c5425b92051187b939860f [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.304777 13792 tablet_replica.cc:333] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
W20260709 13:08:36.309358 15516 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.305703 13792 raft_consensus.cc:2243] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.313478 13792 raft_consensus.cc:2272] T 73ceb2cea7314e0cadb64aa9ccbad8de P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.314826 15008 consensus_peers.cc:597] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:08:36.315596 15008 consensus_peers.cc:597] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:36.317291 13792 tablet_replica.cc:333] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.318773 13792 raft_consensus.cc:2243] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.322206 13792 raft_consensus.cc:2272] T 5cbe935ec59f4f31a383418c80f8823b P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.323187 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:36.323781 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:36.324934 13792 tablet_replica.cc:333] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.327252 13792 raft_consensus.cc:2243] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.328806 13792 raft_consensus.cc:2272] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.331458 13792 tablet_replica.cc:333] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.332266 13792 raft_consensus.cc:2243] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.333365 13792 raft_consensus.cc:2272] T e466470834d346b8a99b98e620844e85 P eb4a5ac9f0c5425b92051187b939860f [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.335700 15516 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.335937 13792 tablet_replica.cc:333] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.336910 13792 raft_consensus.cc:2243] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 15 LEADER]: Raft consensus shutting down.
W20260709 13:08:36.337538 15516 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.338169 13792 raft_consensus.cc:2272] T 599606a370ab4d629b9cac083be835da P eb4a5ac9f0c5425b92051187b939860f [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.338464 15516 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.340997 13792 tablet_replica.cc:333] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.341776 13792 raft_consensus.cc:2243] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.342361 13792 raft_consensus.cc:2272] T 754b0ca0f8c0459c8b6f122a5ff76b39 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.345011 13792 tablet_replica.cc:333] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.345734 13792 raft_consensus.cc:2243] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.346856 13792 raft_consensus.cc:2272] T 7b35154b94cb40bc8e8f780311834ad6 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.350338 13792 tablet_replica.cc:333] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.351158 13792 raft_consensus.cc:2243] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.351944 13792 raft_consensus.cc:2272] T 410c57dd04b546f3be0269aecdb13719 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.355116 13792 tablet_replica.cc:333] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.355903 13792 raft_consensus.cc:2243] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.357158 13792 raft_consensus.cc:2272] T 66e4432ba29a43668db5483ebef3b522 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.359771 13792 tablet_replica.cc:333] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.360558 13792 raft_consensus.cc:2243] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.361186 13792 raft_consensus.cc:2272] T f85c193fa13b46d9bceea2295f514c29 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.361346 15516 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:08:36.363852 13792 tablet_replica.cc:333] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.364576 13792 raft_consensus.cc:2243] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.365739 13792 raft_consensus.cc:2272] T 6eec3351a3e94e158c79a8784e2c6574 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.368418 13792 tablet_replica.cc:333] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.369231 13792 raft_consensus.cc:2243] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.370460 13792 raft_consensus.cc:2272] T cfa2777cd48541b3b2bcf2ed038ac645 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.373045 13792 tablet_replica.cc:333] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.373773 13792 raft_consensus.cc:2243] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.375126 13792 raft_consensus.cc:2272] T 6ab3877f8e9e4155a67e7a196ed5eb60 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.377653 13792 tablet_replica.cc:333] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.378425 13792 raft_consensus.cc:2243] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.379117 13792 raft_consensus.cc:2272] T b1b0b2aff5c14c50aac568802fb9aa6c P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.381778 13792 tablet_replica.cc:333] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.382571 13792 raft_consensus.cc:2243] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.383328 13792 raft_consensus.cc:2272] T 67571e95c6f547b989f85aa109da10a9 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.386113 13792 tablet_replica.cc:333] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.386906 13792 raft_consensus.cc:2243] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.387507 13792 raft_consensus.cc:2272] T 8b9af86494f14821b5b88018dbe4a1c2 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.389989 13792 tablet_replica.cc:333] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.390722 13792 raft_consensus.cc:2243] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.391387 13792 raft_consensus.cc:2272] T 8b1d51e80f4e47638e5c23566e217993 P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.393501 23313 raft_consensus.cc:493] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:36.393836 13792 tablet_replica.cc:333] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.394112 23313 raft_consensus.cc:515] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:36.394833 13792 raft_consensus.cc:2243] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.395619 13792 raft_consensus.cc:2272] T a3da3e723e874330b684997f3ab5385e P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.396704 23313 leader_election.cc:290] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:36.400904 15007 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:36.403110 13792 tablet_replica.cc:333] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.407961 13792 raft_consensus.cc:2243] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 13:08:36.408179 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:36.408656 13792 raft_consensus.cc:2272] T 9648bab22a13442a81e0775163508e93 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.411448 13792 tablet_replica.cc:333] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
W20260709 13:08:36.420545 15008 leader_election.cc:336] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:36.421140 15008 leader_election.cc:304] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:36.421887 23313 raft_consensus.cc:2749] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:36.423130 13792 raft_consensus.cc:2243] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.424700 13792 raft_consensus.cc:2272] T 376f02b12a354291b7600c9c176e3885 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.427436 13792 tablet_replica.cc:333] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.428229 13792 raft_consensus.cc:2243] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.428947 13792 raft_consensus.cc:2272] T 022fa149e13b44eeae0eb2555eb6eb80 P eb4a5ac9f0c5425b92051187b939860f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.431903 13792 tablet_replica.cc:333] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.432711 13792 raft_consensus.cc:2243] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.433423 13792 raft_consensus.cc:2272] T 1040e321bc7c46f79cd0ad55259aba21 P eb4a5ac9f0c5425b92051187b939860f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.436074 13792 tablet_replica.cc:333] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.436964 13792 raft_consensus.cc:2243] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.437703 13792 raft_consensus.cc:2272] T be840274e2c843b9b2b9f24277dca78d P eb4a5ac9f0c5425b92051187b939860f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.441900 13792 tablet_replica.cc:333] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.442781 13792 raft_consensus.cc:2243] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.443620 13792 raft_consensus.cc:2272] T 77cfe8a6078741239e2d788a50d260dc P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.447162 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:36.447654 23313 raft_consensus.cc:493] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:36.448181 23313 raft_consensus.cc:515] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } }
I20260709 13:08:36.450161 23313 leader_election.cc:290] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:36.455283 15007 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:36.458403 13792 tablet_replica.cc:333] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.459230 13792 raft_consensus.cc:2243] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.460429 13792 raft_consensus.cc:2272] T cbe1d22f90c742fd86d8bd93e5d59e59 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.465237 13792 tablet_replica.cc:333] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.466020 13792 raft_consensus.cc:2243] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.466679 13792 raft_consensus.cc:2272] T 0d3b63f39d444317899acc30914f8801 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.469503 13792 tablet_replica.cc:333] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
W20260709 13:08:36.469341 15008 leader_election.cc:336] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:36.470039 15008 leader_election.cc:304] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb4a5ac9f0c5425b92051187b939860f; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:36.470434 13792 raft_consensus.cc:2243] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.470764 23313 raft_consensus.cc:2749] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:36.471953 13792 raft_consensus.cc:2272] T b4b44d3457824f63aaf8c5cafbd75ea0 P eb4a5ac9f0c5425b92051187b939860f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.475013 13792 tablet_replica.cc:333] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.475873 13792 raft_consensus.cc:2243] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.476562 13792 raft_consensus.cc:2272] T 205008a787ca45349273b1e8daaebdf5 P eb4a5ac9f0c5425b92051187b939860f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.479528 13792 tablet_replica.cc:333] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.480201 13792 raft_consensus.cc:2243] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.484608 13792 raft_consensus.cc:2272] T 338c720b04aa4c14b53937055c254e24 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.493718 13792 tablet_replica.cc:333] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.494525 13792 raft_consensus.cc:2243] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.495304 13792 raft_consensus.cc:2272] T 37a7135d72784bd590fd05aeda0ea3b6 P eb4a5ac9f0c5425b92051187b939860f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.497992 13792 tablet_replica.cc:333] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.498811 13792 raft_consensus.cc:2243] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.500036 13792 raft_consensus.cc:2272] T a86ee695370844fcbe0c2c00edd26e73 P eb4a5ac9f0c5425b92051187b939860f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.502887 13792 tablet_replica.cc:333] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.503650 13792 raft_consensus.cc:2243] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.504614 13792 raft_consensus.cc:2272] T 6a698f3a4fb348b4a13de15324682404 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.507434 13792 tablet_replica.cc:333] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.508172 13792 raft_consensus.cc:2243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 26 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.509420 13792 raft_consensus.cc:2272] T 7d87ff4cfb034c7eb5e9fdb522974b90 P eb4a5ac9f0c5425b92051187b939860f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.512028 13792 tablet_replica.cc:333] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.513056 13792 raft_consensus.cc:2243] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.520937 13792 raft_consensus.cc:2272] T 2287a0d46a894be29150ebdc058fcfb6 P eb4a5ac9f0c5425b92051187b939860f [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.523274 15513 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:36.524425 15514 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:36.524686 13792 tablet_replica.cc:333] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.525449 13792 raft_consensus.cc:2243] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:36.526993 13792 raft_consensus.cc:2272] T 770c4e1c2abb48cba0a9b362f6be74f5 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:36.529479 13792 tablet_replica.cc:333] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f: stopping tablet replica
I20260709 13:08:36.530136 13792 raft_consensus.cc:2243] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:36.530985 13792 raft_consensus.cc:2272] T 13ff541fc966499ea2706d34cfb2c964 P eb4a5ac9f0c5425b92051187b939860f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 13:08:36.600487 15513 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:36.767946 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:36.818064 15514 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:08:36.977376 23300 raft_consensus.cc:493] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:36.977917 23300 raft_consensus.cc:515] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:36.980026 23300 leader_election.cc:290] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:36.985313 15513 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:36.989382 15514 leader_election.cc:336] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:36.989874 15514 leader_election.cc:304] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:36.991099 23300 raft_consensus.cc:2749] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 13:08:37.009868 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:37.081734 23302 raft_consensus.cc:493] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:37.082324 23302 raft_consensus.cc:515] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.084498 23302 leader_election.cc:290] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:37.089718 15514 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.090440 15513 leader_election.cc:336] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:37.090862 15513 leader_election.cc:304] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:37.091562 23302 raft_consensus.cc:2749] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:37.235078 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08000c93c0 after lost signal to thread 13795
W20260709 13:08:37.236253 15065 debug-util.cc:398] Leaking SignalData structure 0x7b0800084640 after lost signal to thread 14827
W20260709 13:08:37.236862 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08001b3840 after lost signal to thread 15068
W20260709 13:08:37.238005 15065 debug-util.cc:398] Leaking SignalData structure 0x7b08000df600 after lost signal to thread 15574
I20260709 13:08:37.389070 23300 raft_consensus.cc:493] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:37.389703 23300 raft_consensus.cc:515] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.392035 23300 leader_election.cc:290] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:37.397181 15514 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.397609 15514 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.398294 15513 leader_election.cc:336] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:37.398809 15513 leader_election.cc:304] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:37.400612 23302 raft_consensus.cc:2749] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 13:08:37.404983 23302 raft_consensus.cc:493] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.405514 23302 raft_consensus.cc:515] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.409624 23302 leader_election.cc:290] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.412810 15514 leader_election.cc:336] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.413367 15516 leader_election.cc:336] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.413808 15516 leader_election.cc:304] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.414516 23302 raft_consensus.cc:2749] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 13:08:37.465003 23302 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.465538 23302 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.467741 23302 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.472131 15513 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:37.472731 15516 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.473153 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.473837 23302 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:08:37.525048 23302 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.525640 23302 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.528824 23302 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.535053 15513 leader_election.cc:336] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:37.536108 15516 leader_election.cc:336] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.536581 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.537672 23302 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:37.575508 23302 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.576109 23302 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.578552 23302 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.585557 15514 leader_election.cc:336] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.586582 15516 leader_election.cc:336] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.586984 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.587733 23302 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:37.631393 23302 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:37.631965 23302 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.637480 23302 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:37.640105 15514 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.640877 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:37.641345 15513 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:37.642504 23302 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:37.651996 23300 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.652601 23300 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.654903 23300 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.659570 15514 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.660377 15516 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.660856 15516 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.661558 23300 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:08:37.672492 13792 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 15065)
W20260709 13:08:37.678707 15513 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:37.680985 23300 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.681623 23302 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.682281 23302 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.684410 23302 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:37.688441 23300 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.690636 23300 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.691341 15513 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:37.696592 15516 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.697125 15516 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.699349 23302 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:08:37.700399 15516 leader_election.cc:336] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
W20260709 13:08:37.705371 15514 leader_election.cc:336] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:37.705807 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.706558 23302 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:37.718350 15514 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:37.768404 23302 raft_consensus.cc:493] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.768924 23302 raft_consensus.cc:515] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.773630 23302 leader_election.cc:290] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.775061 15513 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:37.780112 15516 leader_election.cc:336] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.780622 15516 leader_election.cc:304] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.781366 23302 raft_consensus.cc:2749] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 13:08:37.801944 23320 raft_consensus.cc:493] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.802515 23320 raft_consensus.cc:515] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.806170 23320 leader_election.cc:290] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.812737 15513 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:37.816927 15516 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:37.817430 15516 leader_election.cc:304] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.818190 23320 raft_consensus.cc:2749] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 13:08:37.822341 23302 raft_consensus.cc:493] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:37.822868 23302 raft_consensus.cc:515] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:37.824972 23302 leader_election.cc:290] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:37.829319 15514 leader_election.cc:336] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:37.831189 15516 leader_election.cc:336] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
W20260709 13:08:37.832525 15513 leader_election.cc:336] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:37.834566 15513 leader_election.cc:304] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:37.835316 23302 raft_consensus.cc:2749] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:37.858517 15514 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.877825 15514 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.938433 15514 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:37.950135 15513 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:37.979997 15514 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.036986 15514 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.101193 15514 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.101596 15514 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.128909 15513 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:38.160286 15516 consensus_peers.cc:597] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.210543 15514 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:38.235664 23302 raft_consensus.cc:493] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:38.236205 23302 raft_consensus.cc:515] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:38.237907 23302 leader_election.cc:290] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:38.242223 15513 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:38.242861 15514 leader_election.cc:336] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:38.243204 15514 leader_election.cc:304] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:38.243850 23302 raft_consensus.cc:2749] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:08:38.308061 15516 consensus_peers.cc:597] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.326269 15516 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.340628 15514 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.341238 15514 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:08:38.351128 23302 raft_consensus.cc:493] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:38.351662 23302 raft_consensus.cc:515] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:38.353340 23302 leader_election.cc:290] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:38.357530 15513 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:38.361807 15514 leader_election.cc:336] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:38.362311 15514 leader_election.cc:304] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:38.363039 23302 raft_consensus.cc:2749] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 13:08:38.363507 15516 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.402544 15516 consensus_peers.cc:597] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.444089 15516 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.474990 15516 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.515589 15513 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:38.535331 15516 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.557917 15513 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111) [suppressed 607 similar messages]
W20260709 13:08:38.574685 15516 consensus_peers.cc:597] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.584435 15513 consensus_peers.cc:597] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:38.590937 15516 consensus_peers.cc:597] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.610021 15516 consensus_peers.cc:597] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.615448 15516 consensus_peers.cc:597] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.620178 15516 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.626034 15513 consensus_peers.cc:597] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:38.646358 15516 consensus_peers.cc:597] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.663619 15516 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.700763 15516 consensus_peers.cc:597] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.721246 15516 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.739672 15516 consensus_peers.cc:597] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.743072 15516 consensus_peers.cc:597] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.772941 15514 consensus_peers.cc:597] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:08:38.774422 15516 consensus_peers.cc:597] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.848603 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 754b0ca0f8c0459c8b6f122a5ff76b39: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:38.867164 23302 raft_consensus.cc:493] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:38.867733 23302 raft_consensus.cc:515] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:38.869597 23302 leader_election.cc:290] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:38.874398 15514 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:38.876168 15513 leader_election.cc:336] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:38.876564 15513 leader_election.cc:304] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:38.877408 23302 raft_consensus.cc:2749] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:08:38.883179 15513 consensus_peers.cc:597] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:08:38.884392 15516 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Couldn't send request to peer eb4a5ac9f0c5425b92051187b939860f. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:08:38.896888 15513 consensus_peers.cc:597] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:38.934691 23302 raft_consensus.cc:493] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:38.935258 23302 raft_consensus.cc:515] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:38.937587 23302 leader_election.cc:290] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:38.942615 15514 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:38.944209 15516 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:38.944640 15516 leader_election.cc:304] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
W20260709 13:08:38.945915 15513 leader_election.cc:336] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:38.946617 23302 raft_consensus.cc:2749] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 13:08:38.952117 15513 consensus_peers.cc:597] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:08:38.958039 15513 consensus_peers.cc:597] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 13:08:39.042914 23320 raft_consensus.cc:493] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:39.043520 23320 raft_consensus.cc:515] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.045241 23320 leader_election.cc:290] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:39.049005 15513 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:39.052964 15516 leader_election.cc:336] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:39.053326 15516 leader_election.cc:304] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:39.053927 23320 raft_consensus.cc:2749] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:08:39.110514 15514 consensus_peers.cc:597] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:39.112323 23320 raft_consensus.cc:493] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:39.112865 23320 raft_consensus.cc:515] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.116706 23320 leader_election.cc:290] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:39.118969 15514 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:39.119580 15513 leader_election.cc:336] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:39.119979 15513 leader_election.cc:304] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:39.120648 23302 raft_consensus.cc:2749] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:08:39.142728 23320 raft_consensus.cc:493] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:39.143262 23320 raft_consensus.cc:515] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.148000 23320 leader_election.cc:290] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:39.148458 15514 leader_election.cc:336] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
W20260709 13:08:39.152746 15516 leader_election.cc:336] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:39.153095 15516 leader_election.cc:304] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:39.153894 23320 raft_consensus.cc:2749] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:39.162216 23320 raft_consensus.cc:493] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:39.162636 23320 raft_consensus.cc:515] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.164464 23320 leader_election.cc:290] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:39.170763 15513 leader_election.cc:336] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:39.174230 15516 leader_election.cc:336] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:08:39.174985 15516 leader_election.cc:304] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:39.175839 23302 raft_consensus.cc:2749] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:08:39.199270 23302 raft_consensus.cc:493] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:39.199795 23302 raft_consensus.cc:515] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.201895 23302 leader_election.cc:290] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:39.206261 15513 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:39.206774 15514 leader_election.cc:336] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:39.207223 15514 leader_election.cc:304] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:39.207942 23302 raft_consensus.cc:2749] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 13:08:39.229956 15513 consensus_peers.cc:597] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:08:39.240024 23302 raft_consensus.cc:493] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:39.240448 23302 raft_consensus.cc:515] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.241962 23302 leader_election.cc:290] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
W20260709 13:08:39.246212 15516 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
W20260709 13:08:39.246645 15514 leader_election.cc:336] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:39.247051 15514 leader_election.cc:304] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:39.247663 23302 raft_consensus.cc:2749] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260709 13:08:39.267023 15514 consensus_peers.cc:597] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Couldn't send request to peer 25b8f0cc46f748468395543b8b174bf4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:08:39.366248 23320 raft_consensus.cc:493] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:39.366722 23320 raft_consensus.cc:515] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.367255 23302 raft_consensus.cc:493] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader eb4a5ac9f0c5425b92051187b939860f)
I20260709 13:08:39.367739 23302 raft_consensus.cc:515] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.368793 23320 leader_election.cc:290] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:39.369560 23302 leader_election.cc:290] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271)
I20260709 13:08:39.372207 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
W20260709 13:08:39.375386 15516 leader_election.cc:336] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
W20260709 13:08:39.376048 15516 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
W20260709 13:08:39.376494 15514 leader_election.cc:336] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:39.376955 15514 leader_election.cc:304] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:39.377677 23302 raft_consensus.cc:2749] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:08:39.382095 15513 leader_election.cc:336] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
I20260709 13:08:39.382606 15513 leader_election.cc:304] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: e4938453819c469599f515b22d92fe27, eb4a5ac9f0c5425b92051187b939860f
I20260709 13:08:39.383338 23302 raft_consensus.cc:2749] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 13:08:39.408035 15513 consensus_peers.cc:597] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:08:39.477905 23302 raft_consensus.cc:493] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:39.478394 23302 raft_consensus.cc:515] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
W20260709 13:08:39.478751 15513 consensus_peers.cc:597] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 -> Peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Couldn't send request to peer e4938453819c469599f515b22d92fe27. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:08:39.483090 23302 leader_election.cc:290] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:39.486460 15513 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:39.487054 15514 leader_election.cc:336] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:39.487102 13792 tablet_server.cc:179] TabletServer@127.13.120.4:0 shutting down...
I20260709 13:08:39.487517 15514 leader_election.cc:304] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:39.489425 23302 raft_consensus.cc:2749] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:08:39.514576 23302 raft_consensus.cc:493] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 25b8f0cc46f748468395543b8b174bf4)
I20260709 13:08:39.519135 23302 raft_consensus.cc:515] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: false } }
I20260709 13:08:39.526830 23302 leader_election.cc:290] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers e4938453819c469599f515b22d92fe27 (127.13.120.1:46755), 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345)
W20260709 13:08:39.533339 15513 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:39.541839 15514 leader_election.cc:336] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 25b8f0cc46f748468395543b8b174bf4 (127.13.120.2:43345): Network error: Client connection negotiation failed: client connection to 127.13.120.2:43345: connect: Connection refused (error 111)
I20260709 13:08:39.542356 15514 leader_election.cc:304] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 58ee9fe38eb8453098f6d964e7675e79; no voters: 25b8f0cc46f748468395543b8b174bf4, e4938453819c469599f515b22d92fe27
I20260709 13:08:39.542850 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:08:39.543660 23320 raft_consensus.cc:2749] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:08:39.545753 13792 tablet_replica.cc:333] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.546975 13792 raft_consensus.cc:2243] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.548996 13792 raft_consensus.cc:2272] T f85c193fa13b46d9bceea2295f514c29 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.552488 13792 tablet_replica.cc:333] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.553320 13792 raft_consensus.cc:2243] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.554126 13792 raft_consensus.cc:2272] T 754b0ca0f8c0459c8b6f122a5ff76b39 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.556458 13792 tablet_replica.cc:333] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.557183 13792 raft_consensus.cc:2243] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.557723 13792 raft_consensus.cc:2272] T da044c14437c4be087d871f129926239 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.559962 13792 tablet_replica.cc:333] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.560595 13792 raft_consensus.cc:2243] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 31 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.561440 13792 raft_consensus.cc:2272] T f7a1be4a55754b9baba160c70df7dc21 P 58ee9fe38eb8453098f6d964e7675e79 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.564169 13792 tablet_replica.cc:333] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.564846 13792 raft_consensus.cc:2243] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.565868 13792 raft_consensus.cc:2272] T 13ff541fc966499ea2706d34cfb2c964 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.569005 13792 tablet_replica.cc:333] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.569648 13792 raft_consensus.cc:2243] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Raft consensus shutting down.
I20260709 13:08:39.570047 13792 pending_rounds.cc:70] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Trying to abort 1 pending ops.
I20260709 13:08:39.570257 13792 pending_rounds.cc:77] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305635111384068096 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "37a7135d72784bd590fd05aeda0ea3b6" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e4938453819c469599f515b22d92fe27" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 46755 } } peers { permanent_uuid: "25b8f0cc46f748468395543b8b174bf4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 43345 } } peers { permanent_uuid: "eb4a5ac9f0c5425b92051187b939860f" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 46271 } attrs { replace: true } } peers { permanent_uuid: "58ee9fe38eb8453098f6d964e7675e79" member_type: NON_VOTER last_known_addr { host: "127.13.120.4" port: 39473 } attrs { promote: true } } } }
I20260709 13:08:39.571048 13792 raft_consensus.cc:2917] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:08:39.571389 13792 raft_consensus.cc:2889] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:08:39.571688 13792 raft_consensus.cc:2272] T 37a7135d72784bd590fd05aeda0ea3b6 P 58ee9fe38eb8453098f6d964e7675e79 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:08:39.573751 13792 tablet_replica.cc:333] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.574635 13792 raft_consensus.cc:2243] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.575754 13792 raft_consensus.cc:2272] T 7933f8a0325b4bf7a8bafc99c9284091 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.578337 13792 tablet_replica.cc:333] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.579077 13792 raft_consensus.cc:2243] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.579699 13792 raft_consensus.cc:2272] T cf48bf0f29ee4f8fabd84185b8cc6a88 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.581919 13792 tablet_replica.cc:333] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.582443 13792 raft_consensus.cc:2243] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.582988 13792 raft_consensus.cc:2272] T 7b35154b94cb40bc8e8f780311834ad6 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.585103 13792 tablet_replica.cc:333] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.585687 13792 raft_consensus.cc:2243] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.586526 13792 raft_consensus.cc:2272] T 7d441a969a644366b3cb4d386d7273e1 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.588668 13792 tablet_replica.cc:333] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.589236 13792 raft_consensus.cc:2243] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.590003 13792 raft_consensus.cc:2272] T 7d87ff4cfb034c7eb5e9fdb522974b90 P 58ee9fe38eb8453098f6d964e7675e79 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.592290 13792 tablet_replica.cc:333] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.592865 13792 raft_consensus.cc:2243] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.593665 13792 raft_consensus.cc:2272] T 2287a0d46a894be29150ebdc058fcfb6 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.595784 13792 tablet_replica.cc:333] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.596325 13792 raft_consensus.cc:2243] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.597003 13792 raft_consensus.cc:2272] T 1ecb36ffe5e640f88b50155fa361883d P 58ee9fe38eb8453098f6d964e7675e79 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.598976 13792 tablet_replica.cc:333] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.599560 13792 raft_consensus.cc:2243] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.600390 13792 raft_consensus.cc:2272] T 83edd178ff3943b58ccf199ddc331aec P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.602558 13792 tablet_replica.cc:333] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.603071 13792 raft_consensus.cc:2243] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.603917 13792 raft_consensus.cc:2272] T 67571e95c6f547b989f85aa109da10a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.605973 13792 tablet_replica.cc:333] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.606623 13792 raft_consensus.cc:2243] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.607494 13792 raft_consensus.cc:2272] T a3da3e723e874330b684997f3ab5385e P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.609397 13792 tablet_replica.cc:333] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.609993 13792 raft_consensus.cc:2243] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.610810 13792 raft_consensus.cc:2272] T 5ae8a41be2704a038fb65d4e543a826c P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.612936 13792 tablet_replica.cc:333] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.613487 13792 raft_consensus.cc:2243] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.614818 13792 raft_consensus.cc:2272] T 8b9af86494f14821b5b88018dbe4a1c2 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.617571 13792 tablet_replica.cc:333] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.618307 13792 raft_consensus.cc:2243] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.618791 13792 raft_consensus.cc:2272] T 7c487d6b8fcd4ff280fa6c3c4a5ac8ab P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.620729 13792 tablet_replica.cc:333] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.621282 13792 raft_consensus.cc:2243] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.622344 13792 raft_consensus.cc:2272] T 8b1d51e80f4e47638e5c23566e217993 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.624823 13792 tablet_replica.cc:333] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.625577 13792 raft_consensus.cc:2243] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.626427 13792 raft_consensus.cc:2272] T 060cd1347c834f27a9abc4cf6d5584a9 P 58ee9fe38eb8453098f6d964e7675e79 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.628504 13792 tablet_replica.cc:333] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.629158 13792 raft_consensus.cc:2243] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.629624 13792 raft_consensus.cc:2272] T c8fa9dae6116418f8b520fc591ae5757 P 58ee9fe38eb8453098f6d964e7675e79 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.632413 13792 tablet_replica.cc:333] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.633163 13792 raft_consensus.cc:2243] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.634040 13792 raft_consensus.cc:2272] T 6eec3351a3e94e158c79a8784e2c6574 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.636917 13792 tablet_replica.cc:333] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.637423 13792 raft_consensus.cc:2243] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.638331 13792 raft_consensus.cc:2272] T 1040e321bc7c46f79cd0ad55259aba21 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.640313 13792 tablet_replica.cc:333] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.640854 13792 raft_consensus.cc:2243] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.641408 13792 raft_consensus.cc:2272] T b4b44d3457824f63aaf8c5cafbd75ea0 P 58ee9fe38eb8453098f6d964e7675e79 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.643685 13792 tablet_replica.cc:333] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.644182 13792 raft_consensus.cc:2243] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.644935 13792 raft_consensus.cc:2272] T 156c010162bf4cb99b535677eccb2740 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.646894 13792 tablet_replica.cc:333] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.647500 13792 raft_consensus.cc:2243] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.648000 13792 raft_consensus.cc:2272] T 4db89b17bfcd40e0a2e2d53f7cf21079 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.649861 13792 tablet_replica.cc:333] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.650426 13792 raft_consensus.cc:2243] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.651158 13792 raft_consensus.cc:2272] T 80a1bdc86202444db87b94ea818eedd5 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.653095 13792 tablet_replica.cc:333] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.653636 13792 raft_consensus.cc:2243] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.654374 13792 raft_consensus.cc:2272] T 599606a370ab4d629b9cac083be835da P 58ee9fe38eb8453098f6d964e7675e79 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.656499 13792 tablet_replica.cc:333] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.657061 13792 raft_consensus.cc:2243] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.657850 13792 raft_consensus.cc:2272] T 0d3b63f39d444317899acc30914f8801 P 58ee9fe38eb8453098f6d964e7675e79 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.660212 13792 tablet_replica.cc:333] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.661135 13792 raft_consensus.cc:2243] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.661876 13792 raft_consensus.cc:2272] T cfa2777cd48541b3b2bcf2ed038ac645 P 58ee9fe38eb8453098f6d964e7675e79 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.664753 13792 tablet_replica.cc:333] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.665284 13792 raft_consensus.cc:2243] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.666142 13792 raft_consensus.cc:2272] T b1b0b2aff5c14c50aac568802fb9aa6c P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.668087 13792 tablet_replica.cc:333] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.668619 13792 raft_consensus.cc:2243] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.669269 13792 raft_consensus.cc:2272] T ebef2badb7124b9fa530c8877d638abe P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.671113 13792 tablet_replica.cc:333] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.671758 13792 raft_consensus.cc:2243] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.672245 13792 raft_consensus.cc:2272] T 66e4432ba29a43668db5483ebef3b522 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.674206 13792 tablet_replica.cc:333] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.674712 13792 raft_consensus.cc:2243] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.675580 13792 raft_consensus.cc:2272] T 410c57dd04b546f3be0269aecdb13719 P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.677328 13792 tablet_replica.cc:333] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.677815 13792 raft_consensus.cc:2243] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.678261 13792 raft_consensus.cc:2272] T a86ee695370844fcbe0c2c00edd26e73 P 58ee9fe38eb8453098f6d964e7675e79 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.680374 13792 tablet_replica.cc:333] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.680887 13792 raft_consensus.cc:2243] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.681731 13792 raft_consensus.cc:2272] T 6a698f3a4fb348b4a13de15324682404 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.683650 13792 tablet_replica.cc:333] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.684160 13792 raft_consensus.cc:2243] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.684715 13792 raft_consensus.cc:2272] T 3ac8b7ea8eec4d01847e30ae2626afd0 P 58ee9fe38eb8453098f6d964e7675e79 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.686592 13792 tablet_replica.cc:333] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.687124 13792 raft_consensus.cc:2243] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.687780 13792 raft_consensus.cc:2272] T 770c4e1c2abb48cba0a9b362f6be74f5 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.689908 13792 tablet_replica.cc:333] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.690412 13792 raft_consensus.cc:2243] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.690929 13792 raft_consensus.cc:2272] T c5af46e976c54b8ba2b6e09ce06690af P 58ee9fe38eb8453098f6d964e7675e79 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.693217 13792 tablet_replica.cc:333] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.693691 13792 raft_consensus.cc:2243] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.694561 13792 raft_consensus.cc:2272] T 8de39bcda9f4437d8538be04713851b1 P 58ee9fe38eb8453098f6d964e7675e79 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.696452 13792 tablet_replica.cc:333] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.696944 13792 raft_consensus.cc:2243] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.697434 13792 raft_consensus.cc:2272] T b9511e929bc448349baf940df42e2a22 P 58ee9fe38eb8453098f6d964e7675e79 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.699509 13792 tablet_replica.cc:333] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.699980 13792 raft_consensus.cc:2243] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.700471 13792 raft_consensus.cc:2272] T 146ff3031af843e3a501710c2301a015 P 58ee9fe38eb8453098f6d964e7675e79 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.702442 13792 tablet_replica.cc:333] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.702927 13792 raft_consensus.cc:2243] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:08:39.703491 13792 raft_consensus.cc:2272] T 46876532b5b6444ba4fbaa536a316857 P 58ee9fe38eb8453098f6d964e7675e79 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.705583 13792 tablet_replica.cc:333] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.706094 13792 raft_consensus.cc:2243] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.706998 13792 raft_consensus.cc:2272] T 9648bab22a13442a81e0775163508e93 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:39.709625 13792 tablet_replica.cc:333] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79: stopping tablet replica
I20260709 13:08:39.710078 13792 raft_consensus.cc:2243] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:08:39.710923 13792 raft_consensus.cc:2272] T 022fa149e13b44eeae0eb2555eb6eb80 P 58ee9fe38eb8453098f6d964e7675e79 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:08:40.341358 13792 tablet_server.cc:196] TabletServer@127.13.120.4:0 shutdown complete.
I20260709 13:08:40.420331 13792 master.cc:562] Master@127.13.120.62:42905 shutting down...
W20260709 13:08:40.451035 14841 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:08:40.451344 14841 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:40.451660 14841 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:08:44.541997 14777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111) [suppressed 134 similar messages]
W20260709 13:08:44.547286 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8b1d51e80f4e47638e5c23566e217993: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:55.248543 14777 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:55.251940 14777 catalog_manager.cc:4755] TS e4938453819c469599f515b22d92fe27 (127.13.120.1:46755): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 754b0ca0f8c0459c8b6f122a5ff76b39: Network error: Client connection negotiation failed: client connection to 127.13.120.1:46755: connect: Connection refused (error 111)
W20260709 13:08:57.012064 14824 debug-util.cc:398] Leaking SignalData structure 0x7b08001dda00 after lost signal to thread 13795
W20260709 13:08:57.012558 14824 debug-util.cc:398] Leaking SignalData structure 0x7b0800149f80 after lost signal to thread 14827
W20260709 13:09:02.682596 14780 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
W20260709 13:09:02.686053 14780 catalog_manager.cc:4755] TS eb4a5ac9f0c5425b92051187b939860f (127.13.120.3:46271): ChangeConfig:REMOVE_PEER RPC failed for tablet 770c4e1c2abb48cba0a9b362f6be74f5: Network error: Client connection negotiation failed: client connection to 127.13.120.3:46271: connect: Connection refused (error 111)
I20260709 13:09:07.035214 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:07.036455 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:07.036875 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P d930a2d37e98496a8994b1d260968086: stopping tablet replica
I20260709 13:09:07.326582 13792 master.cc:584] Master@127.13.120.62:42905 shutdown complete.
I20260709 13:09:07.375736 13792 test_util.cc:182] -----------------------------------------------
I20260709 13:09:07.375969 13792 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602243021600-13792-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (281253 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:09:07.379323 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:34857
I20260709 13:09:07.380506 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.386463 23336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.386485 23335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.386938 23338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.387880 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:07.392335 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:07.392516 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.392704 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602547392672 us; error 0 us; skew 500 ppm
I20260709 13:09:07.393216 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.395519 13792 webserver.cc:533] Webserver started at http://127.13.120.62:46063/ using document root <none> and password file <none>
I20260709 13:09:07.395991 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.396198 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.396477 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.397686 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "d74c45bec35146d3ad75701666141fab"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.402213 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:09:07.405543 23343 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.406277 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:07.406594 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "d74c45bec35146d3ad75701666141fab"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.406867 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.426223 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.427537 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.465935 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:34857
I20260709 13:09:07.466045 23394 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:34857 every 8 connection(s)
I20260709 13:09:07.470141 23395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:07.481371 23395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab: Bootstrap starting.
I20260709 13:09:07.486191 23395 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:07.490257 23395 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab: No bootstrap required, opened a new log
I20260709 13:09:07.492441 23395 raft_consensus.cc:359] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74c45bec35146d3ad75701666141fab" member_type: VOTER }
I20260709 13:09:07.492887 23395 raft_consensus.cc:385] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:07.493119 23395 raft_consensus.cc:740] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d74c45bec35146d3ad75701666141fab, State: Initialized, Role: FOLLOWER
I20260709 13:09:07.493753 23395 consensus_queue.cc:260] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74c45bec35146d3ad75701666141fab" member_type: VOTER }
I20260709 13:09:07.494248 23395 raft_consensus.cc:399] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:07.494486 23395 raft_consensus.cc:493] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:07.494768 23395 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:07.499204 23395 raft_consensus.cc:515] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74c45bec35146d3ad75701666141fab" member_type: VOTER }
I20260709 13:09:07.499722 23395 leader_election.cc:304] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d74c45bec35146d3ad75701666141fab; no voters: 
I20260709 13:09:07.501020 23395 leader_election.cc:290] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:07.501379 23398 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:07.503093 23398 raft_consensus.cc:697] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 1 LEADER]: Becoming Leader. State: Replica: d74c45bec35146d3ad75701666141fab, State: Running, Role: LEADER
I20260709 13:09:07.504212 23398 consensus_queue.cc:237] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74c45bec35146d3ad75701666141fab" member_type: VOTER }
I20260709 13:09:07.504866 23395 sys_catalog.cc:565] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:07.514155 23399 sys_catalog.cc:455] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d74c45bec35146d3ad75701666141fab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74c45bec35146d3ad75701666141fab" member_type: VOTER } }
I20260709 13:09:07.514981 23399 sys_catalog.cc:458] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:07.515892 23400 sys_catalog.cc:455] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [sys.catalog]: SysCatalogTable state changed. Reason: New leader d74c45bec35146d3ad75701666141fab. Latest consensus state: current_term: 1 leader_uuid: "d74c45bec35146d3ad75701666141fab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d74c45bec35146d3ad75701666141fab" member_type: VOTER } }
I20260709 13:09:07.516749 23400 sys_catalog.cc:458] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:07.518930 23408 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:07.526818 23408 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:07.527812 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:07.535704 23408 catalog_manager.cc:1383] Generated new cluster ID: f4e34342d3b749668398c1c7023b98fb
I20260709 13:09:07.535976 23408 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:07.550995 23408 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:07.552390 23408 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:07.566607 23408 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab: Generated new TSK 0
I20260709 13:09:07.567162 23408 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:07.594141 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.600827 23416 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.602002 23417 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.604492 23419 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.604830 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:07.607756 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:07.607940 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.608069 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602547608053 us; error 0 us; skew 500 ppm
I20260709 13:09:07.608623 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.611044 13792 webserver.cc:533] Webserver started at http://127.13.120.1:35121/ using document root <none> and password file <none>
I20260709 13:09:07.611533 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.611696 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.611907 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.613049 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "6f0851261b6d4832b826564f378ba69d"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.617681 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:07.620862 23424 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.621658 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:07.621960 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "6f0851261b6d4832b826564f378ba69d"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.622197 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.637699 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.638942 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.640532 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.642926 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.643102 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.643436 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.643600 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:09:07.685125 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:45163
I20260709 13:09:07.685218 23486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:45163 every 8 connection(s)
I20260709 13:09:07.690500 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.698931 23491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.699584 23492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.704190 23495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.704469 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:07.707171 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:07.707456 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.707669 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602547707653 us; error 0 us; skew 500 ppm
I20260709 13:09:07.708455 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.709915 23487 heartbeater.cc:344] Connected to a master server at 127.13.120.62:34857
I20260709 13:09:07.710319 23487 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:07.711284 13792 webserver.cc:533] Webserver started at http://127.13.120.2:45813/ using document root <none> and password file <none>
I20260709 13:09:07.711350 23487 heartbeater.cc:507] Master 127.13.120.62:34857 requested a full tablet report, sending...
I20260709 13:09:07.712108 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.712388 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.712713 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.713837 23360 ts_manager.cc:194] Registered new tserver with Master: 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:07.713940 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.715828 23360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48462
I20260709 13:09:07.718886 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.004s
I20260709 13:09:07.722368 23499 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.723104 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:07.723441 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.723799 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.737015 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.738212 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.739699 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.741807 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.742031 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.742269 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.742450 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.784448 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:38613
I20260709 13:09:07.784536 23561 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:38613 every 8 connection(s)
I20260709 13:09:07.790289 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.799011 23565 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.800689 23566 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.803004 13792 server_base.cc:1061] running on GCE node
W20260709 13:09:07.803597 23568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.804514 23562 heartbeater.cc:344] Connected to a master server at 127.13.120.62:34857
I20260709 13:09:07.804801 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:07.804957 23562 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:07.805101 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.805476 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602547805461 us; error 0 us; skew 500 ppm
I20260709 13:09:07.806092 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.806136 23562 heartbeater.cc:507] Master 127.13.120.62:34857 requested a full tablet report, sending...
I20260709 13:09:07.808853 23360 ts_manager.cc:194] Registered new tserver with Master: 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:07.809155 13792 webserver.cc:533] Webserver started at http://127.13.120.3:35731/ using document root <none> and password file <none>
I20260709 13:09:07.809798 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.810039 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.810349 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.810722 23360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48474
I20260709 13:09:07.812059 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.816705 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:07.820154 23573 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.821004 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:07.821254 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.821496 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.831318 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.832540 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.834030 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.836659 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.836834 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.837139 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.837306 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.877413 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:44887
I20260709 13:09:07.877512 23635 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:44887 every 8 connection(s)
I20260709 13:09:07.882424 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:07.889686 23639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.889853 23640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:07.893333 23642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:07.893859 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:07.894619 23636 heartbeater.cc:344] Connected to a master server at 127.13.120.62:34857
I20260709 13:09:07.894884 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:07.895002 23636 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:07.895171 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:07.895473 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602547895452 us; error 0 us; skew 500 ppm
I20260709 13:09:07.895958 23636 heartbeater.cc:507] Master 127.13.120.62:34857 requested a full tablet report, sending...
I20260709 13:09:07.896154 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:07.898005 23360 ts_manager.cc:194] Registered new tserver with Master: 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:07.898952 13792 webserver.cc:533] Webserver started at http://127.13.120.4:41001/ using document root <none> and password file <none>
I20260709 13:09:07.899530 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:07.899536 23360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48484
I20260709 13:09:07.899821 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:07.900195 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:07.901846 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-3-root/instance:
uuid: "18312e6c7d274b80b354ee1498cc3449"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.906608 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:09:07.910048 23647 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.910761 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:07.911012 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-3-root
uuid: "18312e6c7d274b80b354ee1498cc3449"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:07.911250 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:07.930133 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:07.931347 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:07.932898 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:07.935146 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:07.935381 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.935654 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:07.935835 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:07.977720 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.4:44569
I20260709 13:09:07.977837 23709 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.4:44569 every 8 connection(s)
I20260709 13:09:07.992594 23710 heartbeater.cc:344] Connected to a master server at 127.13.120.62:34857
I20260709 13:09:07.992969 23710 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:07.993669 23710 heartbeater.cc:507] Master 127.13.120.62:34857 requested a full tablet report, sending...
I20260709 13:09:07.995585 23360 ts_manager.cc:194] Registered new tserver with Master: 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:07.996012 13792 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014799043s
I20260709 13:09:07.997066 23360 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48500
I20260709 13:09:08.024319 23360 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48504:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:09:08.261917 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a6fbf390f4379ad04ceb78ab203b6 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:08.263486 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a6fbf390f4379ad04ceb78ab203b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.265339 23526 tablet_service.cc:1511] Processing CreateTablet for tablet 8773bb3ecbee48738d3b1c65f086bf88 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:08.266813 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8773bb3ecbee48738d3b1c65f086bf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.268085 23675 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a6fbf390f4379ad04ceb78ab203b6 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:08.269498 23675 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a6fbf390f4379ad04ceb78ab203b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.275142 23525 tablet_service.cc:1511] Processing CreateTablet for tablet aff520a7b42548a7a2e0e5ca849ec785 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:08.276600 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff520a7b42548a7a2e0e5ca849ec785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.280629 23674 tablet_service.cc:1511] Processing CreateTablet for tablet aff520a7b42548a7a2e0e5ca849ec785 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:08.282001 23674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff520a7b42548a7a2e0e5ca849ec785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.284628 23673 tablet_service.cc:1511] Processing CreateTablet for tablet b65d1bee3bb54b66998685be52e5bf04 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:08.286018 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65d1bee3bb54b66998685be52e5bf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.289233 23524 tablet_service.cc:1511] Processing CreateTablet for tablet fcef80a7a0d24b8886b0b356906a7bab (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:08.290655 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcef80a7a0d24b8886b0b356906a7bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.293016 23672 tablet_service.cc:1511] Processing CreateTablet for tablet 8291e2ee677e4f8780ef9c902583fb55 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:08.294396 23601 tablet_service.cc:1511] Processing CreateTablet for tablet 2a3a6fbf390f4379ad04ceb78ab203b6 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:08.295833 23601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a3a6fbf390f4379ad04ceb78ab203b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.296753 23599 tablet_service.cc:1511] Processing CreateTablet for tablet b65d1bee3bb54b66998685be52e5bf04 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:08.298282 23600 tablet_service.cc:1511] Processing CreateTablet for tablet 8773bb3ecbee48738d3b1c65f086bf88 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:08.299011 23598 tablet_service.cc:1511] Processing CreateTablet for tablet fcef80a7a0d24b8886b0b356906a7bab (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:08.300407 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcef80a7a0d24b8886b0b356906a7bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.302690 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65d1bee3bb54b66998685be52e5bf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.304838 23671 tablet_service.cc:1511] Processing CreateTablet for tablet 1170481acec64cbe9a79c5bf7f04b3f6 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:08.305207 23670 tablet_service.cc:1511] Processing CreateTablet for tablet f5fd63cafcbb4ac68010a87bab3f897d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:08.306200 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8773bb3ecbee48738d3b1c65f086bf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.307075 23596 tablet_service.cc:1511] Processing CreateTablet for tablet f5fd63cafcbb4ac68010a87bab3f897d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:08.294490 23672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8291e2ee677e4f8780ef9c902583fb55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.317102 23522 tablet_service.cc:1511] Processing CreateTablet for tablet f5fd63cafcbb4ac68010a87bab3f897d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:08.308933 23597 tablet_service.cc:1511] Processing CreateTablet for tablet 1170481acec64cbe9a79c5bf7f04b3f6 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:08.312063 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fd63cafcbb4ac68010a87bab3f897d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.316744 23523 tablet_service.cc:1511] Processing CreateTablet for tablet 8291e2ee677e4f8780ef9c902583fb55 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:08.319180 23522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fd63cafcbb4ac68010a87bab3f897d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.326135 23670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5fd63cafcbb4ac68010a87bab3f897d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.329787 23728 tablet_bootstrap.cc:492] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:08.330523 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1170481acec64cbe9a79c5bf7f04b3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.338341 23452 tablet_service.cc:1511] Processing CreateTablet for tablet 8773bb3ecbee48738d3b1c65f086bf88 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:08.339793 23452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8773bb3ecbee48738d3b1c65f086bf88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.340703 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1170481acec64cbe9a79c5bf7f04b3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.342301 23451 tablet_service.cc:1511] Processing CreateTablet for tablet aff520a7b42548a7a2e0e5ca849ec785 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:08.343701 23523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8291e2ee677e4f8780ef9c902583fb55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.343775 23451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aff520a7b42548a7a2e0e5ca849ec785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.351871 23450 tablet_service.cc:1511] Processing CreateTablet for tablet b65d1bee3bb54b66998685be52e5bf04 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:08.353322 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b65d1bee3bb54b66998685be52e5bf04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.357241 23521 tablet_service.cc:1511] Processing CreateTablet for tablet aa451ba4f51342709eee5e2296060483 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:08.358784 23521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa451ba4f51342709eee5e2296060483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.358963 23448 tablet_service.cc:1511] Processing CreateTablet for tablet 8291e2ee677e4f8780ef9c902583fb55 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:08.357267 23449 tablet_service.cc:1511] Processing CreateTablet for tablet fcef80a7a0d24b8886b0b356906a7bab (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:08.360383 23448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8291e2ee677e4f8780ef9c902583fb55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.365417 23447 tablet_service.cc:1511] Processing CreateTablet for tablet 1170481acec64cbe9a79c5bf7f04b3f6 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:08.366963 23447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1170481acec64cbe9a79c5bf7f04b3f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.367056 23595 tablet_service.cc:1511] Processing CreateTablet for tablet aa451ba4f51342709eee5e2296060483 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:08.367789 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcef80a7a0d24b8886b0b356906a7bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.368490 23595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa451ba4f51342709eee5e2296060483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.386855 23669 tablet_service.cc:1511] Processing CreateTablet for tablet 4b662a4231d147f2b1090f982677eaef (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:08.388392 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b662a4231d147f2b1090f982677eaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.389966 23520 tablet_service.cc:1511] Processing CreateTablet for tablet 4b662a4231d147f2b1090f982677eaef (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:08.392015 23520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b662a4231d147f2b1090f982677eaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.397490 23594 tablet_service.cc:1511] Processing CreateTablet for tablet 556d579561ea4a0ba8abee89a0e60ef4 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:08.398886 23594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d579561ea4a0ba8abee89a0e60ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.412614 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 556d579561ea4a0ba8abee89a0e60ef4 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:08.414136 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d579561ea4a0ba8abee89a0e60ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.437860 23446 tablet_service.cc:1511] Processing CreateTablet for tablet aa451ba4f51342709eee5e2296060483 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:08.440634 23445 tablet_service.cc:1511] Processing CreateTablet for tablet 4b662a4231d147f2b1090f982677eaef (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:08.444996 23727 tablet_bootstrap.cc:492] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:08.448276 23728 tablet_bootstrap.cc:654] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.442965 23444 tablet_service.cc:1511] Processing CreateTablet for tablet 556d579561ea4a0ba8abee89a0e60ef4 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:08.439340 23446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa451ba4f51342709eee5e2296060483. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.467784 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d579561ea4a0ba8abee89a0e60ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.471763 23445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b662a4231d147f2b1090f982677eaef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.490406 23727 tablet_bootstrap.cc:654] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.509490 23594 tablet_service.cc:1511] Processing CreateTablet for tablet f7e94b011aa846abb8f089c79400c51b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:08.510820 23594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e94b011aa846abb8f089c79400c51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.511523 23523 tablet_service.cc:1511] Processing CreateTablet for tablet f7e94b011aa846abb8f089c79400c51b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:08.512820 23523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e94b011aa846abb8f089c79400c51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.512588 23449 tablet_service.cc:1511] Processing CreateTablet for tablet edabba6fc9934299a8366e57960d9733 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:08.518780 23731 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:08.519836 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:08.521780 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edabba6fc9934299a8366e57960d9733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.528690 23524 tablet_service.cc:1511] Processing CreateTablet for tablet edabba6fc9934299a8366e57960d9733 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:08.530148 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edabba6fc9934299a8366e57960d9733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.532618 23731 tablet_bootstrap.cc:654] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.535176 23599 tablet_service.cc:1511] Processing CreateTablet for tablet edabba6fc9934299a8366e57960d9733 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:08.536581 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edabba6fc9934299a8366e57960d9733. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.541651 23671 tablet_service.cc:1511] Processing CreateTablet for tablet f7e94b011aa846abb8f089c79400c51b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:08.542991 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7e94b011aa846abb8f089c79400c51b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.546252 23729 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:08.546591 23670 tablet_service.cc:1511] Processing CreateTablet for tablet a22253dd90fd40809d13b1e79d2ea774 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:08.547902 23670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22253dd90fd40809d13b1e79d2ea774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.556396 23522 tablet_service.cc:1511] Processing CreateTablet for tablet a22253dd90fd40809d13b1e79d2ea774 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:08.557761 23522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22253dd90fd40809d13b1e79d2ea774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.560395 23596 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7c02730daf418a8e9783caba996c49 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:08.560737 23673 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7c02730daf418a8e9783caba996c49 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:08.556542 23450 tablet_service.cc:1511] Processing CreateTablet for tablet a22253dd90fd40809d13b1e79d2ea774 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:08.561672 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7c02730daf418a8e9783caba996c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.562139 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7c02730daf418a8e9783caba996c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.569012 23449 tablet_service.cc:1511] Processing CreateTablet for tablet 0a7c02730daf418a8e9783caba996c49 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:08.570276 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a7c02730daf418a8e9783caba996c49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.582353 23728 tablet_bootstrap.cc:492] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:08.584756 23728 ts_tablet_manager.cc:1403] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.255s	user 0.013s	sys 0.018s
I20260709 13:09:08.586030 23525 tablet_service.cc:1511] Processing CreateTablet for tablet 9e30e6ebdca44cbdb950b5df31f1e15a (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:08.586504 23727 tablet_bootstrap.cc:492] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:08.584023 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a22253dd90fd40809d13b1e79d2ea774. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.587863 23727 ts_tablet_manager.cc:1403] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.143s	user 0.006s	sys 0.011s
I20260709 13:09:08.587456 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e30e6ebdca44cbdb950b5df31f1e15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.588379 23728 raft_consensus.cc:359] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.589205 23728 raft_consensus.cc:385] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.589751 23728 raft_consensus.cc:740] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.590780 23728 consensus_queue.cc:260] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.591324 23597 tablet_service.cc:1511] Processing CreateTablet for tablet 9e30e6ebdca44cbdb950b5df31f1e15a (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:08.593066 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e30e6ebdca44cbdb950b5df31f1e15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.600664 23731 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:08.601202 23731 ts_tablet_manager.cc:1403] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.024s
I20260709 13:09:08.604180 23731 raft_consensus.cc:359] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.604885 23731 raft_consensus.cc:385] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.605183 23727 raft_consensus.cc:359] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.605966 23727 raft_consensus.cc:385] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.606803 23727 raft_consensus.cc:740] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.613273 23727 consensus_queue.cc:260] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.617269 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 2575893fed284ec6ab4150b792b0b790 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:08.618937 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2575893fed284ec6ab4150b792b0b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.620195 23446 tablet_service.cc:1511] Processing CreateTablet for tablet 2575893fed284ec6ab4150b792b0b790 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:08.621454 23446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2575893fed284ec6ab4150b792b0b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.624588 23710 heartbeater.cc:499] Master 127.13.120.62:34857 was elected leader, sending a full tablet report...
I20260709 13:09:08.625782 23728 ts_tablet_manager.cc:1434] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.041s	user 0.009s	sys 0.005s
I20260709 13:09:08.627013 23728 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:08.632771 23729 tablet_bootstrap.cc:654] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.636145 23728 tablet_bootstrap.cc:654] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.644419 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 2575893fed284ec6ab4150b792b0b790 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:08.646315 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2575893fed284ec6ab4150b792b0b790. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.654574 23671 tablet_service.cc:1511] Processing CreateTablet for tablet c47a3456a44347848b814a90540324bc (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:08.655929 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47a3456a44347848b814a90540324bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.624575 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 9e30e6ebdca44cbdb950b5df31f1e15a (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:08.657215 23444 tablet_service.cc:1511] Processing CreateTablet for tablet c47a3456a44347848b814a90540324bc (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:08.658459 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47a3456a44347848b814a90540324bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.605188 23731 raft_consensus.cc:740] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.660840 23731 consensus_queue.cc:260] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.663782 23562 heartbeater.cc:499] Master 127.13.120.62:34857 was elected leader, sending a full tablet report...
I20260709 13:09:08.667759 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e30e6ebdca44cbdb950b5df31f1e15a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.669122 23524 tablet_service.cc:1511] Processing CreateTablet for tablet c47a3456a44347848b814a90540324bc (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:08.670388 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47a3456a44347848b814a90540324bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.673990 23727 ts_tablet_manager.cc:1434] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.016s
I20260709 13:09:08.676409 23727 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:08.677533 23729 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:08.678050 23729 ts_tablet_manager.cc:1403] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.132s	user 0.013s	sys 0.000s
I20260709 13:09:08.681293 23729 raft_consensus.cc:359] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:08.682066 23729 raft_consensus.cc:385] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.682361 23729 raft_consensus.cc:740] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.686384 23727 tablet_bootstrap.cc:654] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.687357 23673 tablet_service.cc:1511] Processing CreateTablet for tablet 306e3c84432447f9be679573a0761c06 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:08.695019 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306e3c84432447f9be679573a0761c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.696382 23522 tablet_service.cc:1511] Processing CreateTablet for tablet ed7b08fe298a4c318662e7b54994912b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:08.696979 23731 ts_tablet_manager.cc:1434] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.095s	user 0.006s	sys 0.006s
I20260709 13:09:08.697675 23522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7b08fe298a4c318662e7b54994912b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.698169 23731 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:08.692602 23487 heartbeater.cc:499] Master 127.13.120.62:34857 was elected leader, sending a full tablet report...
I20260709 13:09:08.699643 23594 tablet_service.cc:1511] Processing CreateTablet for tablet 306e3c84432447f9be679573a0761c06 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:08.709358 23594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306e3c84432447f9be679573a0761c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.710573 23596 tablet_service.cc:1511] Processing CreateTablet for tablet ed7b08fe298a4c318662e7b54994912b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:08.711933 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7b08fe298a4c318662e7b54994912b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.713331 23670 tablet_service.cc:1511] Processing CreateTablet for tablet ed7b08fe298a4c318662e7b54994912b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:08.714669 23670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed7b08fe298a4c318662e7b54994912b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.722648 23731 tablet_bootstrap.cc:654] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.724677 23450 tablet_service.cc:1511] Processing CreateTablet for tablet 9997887126674260a9b0753308029e17 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:08.726572 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9997887126674260a9b0753308029e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.692705 23738 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.728015 23728 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:08.728652 23728 ts_tablet_manager.cc:1403] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.102s	user 0.015s	sys 0.013s
I20260709 13:09:08.727696 23738 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.735436 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 9997887126674260a9b0753308029e17 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
W20260709 13:09:08.736851 23711 tablet.cc:2406] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:08.737311 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9997887126674260a9b0753308029e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.740970 23728 raft_consensus.cc:359] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.751592 23728 raft_consensus.cc:385] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.748433 23449 tablet_service.cc:1511] Processing CreateTablet for tablet 306e3c84432447f9be679573a0761c06 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:08.763903 23597 tablet_service.cc:1511] Processing CreateTablet for tablet 9997887126674260a9b0753308029e17 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:08.764341 23670 tablet_service.cc:1511] Processing CreateTablet for tablet c740becc06a7409891e4058e37695e2c (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:08.753409 23729 consensus_queue.cc:260] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:08.759085 23738 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:08.752071 23728 raft_consensus.cc:740] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.775473 23525 tablet_service.cc:1511] Processing CreateTablet for tablet c740becc06a7409891e4058e37695e2c (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:08.776858 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c740becc06a7409891e4058e37695e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.778890 23731 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:08.772822 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9997887126674260a9b0753308029e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.779472 23731 ts_tablet_manager.cc:1403] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.000s
I20260709 13:09:08.772954 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 306e3c84432447f9be679573a0761c06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.787127 23670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c740becc06a7409891e4058e37695e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.791354 23452 tablet_service.cc:1511] Processing CreateTablet for tablet c740becc06a7409891e4058e37695e2c (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:08.801990 23452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c740becc06a7409891e4058e37695e2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.802284 23596 tablet_service.cc:1511] Processing CreateTablet for tablet ef38dca00e5e45d194aa64b09b4a4271 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:08.805097 23727 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:08.808055 23727 ts_tablet_manager.cc:1403] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.132s	user 0.009s	sys 0.010s
I20260709 13:09:08.805505 23596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef38dca00e5e45d194aa64b09b4a4271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.817692 23734 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.807132 23446 tablet_service.cc:1511] Processing CreateTablet for tablet ef38dca00e5e45d194aa64b09b4a4271 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:08.818197 23734 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.818665 23727 raft_consensus.cc:359] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.819454 23727 raft_consensus.cc:385] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.819739 23727 raft_consensus.cc:740] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.821336 23446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef38dca00e5e45d194aa64b09b4a4271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.820511 23727 consensus_queue.cc:260] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.827271 23731 raft_consensus.cc:359] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.827816 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 985baf5be41844358d43f30ddeee2e3d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:08.834856 23734 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:08.833030 23731 raft_consensus.cc:385] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:08.835433 23731 raft_consensus.cc:740] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:08.836196 23731 consensus_queue.cc:260] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.837026 23738 raft_consensus.cc:493] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.837460 23738 raft_consensus.cc:515] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:08.842640 23738 leader_election.cc:290] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:08.850816 23749 raft_consensus.cc:493] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.851059 23636 heartbeater.cc:499] Master 127.13.120.62:34857 was elected leader, sending a full tablet report...
I20260709 13:09:08.851327 23749 raft_consensus.cc:515] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:08.854139 23749 leader_election.cc:290] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:08.853696 23522 tablet_service.cc:1511] Processing CreateTablet for tablet 985baf5be41844358d43f30ddeee2e3d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:08.869768 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985baf5be41844358d43f30ddeee2e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.871007 23671 tablet_service.cc:1511] Processing CreateTablet for tablet 985baf5be41844358d43f30ddeee2e3d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:08.872355 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985baf5be41844358d43f30ddeee2e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.789191 23728 consensus_queue.cc:260] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.878019 23728 ts_tablet_manager.cc:1434] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.000s
I20260709 13:09:08.878194 23598 tablet_service.cc:1511] Processing CreateTablet for tablet cd525747a77e4b33a52ddb98c3dae259 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:08.879571 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd525747a77e4b33a52ddb98c3dae259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.878194 23673 tablet_service.cc:1511] Processing CreateTablet for tablet ef38dca00e5e45d194aa64b09b4a4271 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:08.882243 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef38dca00e5e45d194aa64b09b4a4271. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.884444 23729 ts_tablet_manager.cc:1434] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.206s	user 0.023s	sys 0.019s
I20260709 13:09:08.885560 23729 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:08.886410 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9e4ec4723345c9bbdcc12fab0be284 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:08.887354 23734 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.887694 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9e4ec4723345c9bbdcc12fab0be284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.887908 23734 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.889863 23731 ts_tablet_manager.cc:1434] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.000s
I20260709 13:09:08.889533 23600 tablet_service.cc:1511] Processing CreateTablet for tablet 70014355724949559ee372d7d1080178 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:08.909034 23728 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:08.915310 23523 tablet_service.cc:1511] Processing CreateTablet for tablet 2051e70e1839470b9d075467894aa8e8 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:08.915818 23669 tablet_service.cc:1511] Processing CreateTablet for tablet 70014355724949559ee372d7d1080178 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:08.916844 23523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2051e70e1839470b9d075467894aa8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.917253 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70014355724949559ee372d7d1080178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.919819 23522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 985baf5be41844358d43f30ddeee2e3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.919917 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70014355724949559ee372d7d1080178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.926241 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9e4ec4723345c9bbdcc12fab0be284 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:08.927618 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9e4ec4723345c9bbdcc12fab0be284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.933792 23727 ts_tablet_manager.cc:1434] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.001s
I20260709 13:09:08.933542 23450 tablet_service.cc:1511] Processing CreateTablet for tablet cd525747a77e4b33a52ddb98c3dae259 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:08.934819 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd525747a77e4b33a52ddb98c3dae259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.939361 23728 tablet_bootstrap.cc:654] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:08.940637 23734 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:08.909598 23731 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:08.953620 23597 tablet_service.cc:1511] Processing CreateTablet for tablet 2051e70e1839470b9d075467894aa8e8 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:08.956303 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2051e70e1839470b9d075467894aa8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.966750 23735 raft_consensus.cc:493] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:08.967620 23735 raft_consensus.cc:515] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:08.972182 23672 tablet_service.cc:1511] Processing CreateTablet for tablet 2051e70e1839470b9d075467894aa8e8 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:08.974198 23672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2051e70e1839470b9d075467894aa8e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:08.980731 23735 leader_election.cc:290] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:08.934845 23727 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:08.941874 23524 tablet_service.cc:1511] Processing CreateTablet for tablet cd525747a77e4b33a52ddb98c3dae259 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:09.001081 23735 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.035398 23445 tablet_service.cc:1511] Processing CreateTablet for tablet 70014355724949559ee372d7d1080178 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:09.040583 23445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70014355724949559ee372d7d1080178. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.040882 23522 tablet_service.cc:1511] Processing CreateTablet for tablet 75d142d8c75c4547b54e489d38fda700 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:09.043001 23601 tablet_service.cc:1511] Processing CreateTablet for tablet 75d142d8c75c4547b54e489d38fda700 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:09.044411 23601 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d142d8c75c4547b54e489d38fda700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.052461 23727 tablet_bootstrap.cc:654] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.022718 23735 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.053413 23444 tablet_service.cc:1511] Processing CreateTablet for tablet 8b9e4ec4723345c9bbdcc12fab0be284 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:09.053700 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:09.054792 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b9e4ec4723345c9bbdcc12fab0be284. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.059988 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcef80a7a0d24b8886b0b356906a7bab" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:09.068696 23449 tablet_service.cc:1511] Processing CreateTablet for tablet 75d142d8c75c4547b54e489d38fda700 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:09.069507 23448 tablet_service.cc:1511] Processing CreateTablet for tablet af1834b561b741d9a51e512f60b6f81b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:09.070253 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d142d8c75c4547b54e489d38fda700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.080053 23597 tablet_service.cc:1511] Processing CreateTablet for tablet c86ffcfced3640e497a9ea757f67f9fa (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:09.038245 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd525747a77e4b33a52ddb98c3dae259. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.072034 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:09.081532 23685 raft_consensus.cc:2468] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:09.089798 23448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1834b561b741d9a51e512f60b6f81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.090719 23451 tablet_service.cc:1511] Processing CreateTablet for tablet c86ffcfced3640e497a9ea757f67f9fa (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:09.092288 23451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ffcfced3640e497a9ea757f67f9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.095644 23522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75d142d8c75c4547b54e489d38fda700. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.097195 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ffcfced3640e497a9ea757f67f9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.087495 23729 tablet_bootstrap.cc:654] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.055375 23735 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
W20260709 13:09:09.107659 23428 leader_election.cc:343] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.109217 23428 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
W20260709 13:09:09.111296 23428 leader_election.cc:343] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.113546 23728 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:09.114128 23728 ts_tablet_manager.cc:1403] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.207s	user 0.015s	sys 0.012s
I20260709 13:09:09.115701 23731 tablet_bootstrap.cc:654] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.124922 23739 raft_consensus.cc:2804] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.125375 23739 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.125764 23739 raft_consensus.cc:3060] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.127683 23727 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:09.128243 23727 ts_tablet_manager.cc:1403] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.194s	user 0.018s	sys 0.004s
I20260709 13:09:09.141052 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:09.143000 23649 leader_election.cc:343] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.158434 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b662a4231d147f2b1090f982677eaef" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:09.158326 23525 tablet_service.cc:1511] Processing CreateTablet for tablet af1834b561b741d9a51e512f60b6f81b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:09.160033 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1834b561b741d9a51e512f60b6f81b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.160386 23502 leader_election.cc:343] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.162655 23671 tablet_service.cc:1511] Processing CreateTablet for tablet af1834b561b741d9a51e512f60b6f81b (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:09.164069 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1834b561b741d9a51e512f60b6f81b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.166216 23523 tablet_service.cc:1511] Processing CreateTablet for tablet 05850e9b37994edb9bcd786b1bdbaccc (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:09.167694 23523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05850e9b37994edb9bcd786b1bdbaccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.171617 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:09.117607 23728 raft_consensus.cc:359] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.184357 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:09.191803 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:09.191876 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:09.192176 23576 leader_election.cc:343] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.192735 23537 raft_consensus.cc:2468] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:09.197237 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b662a4231d147f2b1090f982677eaef" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:09.197686 23651 leader_election.cc:343] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.197970 23739 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.184821 23728 raft_consensus.cc:385] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.198541 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:09.200338 23684 raft_consensus.cc:2468] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:09.199846 23462 raft_consensus.cc:2393] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:09.204928 23650 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:09.206162 23734 raft_consensus.cc:3060] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.204077 23728 raft_consensus.cc:740] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.212651 23734 raft_consensus.cc:2749] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.212509 23728 consensus_queue.cc:260] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.213569 23685 raft_consensus.cc:2468] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:09.153282 23727 raft_consensus.cc:359] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.217592 23669 tablet_service.cc:1511] Processing CreateTablet for tablet c86ffcfced3640e497a9ea757f67f9fa (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:09.222304 23598 tablet_service.cc:1511] Processing CreateTablet for tablet 05850e9b37994edb9bcd786b1bdbaccc (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:09.232158 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05850e9b37994edb9bcd786b1bdbaccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.219607 23727 raft_consensus.cc:385] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.198573 23651 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:09.234764 23727 raft_consensus.cc:740] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.236318 23727 consensus_queue.cc:260] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.238938 23734 raft_consensus.cc:2804] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.239122 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:09.240573 23501 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:09.244585 23735 raft_consensus.cc:2804] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.245090 23735 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.245530 23735 raft_consensus.cc:3060] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.239439 23734 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:09.252274 23501 leader_election.cc:343] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.253535 23729 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:09.254076 23729 ts_tablet_manager.cc:1403] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.369s	user 0.017s	sys 0.009s
I20260709 13:09:09.257400 23446 tablet_service.cc:1511] Processing CreateTablet for tablet 69fed89fed14448fa25983c72e7f1e64 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:09.258872 23446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fed89fed14448fa25983c72e7f1e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.259474 23734 raft_consensus.cc:3060] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.260694 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 69fed89fed14448fa25983c72e7f1e64 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:09.262233 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fed89fed14448fa25983c72e7f1e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.257426 23729 raft_consensus.cc:359] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.264451 23729 raft_consensus.cc:385] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.264778 23729 raft_consensus.cc:740] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.265580 23729 consensus_queue.cc:260] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.267431 23727 ts_tablet_manager.cc:1434] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.139s	user 0.010s	sys 0.000s
I20260709 13:09:09.268779 23727 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:09.281682 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:09.281961 23731 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:09.282720 23731 ts_tablet_manager.cc:1403] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.380s	user 0.009s	sys 0.012s
W20260709 13:09:09.283793 23428 leader_election.cc:343] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.282810 23739 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:09.287397 23501 leader_election.cc:304] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:09.291455 23731 raft_consensus.cc:359] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:09.292207 23731 raft_consensus.cc:385] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.292479 23731 raft_consensus.cc:740] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.293375 23729 ts_tablet_manager.cc:1434] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.005s
I20260709 13:09:09.293213 23731 consensus_queue.cc:260] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:09.294541 23729 tablet_bootstrap.cc:492] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:09.296053 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c86ffcfced3640e497a9ea757f67f9fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.297102 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:09.302268 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcef80a7a0d24b8886b0b356906a7bab" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:09.304366 23426 leader_election.cc:343] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.304870 23426 leader_election.cc:304] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:09.308790 23685 raft_consensus.cc:2468] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:09.299084 23735 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.314126 23728 ts_tablet_manager.cc:1434] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.200s	user 0.032s	sys 0.027s
I20260709 13:09:09.315238 23728 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:09.314390 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 69fed89fed14448fa25983c72e7f1e64 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:09.316979 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69fed89fed14448fa25983c72e7f1e64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.322664 23728 tablet_bootstrap.cc:654] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.326058 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:09.320616 23727 tablet_bootstrap.cc:654] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.327518 23597 tablet_service.cc:1511] Processing CreateTablet for tablet d06495ae663546c0bba8a8faac68e49d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:09.332433 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06495ae663546c0bba8a8faac68e49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.333226 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 05850e9b37994edb9bcd786b1bdbaccc (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:09.334510 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05850e9b37994edb9bcd786b1bdbaccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.335175 23426 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:09.336228 23738 raft_consensus.cc:2749] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.336910 23738 raft_consensus.cc:2804] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.337328 23738 raft_consensus.cc:697] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:09.338173 23738 consensus_queue.cc:237] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.320390 23729 tablet_bootstrap.cc:654] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.331069 23671 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3a5fa062b44bf98d8c3c2ed4109355 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:09.348377 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3a5fa062b44bf98d8c3c2ed4109355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.348703 23446 tablet_service.cc:1511] Processing CreateTablet for tablet d06495ae663546c0bba8a8faac68e49d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:09.350062 23446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06495ae663546c0bba8a8faac68e49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.354769 23444 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3a5fa062b44bf98d8c3c2ed4109355 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:09.356523 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3a5fa062b44bf98d8c3c2ed4109355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.356997 23767 raft_consensus.cc:2804] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:09.356868 23501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.4:44569, user_credentials={real_user=slave}} blocked reactor thread for 69565.4us
I20260709 13:09:09.357553 23767 raft_consensus.cc:493] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.357923 23767 raft_consensus.cc:3060] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.359655 23735 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:09.361037 23673 tablet_service.cc:1511] Processing CreateTablet for tablet d06495ae663546c0bba8a8faac68e49d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:09.362555 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06495ae663546c0bba8a8faac68e49d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.370072 23767 raft_consensus.cc:515] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.361112 23734 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.371626 23738 raft_consensus.cc:493] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.372239 23738 raft_consensus.cc:515] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:09.372414 23767 leader_election.cc:290] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:09.373588 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b662a4231d147f2b1090f982677eaef" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:09.374804 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:09.376010 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:09.376235 23649 leader_election.cc:343] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:09.377508 23426 leader_election.cc:343] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.378165 23738 leader_election.cc:290] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
W20260709 13:09:09.378506 23502 leader_election.cc:343] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:09.381232 23575 leader_election.cc:343] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.381385 23598 tablet_service.cc:1511] Processing CreateTablet for tablet 31b8a011953547178d6c255a7b9a072f (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:09.381819 23575 leader_election.cc:304] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:09.382709 23749 raft_consensus.cc:2749] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.388849 23731 ts_tablet_manager.cc:1434] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.001s
I20260709 13:09:09.382899 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b8a011953547178d6c255a7b9a072f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.385618 23734 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:09.401399 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:09.401788 23672 tablet_service.cc:1511] Processing CreateTablet for tablet 31b8a011953547178d6c255a7b9a072f (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
W20260709 13:09:09.402855 23426 leader_election.cc:343] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.403192 23672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b8a011953547178d6c255a7b9a072f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.403329 23426 leader_election.cc:304] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:09.403373 23445 tablet_service.cc:1511] Processing CreateTablet for tablet b7f78bc1f917479c95f330e249821717 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:09.404747 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:09.406507 23685 raft_consensus.cc:2393] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:09.406955 23445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f78bc1f917479c95f330e249821717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.409931 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b662a4231d147f2b1090f982677eaef" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:09.409992 23525 tablet_service.cc:1511] Processing CreateTablet for tablet 31b8a011953547178d6c255a7b9a072f (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:09.410384 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:09.410686 23685 raft_consensus.cc:3060] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.411299 23537 raft_consensus.cc:2393] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 1: Already voted for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in this term.
I20260709 13:09:09.411352 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b8a011953547178d6c255a7b9a072f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.412295 23738 raft_consensus.cc:2749] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.413818 23651 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:09.414603 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:09.417184 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 5d3a5fa062b44bf98d8c3c2ed4109355 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:09.418102 23734 raft_consensus.cc:2749] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.418628 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d3a5fa062b44bf98d8c3c2ed4109355. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.418339 23358 catalog_manager.cc:5697] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:09.422983 23501 leader_election.cc:343] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.423668 23501 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:09.424515 23767 raft_consensus.cc:2749] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.432372 23600 tablet_service.cc:1511] Processing CreateTablet for tablet b7f78bc1f917479c95f330e249821717 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:09.433877 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f78bc1f917479c95f330e249821717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.432543 23523 tablet_service.cc:1511] Processing CreateTablet for tablet b7f78bc1f917479c95f330e249821717 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:09.435344 23523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7f78bc1f917479c95f330e249821717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.439533 23731 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:09.445612 23727 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:09.446169 23727 ts_tablet_manager.cc:1403] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.178s	user 0.012s	sys 0.015s
I20260709 13:09:09.448840 23727 raft_consensus.cc:359] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.449386 23727 raft_consensus.cc:385] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.449680 23727 raft_consensus.cc:740] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.450606 23727 consensus_queue.cc:260] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.457279 23728 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:09.457875 23728 ts_tablet_manager.cc:1403] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.014s
I20260709 13:09:09.460388 23451 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd51d50e9f64154965524bf64801024 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:09.461822 23451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd51d50e9f64154965524bf64801024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.462396 23728 raft_consensus.cc:359] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.460388 23673 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd51d50e9f64154965524bf64801024 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:09.464103 23728 raft_consensus.cc:385] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.464471 23728 raft_consensus.cc:740] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.465112 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd51d50e9f64154965524bf64801024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.465365 23728 consensus_queue.cc:260] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.468760 23727 ts_tablet_manager.cc:1434] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:09:09.469835 23727 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:09.476855 23729 tablet_bootstrap.cc:492] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:09.477435 23729 ts_tablet_manager.cc:1403] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.183s	user 0.013s	sys 0.008s
I20260709 13:09:09.483517 23727 tablet_bootstrap.cc:654] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.483997 23729 raft_consensus.cc:359] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.485834 23729 raft_consensus.cc:385] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.486222 23729 raft_consensus.cc:740] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.487295 23525 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd51d50e9f64154965524bf64801024 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:09.487867 23600 tablet_service.cc:1511] Processing CreateTablet for tablet ef32908f3a2d412090974bfa5caba496 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:09.487388 23729 consensus_queue.cc:260] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.489249 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd51d50e9f64154965524bf64801024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.502226 23522 tablet_service.cc:1511] Processing CreateTablet for tablet 34e5e8374cc9436696a431388a452768 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:09.503504 23522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e5e8374cc9436696a431388a452768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.504884 23598 tablet_service.cc:1511] Processing CreateTablet for tablet 34e5e8374cc9436696a431388a452768 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:09.489251 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef32908f3a2d412090974bfa5caba496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.507702 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e5e8374cc9436696a431388a452768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.490715 23685 raft_consensus.cc:2468] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:09.493038 23668 tablet_service.cc:1511] Processing CreateTablet for tablet ef32908f3a2d412090974bfa5caba496 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:09.510319 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef32908f3a2d412090974bfa5caba496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.510541 23501 leader_election.cc:304] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:09.514580 23767 raft_consensus.cc:2804] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.514627 23669 tablet_service.cc:1511] Processing CreateTablet for tablet 34e5e8374cc9436696a431388a452768 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:09.515334 23767 raft_consensus.cc:697] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:09.516044 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e5e8374cc9436696a431388a452768. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.516347 23767 consensus_queue.cc:237] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.517400 23729 ts_tablet_manager.cc:1434] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:09:09.494148 23731 tablet_bootstrap.cc:654] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.498025 23445 tablet_service.cc:1511] Processing CreateTablet for tablet ef32908f3a2d412090974bfa5caba496 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:09.501457 23728 ts_tablet_manager.cc:1434] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
W20260709 13:09:09.525516 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:09.526034 23445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef32908f3a2d412090974bfa5caba496. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.520352 23444 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2d5e15657d4d9caeb89fd380cedcb3 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:09.528184 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2d5e15657d4d9caeb89fd380cedcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.528569 23728 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:09.529551 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2d5e15657d4d9caeb89fd380cedcb3 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:09.530879 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2d5e15657d4d9caeb89fd380cedcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.539105 23728 tablet_bootstrap.cc:654] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.520354 23729 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:09.561076 23523 tablet_service.cc:1511] Processing CreateTablet for tablet 2f2d5e15657d4d9caeb89fd380cedcb3 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:09.561615 23672 tablet_service.cc:1511] Processing CreateTablet for tablet baa3243f757c4f6dac4677c739e8f145 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:09.562927 23672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa3243f757c4f6dac4677c739e8f145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.563053 23523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f2d5e15657d4d9caeb89fd380cedcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.577862 23446 tablet_service.cc:1511] Processing CreateTablet for tablet baa3243f757c4f6dac4677c739e8f145 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:09.578358 23524 tablet_service.cc:1511] Processing CreateTablet for tablet baa3243f757c4f6dac4677c739e8f145 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:09.579304 23446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa3243f757c4f6dac4677c739e8f145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.579641 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet baa3243f757c4f6dac4677c739e8f145. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.595744 23729 tablet_bootstrap.cc:654] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.595243 23600 tablet_service.cc:1511] Processing CreateTablet for tablet cecd26fe571241608c608c52c4e6e4b1 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:09.597136 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecd26fe571241608c608c52c4e6e4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.595286 23673 tablet_service.cc:1511] Processing CreateTablet for tablet cecd26fe571241608c608c52c4e6e4b1 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:09.600734 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecd26fe571241608c608c52c4e6e4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.621454 23450 tablet_service.cc:1511] Processing CreateTablet for tablet cecd26fe571241608c608c52c4e6e4b1 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:09.622902 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cecd26fe571241608c608c52c4e6e4b1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.627635 23448 tablet_service.cc:1511] Processing CreateTablet for tablet 22b49ed532684aa3ae75017b8afe8475 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:09.629340 23767 raft_consensus.cc:493] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.629900 23767 raft_consensus.cc:515] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.630645 23527 tablet_service.cc:1511] Processing CreateTablet for tablet cb8713a52bae4dc3b7153d826f171c88 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:09.632089 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8713a52bae4dc3b7153d826f171c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.632373 23767 leader_election.cc:290] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:09.637223 23526 tablet_service.cc:1511] Processing CreateTablet for tablet 22b49ed532684aa3ae75017b8afe8475 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:09.638531 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa451ba4f51342709eee5e2296060483" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:09.638319 23357 catalog_manager.cc:5697] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:09.639191 23611 raft_consensus.cc:2468] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:09.640506 23501 leader_election.cc:304] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:09.642874 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 22b49ed532684aa3ae75017b8afe8475 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:09.644240 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b49ed532684aa3ae75017b8afe8475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.645721 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b49ed532684aa3ae75017b8afe8475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.642930 23767 raft_consensus.cc:2804] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.648051 23767 raft_consensus.cc:493] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.648097 23668 tablet_service.cc:1511] Processing CreateTablet for tablet f2b7234d417542daa1fa8313cc1ab199 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:09.648636 23767 raft_consensus.cc:3060] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.643880 23669 tablet_service.cc:1511] Processing CreateTablet for tablet cb8713a52bae4dc3b7153d826f171c88 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:09.659723 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b7234d417542daa1fa8313cc1ab199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.659862 23727 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:09.664793 23727 ts_tablet_manager.cc:1403] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.195s	user 0.012s	sys 0.003s
I20260709 13:09:09.668047 23727 raft_consensus.cc:359] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.668963 23727 raft_consensus.cc:385] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.669268 23448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22b49ed532684aa3ae75017b8afe8475. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.669305 23727 raft_consensus.cc:740] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.660588 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa451ba4f51342709eee5e2296060483" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:09.663731 23449 tablet_service.cc:1511] Processing CreateTablet for tablet f2b7234d417542daa1fa8313cc1ab199 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:09.673269 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b7234d417542daa1fa8313cc1ab199. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.673662 23502 leader_election.cc:343] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.675089 23727 consensus_queue.cc:260] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.689514 23727 ts_tablet_manager.cc:1434] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 13:09:09.690686 23727 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:09.691545 23598 tablet_service.cc:1511] Processing CreateTablet for tablet cb8713a52bae4dc3b7153d826f171c88 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:09.684001 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8713a52bae4dc3b7153d826f171c88. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:09.706661 23347 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 46571.6us
I20260709 13:09:09.708483 23728 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:09.711787 23728 ts_tablet_manager.cc:1403] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.007s
I20260709 13:09:09.716672 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb8713a52bae4dc3b7153d826f171c88. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.721386 23444 tablet_service.cc:1511] Processing CreateTablet for tablet 925234f9de154af68ec326257968572d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:09.722565 23729 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:09.722870 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925234f9de154af68ec326257968572d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.723094 23729 ts_tablet_manager.cc:1403] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.203s	user 0.038s	sys 0.019s
I20260709 13:09:09.722302 23525 tablet_service.cc:1511] Processing CreateTablet for tablet ccefc8653d6d40a98aa795e53e75e1e7 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:09.729247 23597 tablet_service.cc:1511] Processing CreateTablet for tablet ccefc8653d6d40a98aa795e53e75e1e7 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:09.718860 23600 tablet_service.cc:1511] Processing CreateTablet for tablet 925234f9de154af68ec326257968572d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:09.730597 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccefc8653d6d40a98aa795e53e75e1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.730248 23671 tablet_service.cc:1511] Processing CreateTablet for tablet ccefc8653d6d40a98aa795e53e75e1e7 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:09.724278 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccefc8653d6d40a98aa795e53e75e1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.731586 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925234f9de154af68ec326257968572d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.720458 23524 tablet_service.cc:1511] Processing CreateTablet for tablet f2b7234d417542daa1fa8313cc1ab199 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:09.734697 23671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccefc8653d6d40a98aa795e53e75e1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.743768 23672 tablet_service.cc:1511] Processing CreateTablet for tablet 925234f9de154af68ec326257968572d (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:09.744565 23731 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:09.745124 23731 ts_tablet_manager.cc:1403] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.306s	user 0.012s	sys 0.004s
I20260709 13:09:09.745249 23672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 925234f9de154af68ec326257968572d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.747596 23767 raft_consensus.cc:515] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.749825 23767 leader_election.cc:290] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:09.750594 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa451ba4f51342709eee5e2296060483" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:09.750926 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa451ba4f51342709eee5e2296060483" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:09.751569 23611 raft_consensus.cc:3060] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:09.752213 23502 leader_election.cc:343] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.755752 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2b7234d417542daa1fa8313cc1ab199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.759182 23611 raft_consensus.cc:2468] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:09.760581 23501 leader_election.cc:304] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:09.762970 23767 raft_consensus.cc:2804] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:09.767858 23767 raft_consensus.cc:697] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:09.775691 23767 consensus_queue.cc:237] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.777235 23731 raft_consensus.cc:359] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.788152 23526 tablet_service.cc:1511] Processing CreateTablet for tablet 10ef9b6dc3e34a46be40dc8a31c2dc57 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:09.788365 23728 raft_consensus.cc:359] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:09.790130 23729 raft_consensus.cc:359] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.779666 23731 raft_consensus.cc:385] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.802690 23727 tablet_bootstrap.cc:654] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.796360 23729 raft_consensus.cc:385] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.803151 23729 raft_consensus.cc:740] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.804098 23729 consensus_queue.cc:260] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.806558 23729 ts_tablet_manager.cc:1434] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.083s	user 0.007s	sys 0.000s
I20260709 13:09:09.807749 23729 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:09.807919 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 10ef9b6dc3e34a46be40dc8a31c2dc57 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:09.819060 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ef9b6dc3e34a46be40dc8a31c2dc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.815935 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ef9b6dc3e34a46be40dc8a31c2dc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.813243 23448 tablet_service.cc:1511] Processing CreateTablet for tablet 10ef9b6dc3e34a46be40dc8a31c2dc57 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:09.795555 23728 raft_consensus.cc:385] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.826042 23448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10ef9b6dc3e34a46be40dc8a31c2dc57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.827639 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 1785fa69f121467b8d300a0bb3cbc644 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:09.829248 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785fa69f121467b8d300a0bb3cbc644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.825896 23728 raft_consensus.cc:740] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.832988 23728 consensus_queue.cc:260] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:09.798120 23731 raft_consensus.cc:740] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.838843 23734 raft_consensus.cc:493] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.839442 23738 consensus_queue.cc:1048] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:09.839346 23734 raft_consensus.cc:515] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.857692 23728 ts_tablet_manager.cc:1434] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.141s	user 0.011s	sys 0.000s
I20260709 13:09:09.858876 23728 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:09.858058 23734 leader_election.cc:290] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:09.860976 23734 raft_consensus.cc:493] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.861424 23734 raft_consensus.cc:515] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:09.865033 23735 raft_consensus.cc:493] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.865520 23735 raft_consensus.cc:515] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.865726 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
W20260709 13:09:09.867139 23650 leader_election.cc:343] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.867602 23735 leader_election.cc:290] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:09.869791 23729 tablet_bootstrap.cc:654] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.870790 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8773bb3ecbee48738d3b1c65f086bf88" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:09.871989 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8773bb3ecbee48738d3b1c65f086bf88" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:09.872354 23502 leader_election.cc:343] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.873770 23734 leader_election.cc:290] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
W20260709 13:09:09.873840 23501 leader_election.cc:343] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:09.874583 23501 leader_election.cc:304] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:09.876207 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:09.877031 23611 raft_consensus.cc:2468] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:09.878573 23649 leader_election.cc:304] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:09.865525 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:09.879801 23735 raft_consensus.cc:2749] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:09.880735 23734 raft_consensus.cc:2804] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.881179 23734 raft_consensus.cc:493] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.881593 23734 raft_consensus.cc:3060] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.882791 23449 tablet_service.cc:1511] Processing CreateTablet for tablet 1785fa69f121467b8d300a0bb3cbc644 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:09.883595 23728 tablet_bootstrap.cc:654] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.884294 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785fa69f121467b8d300a0bb3cbc644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.878278 23731 consensus_queue.cc:260] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.886407 23462 raft_consensus.cc:2468] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:09.889292 23650 leader_election.cc:304] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:09.903517 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 1785fa69f121467b8d300a0bb3cbc644 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:09.905246 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1785fa69f121467b8d300a0bb3cbc644. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.908697 23749 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:09.909281 23749 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.922252 23728 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:09.921926 23357 catalog_manager.cc:5697] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:09.923377 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:09.924453 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 5872ed9104d54b1e88ce2e4c22f56596 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:09.929723 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5872ed9104d54b1e88ce2e4c22f56596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.930140 23537 raft_consensus.cc:2468] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:09.930347 23749 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:09.931785 23731 ts_tablet_manager.cc:1434] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.186s	user 0.014s	sys 0.002s
I20260709 13:09:09.947043 23731 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:09.932086 23428 consensus_peers.cc:597] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:09.933820 23444 tablet_service.cc:1511] Processing CreateTablet for tablet 5872ed9104d54b1e88ce2e4c22f56596 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:09.921262 23783 raft_consensus.cc:2804] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:09.952204 23783 raft_consensus.cc:493] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:09.952623 23783 raft_consensus.cc:3060] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:09.939845 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:09.955905 23684 raft_consensus.cc:2393] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:09.941641 23673 tablet_service.cc:1511] Processing CreateTablet for tablet 5872ed9104d54b1e88ce2e4c22f56596 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:09.942598 23727 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:09.922870 23728 ts_tablet_manager.cc:1403] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.064s	user 0.010s	sys 0.010s
I20260709 13:09:09.957993 23727 ts_tablet_manager.cc:1403] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.268s	user 0.014s	sys 0.013s
I20260709 13:09:09.956705 23731 tablet_bootstrap.cc:654] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:09.961004 23729 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:09.961093 23727 raft_consensus.cc:359] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.961970 23727 raft_consensus.cc:385] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.962266 23727 raft_consensus.cc:740] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.957329 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5872ed9104d54b1e88ce2e4c22f56596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.963081 23728 raft_consensus.cc:359] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:09.963886 23728 raft_consensus.cc:385] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.961660 23729 ts_tablet_manager.cc:1403] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.154s	user 0.005s	sys 0.007s
I20260709 13:09:09.967368 23729 raft_consensus.cc:359] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.969636 23525 tablet_service.cc:1511] Processing CreateTablet for tablet 38fe0d3b4c474223a67e5f053027bc51 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:09.971004 23525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fe0d3b4c474223a67e5f053027bc51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.968086 23729 raft_consensus.cc:385] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:09.971594 23729 raft_consensus.cc:740] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.964182 23728 raft_consensus.cc:740] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:09.974649 23598 tablet_service.cc:1511] Processing CreateTablet for tablet 38fe0d3b4c474223a67e5f053027bc51 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:09.963028 23727 consensus_queue.cc:260] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:09.975888 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fe0d3b4c474223a67e5f053027bc51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.976765 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5872ed9104d54b1e88ce2e4c22f56596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.979679 23672 tablet_service.cc:1511] Processing CreateTablet for tablet 38fe0d3b4c474223a67e5f053027bc51 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:09.980906 23672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38fe0d3b4c474223a67e5f053027bc51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.983659 23728 consensus_queue.cc:260] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:09.984844 23729 consensus_queue.cc:260] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.989199 23728 ts_tablet_manager.cc:1434] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 13:09:09.990275 23728 tablet_bootstrap.cc:492] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:09.992365 23727 ts_tablet_manager.cc:1434] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.003s
I20260709 13:09:09.992684 23729 ts_tablet_manager.cc:1434] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:09:09.997459 23524 tablet_service.cc:1511] Processing CreateTablet for tablet 6d64d538619c4e1ab146400dad7d1688 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:09.998783 23524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d64d538619c4e1ab146400dad7d1688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:09.999675 23449 tablet_service.cc:1511] Processing CreateTablet for tablet 6d64d538619c4e1ab146400dad7d1688 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:10.001531 23600 tablet_service.cc:1511] Processing CreateTablet for tablet 6d64d538619c4e1ab146400dad7d1688 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:10.002836 23600 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d64d538619c4e1ab146400dad7d1688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.003299 23727 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.006904 23450 tablet_service.cc:1511] Processing CreateTablet for tablet eb9bce9a34294ef08a3a6e43d8b25b1a (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:10.010305 23669 tablet_service.cc:1511] Processing CreateTablet for tablet eb9bce9a34294ef08a3a6e43d8b25b1a (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:10.013114 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9bce9a34294ef08a3a6e43d8b25b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.013581 23731 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.014124 23731 ts_tablet_manager.cc:1403] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:09:10.016212 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d64d538619c4e1ab146400dad7d1688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.018729 23731 raft_consensus.cc:359] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.019528 23731 raft_consensus.cc:385] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.019833 23731 raft_consensus.cc:740] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.020637 23731 consensus_queue.cc:260] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:09.970854 23734 raft_consensus.cc:515] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.027285 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.028215 23537 raft_consensus.cc:2393] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in this term.
I20260709 13:09:10.029641 23577 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:10.029839 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.030055 23734 leader_election.cc:290] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.030781 23749 raft_consensus.cc:3060] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:10.031278 23650 leader_election.cc:343] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.024187 23783 raft_consensus.cc:515] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.034413 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.034974 23462 raft_consensus.cc:3060] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.036300 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:10.036902 23611 raft_consensus.cc:3060] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.037106 23526 tablet_service.cc:1511] Processing CreateTablet for tablet eb9bce9a34294ef08a3a6e43d8b25b1a (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:10.038406 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9bce9a34294ef08a3a6e43d8b25b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.040069 23729 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:10.042286 23462 raft_consensus.cc:2468] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.043869 23650 leader_election.cc:304] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:10.044981 23734 raft_consensus.cc:2804] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.046555 23734 raft_consensus.cc:697] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:10.047787 23734 consensus_queue.cc:237] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.048041 23597 tablet_service.cc:1511] Processing CreateTablet for tablet bd771a7f581f469db75c0b9d33768447 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:10.049244 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb9bce9a34294ef08a3a6e43d8b25b1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.056550 23527 tablet_service.cc:1511] Processing CreateTablet for tablet 05fee14e6e9a4abd9331249fe4afd97e (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:10.056901 23448 tablet_service.cc:1511] Processing CreateTablet for tablet bd771a7f581f469db75c0b9d33768447 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:10.050253 23749 raft_consensus.cc:2749] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.050670 23731 ts_tablet_manager.cc:1434] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.004s
I20260709 13:09:10.064523 23731 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.065544 23448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd771a7f581f469db75c0b9d33768447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.052557 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:10.049634 23783 leader_election.cc:290] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.056594 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd771a7f581f469db75c0b9d33768447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.066605 23537 raft_consensus.cc:3060] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.057848 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05fee14e6e9a4abd9331249fe4afd97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.062060 23668 tablet_service.cc:1511] Processing CreateTablet for tablet bd771a7f581f469db75c0b9d33768447 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:10.096724 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd771a7f581f469db75c0b9d33768447. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.104547 23767 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.105322 23767 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.132573 23735 consensus_queue.cc:1048] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:10.135521 23502 consensus_peers.cc:597] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.136336 23611 raft_consensus.cc:2468] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.136858 23599 tablet_service.cc:1511] Processing CreateTablet for tablet 05fee14e6e9a4abd9331249fe4afd97e (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:10.137645 23649 leader_election.cc:304] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:10.138057 23599 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05fee14e6e9a4abd9331249fe4afd97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.138522 23783 raft_consensus.cc:2804] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.139259 23783 raft_consensus.cc:697] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:10.140234 23783 consensus_queue.cc:237] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.152132 23727 tablet_bootstrap.cc:654] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.147356 23729 tablet_bootstrap.cc:654] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.148910 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.180122 23749 raft_consensus.cc:493] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.188287 23749 raft_consensus.cc:515] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.190464 23749 leader_election.cc:290] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.193023 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcef80a7a0d24b8886b0b356906a7bab" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.193717 23462 raft_consensus.cc:2468] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:10.195040 23576 leader_election.cc:304] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.196002 23749 raft_consensus.cc:2804] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.196419 23749 raft_consensus.cc:493] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.197224 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcef80a7a0d24b8886b0b356906a7bab" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:10.198776 23577 leader_election.cc:343] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.198949 23537 raft_consensus.cc:2468] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.196811 23749 raft_consensus.cc:3060] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.185722 23728 tablet_bootstrap.cc:654] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.149528 23767 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:10.182602 23357 catalog_manager.cc:5697] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.222154 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:10.224475 23450 tablet_service.cc:1511] Processing CreateTablet for tablet ba066265aaf44df488ed17c1bb390276 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:10.225852 23450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba066265aaf44df488ed17c1bb390276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.227082 23784 raft_consensus.cc:493] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.227629 23784 raft_consensus.cc:515] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.229710 23784 leader_election.cc:290] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.231205 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:10.232760 23649 leader_election.cc:343] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.233417 23501 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:10.234231 23444 tablet_service.cc:1511] Processing CreateTablet for tablet a4fae8af871f40669a26b56a15979adf (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 13:09:10.235536 23502 consensus_peers.cc:597] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:10.236187 23767 raft_consensus.cc:2749] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.235532 23444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fae8af871f40669a26b56a15979adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.236747 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.237967 23462 raft_consensus.cc:2468] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.239358 23527 tablet_service.cc:1511] Processing CreateTablet for tablet ba066265aaf44df488ed17c1bb390276 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:10.240978 23527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba066265aaf44df488ed17c1bb390276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.241050 23668 tablet_service.cc:1511] Processing CreateTablet for tablet 05fee14e6e9a4abd9331249fe4afd97e (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:10.242638 23668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05fee14e6e9a4abd9331249fe4afd97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.251516 23650 leader_election.cc:304] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:10.251739 23449 tablet_service.cc:1511] Processing CreateTablet for tablet c28bba470bb64f2ea64dd235d43bf174 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:10.252954 23449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28bba470bb64f2ea64dd235d43bf174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.253626 23731 tablet_bootstrap.cc:654] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.258333 23728 tablet_bootstrap.cc:492] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:10.258817 23728 ts_tablet_manager.cc:1403] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.269s	user 0.013s	sys 0.007s
I20260709 13:09:10.261005 23357 catalog_manager.cc:5697] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.261834 23728 raft_consensus.cc:359] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.262610 23728 raft_consensus.cc:385] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.262979 23728 raft_consensus.cc:740] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.262253 23749 raft_consensus.cc:515] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.265090 23783 raft_consensus.cc:2804] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.266455 23783 raft_consensus.cc:493] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.266793 23783 raft_consensus.cc:3060] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.267535 23526 tablet_service.cc:1511] Processing CreateTablet for tablet a4fae8af871f40669a26b56a15979adf (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:10.273350 23673 tablet_service.cc:1511] Processing CreateTablet for tablet c28bba470bb64f2ea64dd235d43bf174 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:10.273489 23783 raft_consensus.cc:515] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.270565 23597 tablet_service.cc:1511] Processing CreateTablet for tablet ba066265aaf44df488ed17c1bb390276 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:10.271340 23731 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.271685 23598 tablet_service.cc:1511] Processing CreateTablet for tablet c28bba470bb64f2ea64dd235d43bf174 (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:10.274480 23673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28bba470bb64f2ea64dd235d43bf174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.275166 23597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba066265aaf44df488ed17c1bb390276. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.283545 23727 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.284044 23727 ts_tablet_manager.cc:1403] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.281s	user 0.017s	sys 0.014s
I20260709 13:09:10.276547 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
W20260709 13:09:10.285511 23649 leader_election.cc:343] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.276521 23731 ts_tablet_manager.cc:1403] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.212s	user 0.013s	sys 0.037s
I20260709 13:09:10.290207 23731 raft_consensus.cc:359] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.291204 23731 raft_consensus.cc:385] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.291600 23731 raft_consensus.cc:740] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.273803 23526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fae8af871f40669a26b56a15979adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.287246 23727 raft_consensus.cc:359] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.302690 23749 leader_election.cc:290] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.303457 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcef80a7a0d24b8886b0b356906a7bab" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.304050 23462 raft_consensus.cc:3060] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.304312 23598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c28bba470bb64f2ea64dd235d43bf174. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.304530 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcef80a7a0d24b8886b0b356906a7bab" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:10.298506 23727 raft_consensus.cc:385] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.311517 23727 raft_consensus.cc:740] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.312341 23729 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:10.312563 23462 raft_consensus.cc:2468] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:10.312870 23669 tablet_service.cc:1511] Processing CreateTablet for tablet a4fae8af871f40669a26b56a15979adf (DEFAULT_TABLE table=test-workload [id=0308566f73a14b3d8e8a5d69a4dd1d46]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:10.313244 23731 consensus_queue.cc:260] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.314071 23576 leader_election.cc:304] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.314318 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.314975 23461 raft_consensus.cc:3060] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.315568 23731 ts_tablet_manager.cc:1434] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 13:09:10.316339 23749 raft_consensus.cc:2804] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.267865 23728 consensus_queue.cc:260] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.312247 23727 consensus_queue.cc:260] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.314319 23669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4fae8af871f40669a26b56a15979adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:10.312973 23729 ts_tablet_manager.cc:1403] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.273s	user 0.023s	sys 0.003s
I20260709 13:09:10.319677 23783 leader_election.cc:290] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.336375 23537 raft_consensus.cc:3060] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.339510 23731 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.340785 23727 ts_tablet_manager.cc:1434] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:09:10.342137 23784 raft_consensus.cc:493] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.352149 23784 raft_consensus.cc:515] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.355866 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fd63cafcbb4ac68010a87bab3f897d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.357049 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fd63cafcbb4ac68010a87bab3f897d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:10.358583 23649 leader_election.cc:343] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.358753 23784 leader_election.cc:290] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.345171 23728 ts_tablet_manager.cc:1434] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 13:09:10.358939 23729 raft_consensus.cc:359] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
W20260709 13:09:10.359722 23651 leader_election.cc:343] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.360108 23728 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:10.360266 23651 leader_election.cc:304] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:10.361614 23784 raft_consensus.cc:2749] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.352577 23727 tablet_bootstrap.cc:492] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.364308 23537 raft_consensus.cc:2468] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:10.364962 23731 tablet_bootstrap.cc:654] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.350723 23461 raft_consensus.cc:2468] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.359776 23729 raft_consensus.cc:385] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.349238 23749 raft_consensus.cc:697] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:10.368507 23650 leader_election.cc:304] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:10.368983 23749 consensus_queue.cc:237] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.370318 23784 raft_consensus.cc:2804] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.371035 23784 raft_consensus.cc:697] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:10.371889 23784 consensus_queue.cc:237] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.372649 23728 tablet_bootstrap.cc:654] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.375150 23729 raft_consensus.cc:740] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.377581 23729 consensus_queue.cc:260] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.392903 23729 ts_tablet_manager.cc:1434] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 13:09:10.396493 23727 tablet_bootstrap.cc:654] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.416671 23729 tablet_bootstrap.cc:492] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:10.419283 23358 catalog_manager.cc:5697] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.426414 23795 consensus_queue.cc:1048] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.428241 23731 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.428726 23731 ts_tablet_manager.cc:1403] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.027s
I20260709 13:09:10.428956 23749 raft_consensus.cc:493] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.429468 23749 raft_consensus.cc:515] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.431561 23749 leader_election.cc:290] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.431876 23729 tablet_bootstrap.cc:654] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.431800 23731 raft_consensus.cc:359] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.432499 23731 raft_consensus.cc:385] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.432901 23731 raft_consensus.cc:740] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.432451 23359 catalog_manager.cc:5697] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.433482 23731 consensus_queue.cc:260] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.436281 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8773bb3ecbee48738d3b1c65f086bf88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.436365 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8773bb3ecbee48738d3b1c65f086bf88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.437013 23461 raft_consensus.cc:2468] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:10.437088 23537 raft_consensus.cc:2468] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:10.438758 23576 leader_election.cc:304] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.440472 23804 raft_consensus.cc:2804] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.440863 23804 raft_consensus.cc:493] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.441201 23804 raft_consensus.cc:3060] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.444893 23731 ts_tablet_manager.cc:1434] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.003s
I20260709 13:09:10.446094 23731 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.462927 23731 tablet_bootstrap.cc:654] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.470938 23727 tablet_bootstrap.cc:492] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.468281 23804 raft_consensus.cc:515] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.472128 23727 ts_tablet_manager.cc:1403] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.120s	user 0.008s	sys 0.010s
I20260709 13:09:10.472690 23731 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.473554 23731 ts_tablet_manager.cc:1403] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.001s
I20260709 13:09:10.474656 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8773bb3ecbee48738d3b1c65f086bf88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.475252 23461 raft_consensus.cc:3060] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.475771 23804 leader_election.cc:290] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.475937 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8773bb3ecbee48738d3b1c65f086bf88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:10.476635 23537 raft_consensus.cc:3060] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.475814 23727 raft_consensus.cc:359] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.477052 23727 raft_consensus.cc:385] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.477324 23727 raft_consensus.cc:740] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.478165 23728 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:10.477993 23727 consensus_queue.cc:260] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.478613 23728 ts_tablet_manager.cc:1403] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.027s
I20260709 13:09:10.481674 23728 raft_consensus.cc:359] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.482306 23728 raft_consensus.cc:385] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.482590 23728 raft_consensus.cc:740] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.482616 23461 raft_consensus.cc:2468] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:10.483732 23537 raft_consensus.cc:2468] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:10.483963 23576 leader_election.cc:304] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.483580 23728 consensus_queue.cc:260] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.484917 23804 raft_consensus.cc:2804] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.485404 23804 raft_consensus.cc:697] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:10.486356 23728 ts_tablet_manager.cc:1434] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:10.486178 23804 consensus_queue.cc:237] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.487977 23727 ts_tablet_manager.cc:1434] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 13:09:10.489717 23729 tablet_bootstrap.cc:492] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:10.490279 23729 ts_tablet_manager.cc:1403] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.074s	user 0.021s	sys 0.023s
I20260709 13:09:10.494818 23729 raft_consensus.cc:359] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.495604 23729 raft_consensus.cc:385] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.495502 23731 raft_consensus.cc:359] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.496101 23729 raft_consensus.cc:740] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.496275 23731 raft_consensus.cc:385] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.497015 23731 raft_consensus.cc:740] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.497215 23729 consensus_queue.cc:260] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.497748 23731 consensus_queue.cc:260] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.499815 23729 ts_tablet_manager.cc:1434] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:10.500910 23729 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:10.503469 23727 tablet_bootstrap.cc:492] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.504383 23728 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:10.505393 23731 ts_tablet_manager.cc:1434] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:10.506338 23731 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.511687 23537 raft_consensus.cc:3060] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.515794 23731 tablet_bootstrap.cc:654] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.507813 23729 tablet_bootstrap.cc:654] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.521703 23360 catalog_manager.cc:5697] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:10.527652 23728 tablet_bootstrap.cc:654] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.528597 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:10.535092 23727 tablet_bootstrap.cc:654] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.539299 23729 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:10.542001 23729 ts_tablet_manager.cc:1403] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.041s	user 0.010s	sys 0.003s
I20260709 13:09:10.542855 23728 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:10.543524 23728 ts_tablet_manager.cc:1403] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.010s
I20260709 13:09:10.547127 23728 raft_consensus.cc:359] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.548045 23728 raft_consensus.cc:385] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.548380 23728 raft_consensus.cc:740] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.549458 23728 consensus_queue.cc:260] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.551723 23729 raft_consensus.cc:359] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.552510 23729 raft_consensus.cc:385] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.552955 23729 raft_consensus.cc:740] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.553841 23731 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.554409 23731 ts_tablet_manager.cc:1403] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.048s	user 0.019s	sys 0.023s
I20260709 13:09:10.553867 23729 consensus_queue.cc:260] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.556416 23729 ts_tablet_manager.cc:1434] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:10.556783 23727 tablet_bootstrap.cc:492] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.557250 23727 ts_tablet_manager.cc:1403] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.054s	user 0.014s	sys 0.002s
I20260709 13:09:10.557555 23729 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:10.560328 23731 raft_consensus.cc:359] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.560982 23731 raft_consensus.cc:385] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.561245 23731 raft_consensus.cc:740] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.562186 23728 ts_tablet_manager.cc:1434] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:09:10.562001 23731 consensus_queue.cc:260] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.563784 23729 tablet_bootstrap.cc:654] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.564252 23731 ts_tablet_manager.cc:1434] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:09:10.565207 23731 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.566246 23728 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:10.571759 23731 tablet_bootstrap.cc:654] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.576277 23728 tablet_bootstrap.cc:654] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.584615 23727 raft_consensus.cc:359] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.585628 23727 raft_consensus.cc:385] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.585969 23727 raft_consensus.cc:740] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.586972 23727 consensus_queue.cc:260] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.589754 23727 ts_tablet_manager.cc:1434] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 13:09:10.591285 23727 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.596932 23727 tablet_bootstrap.cc:654] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.602383 23728 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:10.602394 23731 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.603019 23731 ts_tablet_manager.cc:1403] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.011s
I20260709 13:09:10.603019 23728 ts_tablet_manager.cc:1403] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.015s
I20260709 13:09:10.605505 23784 consensus_queue.cc:1048] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.606060 23727 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.605908 23731 raft_consensus.cc:359] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.606222 23728 raft_consensus.cc:359] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.606635 23727 ts_tablet_manager.cc:1403] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:09:10.606786 23731 raft_consensus.cc:385] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.606968 23728 raft_consensus.cc:385] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.607256 23728 raft_consensus.cc:740] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.607160 23731 raft_consensus.cc:740] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.608027 23728 consensus_queue.cc:260] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.608201 23731 consensus_queue.cc:260] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.609668 23727 raft_consensus.cc:359] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.610320 23727 raft_consensus.cc:385] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.610616 23727 raft_consensus.cc:740] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.611291 23727 consensus_queue.cc:260] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.612843 23804 raft_consensus.cc:493] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.613329 23804 raft_consensus.cc:515] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.613539 23727 ts_tablet_manager.cc:1434] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:10.614670 23727 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.617005 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:10.613499 23461 raft_consensus.cc:3060] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.618471 23731 ts_tablet_manager.cc:1434] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:10.618369 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.619259 23462 raft_consensus.cc:2393] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:10.620659 23727 tablet_bootstrap.cc:654] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.621410 23575 leader_election.cc:304] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:10.622053 23731 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.622368 23749 raft_consensus.cc:3060] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.628399 23731 tablet_bootstrap.cc:654] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.628759 23783 consensus_queue.cc:1048] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.629197 23735 raft_consensus.cc:493] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.629858 23735 raft_consensus.cc:515] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.630411 23789 raft_consensus.cc:493] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.630929 23789 raft_consensus.cc:515] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.631922 23784 raft_consensus.cc:493] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.632403 23784 raft_consensus.cc:515] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.633112 23789 leader_election.cc:290] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.634266 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa451ba4f51342709eee5e2296060483" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.634560 23784 leader_election.cc:290] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.615348 23804 leader_election.cc:290] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.635807 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.635797 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa451ba4f51342709eee5e2296060483" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.636978 23735 leader_election.cc:290] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:10.637532 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.634568 23783 consensus_queue.cc:1048] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:10.638188 23610 raft_consensus.cc:2468] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.639392 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.640079 23428 leader_election.cc:304] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:10.641022 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:10.639446 23649 leader_election.cc:304] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.642210 23462 raft_consensus.cc:2468] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.642316 23789 raft_consensus.cc:2749] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:10.642455 23501 leader_election.cc:343] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:10.645229 23501 leader_election.cc:343] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.645783 23501 leader_election.cc:304] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:10.648211 23735 raft_consensus.cc:2749] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.648572 23783 raft_consensus.cc:2804] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.649803 23783 raft_consensus.cc:493] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.650127 23783 raft_consensus.cc:3060] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.632403 23727 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.655143 23727 ts_tablet_manager.cc:1403] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.041s	user 0.005s	sys 0.011s
I20260709 13:09:10.658630 23728 ts_tablet_manager.cc:1434] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:09:10.662292 23728 tablet_bootstrap.cc:492] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:10.660372 23729 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:10.664129 23729 ts_tablet_manager.cc:1403] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.107s	user 0.025s	sys 0.007s
I20260709 13:09:10.674952 23727 raft_consensus.cc:359] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.676069 23727 raft_consensus.cc:385] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.676429 23727 raft_consensus.cc:740] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.680374 23749 raft_consensus.cc:2749] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:10.685307 23729 raft_consensus.cc:359] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.685994 23729 raft_consensus.cc:385] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.686262 23729 raft_consensus.cc:740] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.680858 23727 consensus_queue.cc:260] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.689054 23727 ts_tablet_manager.cc:1434] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.000s
I20260709 13:09:10.690001 23727 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.698063 23728 tablet_bootstrap.cc:654] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.698307 23783 raft_consensus.cc:515] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.700429 23729 consensus_queue.cc:260] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.704568 23731 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.705133 23731 ts_tablet_manager.cc:1403] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.083s	user 0.033s	sys 0.032s
I20260709 13:09:10.707226 23729 ts_tablet_manager.cc:1434] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 13:09:10.708438 23729 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:10.708117 23731 raft_consensus.cc:359] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.708943 23731 raft_consensus.cc:385] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.709221 23731 raft_consensus.cc:740] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.709998 23731 consensus_queue.cc:260] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
W20260709 13:09:10.711585 23428 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 71601.2us
I20260709 13:09:10.712307 23731 ts_tablet_manager.cc:1434] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:10.713462 23727 tablet_bootstrap.cc:654] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.713971 23731 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.714982 23460 raft_consensus.cc:3060] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.717221 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:10.718690 23611 raft_consensus.cc:3060] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.718681 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.719494 23461 raft_consensus.cc:3060] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.720016 23729 tablet_bootstrap.cc:654] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.720532 23731 tablet_bootstrap.cc:654] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.726648 23727 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.727116 23727 ts_tablet_manager.cc:1403] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.002s
I20260709 13:09:10.728732 23611 raft_consensus.cc:2468] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.729806 23727 raft_consensus.cc:359] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.736630 23727 raft_consensus.cc:385] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.737083 23727 raft_consensus.cc:740] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.737047 23649 leader_election.cc:304] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.739632 23727 consensus_queue.cc:260] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.742336 23727 ts_tablet_manager.cc:1434] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:09:10.754267 23840 raft_consensus.cc:2804] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.754787 23462 raft_consensus.cc:3060] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.730526 23461 raft_consensus.cc:2468] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.758136 23840 raft_consensus.cc:697] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:10.759076 23840 consensus_queue.cc:237] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.737946 23783 leader_election.cc:290] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.767167 23784 consensus_queue.cc:1048] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.774883 23749 consensus_queue.cc:1048] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.775322 23728 tablet_bootstrap.cc:492] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:10.776062 23728 ts_tablet_manager.cc:1403] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.114s	user 0.028s	sys 0.006s
I20260709 13:09:10.780583 23830 consensus_queue.cc:1048] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:10.786098 23830 raft_consensus.cc:493] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.779048 23728 raft_consensus.cc:359] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.787997 23728 raft_consensus.cc:385] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.788292 23728 raft_consensus.cc:740] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.789026 23728 consensus_queue.cc:260] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.794086 23728 ts_tablet_manager.cc:1434] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.001s
I20260709 13:09:10.795087 23728 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:10.783278 23727 tablet_bootstrap.cc:492] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:10.786595 23830 raft_consensus.cc:515] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.804598 23828 raft_consensus.cc:493] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.805157 23828 raft_consensus.cc:515] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.806339 23830 leader_election.cc:290] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.805282 23804 consensus_queue.cc:1048] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.807505 23828 leader_election.cc:290] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.809525 23611 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.810601 23728 tablet_bootstrap.cc:654] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:10.811143 23426 leader_election.cc:343] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.812505 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.812984 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7c02730daf418a8e9783caba996c49" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.813213 23537 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:10.814728 23727 tablet_bootstrap.cc:654] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.814924 23428 leader_election.cc:304] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
W20260709 13:09:10.815013 23650 leader_election.cc:343] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.815707 23830 raft_consensus.cc:493] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.816247 23829 raft_consensus.cc:2804] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.817526 23829 raft_consensus.cc:493] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.817619 23731 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:10.818113 23829 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.819713 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7c02730daf418a8e9783caba996c49" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.820402 23610 raft_consensus.cc:2468] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.824159 23649 leader_election.cc:304] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:10.826694 23731 ts_tablet_manager.cc:1403] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.012s
I20260709 13:09:10.829033 23831 raft_consensus.cc:2804] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.829675 23831 raft_consensus.cc:493] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.830215 23831 raft_consensus.cc:3060] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:10.799667 23651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 94892.6us
I20260709 13:09:10.833256 23839 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.833758 23839 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.836037 23839 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.837220 23829 raft_consensus.cc:515] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.842235 23749 raft_consensus.cc:493] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.844125 23828 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:10.843968 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:10.845064 23731 raft_consensus.cc:359] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.848568 23731 raft_consensus.cc:385] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.848951 23731 raft_consensus.cc:740] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.849493 23828 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.849831 23731 consensus_queue.cc:260] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.846917 23749 raft_consensus.cc:515] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.851445 23731 ts_tablet_manager.cc:1434] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 13:09:10.852195 23749 leader_election.cc:290] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:10.852412 23731 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:10.852761 23458 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.816215 23830 raft_consensus.cc:515] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.855316 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fd63cafcbb4ac68010a87bab3f897d" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.855334 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:10.855959 23830 leader_election.cc:290] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.856129 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.856575 23685 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:10.856958 23536 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:10.857921 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:10.858067 23426 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:10.859048 23789 raft_consensus.cc:2804] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:10.859371 23649 leader_election.cc:343] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:10.859469 23789 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.860041 23789 raft_consensus.cc:3060] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.861076 23650 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:10.862283 23828 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.863149 23731 tablet_bootstrap.cc:654] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.856053 23537 raft_consensus.cc:2468] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:10.868494 23789 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.874325 23729 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:10.875006 23729 ts_tablet_manager.cc:1403] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.167s	user 0.017s	sys 0.020s
I20260709 13:09:10.868425 23840 raft_consensus.cc:2804] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.868552 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.877303 23840 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.888850 23840 raft_consensus.cc:3060] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.878621 23536 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.884097 23729 raft_consensus.cc:359] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.891038 23729 raft_consensus.cc:385] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.891345 23729 raft_consensus.cc:740] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.891978 23729 consensus_queue.cc:260] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.884564 23829 leader_election.cc:290] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.885681 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fd63cafcbb4ac68010a87bab3f897d" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:10.894929 23729 ts_tablet_manager.cc:1434] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:09:10.886123 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:10.886439 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:10.887977 23789 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.893183 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:10.901049 23535 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.901405 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:10.902038 23536 raft_consensus.cc:3060] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.896126 23610 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.903818 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:10.877382 23577 leader_election.cc:304] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.885087 23831 raft_consensus.cc:515] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.895958 23729 tablet_bootstrap.cc:492] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:10.895375 23685 raft_consensus.cc:2468] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:10.895843 23537 raft_consensus.cc:2468] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:10.905941 23749 raft_consensus.cc:2804] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.906345 23749 raft_consensus.cc:493] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.906800 23749 raft_consensus.cc:3060] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.906906 23651 leader_election.cc:304] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:10.908257 23830 raft_consensus.cc:2804] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:10.908653 23830 raft_consensus.cc:493] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:10.911221 23830 raft_consensus.cc:3060] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.895859 23359 catalog_manager.cc:5697] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:10.916642 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7c02730daf418a8e9783caba996c49" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:10.917346 23609 raft_consensus.cc:3060] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.919094 23831 leader_election.cc:290] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:10.921702 23831 consensus_queue.cc:1048] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.922498 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a7c02730daf418a8e9783caba996c49" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:10.924149 23460 raft_consensus.cc:3060] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.939530 23830 raft_consensus.cc:515] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.942565 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:10.943186 23537 raft_consensus.cc:3060] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:10.946954 23610 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:10.948300 23426 leader_election.cc:304] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.949151 23828 raft_consensus.cc:2804] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.949622 23828 raft_consensus.cc:697] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:10.950441 23828 consensus_queue.cc:237] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:10.952121 23729 tablet_bootstrap.cc:654] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:10.952543 23537 raft_consensus.cc:2468] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.953966 23651 leader_election.cc:304] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:10.954035 23804 consensus_queue.cc:1048] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:10.955399 23836 raft_consensus.cc:2804] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.955935 23836 raft_consensus.cc:697] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:10.956997 23535 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:10.956760 23836 consensus_queue.cc:237] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.957696 23840 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:10.960183 23728 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:10.960879 23728 ts_tablet_manager.cc:1403] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.166s	user 0.013s	sys 0.032s
I20260709 13:09:10.928333 23749 raft_consensus.cc:515] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.961920 23536 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:10.970105 23684 raft_consensus.cc:2393] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0851261b6d4832b826564f378ba69d in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:10.964526 23609 raft_consensus.cc:2468] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.971921 23460 raft_consensus.cc:2468] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:10.979063 23727 tablet_bootstrap.cc:492] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:10.979809 23727 ts_tablet_manager.cc:1403] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.197s	user 0.015s	sys 0.018s
I20260709 13:09:10.987077 23727 raft_consensus.cc:359] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:10.988505 23727 raft_consensus.cc:385] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.988878 23727 raft_consensus.cc:740] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.991866 23830 leader_election.cc:290] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:10.984398 23649 leader_election.cc:304] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:10.994007 23728 raft_consensus.cc:359] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:10.994680 23728 raft_consensus.cc:385] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:10.994935 23728 raft_consensus.cc:740] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.995043 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:10.997330 23830 raft_consensus.cc:2804] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:10.996833 23728 consensus_queue.cc:260] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.005723 23731 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.013571 23731 ts_tablet_manager.cc:1403] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.161s	user 0.020s	sys 0.005s
I20260709 13:09:10.999146 23830 raft_consensus.cc:697] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:11.014724 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:11.015708 23534 raft_consensus.cc:2393] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:11.015542 23830 consensus_queue.cc:237] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.003772 23727 consensus_queue.cc:260] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.017278 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fd63cafcbb4ac68010a87bab3f897d" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:11.017969 23536 raft_consensus.cc:3060] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.020038 23727 ts_tablet_manager.cc:1434] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.040s	user 0.010s	sys 0.000s
I20260709 13:09:11.002650 23840 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:10.999028 23749 leader_election.cc:290] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.022090 23728 ts_tablet_manager.cc:1434] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.061s	user 0.007s	sys 0.000s
I20260709 13:09:11.025556 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:11.025900 23728 tablet_bootstrap.cc:492] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.026466 23460 raft_consensus.cc:2393] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
W20260709 13:09:11.027706 23649 leader_election.cc:343] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.027870 23731 raft_consensus.cc:359] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.028875 23731 raft_consensus.cc:385] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.029224 23731 raft_consensus.cc:740] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:10.991251 23428 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449
I20260709 13:09:11.030097 23731 consensus_queue.cc:260] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.030802 23789 raft_consensus.cc:2804] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.032248 23727 tablet_bootstrap.cc:492] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:11.033067 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5fd63cafcbb4ac68010a87bab3f897d" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:11.033943 23684 raft_consensus.cc:3060] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.046489 23650 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:11.051637 23727 tablet_bootstrap.cc:654] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.054061 23729 tablet_bootstrap.cc:492] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.054626 23729 ts_tablet_manager.cc:1403] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.159s	user 0.030s	sys 0.025s
I20260709 13:09:11.055195 23804 consensus_queue.cc:1048] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.055528 23731 ts_tablet_manager.cc:1434] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 13:09:11.056963 23731 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.057893 23684 raft_consensus.cc:2468] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:11.059561 23729 raft_consensus.cc:359] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.060269 23729 raft_consensus.cc:385] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.060493 23575 leader_election.cc:304] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:11.061422 23804 raft_consensus.cc:2804] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.060527 23729 raft_consensus.cc:740] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.065048 23729 consensus_queue.cc:260] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.069680 23536 raft_consensus.cc:2468] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:11.066722 23804 raft_consensus.cc:697] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:11.072321 23804 consensus_queue.cc:237] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.089008 23789 raft_consensus.cc:697] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:11.089421 23735 raft_consensus.cc:493] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.089975 23735 raft_consensus.cc:515] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.090452 23789 consensus_queue.cc:237] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.092473 23735 leader_election.cc:290] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.067330 23830 raft_consensus.cc:2749] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.095139 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2575893fed284ec6ab4150b792b0b790" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:11.117031 23728 tablet_bootstrap.cc:654] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.118665 23729 ts_tablet_manager.cc:1434] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:09:11.121085 23729 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.118553 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2575893fed284ec6ab4150b792b0b790" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.127218 23727 tablet_bootstrap.cc:492] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
W20260709 13:09:11.127903 23502 leader_election.cc:343] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.130100 23731 tablet_bootstrap.cc:654] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.133248 23727 ts_tablet_manager.cc:1403] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.034s
W20260709 13:09:11.135253 23501 leader_election.cc:343] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.136456 23501 leader_election.cc:304] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:11.137262 23735 raft_consensus.cc:2749] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.141294 23727 raft_consensus.cc:359] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.142151 23727 raft_consensus.cc:385] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.142413 23727 raft_consensus.cc:740] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.143328 23727 consensus_queue.cc:260] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.145308 23358 catalog_manager.cc:5697] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.148244 23358 catalog_manager.cc:5697] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.157538 23861 raft_consensus.cc:493] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.155216 23830 consensus_queue.cc:1048] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:11.159350 23861 raft_consensus.cc:515] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.162760 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47a3456a44347848b814a90540324bc" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:11.164850 23426 leader_election.cc:343] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.164700 23357 catalog_manager.cc:5697] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.168370 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47a3456a44347848b814a90540324bc" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:11.171679 23428 leader_election.cc:343] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.172350 23428 leader_election.cc:304] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:11.173609 23828 raft_consensus.cc:2749] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.174682 23861 leader_election.cc:290] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.152014 23729 tablet_bootstrap.cc:654] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.177994 23728 tablet_bootstrap.cc:492] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:11.178498 23728 ts_tablet_manager.cc:1403] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.153s	user 0.011s	sys 0.002s
I20260709 13:09:11.181675 23731 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.182156 23731 ts_tablet_manager.cc:1403] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.000s
I20260709 13:09:11.182847 23728 raft_consensus.cc:359] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.183633 23728 raft_consensus.cc:385] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.183936 23728 raft_consensus.cc:740] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.184613 23728 consensus_queue.cc:260] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.184901 23731 raft_consensus.cc:359] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.185552 23731 raft_consensus.cc:385] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.185819 23731 raft_consensus.cc:740] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.186697 23729 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.186487 23731 consensus_queue.cc:260] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.187219 23729 ts_tablet_manager.cc:1403] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.003s
I20260709 13:09:11.188779 23731 ts_tablet_manager.cc:1434] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:11.191146 23358 catalog_manager.cc:5697] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.192986 23358 catalog_manager.cc:5697] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.194024 23731 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.190132 23729 raft_consensus.cc:359] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.195223 23729 raft_consensus.cc:385] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.195544 23729 raft_consensus.cc:740] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.196231 23729 consensus_queue.cc:260] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.197093 23836 consensus_queue.cc:1048] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.198355 23729 ts_tablet_manager.cc:1434] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:09:11.205709 23729 tablet_bootstrap.cc:492] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.211306 23731 tablet_bootstrap.cc:654] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.215056 23840 raft_consensus.cc:493] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.215826 23840 raft_consensus.cc:515] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.218322 23840 leader_election.cc:290] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.219162 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7b08fe298a4c318662e7b54994912b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:11.219883 23536 raft_consensus.cc:2468] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:11.221284 23651 leader_election.cc:304] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:11.222741 23831 raft_consensus.cc:2804] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.223263 23831 raft_consensus.cc:493] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.223800 23831 raft_consensus.cc:3060] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.179075 23727 ts_tablet_manager.cc:1434] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:09:11.228565 23727 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:11.231089 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7b08fe298a4c318662e7b54994912b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:11.236248 23649 leader_election.cc:343] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.237262 23729 tablet_bootstrap.cc:654] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.238346 23727 tablet_bootstrap.cc:654] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.241535 23731 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.242023 23731 ts_tablet_manager.cc:1403] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.005s
I20260709 13:09:11.186746 23728 ts_tablet_manager.cc:1434] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:11.243294 23728 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.245814 23731 raft_consensus.cc:359] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.246594 23731 raft_consensus.cc:385] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.246866 23731 raft_consensus.cc:740] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.247666 23731 consensus_queue.cc:260] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.249940 23731 ts_tablet_manager.cc:1434] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:11.230643 23831 raft_consensus.cc:515] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.258186 23728 tablet_bootstrap.cc:654] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.259793 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7b08fe298a4c318662e7b54994912b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:11.260412 23536 raft_consensus.cc:3060] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.261286 23727 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:11.261786 23727 ts_tablet_manager.cc:1403] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.033s	user 0.004s	sys 0.007s
I20260709 13:09:11.260188 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7b08fe298a4c318662e7b54994912b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:11.264694 23727 raft_consensus.cc:359] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:11.264880 23649 leader_election.cc:343] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.265409 23727 raft_consensus.cc:385] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.265755 23727 raft_consensus.cc:740] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.266623 23831 leader_election.cc:290] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.270123 23729 tablet_bootstrap.cc:492] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.270629 23729 ts_tablet_manager.cc:1403] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.010s
I20260709 13:09:11.271173 23536 raft_consensus.cc:2468] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:11.283222 23731 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.288532 23651 leader_election.cc:304] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:11.289806 23831 raft_consensus.cc:2804] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.290319 23831 raft_consensus.cc:697] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:11.290892 23731 tablet_bootstrap.cc:654] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.291217 23831 consensus_queue.cc:237] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.273483 23729 raft_consensus.cc:359] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.273555 23727 consensus_queue.cc:260] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.294559 23729 raft_consensus.cc:385] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.294903 23729 raft_consensus.cc:740] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.298210 23729 consensus_queue.cc:260] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.303033 23731 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.303584 23731 ts_tablet_manager.cc:1403] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.021s	user 0.018s	sys 0.000s
I20260709 13:09:11.305016 23729 ts_tablet_manager.cc:1434] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.005s
I20260709 13:09:11.305109 23727 ts_tablet_manager.cc:1434] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:09:11.306044 23729 tablet_bootstrap.cc:492] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.306339 23731 raft_consensus.cc:359] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.307305 23731 raft_consensus.cc:385] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.307729 23731 raft_consensus.cc:740] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.308712 23731 consensus_queue.cc:260] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.311069 23731 ts_tablet_manager.cc:1434] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:11.312165 23731 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.318032 23727 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:11.320106 23729 tablet_bootstrap.cc:654] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.323056 23728 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:11.323637 23728 ts_tablet_manager.cc:1403] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.081s	user 0.017s	sys 0.000s
I20260709 13:09:11.326962 23731 tablet_bootstrap.cc:654] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.326793 23728 raft_consensus.cc:359] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.328122 23728 raft_consensus.cc:385] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.328509 23728 raft_consensus.cc:740] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.329243 23728 consensus_queue.cc:260] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.331362 23728 ts_tablet_manager.cc:1434] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:11.332317 23728 tablet_bootstrap.cc:492] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.334208 23727 tablet_bootstrap.cc:654] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.336315 23728 tablet_bootstrap.cc:654] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.342036 23749 raft_consensus.cc:493] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.342725 23749 raft_consensus.cc:515] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.345430 23360 catalog_manager.cc:5697] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.346752 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2575893fed284ec6ab4150b792b0b790" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:11.347693 23460 raft_consensus.cc:2468] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:11.350729 23865 raft_consensus.cc:493] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.351584 23865 raft_consensus.cc:515] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.354592 23865 leader_election.cc:290] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.356249 23729 tablet_bootstrap.cc:492] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.356935 23729 ts_tablet_manager.cc:1403] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.001s
I20260709 13:09:11.357234 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:11.359014 23576 leader_election.cc:304] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:11.359161 23840 raft_consensus.cc:493] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.359766 23840 raft_consensus.cc:515] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.360193 23729 raft_consensus.cc:359] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.360538 23735 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.360870 23729 raft_consensus.cc:385] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.361210 23729 raft_consensus.cc:740] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.361119 23735 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.361986 23840 leader_election.cc:290] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:11.362020 23729 consensus_queue.cc:260] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.362655 23840 consensus_queue.cc:1048] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.363806 23804 raft_consensus.cc:2804] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.364221 23804 raft_consensus.cc:493] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.364307 23729 ts_tablet_manager.cc:1434] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:11.364583 23804 raft_consensus.cc:3060] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.365284 23729 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.366080 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7e94b011aa846abb8f089c79400c51b" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:11.366830 23536 raft_consensus.cc:2393] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:11.368167 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306e3c84432447f9be679573a0761c06" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:11.368789 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306e3c84432447f9be679573a0761c06" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.369004 23460 raft_consensus.cc:2468] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:11.370941 23650 leader_election.cc:304] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:11.371006 23577 leader_election.cc:304] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:11.372457 23729 tablet_bootstrap.cc:654] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:11.372514 23649 leader_election.cc:343] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.373302 23860 raft_consensus.cc:3060] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.374039 23840 raft_consensus.cc:2804] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.374451 23840 raft_consensus.cc:493] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.374817 23840 raft_consensus.cc:3060] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.376662 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.377666 23608 raft_consensus.cc:2468] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:11.379946 23501 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:11.381595 23875 raft_consensus.cc:2804] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:11.381974 23875 raft_consensus.cc:493] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.382280 23875 raft_consensus.cc:3060] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.383069 23728 tablet_bootstrap.cc:492] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:11.383621 23728 ts_tablet_manager.cc:1403] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.051s	user 0.030s	sys 0.005s
I20260709 13:09:11.385396 23727 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:11.385901 23727 ts_tablet_manager.cc:1403] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.079s	user 0.014s	sys 0.009s
I20260709 13:09:11.387552 23731 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.387391 23728 raft_consensus.cc:359] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.388055 23731 ts_tablet_manager.cc:1403] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.001s
I20260709 13:09:11.388163 23728 raft_consensus.cc:385] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.388513 23728 raft_consensus.cc:740] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.388738 23727 raft_consensus.cc:359] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.389442 23727 raft_consensus.cc:385] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.389295 23728 consensus_queue.cc:260] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.389758 23727 raft_consensus.cc:740] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.390499 23727 consensus_queue.cc:260] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.390789 23731 raft_consensus.cc:359] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.391479 23731 raft_consensus.cc:385] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.391763 23731 raft_consensus.cc:740] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.392442 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:11.392411 23731 consensus_queue.cc:260] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.393186 23684 raft_consensus.cc:2468] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:11.393606 23828 raft_consensus.cc:493] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.394363 23731 ts_tablet_manager.cc:1434] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:11.394093 23828 raft_consensus.cc:515] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.395349 23731 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.396123 23828 leader_election.cc:290] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.397998 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:11.400815 23426 leader_election.cc:343] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.400962 23728 ts_tablet_manager.cc:1434] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:11.402022 23840 raft_consensus.cc:515] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.402524 23731 tablet_bootstrap.cc:654] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.363298 23735 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.404897 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306e3c84432447f9be679573a0761c06" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
W20260709 13:09:11.406649 23649 leader_election.cc:343] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.407889 23749 leader_election.cc:290] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.409467 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306e3c84432447f9be679573a0761c06" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:11.410133 23460 raft_consensus.cc:3060] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.411567 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:11.413898 23426 leader_election.cc:343] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.414395 23426 leader_election.cc:304] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:11.415567 23828 raft_consensus.cc:2749] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.415891 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2575893fed284ec6ab4150b792b0b790" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:11.416626 23536 raft_consensus.cc:2468] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:11.422472 23836 consensus_queue.cc:1048] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.425196 23728 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.430997 23731 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.431633 23731 ts_tablet_manager.cc:1403] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.003s
I20260709 13:09:11.432129 23728 tablet_bootstrap.cc:654] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.434513 23460 raft_consensus.cc:2468] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:11.434332 23731 raft_consensus.cc:359] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.435141 23731 raft_consensus.cc:385] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.436079 23650 leader_election.cc:304] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:11.438227 23804 raft_consensus.cc:515] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.442962 23830 raft_consensus.cc:2804] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.443521 23830 raft_consensus.cc:697] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:11.444608 23804 leader_election.cc:290] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.441133 23860 raft_consensus.cc:2749] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.444365 23830 consensus_queue.cc:237] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.445192 23731 raft_consensus.cc:740] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.445997 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2575893fed284ec6ab4150b792b0b790" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:11.446686 23731 consensus_queue.cc:260] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.446733 23462 raft_consensus.cc:3060] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.450461 23731 ts_tablet_manager.cc:1434] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260709 13:09:11.451447 23731 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.455211 23828 raft_consensus.cc:493] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.455760 23828 raft_consensus.cc:515] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.456739 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2575893fed284ec6ab4150b792b0b790" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:11.457367 23537 raft_consensus.cc:3060] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.457919 23828 leader_election.cc:290] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.458359 23875 raft_consensus.cc:515] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.460093 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:11.460851 23875 leader_election.cc:290] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
W20260709 13:09:11.461357 23428 leader_election.cc:343] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.462527 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:11.463109 23684 raft_consensus.cc:3060] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.462949 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:11.464548 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a3a6fbf390f4379ad04ceb78ab203b6" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
W20260709 13:09:11.464936 23426 leader_election.cc:343] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.465592 23426 leader_election.cc:304] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:11.466542 23828 raft_consensus.cc:2749] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.465144 23608 raft_consensus.cc:3060] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:11.470721 23684 raft_consensus.cc:2468] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:11.472242 23731 tablet_bootstrap.cc:654] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.475371 23875 raft_consensus.cc:493] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.475910 23875 raft_consensus.cc:515] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.482482 23890 consensus_queue.cc:1048] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.483243 23840 leader_election.cc:290] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:11.484848 23727 ts_tablet_manager.cc:1434] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.001s
I20260709 13:09:11.486068 23501 leader_election.cc:304] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:11.497622 23728 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:11.485833 23359 catalog_manager.cc:5697] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.498142 23728 ts_tablet_manager.cc:1403] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.007s
I20260709 13:09:11.487799 23875 leader_election.cc:290] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.495496 23608 raft_consensus.cc:2468] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:11.498150 23729 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.500600 23729 ts_tablet_manager.cc:1403] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.136s	user 0.020s	sys 0.028s
I20260709 13:09:11.499600 23735 raft_consensus.cc:2804] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:11.502965 23735 raft_consensus.cc:697] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:11.503823 23735 consensus_queue.cc:237] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.511255 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e30e6ebdca44cbdb950b5df31f1e15a" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:11.512001 23684 raft_consensus.cc:2468] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:11.513093 23501 leader_election.cc:304] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:11.514029 23872 raft_consensus.cc:2804] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.514397 23872 raft_consensus.cc:493] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.514410 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e30e6ebdca44cbdb950b5df31f1e15a" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.514846 23872 raft_consensus.cc:3060] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.515187 23608 raft_consensus.cc:2468] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:11.503214 23729 raft_consensus.cc:359] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.519316 23729 raft_consensus.cc:385] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.519626 23729 raft_consensus.cc:740] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.521076 23729 consensus_queue.cc:260] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.521926 23731 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.522424 23731 ts_tablet_manager.cc:1403] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.006s
I20260709 13:09:11.523307 23729 ts_tablet_manager.cc:1434] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:09:11.525697 23893 raft_consensus.cc:493] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.526214 23893 raft_consensus.cc:515] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.527063 23729 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.527122 23731 raft_consensus.cc:359] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.528012 23731 raft_consensus.cc:385] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.528270 23731 raft_consensus.cc:740] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.525463 23728 raft_consensus.cc:359] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.529006 23728 raft_consensus.cc:385] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.530426 23728 raft_consensus.cc:740] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.531095 23728 consensus_queue.cc:260] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.532534 23890 consensus_queue.cc:1048] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.533227 23728 ts_tablet_manager.cc:1434] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.000s
I20260709 13:09:11.534188 23728 tablet_bootstrap.cc:492] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.533787 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47a3456a44347848b814a90540324bc" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:11.535076 23536 raft_consensus.cc:2468] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:11.537604 23651 leader_election.cc:304] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:11.538460 23828 consensus_queue.cc:1048] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:11.540508 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:11.540580 23872 raft_consensus.cc:515] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.536319 23731 consensus_queue.cc:260] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.495510 23462 raft_consensus.cc:2468] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:11.545470 23727 tablet_bootstrap.cc:492] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:11.549261 23729 tablet_bootstrap.cc:654] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.554078 23875 raft_consensus.cc:493] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.554615 23875 raft_consensus.cc:515] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.536217 23893 leader_election.cc:290] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.545616 23890 raft_consensus.cc:2804] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.555805 23890 raft_consensus.cc:493] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.556160 23890 raft_consensus.cc:3060] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.556305 23731 ts_tablet_manager.cc:1434] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:09:11.557359 23731 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.565467 23872 leader_election.cc:290] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.566321 23576 leader_election.cc:304] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:11.570590 23731 tablet_bootstrap.cc:654] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.482913 23537 raft_consensus.cc:2468] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:11.569111 23804 raft_consensus.cc:2804] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.575940 23728 tablet_bootstrap.cc:654] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.575736 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e30e6ebdca44cbdb950b5df31f1e15a" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:11.576191 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9997887126674260a9b0753308029e17" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:11.576427 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e30e6ebdca44cbdb950b5df31f1e15a" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:11.578359 23828 consensus_queue.cc:1048] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.557965 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9997887126674260a9b0753308029e17" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.568656 23875 leader_election.cc:290] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.568169 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47a3456a44347848b814a90540324bc" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:11.593075 23607 raft_consensus.cc:3060] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.586150 23685 raft_consensus.cc:3060] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.593727 23828 consensus_queue.cc:1048] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.587631 23804 raft_consensus.cc:697] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:11.589342 23462 raft_consensus.cc:2468] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:11.601106 23890 raft_consensus.cc:515] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.614616 23789 consensus_queue.cc:1048] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.620981 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47a3456a44347848b814a90540324bc" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:11.623984 23804 consensus_queue.cc:237] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.613320 23608 raft_consensus.cc:2468] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:11.615047 23460 raft_consensus.cc:2468] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
W20260709 13:09:11.632212 23888 log.cc:927] Time spent T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:09:11.643376 23502 leader_election.cc:304] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:11.655654 23875 raft_consensus.cc:2804] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.633886 23358 catalog_manager.cc:5697] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.662475 23727 tablet_bootstrap.cc:654] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.646792 23607 raft_consensus.cc:2468] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:11.668432 23501 leader_election.cc:304] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:11.669298 23735 raft_consensus.cc:2804] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.656213 23875 raft_consensus.cc:493] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.670493 23875 raft_consensus.cc:3060] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.670539 23865 consensus_queue.cc:1048] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.669806 23735 raft_consensus.cc:697] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:11.674899 23735 consensus_queue.cc:237] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.676484 23865 consensus_queue.cc:1048] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.677693 23729 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.651371 23685 raft_consensus.cc:2468] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:11.682521 23728 tablet_bootstrap.cc:492] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:11.685585 23890 leader_election.cc:290] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.686178 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c47a3456a44347848b814a90540324bc" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:11.692106 23728 ts_tablet_manager.cc:1403] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.019s
I20260709 13:09:11.692080 23729 ts_tablet_manager.cc:1403] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.168s	user 0.024s	sys 0.022s
I20260709 13:09:11.699697 23534 raft_consensus.cc:3060] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.699973 23729 raft_consensus.cc:359] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.703727 23729 raft_consensus.cc:385] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.703997 23729 raft_consensus.cc:740] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.704758 23729 consensus_queue.cc:260] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.717021 23729 ts_tablet_manager.cc:1434] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 13:09:11.718601 23830 raft_consensus.cc:493] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.719188 23830 raft_consensus.cc:515] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.720680 23731 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:11.721182 23731 ts_tablet_manager.cc:1403] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.164s	user 0.016s	sys 0.001s
I20260709 13:09:11.721312 23830 leader_election.cc:290] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.705057 23865 raft_consensus.cc:493] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.721891 23865 raft_consensus.cc:515] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.723917 23865 leader_election.cc:290] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.723958 23731 raft_consensus.cc:359] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.724751 23731 raft_consensus.cc:385] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.725010 23731 raft_consensus.cc:740] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.725690 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7b08fe298a4c318662e7b54994912b" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:11.725657 23731 consensus_queue.cc:260] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.726572 23535 raft_consensus.cc:2393] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:11.727305 23731 ts_tablet_manager.cc:1434] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:11.728272 23728 raft_consensus.cc:359] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.728936 23728 raft_consensus.cc:385] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.729180 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:11.729789 23460 raft_consensus.cc:2468] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:11.730094 23729 tablet_bootstrap.cc:492] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.731007 23650 leader_election.cc:304] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:11.729189 23728 raft_consensus.cc:740] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.731856 23890 raft_consensus.cc:2804] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:11.732386 23890 raft_consensus.cc:493] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:11.732719 23890 raft_consensus.cc:3060] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.733304 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed7b08fe298a4c318662e7b54994912b" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:11.733912 23358 catalog_manager.cc:5697] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:11.736207 23575 leader_election.cc:304] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:11.736568 23729 tablet_bootstrap.cc:654] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.737874 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:11.739316 23651 leader_election.cc:343] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.739955 23865 raft_consensus.cc:3060] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.741425 23534 raft_consensus.cc:2468] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:11.742651 23651 leader_election.cc:304] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:11.743610 23840 raft_consensus.cc:2804] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.744091 23840 raft_consensus.cc:697] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:11.747496 23731 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:11.732678 23728 consensus_queue.cc:260] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.744911 23840 consensus_queue.cc:237] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.757045 23728 ts_tablet_manager.cc:1434] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.000s
I20260709 13:09:11.758395 23728 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.783965 23728 tablet_bootstrap.cc:654] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.803217 23359 catalog_manager.cc:5697] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.827085 23830 consensus_queue.cc:1048] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:11.807098 23890 raft_consensus.cc:515] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.844117 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:11.857882 23727 tablet_bootstrap.cc:492] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:11.858700 23727 ts_tablet_manager.cc:1403] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.316s	user 0.017s	sys 0.006s
I20260709 13:09:11.867654 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:11.848325 23890 leader_election.cc:290] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:11.868549 23460 raft_consensus.cc:3060] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.876904 23651 leader_election.cc:343] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.878602 23729 tablet_bootstrap.cc:492] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:11.879006 23729 ts_tablet_manager.cc:1403] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.040s
I20260709 13:09:11.882747 23728 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:11.883494 23728 ts_tablet_manager.cc:1403] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.125s	user 0.016s	sys 0.007s
I20260709 13:09:11.904027 23729 raft_consensus.cc:359] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.905103 23729 raft_consensus.cc:385] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.905395 23729 raft_consensus.cc:740] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.904165 23861 raft_consensus.cc:493] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.906389 23729 consensus_queue.cc:260] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.899242 23727 raft_consensus.cc:359] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.908630 23727 raft_consensus.cc:385] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.909055 23727 raft_consensus.cc:740] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.909143 23861 raft_consensus.cc:515] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.913225 23861 leader_election.cc:290] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:11.914044 23728 raft_consensus.cc:359] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.914686 23728 raft_consensus.cc:385] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:11.914922 23728 raft_consensus.cc:740] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:11.920964 23360 catalog_manager.cc:5697] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:11.922760 23729 ts_tablet_manager.cc:1434] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.002s
I20260709 13:09:11.922887 23727 consensus_queue.cc:260] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:11.923921 23729 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:11.925410 23728 consensus_queue.cc:260] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:11.924749 23875 raft_consensus.cc:515] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:11.927721 23649 consensus_peers.cc:597] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:11.929946 23731 tablet_bootstrap.cc:654] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.933483 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ffcfced3640e497a9ea757f67f9fa" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.937510 23728 ts_tablet_manager.cc:1434] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.054s	user 0.014s	sys 0.008s
I20260709 13:09:11.939851 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ffcfced3640e497a9ea757f67f9fa" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:11.942380 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9997887126674260a9b0753308029e17" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:11.943003 23457 raft_consensus.cc:3060] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:11.945233 23426 leader_election.cc:343] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.948263 23426 leader_election.cc:343] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.948709 23426 leader_election.cc:304] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
W20260709 13:09:11.949661 23905 log.cc:927] Time spent T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:09:11.949803 23861 raft_consensus.cc:2749] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.936821 23865 raft_consensus.cc:2749] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.954332 23875 leader_election.cc:290] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.954887 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9997887126674260a9b0753308029e17" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
W20260709 13:09:11.955343 23916 log.cc:927] Time spent T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:09:11.955574 23607 raft_consensus.cc:3060] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:11.957158 23893 consensus_queue.cc:1048] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.958951 23460 raft_consensus.cc:2468] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:11.963932 23607 raft_consensus.cc:2468] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:11.965085 23501 leader_election.cc:304] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:11.965911 23875 raft_consensus.cc:2804] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.965962 23650 leader_election.cc:304] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:11.967177 23727 ts_tablet_manager.cc:1434] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.108s	user 0.011s	sys 0.005s
I20260709 13:09:11.966624 23875 raft_consensus.cc:697] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:11.967640 23831 raft_consensus.cc:2804] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:11.968180 23727 tablet_bootstrap.cc:492] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:11.968195 23831 raft_consensus.cc:697] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:11.968375 23875 consensus_queue.cc:237] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.969502 23831 consensus_queue.cc:237] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:11.971195 23457 raft_consensus.cc:2468] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:11.972949 23728 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:11.978250 23729 tablet_bootstrap.cc:654] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.983381 23828 raft_consensus.cc:493] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:11.984110 23828 raft_consensus.cc:515] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:11.986883 23828 leader_election.cc:290] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:11.988471 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:11.989173 23727 tablet_bootstrap.cc:654] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.990721 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:11.990839 23426 leader_election.cc:343] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:11.992507 23428 leader_election.cc:343] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:11.992967 23428 leader_election.cc:304] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:11.993180 23683 raft_consensus.cc:1275] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:11.993882 23728 tablet_bootstrap.cc:654] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:11.994292 23828 raft_consensus.cc:2749] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:11.994827 23872 consensus_queue.cc:1048] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:11.996249 23865 raft_consensus.cc:493] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.000355 23865 raft_consensus.cc:515] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.005927 23865 leader_election.cc:290] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:12.007156 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:12.007302 23893 consensus_queue.cc:1048] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.007961 23457 raft_consensus.cc:2468] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:12.009406 23576 leader_election.cc:304] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:12.010557 23865 raft_consensus.cc:2804] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.011039 23865 raft_consensus.cc:493] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.011548 23865 raft_consensus.cc:3060] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.017460 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:12.021675 23575 leader_election.cc:343] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.022625 23731 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:12.031780 23731 ts_tablet_manager.cc:1403] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.289s	user 0.005s	sys 0.024s
I20260709 13:09:12.037626 23728 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:12.038233 23728 ts_tablet_manager.cc:1403] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.000s
I20260709 13:09:12.041725 23729 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:12.043061 23729 ts_tablet_manager.cc:1403] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.001s
I20260709 13:09:12.046888 23607 raft_consensus.cc:1275] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:12.046654 23729 raft_consensus.cc:359] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.048069 23729 raft_consensus.cc:385] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.048471 23735 consensus_queue.cc:1048] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.048774 23729 raft_consensus.cc:740] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.050055 23729 consensus_queue.cc:260] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.053083 23729 ts_tablet_manager.cc:1434] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:09:12.055265 23729 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:12.047211 23865 raft_consensus.cc:515] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.063659 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
W20260709 13:09:12.065303 23575 leader_election.cc:343] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.066126 23729 tablet_bootstrap.cc:654] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.067266 23727 tablet_bootstrap.cc:492] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:12.067793 23727 ts_tablet_manager.cc:1403] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.002s
I20260709 13:09:12.068334 23731 raft_consensus.cc:359] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.068943 23731 raft_consensus.cc:385] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.066716 23358 catalog_manager.cc:5697] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.069133 23731 raft_consensus.cc:740] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.072289 23731 consensus_queue.cc:260] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.074355 23731 ts_tablet_manager.cc:1434] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.001s
I20260709 13:09:12.074077 23727 raft_consensus.cc:359] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.075176 23727 raft_consensus.cc:385] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.075640 23727 raft_consensus.cc:740] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.076052 23731 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:12.075034 23728 raft_consensus.cc:359] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.078477 23728 raft_consensus.cc:385] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.078845 23728 raft_consensus.cc:740] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.081457 23727 consensus_queue.cc:260] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.084065 23727 ts_tablet_manager.cc:1434] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:12.084688 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:12.085031 23727 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:12.085325 23457 raft_consensus.cc:3060] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.085494 23731 tablet_bootstrap.cc:654] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.087504 23865 leader_election.cc:290] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:12.093405 23727 tablet_bootstrap.cc:654] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.093669 23457 raft_consensus.cc:2468] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:12.097591 23576 leader_election.cc:304] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449
I20260709 13:09:12.100478 23915 raft_consensus.cc:2804] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.107807 23915 raft_consensus.cc:697] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:12.111148 23915 consensus_queue.cc:237] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.101643 23728 consensus_queue.cc:260] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.102787 23865 raft_consensus.cc:493] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.121481 23831 raft_consensus.cc:493] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.121766 23728 ts_tablet_manager.cc:1434] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.002s
I20260709 13:09:12.122068 23831 raft_consensus.cc:515] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.122939 23728 tablet_bootstrap.cc:492] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:12.124383 23831 leader_election.cc:290] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:12.129047 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:12.120911 23865 raft_consensus.cc:515] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
W20260709 13:09:12.131150 23650 leader_election.cc:343] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.132225 23865 leader_election.cc:290] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:12.133903 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2051e70e1839470b9d075467894aa8e8" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:12.135636 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2051e70e1839470b9d075467894aa8e8" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:12.136389 23536 raft_consensus.cc:2468] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
W20260709 13:09:12.137789 23575 leader_election.cc:343] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.139065 23577 leader_election.cc:304] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449
I20260709 13:09:12.143042 23358 catalog_manager.cc:5697] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.143954 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:12.144783 23865 raft_consensus.cc:2804] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:12.145285 23649 leader_election.cc:343] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.145993 23649 leader_election.cc:304] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:12.146955 23875 consensus_queue.cc:1048] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.147500 23830 raft_consensus.cc:2749] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.145289 23865 raft_consensus.cc:493] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.151733 23865 raft_consensus.cc:3060] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.162796 23749 consensus_queue.cc:1048] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.193840 23830 raft_consensus.cc:493] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.194622 23830 raft_consensus.cc:515] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.201601 23830 leader_election.cc:290] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:12.240844 23728 tablet_bootstrap.cc:654] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.257711 23875 consensus_queue.cc:1048] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.263803 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985baf5be41844358d43f30ddeee2e3d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:12.263386 23357 catalog_manager.cc:5697] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.264535 23536 raft_consensus.cc:2468] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:12.266041 23828 raft_consensus.cc:493] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.266549 23828 raft_consensus.cc:515] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.271104 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:12.272614 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:12.274326 23428 leader_election.cc:343] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:12.275707 23426 leader_election.cc:343] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.276292 23426 leader_election.cc:304] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:12.277191 23731 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:12.277390 23902 raft_consensus.cc:2749] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.277761 23731 ts_tablet_manager.cc:1403] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.202s	user 0.021s	sys 0.008s
I20260709 13:09:12.280089 23727 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:12.280658 23727 ts_tablet_manager.cc:1403] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.033s
I20260709 13:09:12.283552 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985baf5be41844358d43f30ddeee2e3d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:12.283705 23727 raft_consensus.cc:359] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.284390 23727 raft_consensus.cc:385] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.284663 23727 raft_consensus.cc:740] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.285380 23727 consensus_queue.cc:260] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.284742 23729 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:12.285921 23828 leader_election.cc:290] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:12.286530 23729 ts_tablet_manager.cc:1403] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.231s	user 0.009s	sys 0.014s
W20260709 13:09:12.286556 23649 leader_election.cc:343] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.283035 23865 raft_consensus.cc:515] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.287493 23651 leader_election.cc:304] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:12.288313 23890 raft_consensus.cc:2804] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.288702 23890 raft_consensus.cc:493] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.289047 23890 raft_consensus.cc:3060] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.289482 23729 raft_consensus.cc:359] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.290130 23729 raft_consensus.cc:385] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.290207 23804 consensus_queue.cc:1048] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.292145 23727 ts_tablet_manager.cc:1434] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:09:12.290477 23729 raft_consensus.cc:740] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.293026 23729 consensus_queue.cc:260] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.294479 23727 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:12.296648 23890 raft_consensus.cc:515] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.305265 23729 ts_tablet_manager.cc:1434] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 13:09:12.306514 23729 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:12.319898 23727 tablet_bootstrap.cc:654] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.316843 23890 leader_election.cc:290] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:12.322959 23731 raft_consensus.cc:359] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.323776 23731 raft_consensus.cc:385] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.318137 23872 raft_consensus.cc:493] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.324083 23731 raft_consensus.cc:740] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.325309 23731 consensus_queue.cc:260] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.333950 23731 ts_tablet_manager.cc:1434] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:09:12.334512 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985baf5be41844358d43f30ddeee2e3d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:12.330044 23804 raft_consensus.cc:493] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:12.335986 23649 leader_election.cc:343] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.335798 23804 raft_consensus.cc:515] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.336947 23731 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:12.338246 23804 leader_election.cc:290] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:12.327258 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "985baf5be41844358d43f30ddeee2e3d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:12.339143 23534 raft_consensus.cc:3060] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.340657 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:12.342487 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:12.343132 23460 raft_consensus.cc:2468] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:12.326630 23872 raft_consensus.cc:515] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.344293 23576 leader_election.cc:304] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
W20260709 13:09:12.345144 23577 leader_election.cc:343] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.346683 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:12.346836 23804 raft_consensus.cc:2804] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.347441 23728 tablet_bootstrap.cc:492] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:12.347636 23460 raft_consensus.cc:2393] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:12.347942 23728 ts_tablet_manager.cc:1403] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.225s	user 0.016s	sys 0.000s
I20260709 13:09:12.345218 23872 leader_election.cc:290] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:12.350544 23731 tablet_bootstrap.cc:654] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.347584 23804 raft_consensus.cc:493] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.351054 23804 raft_consensus.cc:3060] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.350718 23728 raft_consensus.cc:359] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.358700 23728 raft_consensus.cc:385] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.359020 23728 raft_consensus.cc:740] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.359720 23728 consensus_queue.cc:260] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.356634 23534 raft_consensus.cc:2468] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:12.368966 23729 tablet_bootstrap.cc:654] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.370689 23865 leader_election.cc:290] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:12.396378 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2051e70e1839470b9d075467894aa8e8" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:12.397343 23536 raft_consensus.cc:3060] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.407109 23457 raft_consensus.cc:3060] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.412876 23728 ts_tablet_manager.cc:1434] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:09:12.413993 23728 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:12.425918 23731 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:12.426520 23731 ts_tablet_manager.cc:1403] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.091s	user 0.010s	sys 0.015s
I20260709 13:09:12.427116 23727 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:12.427644 23727 ts_tablet_manager.cc:1403] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.018s
I20260709 13:09:12.429347 23731 raft_consensus.cc:359] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.430061 23731 raft_consensus.cc:385] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.430353 23731 raft_consensus.cc:740] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.430346 23727 raft_consensus.cc:359] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.431195 23727 raft_consensus.cc:385] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.431670 23727 raft_consensus.cc:740] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.431478 23731 consensus_queue.cc:260] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.432614 23727 consensus_queue.cc:260] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.435345 23731 ts_tablet_manager.cc:1434] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:12.435072 23875 consensus_queue.cc:1048] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.437651 23727 ts_tablet_manager.cc:1434] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:09:12.438620 23728 tablet_bootstrap.cc:654] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.438797 23731 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:12.444190 23727 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:12.454180 23804 raft_consensus.cc:515] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.454986 23731 tablet_bootstrap.cc:654] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.457515 23804 leader_election.cc:290] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:12.443029 23536 raft_consensus.cc:2468] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:12.459041 23577 leader_election.cc:304] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:12.459831 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:12.460839 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:12.463266 23727 tablet_bootstrap.cc:654] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.465142 23830 raft_consensus.cc:493] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.466841 23804 raft_consensus.cc:2804] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.467495 23804 raft_consensus.cc:697] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:12.465649 23830 raft_consensus.cc:515] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.472895 23729 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:12.473590 23729 ts_tablet_manager.cc:1403] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.167s	user 0.021s	sys 0.039s
I20260709 13:09:12.476835 23828 raft_consensus.cc:493] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.477526 23828 raft_consensus.cc:515] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.480355 23890 consensus_queue.cc:1048] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.482108 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:12.483639 23828 leader_election.cc:290] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:12.485198 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:12.486565 23534 raft_consensus.cc:3060] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.487977 23830 leader_election.cc:290] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
W20260709 13:09:12.491020 23577 leader_election.cc:343] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.492029 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:12.493073 23460 raft_consensus.cc:3060] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.474663 23804 consensus_queue.cc:237] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.496402 23610 raft_consensus.cc:3060] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.496487 23651 leader_election.cc:304] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:12.497720 23831 raft_consensus.cc:2804] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.498333 23831 raft_consensus.cc:697] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:12.499509 23831 consensus_queue.cc:237] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:12.505470 23460 raft_consensus.cc:2468] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:12.507558 23576 leader_election.cc:304] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:12.508414 23915 raft_consensus.cc:2804] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.493929 23729 raft_consensus.cc:359] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.508898 23915 raft_consensus.cc:697] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:12.509864 23915 consensus_queue.cc:237] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.510025 23875 consensus_queue.cc:1048] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.505688 23728 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:12.508981 23729 raft_consensus.cc:385] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.513010 23728 ts_tablet_manager.cc:1403] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.000s
I20260709 13:09:12.512851 23729 raft_consensus.cc:740] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.517619 23729 consensus_queue.cc:260] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.514014 23830 consensus_queue.cc:1048] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:12.520416 23729 ts_tablet_manager.cc:1434] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:09:12.521540 23729 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:12.527091 23728 raft_consensus.cc:359] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.531629 23728 raft_consensus.cc:385] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.531953 23728 raft_consensus.cc:740] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.517449 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef38dca00e5e45d194aa64b09b4a4271" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:12.535146 23728 consensus_queue.cc:260] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.524503 23607 raft_consensus.cc:2468] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:12.539772 23728 ts_tablet_manager.cc:1434] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:09:12.540712 23728 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:12.541641 23890 consensus_queue.cc:1048] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:12.542557 23426 leader_election.cc:304] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:12.543596 23861 raft_consensus.cc:2804] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.544075 23861 raft_consensus.cc:493] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.544490 23861 raft_consensus.cc:3060] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.534354 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:12.558843 23457 raft_consensus.cc:2393] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 1: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
I20260709 13:09:12.551378 23890 consensus_queue.cc:1048] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:12.571002 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2051e70e1839470b9d075467894aa8e8" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:12.609370 23683 raft_consensus.cc:3060] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.612519 23650 leader_election.cc:304] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:12.612138 23360 catalog_manager.cc:5697] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.615224 23830 raft_consensus.cc:3060] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:12.590368 23428 leader_election.cc:343] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:12.621855 23727 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:12.606704 23501 leader_election.cc:304] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:12.623682 23735 raft_consensus.cc:2749] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.632308 23804 consensus_queue.cc:1048] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.607326 23355 catalog_manager.cc:5697] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:12.622452 23727 ts_tablet_manager.cc:1403] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.002s
I20260709 13:09:12.660964 23728 tablet_bootstrap.cc:654] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.675359 23727 raft_consensus.cc:359] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.679242 23727 raft_consensus.cc:385] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.681420 23890 raft_consensus.cc:493] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.704317 23727 raft_consensus.cc:740] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.704468 23890 raft_consensus.cc:515] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.705448 23727 consensus_queue.cc:260] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.706718 23890 leader_election.cc:290] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:12.681823 23731 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:12.690286 23830 raft_consensus.cc:2749] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:12.708081 23731 ts_tablet_manager.cc:1403] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.269s	user 0.034s	sys 0.018s
I20260709 13:09:12.698647 23729 tablet_bootstrap.cc:654] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.707928 23727 ts_tablet_manager.cc:1434] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.061s	user 0.008s	sys 0.000s
I20260709 13:09:12.709522 23727 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:12.714231 23731 raft_consensus.cc:359] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.716588 23731 raft_consensus.cc:385] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.716990 23731 raft_consensus.cc:740] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.719081 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9e4ec4723345c9bbdcc12fab0be284" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:12.721635 23537 raft_consensus.cc:2468] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:12.723224 23651 leader_election.cc:304] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:12.721637 23683 raft_consensus.cc:2468] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:12.724056 23830 raft_consensus.cc:2804] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.724700 23830 raft_consensus.cc:493] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.725152 23830 raft_consensus.cc:3060] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.729995 23731 consensus_queue.cc:260] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.741869 23731 ts_tablet_manager.cc:1434] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.003s
I20260709 13:09:12.742722 23731 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:12.735083 23861 raft_consensus.cc:515] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.738623 23804 consensus_queue.cc:1048] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:12.764830 23861 leader_election.cc:290] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:12.765220 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:12.770717 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:12.771440 23607 raft_consensus.cc:3060] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.771646 23537 raft_consensus.cc:3060] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.778441 23537 raft_consensus.cc:2468] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:12.778574 23607 raft_consensus.cc:2468] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:12.779841 23426 leader_election.cc:304] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:12.780668 23861 raft_consensus.cc:2804] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.759258 23830 raft_consensus.cc:515] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.781221 23861 raft_consensus.cc:697] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:12.781951 23861 consensus_queue.cc:237] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.782794 23830 leader_election.cc:290] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:12.784015 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9e4ec4723345c9bbdcc12fab0be284" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:12.784626 23537 raft_consensus.cc:3060] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.790867 23731 tablet_bootstrap.cc:654] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.794381 23728 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:12.794852 23728 ts_tablet_manager.cc:1403] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.254s	user 0.022s	sys 0.004s
I20260709 13:09:12.797567 23728 raft_consensus.cc:359] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.798264 23728 raft_consensus.cc:385] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.798502 23728 raft_consensus.cc:740] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.799069 23728 consensus_queue.cc:260] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.800837 23728 ts_tablet_manager.cc:1434] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:12.801632 23728 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:12.817562 23727 tablet_bootstrap.cc:654] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:12.823872 23650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:45163, user_credentials={real_user=slave}} blocked reactor thread for 211497us
I20260709 13:09:12.825212 23537 raft_consensus.cc:2468] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:12.826541 23728 tablet_bootstrap.cc:654] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.829495 23651 leader_election.cc:304] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:12.830698 23831 raft_consensus.cc:2804] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:12.831382 23831 raft_consensus.cc:697] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:12.831864 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9e4ec4723345c9bbdcc12fab0be284" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:12.833345 23831 consensus_queue.cc:237] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.840791 23729 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:12.841240 23729 ts_tablet_manager.cc:1403] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.320s	user 0.013s	sys 0.012s
I20260709 13:09:12.830502 23355 catalog_manager.cc:5697] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:12.836907 23462 raft_consensus.cc:2468] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:12.852224 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b9e4ec4723345c9bbdcc12fab0be284" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:12.852926 23458 raft_consensus.cc:3060] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.857795 23729 raft_consensus.cc:359] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.858548 23729 raft_consensus.cc:385] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.858812 23729 raft_consensus.cc:740] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.859596 23729 consensus_queue.cc:260] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.868413 23902 raft_consensus.cc:493] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:12.868949 23902 raft_consensus.cc:515] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:12.871901 23902 leader_election.cc:290] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:12.877866 23729 ts_tablet_manager.cc:1434] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:09:12.897640 23729 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:12.871095 23458 raft_consensus.cc:2468] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:12.915747 23731 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:12.916297 23731 ts_tablet_manager.cc:1403] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.174s	user 0.025s	sys 0.012s
I20260709 13:09:12.908140 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:12.920758 23607 raft_consensus.cc:2468] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
W20260709 13:09:12.921169 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:12.922096 23426 leader_election.cc:304] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:12.923117 23861 raft_consensus.cc:2804] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:12.923683 23861 raft_consensus.cc:493] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:12.924161 23861 raft_consensus.cc:3060] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:12.927771 23728 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:12.928529 23728 ts_tablet_manager.cc:1403] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.127s	user 0.019s	sys 0.017s
I20260709 13:09:12.934582 23749 consensus_queue.cc:1048] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:12.939987 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:12.940723 23683 raft_consensus.cc:2468] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:12.960736 23731 raft_consensus.cc:359] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.961537 23731 raft_consensus.cc:385] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.961756 23728 raft_consensus.cc:359] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.962776 23728 raft_consensus.cc:385] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.963122 23728 raft_consensus.cc:740] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.961834 23731 raft_consensus.cc:740] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.964048 23728 consensus_queue.cc:260] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:12.965981 23731 consensus_queue.cc:260] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.977613 23727 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:12.978088 23727 ts_tablet_manager.cc:1403] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.269s	user 0.020s	sys 0.024s
I20260709 13:09:12.979246 23728 ts_tablet_manager.cc:1434] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 13:09:12.980531 23728 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:12.984825 23729 tablet_bootstrap.cc:654] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:12.987907 23727 raft_consensus.cc:359] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:12.988643 23727 raft_consensus.cc:385] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:12.988935 23727 raft_consensus.cc:740] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:12.989864 23727 consensus_queue.cc:260] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:12.995606 23577 consensus_peers.cc:597] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.001654 23727 ts_tablet_manager.cc:1434] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:09:13.007124 23727 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:13.007822 23728 tablet_bootstrap.cc:654] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.014443 23804 consensus_queue.cc:1048] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.015859 23861 raft_consensus.cc:515] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.022903 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:13.023597 23861 leader_election.cc:290] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:13.023972 23607 raft_consensus.cc:3060] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.031396 23649 consensus_peers.cc:597] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:13.031756 23727 tablet_bootstrap.cc:654] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.032822 23749 consensus_queue.cc:1048] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.036937 23355 catalog_manager.cc:5697] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.041450 23728 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.041425 23727 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:13.047466 23728 ts_tablet_manager.cc:1403] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.007s
I20260709 13:09:13.047466 23727 ts_tablet_manager.cc:1403] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.007s
I20260709 13:09:13.046680 23731 ts_tablet_manager.cc:1434] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.130s	user 0.006s	sys 0.002s
I20260709 13:09:13.049243 23731 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:13.055616 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:13.056311 23684 raft_consensus.cc:3060] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.063944 23727 raft_consensus.cc:359] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.064693 23727 raft_consensus.cc:385] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.064977 23727 raft_consensus.cc:740] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.065811 23727 consensus_queue.cc:260] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.068128 23727 ts_tablet_manager.cc:1434] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:09:13.069049 23727 tablet_bootstrap.cc:492] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:13.070962 23728 raft_consensus.cc:359] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.045665 23607 raft_consensus.cc:2468] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:13.071923 23728 raft_consensus.cc:385] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.072372 23728 raft_consensus.cc:740] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.073015 23426 leader_election.cc:304] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:13.073932 23861 raft_consensus.cc:2804] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.073244 23728 consensus_queue.cc:260] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.074471 23861 raft_consensus.cc:697] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:13.075366 23861 consensus_queue.cc:237] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.076184 23728 ts_tablet_manager.cc:1434] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.005s
I20260709 13:09:13.077114 23728 tablet_bootstrap.cc:492] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:13.078732 23727 tablet_bootstrap.cc:654] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.089442 23729 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:13.083779 23684 raft_consensus.cc:2468] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:13.090070 23729 ts_tablet_manager.cc:1403] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.209s	user 0.022s	sys 0.032s
I20260709 13:09:13.092573 23728 tablet_bootstrap.cc:654] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.099440 23731 tablet_bootstrap.cc:654] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.103835 23729 raft_consensus.cc:359] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.104557 23729 raft_consensus.cc:385] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.104830 23729 raft_consensus.cc:740] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.105593 23729 consensus_queue.cc:260] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.106150 23360 catalog_manager.cc:5697] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.109045 23729 ts_tablet_manager.cc:1434] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:09:13.110433 23729 tablet_bootstrap.cc:492] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:13.119263 23861 raft_consensus.cc:493] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.128443 23861 raft_consensus.cc:515] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.135697 23875 raft_consensus.cc:493] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.136456 23875 raft_consensus.cc:515] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.177591 23729 tablet_bootstrap.cc:654] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.180750 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fed89fed14448fa25983c72e7f1e64" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:13.181473 23727 tablet_bootstrap.cc:492] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:13.206909 23727 ts_tablet_manager.cc:1403] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.138s	user 0.005s	sys 0.025s
I20260709 13:09:13.206825 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:13.210558 23727 raft_consensus.cc:359] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.192698 23728 tablet_bootstrap.cc:492] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.211838 23728 ts_tablet_manager.cc:1403] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.135s	user 0.011s	sys 0.019s
I20260709 13:09:13.212472 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:13.212358 23357 catalog_manager.cc:5697] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
W20260709 13:09:13.213797 23428 leader_election.cc:343] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.214740 23502 leader_election.cc:304] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:13.215862 23947 raft_consensus.cc:2749] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.220260 23728 raft_consensus.cc:359] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.221043 23728 raft_consensus.cc:385] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.221339 23728 raft_consensus.cc:740] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.222139 23728 consensus_queue.cc:260] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.211338 23727 raft_consensus.cc:385] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.223698 23727 raft_consensus.cc:740] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.224712 23727 consensus_queue.cc:260] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.225006 23902 consensus_queue.cc:1048] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:13.227304 23890 raft_consensus.cc:493] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.227833 23890 raft_consensus.cc:515] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.230090 23890 leader_election.cc:290] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:13.190395 23831 consensus_queue.cc:1048] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.198603 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fed89fed14448fa25983c72e7f1e64" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:13.233031 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:13.233780 23457 raft_consensus.cc:2468] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
W20260709 13:09:13.234925 23426 leader_election.cc:343] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.235198 23728 ts_tablet_manager.cc:1434] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.002s
I20260709 13:09:13.235471 23426 leader_election.cc:304] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:13.200623 23966 raft_consensus.cc:493] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.237380 23735 raft_consensus.cc:493] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.237528 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:13.237903 23735 raft_consensus.cc:515] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.238416 23537 raft_consensus.cc:2468] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:13.240192 23735 leader_election.cc:290] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:13.235646 23650 leader_election.cc:304] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:13.242149 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05850e9b37994edb9bcd786b1bdbaccc" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:13.236694 23966 raft_consensus.cc:515] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.243284 23830 raft_consensus.cc:2804] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.200165 23861 leader_election.cc:290] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:13.243777 23830 raft_consensus.cc:493] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.244218 23830 raft_consensus.cc:3060] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:13.244402 23501 leader_election.cc:343] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.236536 23728 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:13.245488 23861 raft_consensus.cc:2749] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.240228 23727 ts_tablet_manager.cc:1434] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.002s
I20260709 13:09:13.257164 23727 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:13.205796 23875 leader_election.cc:290] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:13.268908 23731 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:13.269474 23731 ts_tablet_manager.cc:1403] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.220s	user 0.015s	sys 0.014s
I20260709 13:09:13.270865 23828 consensus_queue.cc:1048] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.272208 23731 raft_consensus.cc:359] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.272918 23731 raft_consensus.cc:385] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.273200 23731 raft_consensus.cc:740] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.273862 23731 consensus_queue.cc:260] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.285208 23727 tablet_bootstrap.cc:654] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.286314 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05850e9b37994edb9bcd786b1bdbaccc" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:13.286669 23966 leader_election.cc:290] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:13.282996 23731 ts_tablet_manager.cc:1434] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:09:13.289275 23731 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:13.290717 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06495ae663546c0bba8a8faac68e49d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:13.290784 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06495ae663546c0bba8a8faac68e49d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:13.291599 23457 raft_consensus.cc:2468] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
W20260709 13:09:13.292502 23649 leader_election.cc:343] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.295635 23650 leader_election.cc:304] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
W20260709 13:09:13.296941 23501 leader_election.cc:343] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.297485 23501 leader_election.cc:304] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:13.299265 23890 raft_consensus.cc:2804] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.299734 23890 raft_consensus.cc:493] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.300081 23890 raft_consensus.cc:3060] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.303620 23947 raft_consensus.cc:2749] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.306692 23729 tablet_bootstrap.cc:492] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:13.307875 23729 ts_tablet_manager.cc:1403] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.198s	user 0.014s	sys 0.006s
I20260709 13:09:13.312048 23731 tablet_bootstrap.cc:654] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.318809 23728 tablet_bootstrap.cc:654] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.324011 23729 raft_consensus.cc:359] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.324877 23729 raft_consensus.cc:385] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.325181 23729 raft_consensus.cc:740] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.328243 23729 consensus_queue.cc:260] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.312307 23830 raft_consensus.cc:515] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.354748 23729 ts_tablet_manager.cc:1434] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 13:09:13.355923 23729 tablet_bootstrap.cc:492] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:13.357240 23893 raft_consensus.cc:493] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.359963 23893 raft_consensus.cc:515] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.361069 23964 consensus_queue.cc:1048] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:13.362064 23893 leader_election.cc:290] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:13.364094 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b8a011953547178d6c255a7b9a072f" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:13.365741 23890 raft_consensus.cc:515] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
W20260709 13:09:13.366091 23649 leader_election.cc:343] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.365765 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:13.368064 23458 raft_consensus.cc:3060] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.369692 23890 leader_election.cc:290] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:13.372865 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b8a011953547178d6c255a7b9a072f" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:13.369942 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06495ae663546c0bba8a8faac68e49d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
W20260709 13:09:13.374598 23649 leader_election.cc:343] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.380854 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06495ae663546c0bba8a8faac68e49d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:13.382508 23457 raft_consensus.cc:3060] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.390740 23952 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.396130 23952 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.398847 23952 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:13.402222 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
W20260709 13:09:13.403570 23651 leader_election.cc:343] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.404314 23651 leader_election.cc:304] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
W20260709 13:09:13.405391 23650 leader_election.cc:343] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.411859 23890 raft_consensus.cc:2749] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.414589 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:13.415242 23537 raft_consensus.cc:3060] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.391492 23458 raft_consensus.cc:2468] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
W20260709 13:09:13.416059 23651 leader_election.cc:343] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.416574 23651 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:13.417423 23890 raft_consensus.cc:2749] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:13.425294 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:13.425809 23650 leader_election.cc:304] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:13.426434 23534 raft_consensus.cc:3060] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.432286 23727 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:13.434257 23865 raft_consensus.cc:493] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.426824 23890 raft_consensus.cc:2804] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.439990 23610 raft_consensus.cc:3060] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.448961 23727 ts_tablet_manager.cc:1403] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.014s
I20260709 13:09:13.396154 23457 raft_consensus.cc:2468] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:13.448360 23830 leader_election.cc:290] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:13.456837 23727 raft_consensus.cc:359] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.458141 23727 raft_consensus.cc:385] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.458493 23727 raft_consensus.cc:740] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.454429 23890 raft_consensus.cc:697] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:13.449220 23865 raft_consensus.cc:515] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.460084 23890 consensus_queue.cc:237] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.461134 23865 leader_election.cc:290] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:13.462195 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ffcfced3640e497a9ea757f67f9fa" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:13.462849 23457 raft_consensus.cc:2468] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:13.462245 23650 leader_election.cc:304] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:13.463954 23576 leader_election.cc:304] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:13.464339 23728 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.464911 23728 ts_tablet_manager.cc:1403] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.229s	user 0.019s	sys 0.017s
I20260709 13:09:13.459352 23727 consensus_queue.cc:260] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.464883 23865 raft_consensus.cc:2804] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.471390 23865 raft_consensus.cc:493] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.472652 23865 raft_consensus.cc:3060] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.473093 23966 consensus_queue.cc:1048] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.475867 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ffcfced3640e497a9ea757f67f9fa" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:13.478076 23728 raft_consensus.cc:359] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.478766 23728 raft_consensus.cc:385] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.479031 23728 raft_consensus.cc:740] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.482753 23731 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:13.483284 23731 ts_tablet_manager.cc:1403] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.194s	user 0.039s	sys 0.032s
I20260709 13:09:13.485954 23731 raft_consensus.cc:359] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.486616 23731 raft_consensus.cc:385] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.486891 23731 raft_consensus.cc:740] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.466358 23830 raft_consensus.cc:2804] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.491950 23830 raft_consensus.cc:697] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:13.492810 23830 consensus_queue.cc:237] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.503607 23727 ts_tablet_manager.cc:1434] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.053s	user 0.007s	sys 0.000s
I20260709 13:09:13.505203 23727 tablet_bootstrap.cc:492] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:13.505250 23728 consensus_queue.cc:260] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.478125 23729 tablet_bootstrap.cc:654] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.506561 23684 raft_consensus.cc:2468] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:13.509824 23731 consensus_queue.cc:260] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.524066 23865 raft_consensus.cc:515] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.528954 23534 raft_consensus.cc:2468] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:13.531976 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ffcfced3640e497a9ea757f67f9fa" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:13.532618 23683 raft_consensus.cc:3060] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.532896 23728 ts_tablet_manager.cc:1434] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.000s
I20260709 13:09:13.533977 23728 tablet_bootstrap.cc:492] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:13.537644 23731 ts_tablet_manager.cc:1434] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.054s	user 0.006s	sys 0.000s
I20260709 13:09:13.538968 23731 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:13.541164 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c86ffcfced3640e497a9ea757f67f9fa" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:13.541774 23462 raft_consensus.cc:3060] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.534590 23865 leader_election.cc:290] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:13.557394 23728 tablet_bootstrap.cc:654] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.576836 23731 tablet_bootstrap.cc:654] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.582314 23462 raft_consensus.cc:2468] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:13.584147 23576 leader_election.cc:304] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:13.585502 23915 raft_consensus.cc:2804] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.591337 23683 raft_consensus.cc:2468] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:13.585997 23915 raft_consensus.cc:697] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:13.594331 23902 consensus_queue.cc:1048] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.594945 23915 consensus_queue.cc:237] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.599179 23902 consensus_queue.cc:1048] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.601852 23727 tablet_bootstrap.cc:654] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.614305 23728 tablet_bootstrap.cc:492] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.615805 23728 ts_tablet_manager.cc:1403] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.082s	user 0.014s	sys 0.010s
I20260709 13:09:13.626047 23729 tablet_bootstrap.cc:492] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:13.626592 23729 ts_tablet_manager.cc:1403] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.271s	user 0.028s	sys 0.018s
I20260709 13:09:13.655427 23357 catalog_manager.cc:5697] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.657644 23357 catalog_manager.cc:5697] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.659824 23728 raft_consensus.cc:359] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.660548 23728 raft_consensus.cc:385] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.660797 23728 raft_consensus.cc:740] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.661525 23728 consensus_queue.cc:260] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.662985 23728 ts_tablet_manager.cc:1434] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.000s
I20260709 13:09:13.663918 23728 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:13.664593 23828 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.665138 23828 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.663163 23729 raft_consensus.cc:359] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.669420 23729 raft_consensus.cc:385] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.669804 23729 raft_consensus.cc:740] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.667932 23828 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:13.673153 23729 consensus_queue.cc:260] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.676013 23729 ts_tablet_manager.cc:1434] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.000s
I20260709 13:09:13.676676 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:13.676692 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:13.677631 23684 raft_consensus.cc:2468] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:13.678886 23728 tablet_bootstrap.cc:654] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:13.680944 23428 leader_election.cc:343] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.682248 23426 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:13.684410 23828 raft_consensus.cc:2804] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.684765 23828 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.685112 23828 raft_consensus.cc:3060] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.710974 23727 tablet_bootstrap.cc:492] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:13.711555 23727 ts_tablet_manager.cc:1403] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.207s	user 0.038s	sys 0.013s
I20260709 13:09:13.715085 23727 raft_consensus.cc:359] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.715855 23727 raft_consensus.cc:385] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.716209 23727 raft_consensus.cc:740] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.703202 23729 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:13.722707 23729 tablet_bootstrap.cc:654] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.723691 23727 consensus_queue.cc:260] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.728581 23727 ts_tablet_manager.cc:1434] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:09:13.729972 23727 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:13.743279 23728 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.743858 23728 ts_tablet_manager.cc:1403] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.080s	user 0.029s	sys 0.022s
I20260709 13:09:13.746503 23728 raft_consensus.cc:359] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.760109 23728 raft_consensus.cc:385] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.757019 23731 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:13.767874 23731 ts_tablet_manager.cc:1403] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.229s	user 0.019s	sys 0.000s
I20260709 13:09:13.760516 23728 raft_consensus.cc:740] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.756731 23828 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.769268 23728 consensus_queue.cc:260] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.760318 23729 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:13.772526 23729 ts_tablet_manager.cc:1403] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.002s
I20260709 13:09:13.773061 23727 tablet_bootstrap.cc:654] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.773940 23728 ts_tablet_manager.cc:1434] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
I20260709 13:09:13.775213 23728 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:13.775151 23729 raft_consensus.cc:359] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.777104 23729 raft_consensus.cc:385] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.777395 23729 raft_consensus.cc:740] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.778086 23729 consensus_queue.cc:260] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.779764 23729 ts_tablet_manager.cc:1434] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:13.780468 23729 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:13.782333 23915 raft_consensus.cc:493] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.782893 23915 raft_consensus.cc:515] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.771422 23731 raft_consensus.cc:359] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.754446 23360 catalog_manager.cc:5697] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.785050 23915 leader_election.cc:290] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:13.783387 23728 tablet_bootstrap.cc:654] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.786164 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05850e9b37994edb9bcd786b1bdbaccc" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:13.791324 23683 raft_consensus.cc:2468] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:13.786382 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05850e9b37994edb9bcd786b1bdbaccc" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:13.792805 23536 raft_consensus.cc:2468] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:13.787106 23731 raft_consensus.cc:385] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.793934 23731 raft_consensus.cc:740] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.787139 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:13.785434 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:13.796092 23684 raft_consensus.cc:3060] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.797998 23727 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:13.798480 23727 ts_tablet_manager.cc:1403] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.069s	user 0.018s	sys 0.006s
I20260709 13:09:13.793943 23577 leader_election.cc:304] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:13.799980 23729 tablet_bootstrap.cc:654] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.800473 23915 raft_consensus.cc:2804] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.800861 23915 raft_consensus.cc:493] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.801200 23915 raft_consensus.cc:3060] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.801292 23727 raft_consensus.cc:359] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.802016 23727 raft_consensus.cc:385] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.802265 23727 raft_consensus.cc:740] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.803123 23727 consensus_queue.cc:260] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.804033 23947 raft_consensus.cc:493] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:13.803793 23731 consensus_queue.cc:260] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.804494 23947 raft_consensus.cc:515] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:13.806438 23947 leader_election.cc:290] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:13.786690 23828 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:13.811766 23727 ts_tablet_manager.cc:1434] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:09:13.812779 23727 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
W20260709 13:09:13.813633 23428 leader_election.cc:343] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:13.811859 23731 ts_tablet_manager.cc:1434] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:09:13.814865 23731 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:13.819274 23727 tablet_bootstrap.cc:654] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.820581 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fed89fed14448fa25983c72e7f1e64" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:13.821280 23462 raft_consensus.cc:2468] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:13.825006 23502 leader_election.cc:304] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:13.827129 23684 raft_consensus.cc:2468] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:13.828859 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fed89fed14448fa25983c72e7f1e64" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:13.833297 23947 raft_consensus.cc:2804] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:13.833392 23607 raft_consensus.cc:2468] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:13.833915 23947 raft_consensus.cc:493] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:13.834384 23947 raft_consensus.cc:3060] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.835733 23426 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:13.836876 23728 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.837148 23828 raft_consensus.cc:2804] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.838347 23828 raft_consensus.cc:697] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:13.839605 23828 consensus_queue.cc:237] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.848884 23731 tablet_bootstrap.cc:654] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.837399 23728 ts_tablet_manager.cc:1403] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.062s	user 0.011s	sys 0.000s
I20260709 13:09:13.831395 23915 raft_consensus.cc:515] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.856555 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05850e9b37994edb9bcd786b1bdbaccc" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:13.857419 23534 raft_consensus.cc:3060] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.874781 23534 raft_consensus.cc:2468] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:13.878345 23728 raft_consensus.cc:359] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.883677 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05850e9b37994edb9bcd786b1bdbaccc" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:13.880816 23577 leader_election.cc:304] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:13.887380 23804 raft_consensus.cc:2804] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:13.888131 23804 raft_consensus.cc:697] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:13.891474 23804 consensus_queue.cc:237] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.894846 23684 raft_consensus.cc:3060] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.879118 23915 leader_election.cc:290] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:13.910389 23728 raft_consensus.cc:385] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.911921 23728 raft_consensus.cc:740] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.913836 23728 consensus_queue.cc:260] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.916074 23729 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:13.921605 23729 ts_tablet_manager.cc:1403] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.141s	user 0.026s	sys 0.018s
W20260709 13:09:13.918483 23501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 75211.7us
I20260709 13:09:13.925887 23729 raft_consensus.cc:359] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.929446 23729 raft_consensus.cc:385] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.929944 23729 raft_consensus.cc:740] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.928586 23728 ts_tablet_manager.cc:1434] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.002s
I20260709 13:09:13.931655 23729 consensus_queue.cc:260] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:13.932512 23728 tablet_bootstrap.cc:492] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:13.933496 23607 raft_consensus.cc:3060] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:13.933847 23729 ts_tablet_manager.cc:1434] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:13.934794 23729 tablet_bootstrap.cc:492] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:13.940562 23729 tablet_bootstrap.cc:654] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.943892 23728 tablet_bootstrap.cc:654] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:13.956357 23359 catalog_manager.cc:5697] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.955114 23356 catalog_manager.cc:5697] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:13.917865 23731 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:13.967597 23731 ts_tablet_manager.cc:1403] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.153s	user 0.012s	sys 0.000s
I20260709 13:09:13.970315 23731 raft_consensus.cc:359] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.971725 23684 raft_consensus.cc:2468] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:13.975574 23728 tablet_bootstrap.cc:492] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:13.976213 23728 ts_tablet_manager.cc:1403] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.004s
I20260709 13:09:13.978097 23890 consensus_queue.cc:1048] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:13.979557 23728 raft_consensus.cc:359] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.980428 23728 raft_consensus.cc:385] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:13.980789 23728 raft_consensus.cc:740] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:13.983171 23728 consensus_queue.cc:260] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:13.991766 23728 ts_tablet_manager.cc:1434] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:09:13.993232 23728 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:14.008783 23728 tablet_bootstrap.cc:654] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.008994 23890 raft_consensus.cc:493] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.009740 23890 raft_consensus.cc:515] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:13.998873 23947 raft_consensus.cc:515] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.024055 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fed89fed14448fa25983c72e7f1e64" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:14.024286 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69fed89fed14448fa25983c72e7f1e64" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:14.024739 23607 raft_consensus.cc:3060] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.024931 23462 raft_consensus.cc:3060] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.026789 23727 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:13.971035 23731 raft_consensus.cc:385] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.027308 23727 ts_tablet_manager.cc:1403] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.215s	user 0.055s	sys 0.082s
I20260709 13:09:14.027566 23731 raft_consensus.cc:740] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.030526 23731 consensus_queue.cc:260] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.036366 23727 raft_consensus.cc:359] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.037123 23727 raft_consensus.cc:385] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.037389 23727 raft_consensus.cc:740] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.042016 23890 leader_election.cc:290] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.044162 23727 consensus_queue.cc:260] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.049453 23727 ts_tablet_manager.cc:1434] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:14.056375 23731 ts_tablet_manager.cc:1434] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.088s	user 0.006s	sys 0.000s
I20260709 13:09:14.056453 23727 tablet_bootstrap.cc:492] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:14.057463 23731 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:14.049142 23947 leader_election.cc:290] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.069736 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd51d50e9f64154965524bf64801024" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.077147 23607 raft_consensus.cc:2468] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:14.081818 23501 leader_election.cc:304] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:14.083388 23947 raft_consensus.cc:2804] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.084133 23947 raft_consensus.cc:697] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:14.091096 23728 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:14.090858 23947 consensus_queue.cc:237] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.091849 23728 ts_tablet_manager.cc:1403] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.099s	user 0.028s	sys 0.016s
I20260709 13:09:14.094205 24006 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.094930 24006 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.097456 24006 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:14.098742 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:14.101078 23729 tablet_bootstrap.cc:492] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:14.101073 23728 raft_consensus.cc:359] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.101824 23729 ts_tablet_manager.cc:1403] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.167s	user 0.025s	sys 0.049s
I20260709 13:09:14.101960 23728 raft_consensus.cc:385] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.102313 23728 raft_consensus.cc:740] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.103065 23728 consensus_queue.cc:260] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.104802 23729 raft_consensus.cc:359] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.105629 23729 raft_consensus.cc:385] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.105950 23728 ts_tablet_manager.cc:1434] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:09:14.106012 23729 raft_consensus.cc:740] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.108165 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd51d50e9f64154965524bf64801024" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:14.108852 23457 raft_consensus.cc:2468] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:14.107370 23728 tablet_bootstrap.cc:492] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:14.110675 23729 consensus_queue.cc:260] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.112991 23729 ts_tablet_manager.cc:1434] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:14.113853 23729 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:14.121989 23729 tablet_bootstrap.cc:654] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.124461 23462 raft_consensus.cc:2468] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:14.127794 23731 tablet_bootstrap.cc:654] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.128623 23650 leader_election.cc:304] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:14.129606 23964 raft_consensus.cc:2804] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.131431 23964 raft_consensus.cc:493] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.131769 23964 raft_consensus.cc:3060] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.134204 23359 catalog_manager.cc:5697] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.136147 24014 consensus_queue.cc:1048] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.143849 24015 consensus_queue.cc:1048] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.144227 23731 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:14.144747 23731 ts_tablet_manager.cc:1403] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.009s
I20260709 13:09:14.145176 23947 raft_consensus.cc:493] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.145689 23947 raft_consensus.cc:515] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.147686 23947 leader_election.cc:290] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:14.147513 23731 raft_consensus.cc:359] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.148211 23731 raft_consensus.cc:385] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.148504 23731 raft_consensus.cc:740] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.148850 23727 tablet_bootstrap.cc:654] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.152415 23947 raft_consensus.cc:493] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.155726 23731 consensus_queue.cc:260] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.158620 23731 ts_tablet_manager.cc:1434] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:14.159744 23731 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:14.160059 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:14.160862 23684 raft_consensus.cc:2393] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:14.162576 23830 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.163058 23830 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.163964 23728 tablet_bootstrap.cc:654] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.165187 23830 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:14.166106 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b8a011953547178d6c255a7b9a072f" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.166427 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:14.166795 23607 raft_consensus.cc:2468] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:14.155211 23947 raft_consensus.cc:515] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.167879 23501 leader_election.cc:304] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:14.168991 24006 raft_consensus.cc:2804] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.169456 24006 raft_consensus.cc:493] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.169813 24006 raft_consensus.cc:3060] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:14.171581 23650 leader_election.cc:343] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.173560 23947 leader_election.cc:290] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.178141 24014 raft_consensus.cc:493] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.183120 23979 raft_consensus.cc:493] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.178648 24014 raft_consensus.cc:515] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.189568 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:14.189893 24014 leader_election.cc:290] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.184069 23979 raft_consensus.cc:515] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.190529 23459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa3243f757c4f6dac4677c739e8f145" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:14.191188 23459 raft_consensus.cc:2468] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:14.191901 23979 leader_election.cc:290] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.192512 23650 leader_election.cc:304] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:14.193262 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.194262 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.194370 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.194427 23460 raft_consensus.cc:2468] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:14.195097 23537 raft_consensus.cc:2468] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
W20260709 13:09:14.195662 23426 leader_election.cc:343] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.196408 24014 raft_consensus.cc:2804] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.196794 24014 raft_consensus.cc:493] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.206727 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b8a011953547178d6c255a7b9a072f" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:14.208441 24014 raft_consensus.cc:3060] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.208623 23684 raft_consensus.cc:2468] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:14.200659 23428 leader_election.cc:304] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.198611 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:14.204197 23501 leader_election.cc:343] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.211308 23915 consensus_queue.cc:1048] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:14.215394 23729 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:14.215816 23729 ts_tablet_manager.cc:1403] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.102s	user 0.005s	sys 0.023s
W20260709 13:09:14.216869 23649 leader_election.cc:343] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.217348 23649 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.218703 23830 raft_consensus.cc:2749] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:14.212812 23651 leader_election.cc:343] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.221750 23830 consensus_queue.cc:1048] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.223052 23828 raft_consensus.cc:2804] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.223515 23828 raft_consensus.cc:493] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.224296 23828 raft_consensus.cc:3060] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.225340 23501 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:14.225766 23731 tablet_bootstrap.cc:654] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.226266 23947 raft_consensus.cc:3060] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.226574 23915 consensus_queue.cc:1048] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.223497 23502 leader_election.cc:304] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.231858 23875 raft_consensus.cc:2804] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.232244 23875 raft_consensus.cc:493] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.232573 23875 raft_consensus.cc:3060] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.235082 23947 raft_consensus.cc:2749] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.236490 23828 raft_consensus.cc:515] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.239399 23875 raft_consensus.cc:515] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.210810 23964 raft_consensus.cc:515] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.276623 23728 tablet_bootstrap.cc:492] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:14.277102 23964 leader_election.cc:290] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.277191 23728 ts_tablet_manager.cc:1403] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.170s	user 0.005s	sys 0.018s
I20260709 13:09:14.278283 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa3243f757c4f6dac4677c739e8f145" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.278973 23828 leader_election.cc:290] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.283171 23890 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.283723 23890 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.285742 23890 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.286702 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:14.287474 23534 raft_consensus.cc:2393] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0851261b6d4832b826564f378ba69d in current term 1: Already voted for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in this term.
I20260709 13:09:14.298957 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:14.299549 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd51d50e9f64154965524bf64801024" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:14.300381 23458 raft_consensus.cc:3060] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.300738 23875 leader_election.cc:290] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.301577 23731 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:14.302063 23731 ts_tablet_manager.cc:1403] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.007s
I20260709 13:09:14.302742 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:14.303570 23457 raft_consensus.cc:2393] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:14.304692 23731 raft_consensus.cc:359] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.305383 23731 raft_consensus.cc:385] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.305665 23731 raft_consensus.cc:740] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.306324 23731 consensus_queue.cc:260] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.308550 23731 ts_tablet_manager.cc:1434] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:14.309497 23731 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:14.311563 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:14.314087 23649 leader_election.cc:343] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.316932 23728 raft_consensus.cc:359] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.317639 23728 raft_consensus.cc:385] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.317906 23728 raft_consensus.cc:740] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.318531 23728 consensus_queue.cc:260] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.319772 23729 raft_consensus.cc:359] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.320825 23729 raft_consensus.cc:385] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:14.322151 23426 leader_election.cc:343] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.323489 23729 raft_consensus.cc:740] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.323684 23426 leader_election.cc:304] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.324543 23728 ts_tablet_manager.cc:1434] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.047s	user 0.004s	sys 0.002s
I20260709 13:09:14.325148 23979 raft_consensus.cc:2749] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.325450 23728 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:14.324170 23729 consensus_queue.cc:260] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.330170 23731 tablet_bootstrap.cc:654] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.313169 23458 raft_consensus.cc:2468] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:14.336856 23729 ts_tablet_manager.cc:1434] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.000s
I20260709 13:09:14.338197 23729 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:14.341557 23727 tablet_bootstrap.cc:492] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:14.342025 23727 ts_tablet_manager.cc:1403] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.286s	user 0.022s	sys 0.002s
I20260709 13:09:14.321269 24006 raft_consensus.cc:515] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.346239 23650 leader_election.cc:304] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:14.348555 24027 raft_consensus.cc:2804] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.349033 24027 raft_consensus.cc:697] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
W20260709 13:09:14.356958 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:14.359344 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd51d50e9f64154965524bf64801024" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:14.360229 24027 consensus_queue.cc:237] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.364051 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.364375 23729 tablet_bootstrap.cc:654] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.369820 23727 raft_consensus.cc:359] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.370566 23727 raft_consensus.cc:385] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.370836 23727 raft_consensus.cc:740] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.371495 23727 consensus_queue.cc:260] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.372969 23727 ts_tablet_manager.cc:1434] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:09:14.373878 23727 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:14.381292 23728 tablet_bootstrap.cc:654] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.380803 23828 consensus_queue.cc:1048] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.374953 23610 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:14.404961 24006 leader_election.cc:290] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
W20260709 13:09:14.410542 23651 leader_election.cc:343] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:14.411566 23651 leader_election.cc:343] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.402251 23610 raft_consensus.cc:3060] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:14.413067 23651 leader_election.cc:343] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.413515 23651 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.414264 24027 raft_consensus.cc:2749] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.415024 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b8a011953547178d6c255a7b9a072f" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:14.415972 23828 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.417320 23828 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.419360 23828 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:14.422175 23608 raft_consensus.cc:3060] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.433596 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:14.434520 23683 raft_consensus.cc:2468] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:14.435745 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b8a011953547178d6c255a7b9a072f" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:14.436393 23685 raft_consensus.cc:3060] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.437361 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.401731 24014 raft_consensus.cc:515] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.441291 24014 leader_election.cc:290] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.443393 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa3243f757c4f6dac4677c739e8f145" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:14.443554 23685 raft_consensus.cc:2468] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:14.444108 23460 raft_consensus.cc:3060] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.439611 23426 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:14.457641 23828 raft_consensus.cc:2804] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:14.457844 23426 leader_election.cc:343] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.458069 23828 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.461474 23727 tablet_bootstrap.cc:654] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.458449 23828 raft_consensus.cc:3060] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.467585 23804 consensus_queue.cc:1048] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.467955 23356 catalog_manager.cc:5697] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:14.472548 23460 raft_consensus.cc:2468] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:14.473879 23650 leader_election.cc:304] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:14.474923 24014 raft_consensus.cc:2804] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.475612 24014 raft_consensus.cc:697] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:14.476480 24014 consensus_queue.cc:237] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.478072 23979 consensus_queue.cc:1048] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.484390 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa3243f757c4f6dac4677c739e8f145" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:14.485682 24006 consensus_queue.cc:1048] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:14.491282 24031 log.cc:927] Time spent T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:09:14.493862 23501 leader_election.cc:304] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:14.495496 24006 raft_consensus.cc:2804] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.498242 24006 raft_consensus.cc:697] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:14.499104 24006 consensus_queue.cc:237] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.524107 23608 raft_consensus.cc:2468] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:14.503368 23828 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.520503 23728 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:14.528695 23728 ts_tablet_manager.cc:1403] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.203s	user 0.027s	sys 0.015s
I20260709 13:09:14.529121 23828 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:14.531826 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:14.531978 23728 raft_consensus.cc:359] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.539808 23728 raft_consensus.cc:385] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.540179 23728 raft_consensus.cc:740] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
W20260709 13:09:14.540769 23426 leader_election.cc:343] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.541007 23728 consensus_queue.cc:260] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.533080 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:14.543746 23684 raft_consensus.cc:3060] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:14.523627 23651 leader_election.cc:343] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.536365 23731 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:14.548434 23731 ts_tablet_manager.cc:1403] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.239s	user 0.021s	sys 0.019s
I20260709 13:09:14.536885 23729 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:14.549364 23729 ts_tablet_manager.cc:1403] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.034s
I20260709 13:09:14.554204 23729 raft_consensus.cc:359] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.555589 23729 raft_consensus.cc:385] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.555855 23729 raft_consensus.cc:740] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.556666 23729 consensus_queue.cc:260] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.559240 23729 ts_tablet_manager.cc:1434] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:14.565528 23729 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:14.569708 23915 consensus_queue.cc:1048] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:14.571782 23728 ts_tablet_manager.cc:1434] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.001s
I20260709 13:09:14.572817 23728 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:14.557435 23731 raft_consensus.cc:359] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.580585 23731 raft_consensus.cc:385] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.580893 23731 raft_consensus.cc:740] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.581557 23731 consensus_queue.cc:260] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.583385 23610 raft_consensus.cc:2468] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:14.584648 23501 leader_election.cc:304] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:14.585690 24006 raft_consensus.cc:2804] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.585927 23684 raft_consensus.cc:2468] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:14.587110 23426 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.588165 23979 raft_consensus.cc:2804] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:14.588656 23979 raft_consensus.cc:697] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:14.589087 24006 raft_consensus.cc:697] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:14.589486 23979 consensus_queue.cc:237] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.590004 24006 consensus_queue.cc:237] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.594501 23731 ts_tablet_manager.cc:1434] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 13:09:14.595594 23731 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:14.600735 24029 consensus_queue.cc:1048] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.602449 23828 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.603022 23828 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.606992 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.619434 23915 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.633566 23915 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.634651 23607 raft_consensus.cc:2468] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:14.636678 23915 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.632108 23729 tablet_bootstrap.cc:654] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.640668 23727 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:14.641305 23727 ts_tablet_manager.cc:1403] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.268s	user 0.013s	sys 0.004s
I20260709 13:09:14.609256 23828 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.650080 23728 tablet_bootstrap.cc:654] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.644317 23359 catalog_manager.cc:5697] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:14.649816 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.679625 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:14.680414 23458 raft_consensus.cc:2468] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:14.669407 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.686785 23426 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:14.688722 23902 raft_consensus.cc:2804] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.689107 23902 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.689432 23902 raft_consensus.cc:3060] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.692171 23576 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:14.693439 23804 raft_consensus.cc:2804] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:14.693801 23804 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.694129 23804 raft_consensus.cc:3060] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.726835 23804 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.730320 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:14.731993 23804 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.734316 23964 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.735078 23964 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.738121 24014 raft_consensus.cc:493] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.738811 24014 raft_consensus.cc:515] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.741530 24014 leader_election.cc:290] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.743611 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccefc8653d6d40a98aa795e53e75e1e7" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.743775 23964 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:14.750097 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
W20260709 13:09:14.750628 23649 leader_election.cc:343] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.745878 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccefc8653d6d40a98aa795e53e75e1e7" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:14.746387 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:14.758332 23651 leader_election.cc:343] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.759171 23651 leader_election.cc:304] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:14.760164 23964 raft_consensus.cc:2749] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:14.760592 23651 leader_election.cc:343] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.773226 23357 catalog_manager.cc:5697] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:14.782286 23428 leader_election.cc:343] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.790627 23731 tablet_bootstrap.cc:654] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.806720 24029 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:14.844476 24029 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.846001 23902 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.846763 24029 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:14.848446 23902 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:14.848701 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:14.860428 23684 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:14.849116 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:14.861666 23501 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:14.862540 24029 raft_consensus.cc:2804] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:09:14.862713 23501 leader_election.cc:343] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.862993 24029 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:14.863456 24029 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.856560 23729 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:14.865007 23729 ts_tablet_manager.cc:1403] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.300s	user 0.019s	sys 0.021s
I20260709 13:09:14.856930 23728 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:14.859316 23727 raft_consensus.cc:359] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.866905 23727 raft_consensus.cc:385] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.867528 23727 raft_consensus.cc:740] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.868314 23727 consensus_queue.cc:260] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:14.866915 23728 ts_tablet_manager.cc:1403] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.294s	user 0.030s	sys 0.027s
I20260709 13:09:14.869431 23458 raft_consensus.cc:2393] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:14.870609 23729 raft_consensus.cc:359] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.871268 23729 raft_consensus.cc:385] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.871563 23729 raft_consensus.cc:740] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.871611 23728 raft_consensus.cc:359] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.872311 23728 raft_consensus.cc:385] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.872735 23728 raft_consensus.cc:740] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.872282 23729 consensus_queue.cc:260] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.874117 24029 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:14.874688 23729 ts_tablet_manager.cc:1434] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:14.874953 23728 consensus_queue.cc:260] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:14.874688 23727 ts_tablet_manager.cc:1434] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.233s	user 0.007s	sys 0.000s
I20260709 13:09:14.876364 23729 tablet_bootstrap.cc:492] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:14.877290 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:14.877475 23728 ts_tablet_manager.cc:1434] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:14.878466 23728 tablet_bootstrap.cc:492] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
W20260709 13:09:14.878716 23501 leader_election.cc:343] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:14.878587 23576 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:14.880398 23749 raft_consensus.cc:2749] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:14.884302 23729 tablet_bootstrap.cc:654] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:14.893260 23533 raft_consensus.cc:3060] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.895764 24029 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:14.898083 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:14.898886 23684 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:14.937968 24025 consensus_queue.cc:1048] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:14.945515 23731 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:14.946237 23731 ts_tablet_manager.cc:1403] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.351s	user 0.011s	sys 0.000s
I20260709 13:09:14.949841 23731 raft_consensus.cc:359] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:14.950742 23731 raft_consensus.cc:385] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:14.951051 23731 raft_consensus.cc:740] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:14.951830 23731 consensus_queue.cc:260] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:15.004343 23651 consensus_peers.cc:597] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:15.014374 23731 ts_tablet_manager.cc:1434] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.004s
I20260709 13:09:15.028159 23684 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:15.031545 23501 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:15.032783 24029 raft_consensus.cc:2804] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.033268 24029 raft_consensus.cc:697] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:15.034479 23728 tablet_bootstrap.cc:654] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.034089 24029 consensus_queue.cc:237] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.049120 23915 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.049803 23915 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.055255 24006 consensus_queue.cc:1048] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.059367 23915 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:15.061991 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:15.064505 23683 raft_consensus.cc:2393] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:15.075601 24029 consensus_queue.cc:1048] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.099617 23728 tablet_bootstrap.cc:492] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:15.100411 23728 ts_tablet_manager.cc:1403] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.222s	user 0.012s	sys 0.000s
I20260709 13:09:15.104221 23728 raft_consensus.cc:359] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.109591 23728 raft_consensus.cc:385] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.110576 23728 raft_consensus.cc:740] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.120007 23875 consensus_queue.cc:1048] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.134151 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:15.138386 23576 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:15.140017 23804 raft_consensus.cc:3060] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.157968 23731 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:15.150224 23728 consensus_queue.cc:260] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.157315 23890 raft_consensus.cc:493] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.183326 23890 raft_consensus.cc:515] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.187083 23804 raft_consensus.cc:2749] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.188045 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecd26fe571241608c608c52c4e6e4b1" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:15.192996 23890 leader_election.cc:290] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
W20260709 13:09:15.197300 23649 leader_election.cc:343] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.198320 23728 ts_tablet_manager.cc:1434] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.097s	user 0.008s	sys 0.000s
I20260709 13:09:15.204015 23729 tablet_bootstrap.cc:492] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:15.204716 23729 ts_tablet_manager.cc:1403] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.329s	user 0.034s	sys 0.100s
I20260709 13:09:15.207516 23731 tablet_bootstrap.cc:654] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:15.294153 23426 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.015s	sys 0.007s
I20260709 13:09:15.318326 23728 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
W20260709 13:09:15.362495 23426 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.017s	sys 0.008s
I20260709 13:09:15.328994 23727 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
W20260709 13:09:15.331492 23425 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.018s
I20260709 13:09:15.336103 23890 raft_consensus.cc:493] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.355208 23731 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:15.322136 23729 raft_consensus.cc:359] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.365608 23729 raft_consensus.cc:385] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.366869 23729 raft_consensus.cc:740] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
W20260709 13:09:15.365749 23425 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.008s	sys 0.021s
I20260709 13:09:15.377295 23890 raft_consensus.cc:515] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.380002 23731 ts_tablet_manager.cc:1403] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.222s	user 0.014s	sys 0.003s
I20260709 13:09:15.385303 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:15.397567 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:15.366777 23426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:44569, user_credentials={real_user=slave}} blocked reactor thread for 661965us
W20260709 13:09:15.399840 23649 leader_election.cc:343] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.399482 23729 consensus_queue.cc:260] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.402225 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:15.403223 23607 raft_consensus.cc:2393] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f0851261b6d4832b826564f378ba69d in current term 1: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
I20260709 13:09:15.387602 23890 leader_election.cc:290] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:15.407052 23729 ts_tablet_manager.cc:1434] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.202s	user 0.008s	sys 0.006s
I20260709 13:09:15.422012 23731 raft_consensus.cc:359] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.426216 23731 raft_consensus.cc:385] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.426491 23731 raft_consensus.cc:740] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.464526 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecd26fe571241608c608c52c4e6e4b1" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:15.488626 23727 tablet_bootstrap.cc:654] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.529659 23728 tablet_bootstrap.cc:654] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.535665 24052 consensus_queue.cc:1048] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.536991 23729 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:15.539523 23731 consensus_queue.cc:260] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.540576 23462 raft_consensus.cc:2468] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:15.553226 23979 consensus_queue.cc:1048] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.553828 23731 ts_tablet_manager.cc:1434] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.173s	user 0.009s	sys 0.001s
W20260709 13:09:15.557037 23502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:45163, user_credentials={real_user=slave}} blocked reactor thread for 45618.9us
I20260709 13:09:15.559883 23731 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:15.581606 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:15.589059 23357 catalog_manager.cc:5697] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } }
I20260709 13:09:15.592095 23357 catalog_manager.cc:5697] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } }
I20260709 13:09:15.617300 24030 consensus_queue.cc:1048] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:09:15.617939 23428 leader_election.cc:343] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.618546 23428 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:15.619622 23979 raft_consensus.cc:2749] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.669543 23731 tablet_bootstrap.cc:654] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:15.673924 23501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 78112.6us
I20260709 13:09:15.682675 23731 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:15.683393 23731 ts_tablet_manager.cc:1403] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.008s
I20260709 13:09:15.686654 23731 raft_consensus.cc:359] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:15.687525 23731 raft_consensus.cc:385] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.687893 23731 raft_consensus.cc:740] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.688820 23731 consensus_queue.cc:260] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
W20260709 13:09:15.692126 23650 leader_election.cc:343] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.692734 23650 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
W20260709 13:09:15.696631 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:15.702116 23606 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.715615 23890 raft_consensus.cc:2749] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.716146 24014 consensus_queue.cc:1048] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.718261 24015 consensus_queue.cc:1048] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.730742 23650 leader_election.cc:304] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:15.738159 24071 raft_consensus.cc:2804] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.738663 24071 raft_consensus.cc:493] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.739027 24071 raft_consensus.cc:3060] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.739069 23749 raft_consensus.cc:493] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:15.739876 23749 raft_consensus.cc:515] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:15.742605 23749 leader_election.cc:290] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:15.745122 23729 tablet_bootstrap.cc:654] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.747944 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:15.757484 23728 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:15.780375 23728 ts_tablet_manager.cc:1403] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.463s	user 0.020s	sys 0.000s
I20260709 13:09:15.757560 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:15.755033 23727 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:15.785346 23727 ts_tablet_manager.cc:1403] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.457s	user 0.013s	sys 0.007s
I20260709 13:09:15.791986 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:15.792968 23728 raft_consensus.cc:359] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.793903 23728 raft_consensus.cc:385] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.794303 23728 raft_consensus.cc:740] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.795315 23728 consensus_queue.cc:260] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.797089 23979 raft_consensus.cc:493] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.797694 23979 raft_consensus.cc:515] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:15.801514 23727 raft_consensus.cc:359] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:15.802294 23727 raft_consensus.cc:385] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.802585 23727 raft_consensus.cc:740] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.695119 23731 ts_tablet_manager.cc:1434] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:15.803232 23728 ts_tablet_manager.cc:1434] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 13:09:15.803875 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b49ed532684aa3ae75017b8afe8475" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:15.804546 23731 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:15.805097 23728 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:15.806763 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b49ed532684aa3ae75017b8afe8475" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:15.808909 23428 leader_election.cc:343] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:15.809751 23426 leader_election.cc:343] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.810285 23426 leader_election.cc:304] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:15.811304 24053 raft_consensus.cc:2749] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.812862 23979 leader_election.cc:290] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
W20260709 13:09:15.824361 23577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 72327.9us
I20260709 13:09:15.827224 23577 leader_election.cc:304] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:15.803329 23727 consensus_queue.cc:260] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:15.828419 23875 raft_consensus.cc:493] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.828918 23875 raft_consensus.cc:515] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:15.833510 23727 ts_tablet_manager.cc:1434] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 13:09:15.833343 24073 raft_consensus.cc:2749] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:15.838559 24006 consensus_queue.cc:1048] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:15.843010 23804 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.844197 23727 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:15.843847 23804 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:15.847373 23804 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:15.850306 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa3243f757c4f6dac4677c739e8f145" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:15.849089 23729 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:15.853617 23729 ts_tablet_manager.cc:1403] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.317s	user 0.017s	sys 0.001s
I20260709 13:09:15.855043 24071 raft_consensus.cc:515] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.857664 23875 leader_election.cc:290] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:15.862412 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:15.858343 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecd26fe571241608c608c52c4e6e4b1" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:15.862275 23731 tablet_bootstrap.cc:654] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.873217 24071 leader_election.cc:290] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:15.898254 23727 tablet_bootstrap.cc:654] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.875136 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cecd26fe571241608c608c52c4e6e4b1" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:15.899008 24015 raft_consensus.cc:493] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:15.917274 24015 raft_consensus.cc:515] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.919507 24015 leader_election.cc:290] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:15.920163 23457 raft_consensus.cc:3060] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.920290 23606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925234f9de154af68ec326257968572d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:15.921785 23649 leader_election.cc:343] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.887637 23729 raft_consensus.cc:359] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.904433 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:15.926036 23681 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:15.927155 23729 raft_consensus.cc:385] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.927680 23729 raft_consensus.cc:740] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.928659 23729 consensus_queue.cc:260] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.905087 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "baa3243f757c4f6dac4677c739e8f145" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:15.932898 23457 raft_consensus.cc:2468] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:15.933673 23729 ts_tablet_manager.cc:1434] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.080s	user 0.000s	sys 0.012s
I20260709 13:09:15.934904 23650 leader_election.cc:304] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:15.935974 24015 raft_consensus.cc:2804] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:15.936600 24015 raft_consensus.cc:697] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:15.937841 24015 consensus_queue.cc:237] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.938750 23609 raft_consensus.cc:3060] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.943495 23729 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:15.942816 23731 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:15.944689 23731 ts_tablet_manager.cc:1403] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.140s	user 0.016s	sys 0.000s
W20260709 13:09:15.909029 23501 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 65985.1us
I20260709 13:09:15.876729 23728 tablet_bootstrap.cc:654] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.948875 23731 raft_consensus.cc:359] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.950305 23731 raft_consensus.cc:385] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.931543 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925234f9de154af68ec326257968572d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:15.950635 23731 raft_consensus.cc:740] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.950867 23875 consensus_queue.cc:1048] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:15.951529 23731 consensus_queue.cc:260] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:15.952440 23462 raft_consensus.cc:2468] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
W20260709 13:09:15.904963 23651 leader_election.cc:343] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:15.954350 23651 leader_election.cc:304] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
W20260709 13:09:15.955214 23651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 50398.2us
I20260709 13:09:15.955952 24015 raft_consensus.cc:2749] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:15.960422 23728 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:15.960557 23650 leader_election.cc:304] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:15.960947 23728 ts_tablet_manager.cc:1403] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.156s	user 0.025s	sys 0.009s
I20260709 13:09:15.961927 24071 raft_consensus.cc:2804] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:15.962339 24071 raft_consensus.cc:493] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:15.962680 24071 raft_consensus.cc:3060] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.964840 23727 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:15.965364 23727 ts_tablet_manager.cc:1403] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.005s
I20260709 13:09:15.968694 23727 raft_consensus.cc:359] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:15.969285 23535 raft_consensus.cc:3060] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:15.969386 23727 raft_consensus.cc:385] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.970192 23728 raft_consensus.cc:359] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:15.970983 23729 tablet_bootstrap.cc:654] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:15.971114 23728 raft_consensus.cc:385] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:15.971509 23728 raft_consensus.cc:740] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.970394 23727 raft_consensus.cc:740] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:15.975492 23727 consensus_queue.cc:260] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:15.976464 23728 consensus_queue.cc:260] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:15.981434 23728 ts_tablet_manager.cc:1434] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.003s
I20260709 13:09:15.981470 23360 catalog_manager.cc:5697] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:15.983088 23728 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:15.986284 23727 ts_tablet_manager.cc:1434] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:09:15.989055 23727 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:15.990314 23731 ts_tablet_manager.cc:1434] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.000s
I20260709 13:09:16.002946 23731 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:16.004437 23651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 44483.9us
I20260709 13:09:16.015388 23729 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:16.016007 23729 ts_tablet_manager.cc:1403] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.073s	user 0.039s	sys 0.008s
I20260709 13:09:16.017112 23727 tablet_bootstrap.cc:654] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.017434 23575 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:16.018666 23804 raft_consensus.cc:2804] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:16.019062 23804 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a59e1270baa49b1b1c6ca3b1a4c3146)
I20260709 13:09:16.019569 23804 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.019110 23729 raft_consensus.cc:359] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.020018 23729 raft_consensus.cc:385] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.020279 23729 raft_consensus.cc:740] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.020577 23728 tablet_bootstrap.cc:654] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.021059 23729 consensus_queue.cc:260] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.025478 23729 ts_tablet_manager.cc:1434] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:16.026789 23729 tablet_bootstrap.cc:492] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:16.030660 23804 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.034099 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:16.035373 24071 raft_consensus.cc:515] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.034372 23804 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.039986 23609 raft_consensus.cc:2468] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:16.041952 23729 tablet_bootstrap.cc:654] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.043056 23727 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.047628 23727 ts_tablet_manager.cc:1403] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.007s
I20260709 13:09:16.049122 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925234f9de154af68ec326257968572d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:16.049853 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:16.050027 23462 raft_consensus.cc:3060] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.057410 23501 leader_election.cc:304] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:16.057878 23728 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:16.044224 24071 leader_election.cc:290] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:16.045256 23606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925234f9de154af68ec326257968572d" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:16.058594 23875 raft_consensus.cc:2749] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.058521 23575 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:16.059517 23731 tablet_bootstrap.cc:654] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:16.059894 23649 leader_election.cc:343] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.064253 23804 raft_consensus.cc:2749] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:16.064349 24053 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.065037 24053 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.067744 23727 raft_consensus.cc:359] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.068733 23727 raft_consensus.cc:385] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.057487 23360 catalog_manager.cc:5697] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.069024 23727 raft_consensus.cc:740] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.080228 23727 consensus_queue.cc:260] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.083127 23727 ts_tablet_manager.cc:1434] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 13:09:16.072515 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:16.084968 23428 leader_election.cc:343] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.073030 24053 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.069255 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.086369 23682 raft_consensus.cc:2468] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:16.088822 23426 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:16.089828 23462 raft_consensus.cc:2468] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:16.091091 23650 leader_election.cc:304] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.091588 24053 raft_consensus.cc:2804] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.092126 24053 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.092559 24053 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.094729 23964 raft_consensus.cc:2804] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.095328 23964 raft_consensus.cc:697] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:16.096379 23964 consensus_queue.cc:237] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.090066 23727 tablet_bootstrap.cc:492] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.117674 23731 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:16.118249 23731 ts_tablet_manager.cc:1403] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.116s	user 0.017s	sys 0.003s
I20260709 13:09:16.058554 23728 ts_tablet_manager.cc:1403] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.003s
I20260709 13:09:16.129961 23609 raft_consensus.cc:1240] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Rejecting Update request from peer 7a59e1270baa49b1b1c6ca3b1a4c3146 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:16.135243 23728 raft_consensus.cc:359] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.136081 23728 raft_consensus.cc:385] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.136335 23728 raft_consensus.cc:740] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.136732 23875 consensus_queue.cc:1059] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.136976 23728 consensus_queue.cc:260] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.137550 23875 raft_consensus.cc:3055] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:16.137902 23875 raft_consensus.cc:740] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:16.138782 23875 consensus_queue.cc:260] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.152443 23875 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.159811 23727 tablet_bootstrap.cc:654] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.165831 24025 raft_consensus.cc:493] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.166356 24025 raft_consensus.cc:515] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.168800 23731 raft_consensus.cc:359] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.169487 23731 raft_consensus.cc:385] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.169770 23731 raft_consensus.cc:740] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.170843 24025 leader_election.cc:290] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.170547 23731 consensus_queue.cc:260] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.173099 23731 ts_tablet_manager.cc:1434] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:09:16.174335 23731 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:16.174419 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785fa69f121467b8d300a0bb3cbc644" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.175099 23462 raft_consensus.cc:2468] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:16.178601 23728 ts_tablet_manager.cc:1434] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.000s
I20260709 13:09:16.179845 23728 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:16.180980 23650 leader_election.cc:304] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:16.189038 23731 tablet_bootstrap.cc:654] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.189364 23964 raft_consensus.cc:2804] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.189822 23964 raft_consensus.cc:493] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.190153 23964 raft_consensus.cc:3060] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.193698 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785fa69f121467b8d300a0bb3cbc644" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:16.195393 23651 leader_election.cc:343] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.196614 23729 tablet_bootstrap.cc:492] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:16.197108 23729 ts_tablet_manager.cc:1403] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.171s	user 0.051s	sys 0.039s
I20260709 13:09:16.197793 24053 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.204258 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:16.204931 23682 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.208994 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
W20260709 13:09:16.210662 23428 leader_election.cc:343] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.210516 23729 raft_consensus.cc:359] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.211285 23729 raft_consensus.cc:385] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.211565 23727 tablet_bootstrap.cc:492] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.212050 23727 ts_tablet_manager.cc:1403] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.122s	user 0.011s	sys 0.003s
I20260709 13:09:16.213289 24053 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.214315 23728 tablet_bootstrap.cc:654] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.214664 23727 raft_consensus.cc:359] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.215373 23727 raft_consensus.cc:385] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.216204 23727 raft_consensus.cc:740] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.216962 23727 consensus_queue.cc:260] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.218581 23359 catalog_manager.cc:5697] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.226392 23964 raft_consensus.cc:515] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.229854 23727 ts_tablet_manager.cc:1434] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 13:09:16.211591 23729 raft_consensus.cc:740] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.233476 23727 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.235759 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785fa69f121467b8d300a0bb3cbc644" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:16.235757 23729 consensus_queue.cc:260] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.236533 23462 raft_consensus.cc:3060] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.236868 23964 leader_election.cc:290] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.237476 23682 raft_consensus.cc:2468] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:16.238739 23426 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:16.240342 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785fa69f121467b8d300a0bb3cbc644" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:16.241559 24053 raft_consensus.cc:2804] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.242302 24053 raft_consensus.cc:697] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:16.243137 24053 consensus_queue.cc:237] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
W20260709 13:09:16.244814 23651 leader_election.cc:343] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.263314 23462 raft_consensus.cc:2468] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:16.264539 23650 leader_election.cc:304] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:16.265283 24025 raft_consensus.cc:2804] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.265764 24025 raft_consensus.cc:697] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:16.266590 24025 consensus_queue.cc:237] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.245421 23731 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:16.268455 23731 ts_tablet_manager.cc:1403] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.004s
I20260709 13:09:16.269752 23727 tablet_bootstrap.cc:654] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.253412 23729 ts_tablet_manager.cc:1434] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.056s	user 0.009s	sys 0.000s
I20260709 13:09:16.273886 23729 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:16.286325 23731 raft_consensus.cc:359] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.287053 23731 raft_consensus.cc:385] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.287317 23731 raft_consensus.cc:740] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.288112 23731 consensus_queue.cc:260] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.292342 23731 ts_tablet_manager.cc:1434] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 13:09:16.296283 23727 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.296798 23727 ts_tablet_manager.cc:1403] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.005s
I20260709 13:09:16.293484 23731 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:16.299842 23727 raft_consensus.cc:359] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.300526 23727 raft_consensus.cc:385] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.300812 23727 raft_consensus.cc:740] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.302284 23359 catalog_manager.cc:5697] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.304787 23729 tablet_bootstrap.cc:654] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.301540 23727 consensus_queue.cc:260] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.308969 23731 tablet_bootstrap.cc:654] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.311623 24073 raft_consensus.cc:493] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.312258 23727 ts_tablet_manager.cc:1434] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:09:16.312103 24073 raft_consensus.cc:515] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.313364 23727 tablet_bootstrap.cc:492] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.314220 24073 leader_election.cc:290] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.315793 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccefc8653d6d40a98aa795e53e75e1e7" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.316500 23682 raft_consensus.cc:2468] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:16.316807 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccefc8653d6d40a98aa795e53e75e1e7" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:16.318181 23575 leader_election.cc:304] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
W20260709 13:09:16.319099 23577 leader_election.cc:343] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.320595 23804 raft_consensus.cc:2804] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.320983 23804 raft_consensus.cc:493] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.321303 23804 raft_consensus.cc:3060] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.327142 23727 tablet_bootstrap.cc:654] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.333716 23360 catalog_manager.cc:5697] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.338289 23727 tablet_bootstrap.cc:492] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.338836 23727 ts_tablet_manager.cc:1403] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.007s
I20260709 13:09:16.340569 23729 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:16.343923 23729 ts_tablet_manager.cc:1403] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.000s
I20260709 13:09:16.346634 23729 raft_consensus.cc:359] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.347289 23729 raft_consensus.cc:385] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.347563 23729 raft_consensus.cc:740] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.351214 23728 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:16.353495 23728 ts_tablet_manager.cc:1403] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.174s	user 0.015s	sys 0.030s
I20260709 13:09:16.342551 23804 raft_consensus.cc:515] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.351092 23729 consensus_queue.cc:260] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.342608 23727 raft_consensus.cc:359] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.357167 23727 raft_consensus.cc:385] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.356642 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccefc8653d6d40a98aa795e53e75e1e7" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:16.357409 23729 ts_tablet_manager.cc:1434] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:16.357669 23682 raft_consensus.cc:3060] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.357463 23727 raft_consensus.cc:740] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.358711 23804 leader_election.cc:290] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.359076 23727 consensus_queue.cc:260] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.359534 23728 raft_consensus.cc:359] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.360205 23728 raft_consensus.cc:385] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.360451 23728 raft_consensus.cc:740] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.361243 23727 ts_tablet_manager.cc:1434] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.000s
I20260709 13:09:16.361104 23728 consensus_queue.cc:260] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.362289 23964 raft_consensus.cc:493] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.362746 23964 raft_consensus.cc:515] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.364917 23964 leader_election.cc:290] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:16.365120 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccefc8653d6d40a98aa795e53e75e1e7" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:16.365749 23534 raft_consensus.cc:3060] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.366014 23727 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.367172 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.358464 23729 tablet_bootstrap.cc:492] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
W20260709 13:09:16.368630 23649 leader_election.cc:343] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.369938 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
W20260709 13:09:16.373780 23650 leader_election.cc:343] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.374197 23650 leader_election.cc:304] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.375734 24015 raft_consensus.cc:2749] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.376123 23727 tablet_bootstrap.cc:654] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.379917 23731 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:16.380445 23729 tablet_bootstrap.cc:654] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.381757 23728 ts_tablet_manager.cc:1434] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:09:16.380453 23731 ts_tablet_manager.cc:1403] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.087s	user 0.006s	sys 0.026s
I20260709 13:09:16.385404 23534 raft_consensus.cc:2468] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:16.386914 23682 raft_consensus.cc:2468] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:16.388065 23575 leader_election.cc:304] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:16.388908 24073 raft_consensus.cc:2804] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.389365 24073 raft_consensus.cc:697] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:16.390172 24073 consensus_queue.cc:237] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.395543 23727 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.396052 23727 ts_tablet_manager.cc:1403] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.003s
I20260709 13:09:16.398720 23727 raft_consensus.cc:359] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.399341 23727 raft_consensus.cc:385] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.399618 23727 raft_consensus.cc:740] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.400272 23727 consensus_queue.cc:260] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.402165 23731 raft_consensus.cc:359] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.402900 23731 raft_consensus.cc:385] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.403167 23731 raft_consensus.cc:740] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.403867 23731 consensus_queue.cc:260] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.404351 23727 ts_tablet_manager.cc:1434] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:16.405412 23727 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.411031 23727 tablet_bootstrap.cc:654] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.412091 23728 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:16.423981 23728 tablet_bootstrap.cc:654] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.429519 23729 tablet_bootstrap.cc:492] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:16.430030 23729 ts_tablet_manager.cc:1403] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.072s	user 0.015s	sys 0.000s
I20260709 13:09:16.430852 23727 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.431339 23727 ts_tablet_manager.cc:1403] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 13:09:16.432715 23729 raft_consensus.cc:359] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.433444 23729 raft_consensus.cc:385] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.433928 23727 raft_consensus.cc:359] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.434587 23727 raft_consensus.cc:385] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.434854 23727 raft_consensus.cc:740] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.435534 23727 consensus_queue.cc:260] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.438342 23728 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:16.438817 23728 ts_tablet_manager.cc:1403] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.027s	user 0.005s	sys 0.004s
I20260709 13:09:16.433707 23729 raft_consensus.cc:740] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.440845 23729 consensus_queue.cc:260] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.441475 23731 ts_tablet_manager.cc:1434] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.002s
I20260709 13:09:16.442762 23731 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:16.444617 23729 ts_tablet_manager.cc:1434] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 13:09:16.445538 23875 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.446132 23729 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:16.446064 23875 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.448215 23875 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:16.449745 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.450600 23457 raft_consensus.cc:2393] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:16.450721 23727 ts_tablet_manager.cc:1434] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:09:16.451081 23731 tablet_bootstrap.cc:654] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.451910 23727 tablet_bootstrap.cc:492] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.453086 23729 tablet_bootstrap.cc:654] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.453292 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.454160 23609 raft_consensus.cc:2393] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
I20260709 13:09:16.455479 23501 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.456748 23875 raft_consensus.cc:3060] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.441408 23728 raft_consensus.cc:359] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.460181 23728 raft_consensus.cc:385] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.460491 23728 raft_consensus.cc:740] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.461347 23728 consensus_queue.cc:260] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.462692 23731 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:16.463200 23731 ts_tablet_manager.cc:1403] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.001s
I20260709 13:09:16.463730 23728 ts_tablet_manager.cc:1434] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.005s
I20260709 13:09:16.465606 23728 tablet_bootstrap.cc:492] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:16.465632 24067 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.467988 23731 raft_consensus.cc:359] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.467891 24067 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.468823 23731 raft_consensus.cc:385] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.472054 23731 raft_consensus.cc:740] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.464506 23727 tablet_bootstrap.cc:654] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.477346 23731 consensus_queue.cc:260] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.478494 23359 catalog_manager.cc:5697] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.479468 23731 ts_tablet_manager.cc:1434] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:16.472492 23728 tablet_bootstrap.cc:654] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.472577 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.480302 23684 raft_consensus.cc:2393] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:16.480500 23731 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:16.473431 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.473903 24067 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:16.482409 23729 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:16.471051 23979 raft_consensus.cc:493] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.482877 23729 ts_tablet_manager.cc:1403] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.009s
I20260709 13:09:16.482990 23979 raft_consensus.cc:515] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.485837 23979 leader_election.cc:290] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:16.486764 23731 tablet_bootstrap.cc:654] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.487448 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.489408 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:16.490031 23534 raft_consensus.cc:2468] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:16.491254 23428 leader_election.cc:304] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:16.492023 24073 raft_consensus.cc:493] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.492488 24073 raft_consensus.cc:515] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.494165 23875 raft_consensus.cc:2749] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.494448 24073 leader_election.cc:290] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.485679 23729 raft_consensus.cc:359] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.495484 23729 raft_consensus.cc:385] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.495652 23979 raft_consensus.cc:2804] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.495914 23729 raft_consensus.cc:740] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.497125 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b49ed532684aa3ae75017b8afe8475" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:16.496170 23979 raft_consensus.cc:493] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.498044 23979 raft_consensus.cc:3060] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.497790 23534 raft_consensus.cc:2468] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:16.499042 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b49ed532684aa3ae75017b8afe8475" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.499739 23457 raft_consensus.cc:2468] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:16.500735 23577 leader_election.cc:304] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:16.497788 24025 consensus_queue.cc:1048] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.501602 24073 raft_consensus.cc:2804] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.502646 24073 raft_consensus.cc:493] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.503096 24073 raft_consensus.cc:3060] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.509688 23727 tablet_bootstrap.cc:492] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:16.510373 23727 ts_tablet_manager.cc:1403] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.002s
I20260709 13:09:16.515674 23979 raft_consensus.cc:515] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.513216 23727 raft_consensus.cc:359] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.517966 23727 raft_consensus.cc:385] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.518313 23727 raft_consensus.cc:740] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.516327 23501 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:16.522665 24067 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.529135 23727 consensus_queue.cc:260] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.529619 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:16.529539 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:16.531837 23534 raft_consensus.cc:3060] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.546571 23727 ts_tablet_manager.cc:1434] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.001s
I20260709 13:09:16.497468 23729 consensus_queue.cc:260] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.552181 23804 raft_consensus.cc:493] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.530012 23979 leader_election.cc:290] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:16.552784 23804 raft_consensus.cc:515] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.553730 24053 raft_consensus.cc:493] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.554808 24053 raft_consensus.cc:515] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.555752 23804 leader_election.cc:290] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.562310 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.562564 24053 leader_election.cc:290] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:16.563261 23684 raft_consensus.cc:2468] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:16.563591 23875 raft_consensus.cc:493] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.564114 23875 raft_consensus.cc:515] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.556252 23609 raft_consensus.cc:2468] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:16.566144 23875 leader_election.cc:290] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:16.567812 24015 consensus_queue.cc:1048] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.568354 23875 raft_consensus.cc:493] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.568863 23875 raft_consensus.cc:515] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.570739 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:16.571111 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785fa69f121467b8d300a0bb3cbc644" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.571868 23457 raft_consensus.cc:2393] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:16.573232 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:16.573916 23535 raft_consensus.cc:2468] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:16.574261 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1785fa69f121467b8d300a0bb3cbc644" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.576774 23575 leader_election.cc:304] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:16.578523 23804 raft_consensus.cc:2804] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.579113 23804 raft_consensus.cc:493] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.579591 23804 raft_consensus.cc:3060] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:16.581375 23428 leader_election.cc:343] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.581604 23729 ts_tablet_manager.cc:1434] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.098s	user 0.008s	sys 0.004s
I20260709 13:09:16.581369 23502 leader_election.cc:304] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
W20260709 13:09:16.580662 23483 debug-util.cc:398] Leaking SignalData structure 0x7b0800297020 after lost signal to thread 13795
I20260709 13:09:16.582669 23729 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:16.582569 23875 leader_election.cc:290] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
W20260709 13:09:16.583467 23483 debug-util.cc:398] Leaking SignalData structure 0x7b0800375fe0 after lost signal to thread 23394
I20260709 13:09:16.583386 24006 raft_consensus.cc:3060] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.589978 23729 tablet_bootstrap.cc:654] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:16.591435 23483 debug-util.cc:398] Leaking SignalData structure 0x7b08002267e0 after lost signal to thread 23486
W20260709 13:09:16.593834 23483 debug-util.cc:398] Leaking SignalData structure 0x7b08001e7b40 after lost signal to thread 23561
W20260709 13:09:16.595136 23483 debug-util.cc:398] Leaking SignalData structure 0x7b0800286640 after lost signal to thread 23635
W20260709 13:09:16.599985 23483 debug-util.cc:398] Leaking SignalData structure 0x7b080020ea00 after lost signal to thread 23709
I20260709 13:09:16.595948 23727 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:16.597013 23534 raft_consensus.cc:2468] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:16.577297 24067 raft_consensus.cc:2749] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.612862 23428 leader_election.cc:304] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.613786 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.614144 24053 raft_consensus.cc:2804] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.614424 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.597540 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.615674 23684 raft_consensus.cc:2468] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:16.617390 23501 leader_election.cc:304] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:16.617771 24053 raft_consensus.cc:697] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:16.618703 24053 consensus_queue.cc:237] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.619549 24067 raft_consensus.cc:2804] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.620033 24067 raft_consensus.cc:493] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.620368 24067 raft_consensus.cc:3060] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.621605 23728 tablet_bootstrap.cc:492] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:16.622154 23728 ts_tablet_manager.cc:1403] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.157s	user 0.014s	sys 0.004s
I20260709 13:09:16.591218 24073 raft_consensus.cc:515] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.625540 23727 tablet_bootstrap.cc:654] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:16.625976 23426 leader_election.cc:343] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.626266 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b49ed532684aa3ae75017b8afe8475" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:16.626860 23457 raft_consensus.cc:3060] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.626467 23426 leader_election.cc:304] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.627962 24090 raft_consensus.cc:2749] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.606060 24006 raft_consensus.cc:2749] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.632985 24067 raft_consensus.cc:515] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.638569 24090 consensus_queue.cc:1048] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:16.639487 23731 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:16.639295 23457 raft_consensus.cc:2468] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:16.645725 23576 leader_election.cc:304] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:16.646875 24069 raft_consensus.cc:2804] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:16.647418 24069 raft_consensus.cc:697] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:16.648252 24069 consensus_queue.cc:237] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.674861 23731 ts_tablet_manager.cc:1403] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.195s	user 0.018s	sys 0.092s
I20260709 13:09:16.676419 23804 raft_consensus.cc:515] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.677759 23607 raft_consensus.cc:2393] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
I20260709 13:09:16.701268 23804 leader_election.cc:290] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.702212 23804 raft_consensus.cc:493] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.702699 23804 raft_consensus.cc:515] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.716580 23731 raft_consensus.cc:359] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.717697 23731 raft_consensus.cc:385] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.718048 23731 raft_consensus.cc:740] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.725188 23804 leader_election.cc:290] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:16.683153 24073 leader_election.cc:290] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
W20260709 13:09:16.731526 23576 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:45163, user_credentials={real_user=slave}} blocked reactor thread for 51187.4us
I20260709 13:09:16.733438 23731 consensus_queue.cc:260] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.699774 24071 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.740986 23804 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.747153 23728 raft_consensus.cc:359] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.748355 23728 raft_consensus.cc:385] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.748693 23728 raft_consensus.cc:740] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.732599 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22b49ed532684aa3ae75017b8afe8475" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:16.751446 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:16.732417 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:16.753415 23804 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.755769 23728 consensus_queue.cc:260] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:16.760025 23457 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925234f9de154af68ec326257968572d" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.761466 23537 raft_consensus.cc:2393] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in this term.
I20260709 13:09:16.761673 23605 raft_consensus.cc:3060] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.755365 23534 raft_consensus.cc:3060] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.742187 24071 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.763312 23979 raft_consensus.cc:493] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.759821 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "925234f9de154af68ec326257968572d" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.755345 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:16.768932 24067 leader_election.cc:290] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.783152 24025 raft_consensus.cc:493] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.787539 23685 raft_consensus.cc:3060] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.789018 23728 ts_tablet_manager.cc:1434] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.167s	user 0.010s	sys 0.000s
I20260709 13:09:16.779798 24070 consensus_queue.cc:1048] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:16.783233 23609 raft_consensus.cc:2393] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
W20260709 13:09:16.808231 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:16.814594 23729 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:16.815378 23729 ts_tablet_manager.cc:1403] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.233s	user 0.020s	sys 0.016s
I20260709 13:09:16.787179 23979 raft_consensus.cc:515] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.810027 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb8713a52bae4dc3b7153d826f171c88" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:16.826380 23728 tablet_bootstrap.cc:492] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:16.827255 23731 ts_tablet_manager.cc:1434] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.152s	user 0.005s	sys 0.023s
I20260709 13:09:16.801513 24025 raft_consensus.cc:515] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:16.830351 23731 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:16.831503 24025 leader_election.cc:290] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.849923 23728 tablet_bootstrap.cc:654] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:16.853096 23729 raft_consensus.cc:359] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.853847 23729 raft_consensus.cc:385] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:16.854116 23729 raft_consensus.cc:740] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:16.854735 23729 consensus_queue.cc:260] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:16.856159 24071 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:16.857736 23979 leader_election.cc:290] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:16.860283 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9bce9a34294ef08a3a6e43d8b25b1a" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.861093 23462 raft_consensus.cc:2468] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:16.886677 23650 leader_election.cc:304] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:16.887815 23606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.888615 23459 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.887006 23685 raft_consensus.cc:2468] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:16.892567 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:16.892931 24071 raft_consensus.cc:2804] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.893191 23685 raft_consensus.cc:2468] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:16.893350 24071 raft_consensus.cc:493] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.893707 24071 raft_consensus.cc:3060] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.893994 23804 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:16.897117 23426 leader_election.cc:304] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:16.898095 24140 raft_consensus.cc:2804] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:16.898602 24140 raft_consensus.cc:493] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.898919 24140 raft_consensus.cc:3060] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:16.902907 23534 raft_consensus.cc:2468] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:16.908957 23964 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.909530 23964 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
W20260709 13:09:16.915282 23649 leader_election.cc:343] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.917161 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:16.917989 23460 raft_consensus.cc:2468] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:16.918496 23729 ts_tablet_manager.cc:1434] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.103s	user 0.005s	sys 0.001s
I20260709 13:09:16.919845 23729 tablet_bootstrap.cc:492] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
W20260709 13:09:16.920889 23650 leader_election.cc:343] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:16.918409 23964 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:16.921439 23650 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.923583 23964 raft_consensus.cc:2749] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:16.936923 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:16.954944 23576 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:16.977485 23804 raft_consensus.cc:2804] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:16.979931 23804 raft_consensus.cc:493] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:16.980218 23804 raft_consensus.cc:3060] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:16.949355 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9bce9a34294ef08a3a6e43d8b25b1a" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:16.958060 23357 catalog_manager.cc:5697] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:16.984539 23875 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:16.997373 23501 leader_election.cc:304] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:16.998766 23875 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
W20260709 13:09:17.006069 23651 leader_election.cc:343] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.007009 23729 tablet_bootstrap.cc:654] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:16.976169 23577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 156114us
I20260709 13:09:17.012526 23804 raft_consensus.cc:515] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:16.985411 24025 consensus_queue.cc:1048] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:09:17.014906 23575 leader_election.cc:304] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:17.021437 23575 leader_election.cc:304] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:17.023761 23875 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:17.024484 23804 leader_election.cc:290] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:17.014279 24066 raft_consensus.cc:2749] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.039021 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.041695 23607 raft_consensus.cc:2468] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:17.049803 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:17.050523 23684 raft_consensus.cc:2468] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:17.050993 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:17.051681 23532 raft_consensus.cc:2468] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:17.053638 24144 consensus_queue.cc:1048] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.055905 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.057878 23731 tablet_bootstrap.cc:654] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.035864 24073 raft_consensus.cc:2804] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.026319 24069 raft_consensus.cc:2749] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.067870 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:17.068605 23536 raft_consensus.cc:2468] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:17.054935 24140 raft_consensus.cc:515] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.076141 23460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:17.076363 24071 raft_consensus.cc:515] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:17.077482 23727 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:17.078035 23727 ts_tablet_manager.cc:1403] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.482s	user 0.016s	sys 0.026s
W20260709 13:09:17.080152 23501 leader_election.cc:343] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.080788 24145 consensus_queue.cc:1048] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.078758 23460 raft_consensus.cc:3060] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.084293 24073 raft_consensus.cc:697] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:17.125604 23501 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:17.133862 23728 tablet_bootstrap.cc:492] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:17.134560 23728 ts_tablet_manager.cc:1403] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.322s	user 0.022s	sys 0.021s
I20260709 13:09:17.112237 24140 leader_election.cc:290] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
W20260709 13:09:17.137985 23577 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 57742.2us
W20260709 13:09:17.111093 23428 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 97966.9us
I20260709 13:09:17.137261 23651 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:17.152628 24137 raft_consensus.cc:2804] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.153096 24137 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.153450 24137 raft_consensus.cc:3060] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.155241 23537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f2d5e15657d4d9caeb89fd380cedcb3" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:17.158568 23537 raft_consensus.cc:3060] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.172005 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:17.172735 23682 raft_consensus.cc:3060] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.173878 23728 raft_consensus.cc:359] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.174556 23728 raft_consensus.cc:385] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.174830 23728 raft_consensus.cc:740] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.163297 24070 raft_consensus.cc:2804] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.177436 23728 consensus_queue.cc:260] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.178289 23537 raft_consensus.cc:2468] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 2.
I20260709 13:09:17.150331 24073 consensus_queue.cc:237] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.183816 24153 consensus_queue.cc:1048] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:09:17.191996 23727 raft_consensus.cc:359] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.192966 23727 raft_consensus.cc:385] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.193305 23727 raft_consensus.cc:740] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.194157 23727 consensus_queue.cc:260] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.180538 24070 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.195379 24071 leader_election.cc:290] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:17.197715 23577 leader_election.cc:304] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:17.202698 23728 ts_tablet_manager.cc:1434] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.003s
I20260709 13:09:17.204905 24069 raft_consensus.cc:2804] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:17.205453 24069 raft_consensus.cc:697] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:17.206360 23804 consensus_queue.cc:1048] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.206308 24069 consensus_queue.cc:237] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.203184 24070 raft_consensus.cc:3060] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.238025 23607 raft_consensus.cc:3060] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.230396 23727 ts_tablet_manager.cc:1434] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.152s	user 0.009s	sys 0.001s
I20260709 13:09:17.236682 23728 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:17.239964 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.245500 23609 raft_consensus.cc:3060] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.255971 23729 tablet_bootstrap.cc:492] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:17.256489 23729 ts_tablet_manager.cc:1403] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.337s	user 0.021s	sys 0.023s
I20260709 13:09:17.249653 24053 consensus_queue.cc:1048] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:17.260919 23731 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:17.261408 23731 ts_tablet_manager.cc:1403] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.431s	user 0.021s	sys 0.020s
I20260709 13:09:17.259207 23729 raft_consensus.cc:359] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.262903 23729 raft_consensus.cc:385] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.263159 23729 raft_consensus.cc:740] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.263849 23729 consensus_queue.cc:260] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.265347 23731 raft_consensus.cc:359] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.265574 23729 ts_tablet_manager.cc:1434] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:17.266085 23731 raft_consensus.cc:385] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.266363 23731 raft_consensus.cc:740] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.280174 23729 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:17.279980 24090 consensus_queue.cc:1048] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.281558 23731 consensus_queue.cc:260] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.284706 23731 ts_tablet_manager.cc:1434] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:09:17.285959 23727 tablet_bootstrap.cc:492] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:17.260671 23460 raft_consensus.cc:2468] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 2.
I20260709 13:09:17.295081 23731 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:17.310482 23728 tablet_bootstrap.cc:654] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.327746 23727 tablet_bootstrap.cc:654] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.315651 23682 raft_consensus.cc:2468] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
W20260709 13:09:17.332279 24164 log.cc:927] Time spent T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:09:17.109766 23649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 170728us
I20260709 13:09:17.343693 23426 leader_election.cc:304] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:17.363374 23731 tablet_bootstrap.cc:654] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.381297 23729 tablet_bootstrap.cc:654] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.371116 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9bce9a34294ef08a3a6e43d8b25b1a" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:17.382694 24134 consensus_queue.cc:1048] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.387691 23461 raft_consensus.cc:3060] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.379004 23609 raft_consensus.cc:2468] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:17.370697 24053 raft_consensus.cc:2804] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:17.377733 23649 leader_election.cc:343] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.411232 24053 raft_consensus.cc:697] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:17.440876 24053 consensus_queue.cc:237] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.413750 24070 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.454727 24137 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
W20260709 13:09:17.428680 23649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 50963.4us
I20260709 13:09:17.465927 23728 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:17.466564 23728 ts_tablet_manager.cc:1403] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.230s	user 0.006s	sys 0.025s
I20260709 13:09:17.496124 23728 raft_consensus.cc:359] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.496896 23728 raft_consensus.cc:385] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.497884 24142 raft_consensus.cc:493] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.498420 24142 raft_consensus.cc:515] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.499135 24070 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:17.500460 24142 leader_election.cc:290] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
W20260709 13:09:17.500650 24149 log.cc:927] Time spent T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Append to log took a long time: real 0.392s	user 0.005s	sys 0.000s
I20260709 13:09:17.497165 23728 raft_consensus.cc:740] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.516889 23728 consensus_queue.cc:260] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
W20260709 13:09:17.526636 24170 log.cc:927] Time spent T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:09:17.486164 24143 consensus_queue.cc:1048] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.092s
I20260709 13:09:17.533835 23461 raft_consensus.cc:2468] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:17.534854 24137 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:17.501498 23964 consensus_queue.cc:1048] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20260709 13:09:17.554934 23605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fee14e6e9a4abd9331249fe4afd97e" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.555660 23605 raft_consensus.cc:2468] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
I20260709 13:09:17.569902 23728 ts_tablet_manager.cc:1434] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.002s
I20260709 13:09:17.575161 23606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.584676 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:17.585860 23532 raft_consensus.cc:2393] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 1: Already voted for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in this term.
I20260709 13:09:17.613234 23728 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: Bootstrap starting.
I20260709 13:09:17.611647 23535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fee14e6e9a4abd9331249fe4afd97e" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:17.626758 23731 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:17.627278 23731 ts_tablet_manager.cc:1403] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.342s	user 0.022s	sys 0.010s
I20260709 13:09:17.629069 23605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.630256 23731 raft_consensus.cc:359] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.631007 23731 raft_consensus.cc:385] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.631287 23731 raft_consensus.cc:740] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.617331 24137 raft_consensus.cc:493] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.631955 24137 raft_consensus.cc:515] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.631992 23731 consensus_queue.cc:260] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.603466 23649 leader_election.cc:304] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:17.638198 24066 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.638773 24066 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.640893 24066 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:17.645663 24142 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7a59e1270baa49b1b1c6ca3b1a4c3146)
I20260709 13:09:17.646220 24142 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.648166 24142 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
W20260709 13:09:17.650633 23649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 68697.1us
I20260709 13:09:17.651041 23729 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:17.651546 23729 ts_tablet_manager.cc:1403] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.372s	user 0.022s	sys 0.016s
I20260709 13:09:17.653256 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9bce9a34294ef08a3a6e43d8b25b1a" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:17.653685 23650 leader_election.cc:304] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:17.656922 24070 raft_consensus.cc:2804] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.657397 24070 raft_consensus.cc:697] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:17.658214 24070 consensus_queue.cc:237] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:17.651391 24151 raft_consensus.cc:2804] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.661018 24151 raft_consensus.cc:493] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.661404 24151 raft_consensus.cc:3060] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:17.651733 23649 leader_election.cc:343] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.662685 23649 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:17.663213 24137 leader_election.cc:290] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:17.663507 23964 raft_consensus.cc:2749] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.666476 23731 ts_tablet_manager.cc:1434] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 13:09:17.668141 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.674659 23731 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:17.674714 23608 raft_consensus.cc:2393] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 2: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
I20260709 13:09:17.649151 23355 catalog_manager.cc:5697] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:17.679512 23729 raft_consensus.cc:359] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.680265 23729 raft_consensus.cc:385] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.680553 23729 raft_consensus.cc:740] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.683377 23729 consensus_queue.cc:260] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.685830 24136 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.686065 23680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:17.686419 24136 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.686920 23680 raft_consensus.cc:2393] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:17.689013 24136 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:17.694020 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:17.694913 23681 raft_consensus.cc:2468] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:17.696115 23426 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:17.695982 24145 consensus_queue.cc:1048] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.693491 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.699684 24136 raft_consensus.cc:2804] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.700160 24136 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.700598 24136 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:17.698932 23501 leader_election.cc:343] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.702111 23426 leader_election.cc:343] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.695920 23502 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:45163, user_credentials={real_user=slave}} blocked reactor thread for 45366.7us
I20260709 13:09:17.706439 23727 tablet_bootstrap.cc:492] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:17.709353 23727 ts_tablet_manager.cc:1403] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.458s	user 0.017s	sys 0.007s
I20260709 13:09:17.710086 23729 ts_tablet_manager.cc:1434] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.058s	user 0.004s	sys 0.003s
W20260709 13:09:17.717717 23651 leader_election.cc:343] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:17.719748 23651 leader_election.cc:343] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.720222 23729 tablet_bootstrap.cc:492] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:17.720841 23501 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:17.721549 23875 raft_consensus.cc:2749] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.723692 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.724444 23603 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:17.724732 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:17.727860 23536 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 2.
I20260709 13:09:17.730607 23680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:17.731256 23680 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:17.731920 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:17.732574 23461 raft_consensus.cc:2468] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:17.723754 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:17.742115 24151 raft_consensus.cc:515] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.742483 23501 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:17.743237 23875 raft_consensus.cc:2804] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:17.743623 23875 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.743919 23875 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.746359 23731 tablet_bootstrap.cc:654] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.752913 23728 tablet_bootstrap.cc:654] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.753284 23502 leader_election.cc:304] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:17.754927 24066 raft_consensus.cc:2804] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:17.755352 24066 raft_consensus.cc:493] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:17.755728 24066 raft_consensus.cc:3060] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.759474 23729 tablet_bootstrap.cc:654] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:17.750941 23609 raft_consensus.cc:2468] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 0.
I20260709 13:09:17.765895 23357 catalog_manager.cc:5697] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:17.754680 23875 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.773814 24069 consensus_queue.cc:1048] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.775671 23606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.776615 23606 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.777658 23875 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 3 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:17.782034 23458 raft_consensus.cc:1275] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Refusing update from remote peer 89c3e465d9db463a9d55c8a2e7c061ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:17.782919 23533 raft_consensus.cc:1275] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 89c3e465d9db463a9d55c8a2e7c061ea: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:17.783815 24145 consensus_queue.cc:1048] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.784518 24151 leader_election.cc:290] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:17.788951 24145 consensus_queue.cc:1048] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:17.793467 23727 raft_consensus.cc:359] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.796516 23727 raft_consensus.cc:385] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.797058 23727 raft_consensus.cc:740] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
W20260709 13:09:17.803226 23651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 73636.6us
I20260709 13:09:17.816947 23651 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:17.822263 24156 raft_consensus.cc:493] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.822809 24156 raft_consensus.cc:515] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.824996 24156 leader_election.cc:290] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:17.826571 24135 raft_consensus.cc:2804] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:17.827000 24135 raft_consensus.cc:493] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7a59e1270baa49b1b1c6ca3b1a4c3146)
I20260709 13:09:17.827479 24135 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:17.827167 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba066265aaf44df488ed17c1bb390276" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:17.832990 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba066265aaf44df488ed17c1bb390276" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:17.834818 23428 leader_election.cc:343] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.802423 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fee14e6e9a4abd9331249fe4afd97e" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.844848 23608 raft_consensus.cc:3060] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:17.846375 23426 leader_election.cc:343] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.850474 23680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:17.851704 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05fee14e6e9a4abd9331249fe4afd97e" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:17.804672 23727 consensus_queue.cc:260] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.862202 23536 raft_consensus.cc:3060] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.797598 24136 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.869576 23426 leader_election.cc:304] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:17.870396 24136 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:17.870739 24135 raft_consensus.cc:515] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.802651 24066 raft_consensus.cc:515] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.876952 24066 leader_election.cc:290] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:17.877535 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:17.877720 23680 raft_consensus.cc:3060] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:17.878189 23681 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.879904 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:17.880203 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.880635 23461 raft_consensus.cc:3060] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.884238 23729 tablet_bootstrap.cc:492] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:17.884959 23729 ts_tablet_manager.cc:1403] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.165s	user 0.024s	sys 0.004s
W20260709 13:09:17.886101 23426 leader_election.cc:343] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:17.870568 24155 raft_consensus.cc:2749] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:17.894953 23681 raft_consensus.cc:2468] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:17.899309 23729 raft_consensus.cc:359] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.902475 23426 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:17.905184 23729 raft_consensus.cc:385] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.906271 23729 raft_consensus.cc:740] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.907778 23729 consensus_queue.cc:260] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.912063 24155 raft_consensus.cc:2804] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.917606 24155 raft_consensus.cc:697] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:17.918509 24155 consensus_queue.cc:237] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:17.921937 23729 ts_tablet_manager.cc:1434] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 13:09:17.928275 23680 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 3.
I20260709 13:09:17.932663 24156 consensus_queue.cc:1048] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:17.933456 24135 leader_election.cc:290] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:17.932219 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.936159 23534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:17.940716 23534 raft_consensus.cc:2368] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 for earlier term 2. Current term is 3.
I20260709 13:09:17.928846 23461 raft_consensus.cc:2468] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:17.943943 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e5e8374cc9436696a431388a452768" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:17.945264 23728 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: No bootstrap required, opened a new log
I20260709 13:09:17.945820 23728 ts_tablet_manager.cc:1403] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: Time spent bootstrapping tablet: real 0.339s	user 0.016s	sys 0.026s
W20260709 13:09:17.958801 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:17.964193 23502 leader_election.cc:304] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:17.965238 24139 raft_consensus.cc:2804] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:17.965704 24139 raft_consensus.cc:697] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:17.966516 24139 consensus_queue.cc:237] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:17.968976 23729 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:17.943033 23609 raft_consensus.cc:3060] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:17.970613 23651 leader_election.cc:400] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Vote denied by peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613) with higher term. Message: Invalid argument: T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 for earlier term 2. Current term is 3.
I20260709 13:09:17.971035 23651 leader_election.cc:403] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:09:17.972707 24157 raft_consensus.cc:2749] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613) with higher term. Message: Invalid argument: T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 for earlier term 2. Current term is 3.
I20260709 13:09:17.969969 23606 raft_consensus.cc:2468] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 3.
I20260709 13:09:17.980029 23501 leader_election.cc:304] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:17.980679 23608 raft_consensus.cc:2468] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:17.981920 23536 raft_consensus.cc:2468] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:17.985229 23727 ts_tablet_manager.cc:1434] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.275s	user 0.011s	sys 0.000s
I20260709 13:09:17.986157 23727 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:17.986292 24152 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:17.988854 23875 raft_consensus.cc:2804] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:17.989563 23875 raft_consensus.cc:697] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:17.990278 23875 consensus_queue.cc:237] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:17.988461 23731 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:17.991827 23731 ts_tablet_manager.cc:1403] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.317s	user 0.018s	sys 0.008s
I20260709 13:09:17.993436 23728 raft_consensus.cc:359] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:17.994140 23728 raft_consensus.cc:385] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:17.996593 23728 raft_consensus.cc:740] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Initialized, Role: FOLLOWER
I20260709 13:09:17.996958 23649 leader_election.cc:304] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:17.988950 24152 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.009593 24157 raft_consensus.cc:2804] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.014014 23728 consensus_queue.cc:260] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.014840 23359 catalog_manager.cc:5697] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.027452 24157 raft_consensus.cc:697] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:18.029004 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:18.032305 23731 raft_consensus.cc:359] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.032671 24157 consensus_queue.cc:237] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:18.033282 23731 raft_consensus.cc:385] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.033732 23731 raft_consensus.cc:740] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
W20260709 13:09:18.034842 23649 leader_election.cc:343] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.025318 24152 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:18.039013 23728 ts_tablet_manager.cc:1434] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: Time spent starting tablet: real 0.093s	user 0.004s	sys 0.002s
I20260709 13:09:18.041971 24156 consensus_queue.cc:1048] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.049010 23609 raft_consensus.cc:2468] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:18.035746 23731 consensus_queue.cc:260] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.059682 23727 tablet_bootstrap.cc:654] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.060895 24192 raft_consensus.cc:493] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.061523 24192 raft_consensus.cc:515] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.062276 23360 catalog_manager.cc:5697] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } }
I20260709 13:09:18.065768 24192 leader_election.cc:290] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:18.066747 23731 ts_tablet_manager.cc:1434] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.002s
I20260709 13:09:18.073305 23731 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:18.102221 23729 tablet_bootstrap.cc:654] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.104560 23731 tablet_bootstrap.cc:654] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.106314 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:18.102221 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:18.110741 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:18.111498 23458 raft_consensus.cc:2468] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 0.
W20260709 13:09:18.116191 23651 leader_election.cc:343] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.160655 24134 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.161365 24134 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:18.163266 23360 catalog_manager.cc:5697] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.165812 23360 catalog_manager.cc:5697] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 2, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 2 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } }
I20260709 13:09:18.168567 24134 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:18.177489 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:18.178289 23532 raft_consensus.cc:2393] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in this term.
W20260709 13:09:18.194410 23651 consensus_peers.cc:597] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.195377 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:18.196440 23682 raft_consensus.cc:2393] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:18.197913 23575 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:18.202030 24160 raft_consensus.cc:3060] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:18.215466 23650 leader_election.cc:343] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.216471 23650 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:18.241261 23650 leader_election.cc:304] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:18.243669 24142 raft_consensus.cc:2749] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.246582 24157 raft_consensus.cc:2804] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.265138 24160 raft_consensus.cc:2749] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.259425 24157 raft_consensus.cc:493] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.275523 24142 consensus_queue.cc:1048] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:18.290251 23727 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:18.291042 23727 ts_tablet_manager.cc:1403] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.305s	user 0.017s	sys 0.006s
I20260709 13:09:18.294338 23727 raft_consensus.cc:359] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.295079 23727 raft_consensus.cc:385] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.295382 23727 raft_consensus.cc:740] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.296106 23727 consensus_queue.cc:260] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.280793 24157 raft_consensus.cc:3060] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.316473 23727 ts_tablet_manager.cc:1434] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.004s
I20260709 13:09:18.323516 23731 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: No bootstrap required, opened a new log
I20260709 13:09:18.324148 23731 ts_tablet_manager.cc:1403] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.257s	user 0.021s	sys 0.011s
I20260709 13:09:18.333146 23731 raft_consensus.cc:359] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.333985 23731 raft_consensus.cc:385] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.334295 23731 raft_consensus.cc:740] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.335031 23731 consensus_queue.cc:260] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.349812 23731 ts_tablet_manager.cc:1434] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260709 13:09:18.362032 23729 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:18.362591 23729 ts_tablet_manager.cc:1403] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.394s	user 0.004s	sys 0.017s
I20260709 13:09:18.366503 23727 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:18.370414 23360 catalog_manager.cc:5697] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.373525 23360 catalog_manager.cc:5697] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.384943 23729 raft_consensus.cc:359] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.386338 23729 raft_consensus.cc:385] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.386621 23729 raft_consensus.cc:740] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.390519 23729 consensus_queue.cc:260] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
W20260709 13:09:18.392536 23426 consensus_peers.cc:597] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:18.393101 23729 ts_tablet_manager.cc:1434] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.030s	user 0.000s	sys 0.007s
I20260709 13:09:18.400344 23729 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:18.406075 23729 tablet_bootstrap.cc:654] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.409667 23727 tablet_bootstrap.cc:654] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.413913 24157 raft_consensus.cc:515] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.417681 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:18.417845 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
W20260709 13:09:18.420233 23651 leader_election.cc:343] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:18.429849 23458 raft_consensus.cc:3060] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.418344 24157 leader_election.cc:290] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:18.448141 23727 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:18.448880 23727 ts_tablet_manager.cc:1403] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.013s
I20260709 13:09:18.453325 23727 raft_consensus.cc:359] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:18.454202 23727 raft_consensus.cc:385] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.454625 23727 raft_consensus.cc:740] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.454010 23357 catalog_manager.cc:5697] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:18.455533 23727 consensus_queue.cc:260] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:18.458434 23727 ts_tablet_manager.cc:1434] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:18.462025 24145 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.462566 24145 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.464592 24145 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:18.465332 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:18.466056 23729 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:18.466209 23681 raft_consensus.cc:2393] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 1: Already voted for candidate 6f0851261b6d4832b826564f378ba69d in this term.
I20260709 13:09:18.466606 23729 ts_tablet_manager.cc:1403] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.011s
I20260709 13:09:18.469403 23729 raft_consensus.cc:359] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:18.470172 24151 consensus_queue.cc:1048] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.470551 23729 raft_consensus.cc:385] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.470995 23729 raft_consensus.cc:740] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.471781 23729 consensus_queue.cc:260] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:18.472051 23456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:18.474259 23729 ts_tablet_manager.cc:1434] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:18.475512 23729 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea: Bootstrap starting.
I20260709 13:09:18.477366 23576 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:18.479282 24145 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.481735 23729 tablet_bootstrap.cc:654] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.482949 24209 consensus_queue.cc:1048] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.497211 23727 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146: Bootstrap starting.
I20260709 13:09:18.513800 23681 raft_consensus.cc:1275] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:18.523980 23875 consensus_queue.cc:1048] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:18.530124 23458 raft_consensus.cc:2468] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:18.537294 23650 leader_election.cc:304] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:18.530596 23729 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea: No bootstrap required, opened a new log
I20260709 13:09:18.538257 23729 ts_tablet_manager.cc:1403] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.019s
I20260709 13:09:18.538192 24209 raft_consensus.cc:2804] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:18.539796 24209 raft_consensus.cc:697] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:18.540900 24209 consensus_queue.cc:237] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.570585 23729 raft_consensus.cc:359] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.572996 24156 consensus_queue.cc:1048] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.583590 23729 raft_consensus.cc:385] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.584070 23729 raft_consensus.cc:740] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.585430 23729 consensus_queue.cc:260] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.587328 23729 ts_tablet_manager.cc:1434] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:09:18.621120 24145 raft_consensus.cc:2749] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:18.574429 23727 tablet_bootstrap.cc:654] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:18.577929 23875 consensus_queue.cc:1048] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.666805 23359 catalog_manager.cc:5697] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 0 to 1, leader changed from <none> to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 1 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:18.796510 24221 raft_consensus.cc:493] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.797078 24221 raft_consensus.cc:515] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.804173 24221 leader_election.cc:290] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:18.805059 24136 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.806536 24069 raft_consensus.cc:493] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:18.807152 24069 raft_consensus.cc:515] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:18.805836 24136 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:18.811393 24136 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:18.816579 24069 leader_election.cc:290] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
W20260709 13:09:18.820714 24215 log.cc:927] Time spent T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 13:09:18.826037 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba066265aaf44df488ed17c1bb390276" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:18.826795 23532 raft_consensus.cc:2468] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:18.835739 23458 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9bce9a34294ef08a3a6e43d8b25b1a" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:18.836512 23875 consensus_queue.cc:1048] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:18.838714 23577 leader_election.cc:304] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:18.839694 24145 raft_consensus.cc:2804] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.840092 24145 raft_consensus.cc:493] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.840175 23680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:18.840588 24145 raft_consensus.cc:3060] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.840988 23680 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:18.847543 23606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:18.848356 23606 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 0.
I20260709 13:09:18.852316 23456 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba066265aaf44df488ed17c1bb390276" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:18.853017 23606 raft_consensus.cc:1275] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:18.868251 23426 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:18.885473 23875 consensus_queue.cc:1048] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:18.896955 23533 raft_consensus.cc:3060] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.898504 23727 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146: No bootstrap required, opened a new log
I20260709 13:09:18.899207 23727 ts_tablet_manager.cc:1403] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent bootstrapping tablet: real 0.402s	user 0.012s	sys 0.002s
I20260709 13:09:18.903924 23727 raft_consensus.cc:359] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.914062 23727 raft_consensus.cc:385] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:18.914521 23727 raft_consensus.cc:740] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Initialized, Role: FOLLOWER
I20260709 13:09:18.915786 23727 consensus_queue.cc:260] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:18.853062 23456 raft_consensus.cc:2468] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 0.
I20260709 13:09:18.876417 24156 raft_consensus.cc:2804] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:18.917534 24156 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:18.918035 24156 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:18.943646 23727 ts_tablet_manager.cc:1434] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.000s
W20260709 13:09:19.005434 23426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:44887, user_credentials={real_user=slave}} blocked reactor thread for 61046us
I20260709 13:09:19.028175 24145 raft_consensus.cc:515] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:19.075139 24145 leader_election.cc:290] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:19.078612 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba066265aaf44df488ed17c1bb390276" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:19.079908 23536 raft_consensus.cc:3060] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.093540 24156 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:19.095260 23536 raft_consensus.cc:2468] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:19.099635 23577 leader_election.cc:304] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:19.100780 24145 raft_consensus.cc:2804] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.101325 24145 raft_consensus.cc:697] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:19.102216 24145 consensus_queue.cc:237] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:19.111584 23651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 164775us
I20260709 13:09:19.148532 24156 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:19.161885 23684 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eb9bce9a34294ef08a3a6e43d8b25b1a" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:19.165117 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba066265aaf44df488ed17c1bb390276" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:19.165856 23461 raft_consensus.cc:3060] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.174605 23536 raft_consensus.cc:3060] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.177527 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:19.178383 23681 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.189478 23501 leader_election.cc:304] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
W20260709 13:09:19.192173 23575 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:44569, user_credentials={real_user=slave}} blocked reactor thread for 217628us
W20260709 13:09:19.209586 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:19.200678 24067 raft_consensus.cc:493] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.239905 24067 raft_consensus.cc:515] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:19.241943 24067 leader_election.cc:290] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:19.247222 23462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d" is_pre_election: true
I20260709 13:09:19.248114 23462 raft_consensus.cc:2468] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:19.252286 23502 leader_election.cc:304] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:19.258988 24067 raft_consensus.cc:2804] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:19.259641 24067 raft_consensus.cc:493] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.269287 23359 catalog_manager.cc:5697] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 1 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.266141 24067 raft_consensus.cc:3060] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:19.278525 23426 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.4:44569, user_credentials={real_user=slave}} blocked reactor thread for 59188.2us
I20260709 13:09:19.289023 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:19.269533 23461 raft_consensus.cc:2468] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:19.269114 24234 consensus_queue.cc:1048] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:09:19.315030 23875 raft_consensus.cc:2749] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:19.318435 23603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:19.319175 23603 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:19.338058 23681 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:19.340516 23426 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:19.342438 24243 raft_consensus.cc:2804] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:19.343190 24243 raft_consensus.cc:697] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:19.344285 24243 consensus_queue.cc:237] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:19.367106 23875 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:19.367719 23875 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:19.371044 23875 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:19.376363 23603 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 1.
I20260709 13:09:19.380757 24067 raft_consensus.cc:515] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:19.397294 23605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:19.398118 23605 raft_consensus.cc:2468] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:19.402035 23501 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:19.403023 24139 raft_consensus.cc:2804] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:19.403461 24139 raft_consensus.cc:493] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:19.403828 24139 raft_consensus.cc:3060] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:19.403960 23651 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:38613, user_credentials={real_user=slave}} blocked reactor thread for 119785us
I20260709 13:09:19.410840 23533 raft_consensus.cc:1240] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Rejecting Update request from peer 18312e6c7d274b80b354ee1498cc3449 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:19.421617 24139 raft_consensus.cc:515] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:19.421561 23359 catalog_manager.cc:5697] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.424621 23682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:19.429454 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:19.430162 23608 raft_consensus.cc:3060] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:19.434839 23679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:19.435567 23679 raft_consensus.cc:2468] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:19.439567 24231 consensus_queue.cc:1059] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:19.440074 23608 raft_consensus.cc:2468] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:19.442380 23501 leader_election.cc:304] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:19.446277 24139 leader_election.cc:290] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:19.446609 24221 raft_consensus.cc:2804] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:19.447191 24221 raft_consensus.cc:697] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:19.448149 24221 consensus_queue.cc:237] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:19.440910 24250 raft_consensus.cc:3055] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:19.449823 24250 raft_consensus.cc:740] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:19.451648 24067 leader_election.cc:290] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:19.451972 24250 consensus_queue.cc:260] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:19.463021 24234 consensus_queue.cc:1048] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.462247 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38fe0d3b4c474223a67e5f053027bc51" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:19.464213 24250 raft_consensus.cc:3060] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:19.464323 23681 raft_consensus.cc:3060] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:19.464695 23461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4fae8af871f40669a26b56a15979adf" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f0851261b6d4832b826564f378ba69d"
I20260709 13:09:19.465309 23461 raft_consensus.cc:3060] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:19.484335 23681 raft_consensus.cc:2468] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:19.486539 23461 raft_consensus.cc:2468] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:19.520103 23502 leader_election.cc:304] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449
I20260709 13:09:19.527289 24221 raft_consensus.cc:2804] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:19.529047 24221 raft_consensus.cc:697] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:19.529932 24221 consensus_queue.cc:237] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:19.531760 23355 catalog_manager.cc:5697] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 0 to 2, leader changed from <none> to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:19.550153 23355 catalog_manager.cc:5697] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:19.654729 24069 consensus_queue.cc:1048] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.665524 24242 consensus_queue.cc:1048] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.806578 24243 consensus_queue.cc:1048] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.823302 24243 consensus_queue.cc:1048] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.910605 23681 raft_consensus.cc:1275] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:09:19.911068 23681 pending_rounds.cc:85] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: Aborting all ops after (but not including) 0
I20260709 13:09:19.911327 23681 pending_rounds.cc:107] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:19.911675 23681 raft_consensus.cc:2889] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:19.912998 24221 consensus_queue.cc:1048] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.926940 23461 raft_consensus.cc:1275] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:19.928690 24139 consensus_queue.cc:1048] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.963904 23608 raft_consensus.cc:1275] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:19.965946 24067 consensus_queue.cc:1048] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:19.980535 23683 raft_consensus.cc:1275] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:19.983369 24139 consensus_queue.cc:1048] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.191045 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
W20260709 13:09:21.221897 23650 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:09:21.243099 23650 consensus_peers.cc:597] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.247247 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:21.247285 23650 consensus_peers.cc:597] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.248486 13792 tablet_replica.cc:333] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.249558 13792 raft_consensus.cc:2243] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.250113 13792 raft_consensus.cc:2272] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.253336 13792 tablet_replica.cc:333] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.254189 13792 raft_consensus.cc:2243] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.255286 13792 raft_consensus.cc:2272] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.257929 13792 tablet_replica.cc:333] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.258822 13792 raft_consensus.cc:2243] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.259434 13792 raft_consensus.cc:2272] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.261899 13792 tablet_replica.cc:333] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
W20260709 13:09:21.262801 23576 consensus_peers.cc:597] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.262817 13792 raft_consensus.cc:2243] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:21.263612 23576 consensus_peers.cc:597] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.263708 13792 raft_consensus.cc:2272] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.266369 13792 tablet_replica.cc:333] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.267225 13792 raft_consensus.cc:2243] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.269526 13792 raft_consensus.cc:2272] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.272011 13792 tablet_replica.cc:333] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.272876 13792 raft_consensus.cc:2243] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.273973 13792 raft_consensus.cc:2272] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.276458 13792 tablet_replica.cc:333] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.277365 13792 raft_consensus.cc:2243] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.278378 13792 raft_consensus.cc:2272] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.281253 23650 consensus_peers.cc:597] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.283571 13792 tablet_replica.cc:333] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.285158 13792 raft_consensus.cc:2243] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.285766 13792 raft_consensus.cc:2272] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.289229 23502 consensus_peers.cc:597] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.289520 13792 tablet_replica.cc:333] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.290514 13792 raft_consensus.cc:2243] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.291031 13792 raft_consensus.cc:2272] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.293455 13792 tablet_replica.cc:333] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.294238 13792 raft_consensus.cc:2243] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.295253 13792 raft_consensus.cc:2272] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.297930 13792 tablet_replica.cc:333] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.298774 13792 raft_consensus.cc:2243] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.299335 13792 raft_consensus.cc:2272] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.303071 13792 tablet_replica.cc:333] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.305217 13792 raft_consensus.cc:2243] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.306412 13792 raft_consensus.cc:2272] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.309392 13792 tablet_replica.cc:333] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.310704 13792 raft_consensus.cc:2243] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.311260 13792 raft_consensus.cc:2272] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.313751 13792 tablet_replica.cc:333] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.314560 13792 raft_consensus.cc:2243] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.315096 13792 raft_consensus.cc:2272] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.317790 13792 tablet_replica.cc:333] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.318602 13792 raft_consensus.cc:2243] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.319187 13792 raft_consensus.cc:2272] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.322001 13792 tablet_replica.cc:333] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
W20260709 13:09:21.322706 23576 consensus_peers.cc:597] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.322783 13792 raft_consensus.cc:2243] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.323688 13792 raft_consensus.cc:2272] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.323583 23576 consensus_peers.cc:597] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.326567 13792 tablet_replica.cc:333] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.327435 13792 raft_consensus.cc:2243] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.328001 13792 raft_consensus.cc:2272] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.331073 13792 tablet_replica.cc:333] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.331858 13792 raft_consensus.cc:2243] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.332862 13792 raft_consensus.cc:2272] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.335675 13792 tablet_replica.cc:333] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.336529 13792 raft_consensus.cc:2243] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.337134 13792 raft_consensus.cc:2272] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.339915 13792 tablet_replica.cc:333] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.344151 13792 raft_consensus.cc:2243] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.345428 13792 raft_consensus.cc:2272] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.348089 13792 tablet_replica.cc:333] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.349205 13792 raft_consensus.cc:2243] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.349846 13792 raft_consensus.cc:2272] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.356097 13792 tablet_replica.cc:333] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.356961 13792 raft_consensus.cc:2243] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:21.357414 23502 consensus_peers.cc:597] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.358805 13792 raft_consensus.cc:2272] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.362149 13792 tablet_replica.cc:333] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.363097 13792 raft_consensus.cc:2243] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.363729 13792 raft_consensus.cc:2272] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.366614 13792 tablet_replica.cc:333] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.367547 13792 raft_consensus.cc:2243] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.368096 13792 raft_consensus.cc:2272] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.369769 23502 consensus_peers.cc:597] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.370863 13792 tablet_replica.cc:333] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.372107 13792 raft_consensus.cc:2243] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.372678 13792 raft_consensus.cc:2272] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.375277 13792 tablet_replica.cc:333] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
W20260709 13:09:21.375555 23650 consensus_peers.cc:597] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.376187 13792 raft_consensus.cc:2243] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.376883 13792 raft_consensus.cc:2272] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.377009 23650 consensus_peers.cc:597] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.379920 13792 tablet_replica.cc:333] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.380790 13792 raft_consensus.cc:2243] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.381793 13792 raft_consensus.cc:2272] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.384464 13792 tablet_replica.cc:333] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.385277 13792 raft_consensus.cc:2243] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.385809 13792 raft_consensus.cc:2272] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.388789 13792 tablet_replica.cc:333] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.389541 13792 raft_consensus.cc:2243] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.390165 13792 raft_consensus.cc:2272] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.393715 13792 tablet_replica.cc:333] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.394541 13792 raft_consensus.cc:2243] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.395605 13792 raft_consensus.cc:2272] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.398254 13792 tablet_replica.cc:333] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
W20260709 13:09:21.400106 23650 consensus_peers.cc:597] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.401494 23502 consensus_peers.cc:597] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.402068 13792 raft_consensus.cc:2243] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.402722 13792 raft_consensus.cc:2272] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.405143 13792 tablet_replica.cc:333] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.405875 13792 raft_consensus.cc:2243] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.406374 13792 raft_consensus.cc:2272] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.409019 13792 tablet_replica.cc:333] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.409720 13792 raft_consensus.cc:2243] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.411074 13792 raft_consensus.cc:2272] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.413504 13792 tablet_replica.cc:333] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.414198 13792 raft_consensus.cc:2243] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.414691 13792 raft_consensus.cc:2272] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.416989 13792 tablet_replica.cc:333] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.417651 13792 raft_consensus.cc:2243] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.418195 13792 raft_consensus.cc:2272] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.420846 13792 tablet_replica.cc:333] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.421461 13792 raft_consensus.cc:2243] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.422009 13792 raft_consensus.cc:2272] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.424507 13792 tablet_replica.cc:333] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.425076 13792 raft_consensus.cc:2243] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.426011 13792 raft_consensus.cc:2272] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.428535 13792 tablet_replica.cc:333] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.429100 13792 raft_consensus.cc:2243] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.429672 13792 raft_consensus.cc:2272] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.432297 13792 tablet_replica.cc:333] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.432981 13792 raft_consensus.cc:2243] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.433471 13792 raft_consensus.cc:2272] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.433310 23576 consensus_peers.cc:597] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.435904 13792 tablet_replica.cc:333] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.436560 13792 raft_consensus.cc:2243] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.436937 13792 raft_consensus.cc:2272] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.439524 13792 tablet_replica.cc:333] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
W20260709 13:09:21.440048 23502 consensus_peers.cc:597] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:21.440239 13792 raft_consensus.cc:2243] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.440801 13792 raft_consensus.cc:2272] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.442804 13792 tablet_replica.cc:333] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.443333 13792 raft_consensus.cc:2243] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:21.444093 13792 raft_consensus.cc:2272] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.446089 13792 tablet_replica.cc:333] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.446650 13792 raft_consensus.cc:2243] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.447084 13792 raft_consensus.cc:2272] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.449025 13792 tablet_replica.cc:333] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.449512 13792 raft_consensus.cc:2243] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.449999 13792 raft_consensus.cc:2272] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:21.452116 13792 tablet_replica.cc:333] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: stopping tablet replica
I20260709 13:09:21.452570 13792 raft_consensus.cc:2243] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:21.453936 13792 raft_consensus.cc:2272] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:21.477216 23650 consensus_peers.cc:597] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.490502 23502 consensus_peers.cc:597] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.492324 23650 consensus_peers.cc:597] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.550239 23576 consensus_peers.cc:597] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.564601 23650 consensus_peers.cc:597] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.589252 23650 consensus_peers.cc:597] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.598105 23502 consensus_peers.cc:597] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.618631 23576 consensus_peers.cc:597] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.619951 23650 consensus_peers.cc:597] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.638514 23576 consensus_peers.cc:597] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.656221 23576 consensus_peers.cc:597] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.670192 23650 consensus_peers.cc:597] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.720520 23650 consensus_peers.cc:597] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.721215 23650 consensus_peers.cc:597] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.721747 23650 consensus_peers.cc:597] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.746027 23650 consensus_peers.cc:597] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:21.746460 23650 consensus_peers.cc:597] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:22.206908 24275 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.207566 24275 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.209775 24275 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.210704 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:22.214295 23576 leader_election.cc:336] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.214740 23576 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.215466 24227 raft_consensus.cc:2749] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.228976 24139 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.229645 24139 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.234760 24139 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.237110 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:22.239871 23502 leader_election.cc:336] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.240283 23502 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.241328 24139 raft_consensus.cc:2749] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.279464 24242 raft_consensus.cc:493] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.280097 24242 raft_consensus.cc:515] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.281788 24242 leader_election.cc:290] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:22.282815 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:22.286500 23576 leader_election.cc:336] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.286947 23576 leader_election.cc:304] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:22.287724 24242 raft_consensus.cc:2749] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.317433 24242 raft_consensus.cc:493] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.317911 24242 raft_consensus.cc:515] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.322360 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:22.322783 24242 leader_election.cc:290] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
W20260709 13:09:22.324666 23576 leader_election.cc:336] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.325163 23576 leader_election.cc:304] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:22.325924 24227 raft_consensus.cc:2749] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.334537 24139 raft_consensus.cc:493] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.335124 24139 raft_consensus.cc:515] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.337194 24139 leader_election.cc:290] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:22.339788 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.340497 23608 raft_consensus.cc:2468] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
W20260709 13:09:22.341010 23502 leader_election.cc:336] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.341665 23501 leader_election.cc:304] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.342509 24139 raft_consensus.cc:2804] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.343556 24139 raft_consensus.cc:493] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.343878 24139 raft_consensus.cc:3060] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.352203 24139 raft_consensus.cc:515] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.354832 24139 leader_election.cc:290] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:22.355027 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10ef9b6dc3e34a46be40dc8a31c2dc57" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.355707 23608 raft_consensus.cc:3060] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.359645 23502 leader_election.cc:336] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.363606 23608 raft_consensus.cc:2468] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:22.364643 23501 leader_election.cc:304] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.365299 24139 raft_consensus.cc:2804] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.365756 24139 raft_consensus.cc:697] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:22.366556 24139 consensus_queue.cc:237] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.375478 23359 catalog_manager.cc:5697] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.387161 24242 raft_consensus.cc:493] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.387719 24242 raft_consensus.cc:515] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.389552 24242 leader_election.cc:290] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.390187 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:22.397915 23576 leader_election.cc:336] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.399201 23576 leader_election.cc:304] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.399976 24242 raft_consensus.cc:2749] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.449753 24242 raft_consensus.cc:493] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.450325 24242 raft_consensus.cc:515] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.452734 24242 leader_election.cc:290] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.454093 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:22.462998 23576 leader_election.cc:336] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.463481 23576 leader_election.cc:304] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.464182 24242 raft_consensus.cc:2749] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.476644 24234 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.477134 24234 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.479118 24234 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:22.480547 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:22.483718 23650 leader_election.cc:336] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.491518 23651 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:22.492332 24268 raft_consensus.cc:493] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.492894 24268 raft_consensus.cc:515] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.493232 24234 raft_consensus.cc:2749] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.495070 24268 leader_election.cc:290] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.499514 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.500159 23607 raft_consensus.cc:2468] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:22.501293 23649 leader_election.cc:304] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:22.502097 24268 raft_consensus.cc:2804] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:22.502187 23650 leader_election.cc:336] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.502533 24268 raft_consensus.cc:493] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.502976 24268 raft_consensus.cc:3060] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.511152 24268 raft_consensus.cc:515] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.513317 24268 leader_election.cc:290] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.514180 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5872ed9104d54b1e88ce2e4c22f56596" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.514793 23607 raft_consensus.cc:3060] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.519064 23650 leader_election.cc:336] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.521051 23607 raft_consensus.cc:2468] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 2.
I20260709 13:09:22.522051 23649 leader_election.cc:304] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.522691 24268 raft_consensus.cc:2804] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.523164 24268 raft_consensus.cc:697] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:22.523917 24268 consensus_queue.cc:237] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.532126 24276 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.532665 24276 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.534860 24276 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:22.535552 23359 catalog_manager.cc:5697] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:22.542236 23650 leader_election.cc:336] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.542785 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
W20260709 13:09:22.542994 13792 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 23483)
I20260709 13:09:22.545007 23651 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:22.547000 24276 raft_consensus.cc:2749] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.572521 24234 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.572978 24234 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.574836 24234 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.576045 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
W20260709 13:09:22.578519 23650 leader_election.cc:336] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.578965 23650 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:22.579670 24234 raft_consensus.cc:2749] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.587271 24234 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.587723 24234 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.591245 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:22.589550 24234 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
W20260709 13:09:22.593083 23650 leader_election.cc:336] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.593482 23650 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:22.594053 24234 raft_consensus.cc:2749] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.599040 24242 raft_consensus.cc:493] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.599653 24242 raft_consensus.cc:515] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.602669 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:22.602161 24242 leader_election.cc:290] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
W20260709 13:09:22.605334 23576 leader_election.cc:336] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.605679 23576 leader_election.cc:304] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146
I20260709 13:09:22.606329 24242 raft_consensus.cc:2749] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.617188 24234 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.618144 24234 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.620409 24234 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:22.622961 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" is_pre_election: true
I20260709 13:09:22.623514 23536 raft_consensus.cc:2468] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:22.624616 23651 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
W20260709 13:09:22.625111 23650 leader_election.cc:336] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.626022 24234 raft_consensus.cc:2804] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.626425 24234 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.626716 24234 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.631829 24234 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.634786 24234 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:22.638161 24139 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.638686 24139 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.639791 23536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:22.640394 23536 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.640494 24139 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.642706 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:22.643316 23681 raft_consensus.cc:2468] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
W20260709 13:09:22.643210 23650 leader_election.cc:336] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
W20260709 13:09:22.645390 23502 leader_election.cc:336] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.646185 23501 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.646955 24139 raft_consensus.cc:2804] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.647343 24139 raft_consensus.cc:493] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.647733 24139 raft_consensus.cc:3060] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.649184 23536 raft_consensus.cc:2468] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 2.
I20260709 13:09:22.650346 23651 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.651051 24234 raft_consensus.cc:2804] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.651701 24234 raft_consensus.cc:697] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:22.656526 24139 raft_consensus.cc:515] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.658962 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d3a5fa062b44bf98d8c3c2ed4109355" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:22.659538 23681 raft_consensus.cc:3060] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.659229 24234 consensus_queue.cc:237] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.665130 23681 raft_consensus.cc:2468] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:22.666040 23501 leader_election.cc:304] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:22.666770 24137 raft_consensus.cc:2804] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.666924 24139 leader_election.cc:290] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.668501 24137 raft_consensus.cc:697] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:22.669449 24137 consensus_queue.cc:237] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
W20260709 13:09:22.672170 23502 leader_election.cc:336] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.681522 23359 catalog_manager.cc:5697] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.685226 23360 catalog_manager.cc:5697] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:22.733733 24268 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.734257 24268 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.736227 24268 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.736954 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.737587 23607 raft_consensus.cc:2468] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:22.738603 23649 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:22.739315 24268 raft_consensus.cc:2804] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.739728 24268 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.740046 24268 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.741003 23650 leader_election.cc:336] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.745453 24268 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.747191 24268 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.747841 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.748327 23607 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.753731 24234 raft_consensus.cc:493] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.757822 23607 raft_consensus.cc:2468] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 2.
W20260709 13:09:22.754159 23650 leader_election.cc:336] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.758347 24234 raft_consensus.cc:515] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.759464 23649 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.762257 24234 leader_election.cc:290] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.762465 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.762843 24234 raft_consensus.cc:2804] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.763124 23607 raft_consensus.cc:2468] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:22.764463 24234 raft_consensus.cc:697] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:22.764575 23649 leader_election.cc:304] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:22.765588 24276 raft_consensus.cc:2804] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.765491 24234 consensus_queue.cc:237] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.766014 24276 raft_consensus.cc:493] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.766422 24276 raft_consensus.cc:3060] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.770227 24242 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.770785 24242 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.772895 24242 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.774488 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:22.775167 23681 raft_consensus.cc:2468] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:22.776373 23575 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:22.777191 24242 raft_consensus.cc:2804] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:22.777456 23576 leader_election.cc:336] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.777576 24242 raft_consensus.cc:493] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.777460 24276 raft_consensus.cc:515] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
W20260709 13:09:22.779212 23650 leader_election.cc:336] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.780550 24276 leader_election.cc:290] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.780941 23607 raft_consensus.cc:1275] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.782727 24137 consensus_queue.cc:1048] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.784624 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70014355724949559ee372d7d1080178" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.785143 23607 raft_consensus.cc:3060] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.791982 23360 catalog_manager.cc:5697] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.789928 24137 raft_consensus.cc:493] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.778090 24242 raft_consensus.cc:3060] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.794755 24137 raft_consensus.cc:515] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:22.795619 23650 leader_election.cc:336] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.803678 24234 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.794085 23607 raft_consensus.cc:2468] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 2.
I20260709 13:09:22.806885 24227 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.807535 24227 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.808951 23649 leader_election.cc:304] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
W20260709 13:09:22.809180 23502 leader_election.cc:336] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.810031 24276 raft_consensus.cc:2804] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.810492 24276 raft_consensus.cc:697] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Becoming Leader. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:22.810777 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:22.811306 24276 consensus_queue.cc:237] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.813912 24137 leader_election.cc:290] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:22.817639 24227 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.804354 24234 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.820221 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.820422 23681 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 1.
I20260709 13:09:22.820899 23604 raft_consensus.cc:2468] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
W20260709 13:09:22.821132 23576 leader_election.cc:336] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.822372 23501 leader_election.cc:304] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.827778 24286 raft_consensus.cc:2804] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.828171 24286 raft_consensus.cc:493] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.828569 24286 raft_consensus.cc:3060] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.828855 24137 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.828733 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.829644 23604 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18312e6c7d274b80b354ee1498cc3449 in term 1.
I20260709 13:09:22.829448 24137 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.830868 24234 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.833233 24137 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
W20260709 13:09:22.838498 23502 leader_election.cc:336] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.838709 24137 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.837867 24286 raft_consensus.cc:515] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:22.842152 23650 leader_election.cc:336] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.845407 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd525747a77e4b33a52ddb98c3dae259" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.846030 23607 raft_consensus.cc:3060] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.845866 24242 raft_consensus.cc:515] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.839354 24137 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.849771 24137 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
W20260709 13:09:22.863586 23502 leader_election.cc:336] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.851301 23575 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.853108 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:22.863377 23360 catalog_manager.cc:5697] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4). New cstate: current_term: 2 leader_uuid: "18312e6c7d274b80b354ee1498cc3449" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.854991 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef32908f3a2d412090974bfa5caba496" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:22.866063 23681 raft_consensus.cc:3060] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.866164 24290 raft_consensus.cc:2804] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.866780 24290 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.867230 24290 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.870133 23502 leader_election.cc:336] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.877235 24290 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.880736 23681 raft_consensus.cc:2468] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 2.
I20260709 13:09:22.885056 24290 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.857321 23685 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
W20260709 13:09:22.861550 23576 leader_election.cc:336] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.886895 23685 raft_consensus.cc:2468] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:22.862778 23607 raft_consensus.cc:2468] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:22.850780 23649 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.865335 23683 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:22.853916 24242 leader_election.cc:290] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.890066 24293 raft_consensus.cc:2804] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.890545 24293 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.890980 24293 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.894124 23575 leader_election.cc:304] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.894888 24292 raft_consensus.cc:2804] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:09:22.895592 23576 leader_election.cc:336] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.895709 23501 leader_election.cc:304] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.855511 24286 leader_election.cc:290] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:22.900882 24292 raft_consensus.cc:697] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:22.900877 24286 raft_consensus.cc:493] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.901760 24292 consensus_queue.cc:237] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.902442 24286 raft_consensus.cc:515] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.903191 24293 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:22.905521 24286 leader_election.cc:290] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:22.906076 24286 raft_consensus.cc:2804] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.906584 24286 raft_consensus.cc:697] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:22.913326 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "18312e6c7d274b80b354ee1498cc3449" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.914122 23608 raft_consensus.cc:2393] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 18312e6c7d274b80b354ee1498cc3449 in current term 2: Already voted for candidate 89c3e465d9db463a9d55c8a2e7c061ea in this term.
I20260709 13:09:22.914234 24286 consensus_queue.cc:237] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.914789 23607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" is_pre_election: true
I20260709 13:09:22.906158 24293 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:22.915356 23607 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 1.
I20260709 13:09:22.930358 23501 leader_election.cc:304] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:22.931217 24286 raft_consensus.cc:2804] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.932461 24286 raft_consensus.cc:493] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.932803 24286 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:22.933650 23502 leader_election.cc:336] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.939013 23359 catalog_manager.cc:5697] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:22.941776 23650 leader_election.cc:336] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:22.939651 23355 catalog_manager.cc:5697] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 2 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.942263 23650 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
I20260709 13:09:22.950410 24293 raft_consensus.cc:2749] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.962597 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:22.963358 23681 raft_consensus.cc:2393] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89c3e465d9db463a9d55c8a2e7c061ea in current term 2: Already voted for candidate 18312e6c7d274b80b354ee1498cc3449 in this term.
I20260709 13:09:22.968411 23575 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.969450 24292 raft_consensus.cc:2749] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:09:22.973948 24286 raft_consensus.cc:515] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:22.975065 23501 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.975939 24294 raft_consensus.cc:2804] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.976055 24286 leader_election.cc:290] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:22.976225 23501 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:22.976402 24294 raft_consensus.cc:493] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.976912 24294 raft_consensus.cc:3060] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.977803 24298 raft_consensus.cc:2804] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:22.978190 24298 raft_consensus.cc:493] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:22.978519 24298 raft_consensus.cc:3060] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.985390 23608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:22.985975 23608 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.986409 24294 raft_consensus.cc:515] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:22.988703 24294 leader_election.cc:290] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:22.996568 23608 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
W20260709 13:09:22.999655 23502 consensus_peers.cc:597] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.000613 23501 leader_election.cc:304] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a59e1270baa49b1b1c6ca3b1a4c3146, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:23.001449 24294 raft_consensus.cc:2804] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.002027 24294 raft_consensus.cc:697] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
W20260709 13:09:23.001996 23502 leader_election.cc:336] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:23.003165 24294 consensus_queue.cc:237] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
W20260709 13:09:23.007499 23502 leader_election.cc:336] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:23.010766 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aff520a7b42548a7a2e0e5ca849ec785" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:23.011435 23683 raft_consensus.cc:3060] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.996927 24298 raft_consensus.cc:515] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:23.020920 23683 raft_consensus.cc:2468] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:23.028403 24298 leader_election.cc:290] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:23.038362 23501 leader_election.cc:304] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:23.040346 24294 raft_consensus.cc:2804] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.040843 24294 raft_consensus.cc:697] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:23.041046 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a22253dd90fd40809d13b1e79d2ea774" candidate_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:23.042527 24294 consensus_queue.cc:237] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:23.044381 23683 raft_consensus.cc:3060] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:23.057554 23359 catalog_manager.cc:5697] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:23.060267 23502 leader_election.cc:336] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:23.062450 23683 raft_consensus.cc:2468] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7a59e1270baa49b1b1c6ca3b1a4c3146 in term 2.
I20260709 13:09:23.064764 23501 leader_election.cc:304] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:23.065891 24294 raft_consensus.cc:2804] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:23.066563 24294 raft_consensus.cc:697] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Leader. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:23.067487 24294 consensus_queue.cc:237] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
W20260709 13:09:23.078909 23650 consensus_peers.cc:597] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.088200 23359 catalog_manager.cc:5697] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.091333 23608 raft_consensus.cc:1275] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 18312e6c7d274b80b354ee1498cc3449: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.090919 23359 catalog_manager.cc:5697] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 reported cstate change: term changed from 1 to 2, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:23.093178 24296 consensus_queue.cc:1048] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:23.105477 23502 consensus_peers.cc:597] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.109143 23533 raft_consensus.cc:1275] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 18312e6c7d274b80b354ee1498cc3449: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.111063 24293 consensus_queue.cc:1048] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:23.137494 23650 consensus_peers.cc:597] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.164645 23683 raft_consensus.cc:1275] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.165946 24298 consensus_queue.cc:1048] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.273806 23608 raft_consensus.cc:1275] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 18312e6c7d274b80b354ee1498cc3449: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.275082 24293 consensus_queue.cc:1048] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:23.291858 23607 raft_consensus.cc:1275] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 18312e6c7d274b80b354ee1498cc3449: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.293208 24276 consensus_queue.cc:1048] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:23.301023 23650 consensus_peers.cc:597] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.336639 23650 consensus_peers.cc:597] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.369279 23576 consensus_peers.cc:597] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.481386 23683 raft_consensus.cc:1275] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 89c3e465d9db463a9d55c8a2e7c061ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.486570 24292 consensus_queue.cc:1048] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:23.488142 23502 consensus_peers.cc:597] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:23.489970 23607 raft_consensus.cc:1275] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.493038 24298 consensus_queue.cc:1048] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
W20260709 13:09:23.519738 23502 consensus_peers.cc:597] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.544423 13792 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 23483)
I20260709 13:09:23.582386 23681 raft_consensus.cc:1275] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.584672 24298 consensus_queue.cc:1048] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:23.602917 23502 consensus_peers.cc:597] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.604121 23650 consensus_peers.cc:597] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:23.604683 23608 raft_consensus.cc:1275] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.609018 24314 consensus_queue.cc:1048] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:23.624953 23681 raft_consensus.cc:1275] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 7a59e1270baa49b1b1c6ca3b1a4c3146: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:23.626566 24294 consensus_queue.cc:1048] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:23.640357 23502 consensus_peers.cc:597] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:23.646888 23576 consensus_peers.cc:597] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.699277 23576 consensus_peers.cc:597] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.716673 23650 consensus_peers.cc:597] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.757033 23576 consensus_peers.cc:597] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.809825 23650 consensus_peers.cc:597] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.834619 23650 consensus_peers.cc:597] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.842221 23576 consensus_peers.cc:597] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.842832 23576 consensus_peers.cc:597] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.843458 23502 consensus_peers.cc:597] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.854600 23650 consensus_peers.cc:597] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.937172 23502 consensus_peers.cc:597] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:23.942721 23502 consensus_peers.cc:597] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.005182 23650 consensus_peers.cc:597] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.015292 23576 consensus_peers.cc:597] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.043380 23650 consensus_peers.cc:597] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.055048 23576 consensus_peers.cc:597] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.058339 23502 consensus_peers.cc:597] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.060088 23650 consensus_peers.cc:597] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.099373 23650 consensus_peers.cc:597] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.104806 23650 consensus_peers.cc:597] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.115705 23576 consensus_peers.cc:597] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.139012 23650 consensus_peers.cc:597] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.159508 23650 consensus_peers.cc:597] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.159970 23650 consensus_peers.cc:597] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.186301 23576 consensus_peers.cc:597] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.228936 23502 consensus_peers.cc:597] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.241323 23502 consensus_peers.cc:597] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.299229 23650 consensus_peers.cc:597] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.374639 23502 consensus_peers.cc:597] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.398825 23650 consensus_peers.cc:597] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.406857 23650 consensus_peers.cc:597] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.409094 23650 consensus_peers.cc:597] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:24.544934 13792 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 23483)
I20260709 13:09:24.764307 24323 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:24.764961 24323 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:24.768189 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449" is_pre_election: true
I20260709 13:09:24.768342 24323 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:24.768807 23681 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 2.
I20260709 13:09:24.770001 23575 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:24.772054 24323 raft_consensus.cc:2804] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:09:24.772481 24323 raft_consensus.cc:493] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:24.772493 23576 leader_election.cc:336] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:24.773114 24323 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.781095 24323 raft_consensus.cc:515] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:24.783152 24323 leader_election.cc:290] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 3 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:24.785072 23681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c28bba470bb64f2ea64dd235d43bf174" candidate_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:24.785643 23681 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:24.792829 23681 raft_consensus.cc:2468] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c3e465d9db463a9d55c8a2e7c061ea in term 3.
I20260709 13:09:24.794150 23575 leader_election.cc:304] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:24.796533 24323 raft_consensus.cc:2804] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:09:24.796656 23576 leader_election.cc:336] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111)
I20260709 13:09:24.797106 24323 raft_consensus.cc:697] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 LEADER]: Becoming Leader. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:24.797951 24323 consensus_queue.cc:237] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:24.810461 23355 catalog_manager.cc:5697] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea reported cstate change: term changed from 1 to 3, leader changed from 6f0851261b6d4832b826564f378ba69d (127.13.120.1) to 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3). New cstate: current_term: 3 leader_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:25.188215 23681 raft_consensus.cc:1275] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Refusing update from remote peer 89c3e465d9db463a9d55c8a2e7c061ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:25.189426 24321 consensus_queue.cc:1048] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:25.227582 23576 consensus_peers.cc:597] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:25.490154 23502 consensus_peers.cc:597] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.542589 23650 consensus_peers.cc:597] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.545284 23650 consensus_peers.cc:597] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.545576 13792 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 23483)
W20260709 13:09:25.615209 23650 consensus_peers.cc:597] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.809659 23502 consensus_peers.cc:597] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.880236 23502 consensus_peers.cc:597] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:25.887223 23502 consensus_peers.cc:597] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:26.069830 23650 consensus_peers.cc:597] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.111692 23576 consensus_peers.cc:597] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:26.123660 23650 consensus_peers.cc:597] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:26.233472 23576 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111) [suppressed 431 similar messages]
W20260709 13:09:26.240437 23576 consensus_peers.cc:597] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.266431 23502 consensus_peers.cc:597] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:26.273820 23502 consensus_peers.cc:597] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.276861 23576 consensus_peers.cc:597] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.281632 23576 consensus_peers.cc:597] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.299854 23502 consensus_peers.cc:597] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.343781 23650 consensus_peers.cc:597] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.399699 23576 consensus_peers.cc:597] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.470126 23576 consensus_peers.cc:597] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.495491 23502 consensus_peers.cc:597] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:26.524080 23650 consensus_peers.cc:597] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.546048 13792 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 23483)
W20260709 13:09:26.547212 23576 consensus_peers.cc:597] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.547534 23650 consensus_peers.cc:597] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.555847 23650 consensus_peers.cc:597] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.563436 23650 consensus_peers.cc:597] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.570075 23650 consensus_peers.cc:597] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.572053 23650 consensus_peers.cc:597] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.582417 23650 consensus_peers.cc:597] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.590179 23576 consensus_peers.cc:597] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.612888 23576 consensus_peers.cc:597] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.613902 23502 consensus_peers.cc:597] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.614504 23502 consensus_peers.cc:597] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.619025 23502 consensus_peers.cc:597] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.682505 23650 consensus_peers.cc:597] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.741407 23502 consensus_peers.cc:597] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.744092 23576 consensus_peers.cc:597] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.761739 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
W20260709 13:09:26.770677 23650 consensus_peers.cc:597] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.796960 23650 consensus_peers.cc:597] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.838367 23650 consensus_peers.cc:597] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.847121 23650 consensus_peers.cc:597] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:26.886013 23502 consensus_peers.cc:597] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.904642 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:26.913075 24339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.919401 24340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:26.919780 24342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:26.921541 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:26.923316 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:26.923672 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:26.923949 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602566923926 us; error 0 us; skew 500 ppm
I20260709 13:09:26.924803 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:09:26.927968 23650 consensus_peers.cc:597] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:26.928252 13792 webserver.cc:533] Webserver started at http://127.13.120.1:35121/ using document root <none> and password file <none>
I20260709 13:09:26.928922 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:26.929116 13792 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:26.933167 13792 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 13:09:26.945920 24347 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:26.946831 13792 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:26.947183 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "6f0851261b6d4832b826564f378ba69d"
format_stamp: "Formatted at 2026-07-09 13:09:07 on dist-test-slave-mcck"
I20260709 13:09:26.947786 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:26.966879 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:26.968580 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:26.970366 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:26.975811 24354 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 13:09:26.983036 23650 consensus_peers.cc:597] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:27.065403 23650 consensus_peers.cc:597] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:27.232762 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:09:27.233117 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.258s	user 0.006s	sys 0.003s
I20260709 13:09:27.233369 13792 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:09:27.237995 24354 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.258394 24354 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.260018 24354 tablet_bootstrap.cc:492] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.260636 24354 ts_tablet_manager.cc:1403] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.006s
I20260709 13:09:27.263331 24354 raft_consensus.cc:359] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.264417 24354 raft_consensus.cc:740] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.265201 24354 consensus_queue.cc:260] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.273473 24354 ts_tablet_manager.cc:1434] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.006s
I20260709 13:09:27.274255 24354 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.286208 24354 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.287195 24354 tablet_bootstrap.cc:492] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.287911 24354 ts_tablet_manager.cc:1403] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 13:09:27.290432 24354 raft_consensus.cc:359] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.291118 24354 raft_consensus.cc:740] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.291831 24354 consensus_queue.cc:260] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.293653 24354 ts_tablet_manager.cc:1434] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:27.294450 24354 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.305932 24354 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.306689 24354 tablet_bootstrap.cc:492] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.307262 24354 ts_tablet_manager.cc:1403] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:09:27.309268 24354 raft_consensus.cc:359] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.309857 24354 raft_consensus.cc:740] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.310552 24354 consensus_queue.cc:260] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.312194 24354 ts_tablet_manager.cc:1434] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:27.312875 24354 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.328897 24354 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.329873 24354 tablet_bootstrap.cc:492] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.330544 24354 ts_tablet_manager.cc:1403] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:09:27.333101 24354 raft_consensus.cc:359] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.333776 24354 raft_consensus.cc:740] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.334493 24354 consensus_queue.cc:260] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.336453 24354 ts_tablet_manager.cc:1434] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:09:27.337262 24354 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.354106 24354 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.355048 24354 tablet_bootstrap.cc:492] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.355721 24354 ts_tablet_manager.cc:1403] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:09:27.357637 24354 raft_consensus.cc:359] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.358141 24354 raft_consensus.cc:740] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.358764 24354 consensus_queue.cc:260] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.360129 24354 ts_tablet_manager.cc:1434] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:27.360939 24354 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.379842 24354 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.380869 24354 tablet_bootstrap.cc:492] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.381608 24354 ts_tablet_manager.cc:1403] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 13:09:27.384089 24354 raft_consensus.cc:359] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.384791 24354 raft_consensus.cc:740] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.385582 24354 consensus_queue.cc:260] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.388227 24354 ts_tablet_manager.cc:1434] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.389055 24354 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.407428 24354 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.408483 24354 tablet_bootstrap.cc:492] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.409194 24354 ts_tablet_manager.cc:1403] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:09:27.411857 24354 raft_consensus.cc:359] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.412568 24354 raft_consensus.cc:740] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.413275 24354 consensus_queue.cc:260] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.415194 24354 ts_tablet_manager.cc:1434] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:27.416040 24354 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.433677 24354 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.434656 24354 tablet_bootstrap.cc:492] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.435312 24354 ts_tablet_manager.cc:1403] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.004s
I20260709 13:09:27.437927 24354 raft_consensus.cc:359] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.438594 24354 raft_consensus.cc:740] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.439268 24354 consensus_queue.cc:260] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.441315 24354 ts_tablet_manager.cc:1434] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:27.442114 24354 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.461930 24354 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.462960 24354 tablet_bootstrap.cc:492] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.463680 24354 ts_tablet_manager.cc:1403] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.000s
I20260709 13:09:27.466246 24354 raft_consensus.cc:359] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.466958 24354 raft_consensus.cc:740] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.467672 24354 consensus_queue.cc:260] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.469888 24354 ts_tablet_manager.cc:1434] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.470705 24354 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.487236 24354 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.488224 24354 tablet_bootstrap.cc:492] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.488843 24354 ts_tablet_manager.cc:1403] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:09:27.491361 24354 raft_consensus.cc:359] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.492164 24354 raft_consensus.cc:740] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.492914 24354 consensus_queue.cc:260] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.494233 13792 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:09:27.494621 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.261s	user 0.244s	sys 0.003s
I20260709 13:09:27.494933 24354 ts_tablet_manager.cc:1434] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.495940 24354 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.531077 24354 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.532204 24354 tablet_bootstrap.cc:492] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.532884 24354 ts_tablet_manager.cc:1403] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 13:09:27.535542 24354 raft_consensus.cc:359] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.536334 24354 raft_consensus.cc:740] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.538051 24354 consensus_queue.cc:260] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.540320 24354 ts_tablet_manager.cc:1434] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:27.540972 24354 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.578579 24354 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.579552 24354 tablet_bootstrap.cc:492] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.580266 24354 ts_tablet_manager.cc:1403] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.003s
I20260709 13:09:27.582924 24354 raft_consensus.cc:359] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.583623 24354 raft_consensus.cc:740] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.584347 24354 consensus_queue.cc:260] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.586879 24354 ts_tablet_manager.cc:1434] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.587545 24354 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.603065 24354 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.604060 24354 tablet_bootstrap.cc:492] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.604733 24354 ts_tablet_manager.cc:1403] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:09:27.607378 24354 raft_consensus.cc:359] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.608135 24354 raft_consensus.cc:740] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.608933 24354 consensus_queue.cc:260] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.611178 24354 ts_tablet_manager.cc:1434] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.002s
I20260709 13:09:27.612067 24354 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.627507 24354 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.628607 24354 tablet_bootstrap.cc:492] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.629339 24354 ts_tablet_manager.cc:1403] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:09:27.631866 24354 raft_consensus.cc:359] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.632606 24354 raft_consensus.cc:740] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.633455 24354 consensus_queue.cc:260] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.635622 24354 ts_tablet_manager.cc:1434] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:27.636518 24354 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:27.644356 23576 consensus_peers.cc:597] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:27.682957 24354 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.684098 24354 tablet_bootstrap.cc:492] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.684828 24354 ts_tablet_manager.cc:1403] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.049s	user 0.026s	sys 0.020s
I20260709 13:09:27.687219 24354 raft_consensus.cc:359] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.687963 24354 raft_consensus.cc:740] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.688796 24354 consensus_queue.cc:260] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.691174 24354 ts_tablet_manager.cc:1434] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.691979 24354 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.706467 24354 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.707397 24354 tablet_bootstrap.cc:492] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.708076 24354 ts_tablet_manager.cc:1403] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
I20260709 13:09:27.710800 24354 raft_consensus.cc:359] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.711536 24354 raft_consensus.cc:740] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.712230 24354 consensus_queue.cc:260] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.714463 24354 ts_tablet_manager.cc:1434] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.715260 24354 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.731532 24354 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.732565 24354 tablet_bootstrap.cc:492] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.733294 24354 ts_tablet_manager.cc:1403] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.002s
I20260709 13:09:27.735841 24354 raft_consensus.cc:359] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.736611 24354 raft_consensus.cc:740] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.737317 24354 consensus_queue.cc:260] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.739370 24354 ts_tablet_manager.cc:1434] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 13:09:27.740098 24354 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.754537 24432 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:45163 every 8 connection(s)
I20260709 13:09:27.755470 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:45163
I20260709 13:09:27.762887 24354 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.764042 24354 tablet_bootstrap.cc:492] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.764794 24354 ts_tablet_manager.cc:1403] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:09:27.767578 24354 raft_consensus.cc:359] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.768558 24354 raft_consensus.cc:740] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.769531 24354 consensus_queue.cc:260] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:27.773897 24354 ts_tablet_manager.cc:1434] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:27.774786 24354 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.796188 24433 heartbeater.cc:344] Connected to a master server at 127.13.120.62:34857
I20260709 13:09:27.796672 24433 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:27.798007 24433 heartbeater.cc:507] Master 127.13.120.62:34857 requested a full tablet report, sending...
I20260709 13:09:27.800567 24354 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.801681 24354 tablet_bootstrap.cc:492] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.802389 24354 ts_tablet_manager.cc:1403] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.000s
I20260709 13:09:27.807014 24354 raft_consensus.cc:359] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.807871 24354 raft_consensus.cc:740] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.808660 24354 consensus_queue.cc:260] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.811002 24354 ts_tablet_manager.cc:1434] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:27.811872 24354 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.818994 23359 ts_manager.cc:194] Re-registered known tserver with Master: 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163)
I20260709 13:09:27.819154 24402 raft_consensus.cc:3060] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.848716 24401 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.868041 23359 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58206
I20260709 13:09:27.873876 24433 heartbeater.cc:499] Master 127.13.120.62:34857 was elected leader, sending a full tablet report...
W20260709 13:09:27.938287 23650 consensus_peers.cc:597] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:27.948750 24354 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.952927 24354 tablet_bootstrap.cc:492] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.953588 24354 ts_tablet_manager.cc:1403] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.142s	user 0.017s	sys 0.004s
I20260709 13:09:27.956120 24354 raft_consensus.cc:359] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.956782 24354 raft_consensus.cc:740] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.957419 24354 consensus_queue.cc:260] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:27.960132 24354 ts_tablet_manager.cc:1434] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:27.961200 24354 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:27.976018 24402 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:27.985122 24354 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:27.986104 24354 tablet_bootstrap.cc:492] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:27.986820 24354 ts_tablet_manager.cc:1403] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.000s
I20260709 13:09:27.990278 24354 raft_consensus.cc:359] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.990774 24354 raft_consensus.cc:740] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:27.991308 24354 consensus_queue.cc:260] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:27.992789 24354 ts_tablet_manager.cc:1434] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.003s
I20260709 13:09:27.993556 24354 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:28.000901 23650 consensus_peers.cc:597] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:28.007951 24354 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.008968 24354 tablet_bootstrap.cc:492] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.009673 24354 ts_tablet_manager.cc:1403] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:09:28.012356 24354 raft_consensus.cc:359] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.013056 24354 raft_consensus.cc:740] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.013729 24354 consensus_queue.cc:260] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.016012 24354 ts_tablet_manager.cc:1434] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:28.017217 24354 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:28.033079 23650 consensus_peers.cc:597] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:28.034297 24354 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.035250 24354 tablet_bootstrap.cc:492] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.035933 24354 ts_tablet_manager.cc:1403] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:09:28.038450 24354 raft_consensus.cc:359] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.039139 24354 raft_consensus.cc:740] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.039850 24354 consensus_queue.cc:260] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.041914 24354 ts_tablet_manager.cc:1434] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:09:28.042730 24354 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.046777 24401 raft_consensus.cc:3060] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.047219 24402 raft_consensus.cc:3060] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.070711 24354 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.071647 24354 tablet_bootstrap.cc:492] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.072244 24354 ts_tablet_manager.cc:1403] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.015s
I20260709 13:09:28.074035 24354 raft_consensus.cc:359] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.074527 24354 raft_consensus.cc:740] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.075167 24354 consensus_queue.cc:260] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.076706 24354 ts_tablet_manager.cc:1434] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:28.077356 24354 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.089345 24354 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.090049 24354 tablet_bootstrap.cc:492] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.090571 24354 ts_tablet_manager.cc:1403] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:09:28.092463 24354 raft_consensus.cc:359] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.093005 24354 raft_consensus.cc:740] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.093590 24354 consensus_queue.cc:260] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.095067 24354 ts_tablet_manager.cc:1434] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:28.096108 24354 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.111341 24354 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.112094 24354 tablet_bootstrap.cc:492] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.112612 24354 ts_tablet_manager.cc:1403] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:09:28.114619 24354 raft_consensus.cc:359] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.115280 24354 raft_consensus.cc:740] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.116017 24354 consensus_queue.cc:260] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.118029 24354 ts_tablet_manager.cc:1434] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:28.119127 24354 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.134083 24354 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.134891 24354 tablet_bootstrap.cc:492] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.135488 24354 ts_tablet_manager.cc:1403] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260709 13:09:28.137461 24354 raft_consensus.cc:359] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.138120 24354 raft_consensus.cc:740] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.138804 24354 consensus_queue.cc:260] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.140924 24354 ts_tablet_manager.cc:1434] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:28.141697 24354 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.153720 24354 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.154516 24354 tablet_bootstrap.cc:492] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.155175 24354 ts_tablet_manager.cc:1403] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:28.157012 24354 raft_consensus.cc:359] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.157493 24354 raft_consensus.cc:740] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.158020 24354 consensus_queue.cc:260] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.159834 24354 ts_tablet_manager.cc:1434] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.004s	user 0.008s	sys 0.000s
I20260709 13:09:28.161201 24354 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.180790 24354 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.181767 24354 tablet_bootstrap.cc:492] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.182407 24354 ts_tablet_manager.cc:1403] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260709 13:09:28.184561 24354 raft_consensus.cc:359] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.185072 24354 raft_consensus.cc:740] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.185690 24354 consensus_queue.cc:260] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.187453 24354 ts_tablet_manager.cc:1434] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:28.188246 24354 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.201530 24354 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.202252 24354 tablet_bootstrap.cc:492] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.202937 24354 ts_tablet_manager.cc:1403] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.000s
I20260709 13:09:28.205349 24354 raft_consensus.cc:359] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.206075 24354 raft_consensus.cc:740] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.206804 24354 consensus_queue.cc:260] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.208675 24354 ts_tablet_manager.cc:1434] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:09:28.209196 24402 raft_consensus.cc:3060] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.209553 24354 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
W20260709 13:09:28.219107 23502 consensus_peers.cc:597] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:28.226521 24354 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.227589 24354 tablet_bootstrap.cc:492] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.228251 24354 ts_tablet_manager.cc:1403] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:09:28.236718 24402 raft_consensus.cc:3060] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.241744 24354 raft_consensus.cc:359] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.242539 24354 raft_consensus.cc:740] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.243227 24354 consensus_queue.cc:260] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.245239 24354 ts_tablet_manager.cc:1434] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:28.246714 24354 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.282476 24354 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.283512 24354 tablet_bootstrap.cc:492] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.284252 24354 ts_tablet_manager.cc:1403] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.008s
I20260709 13:09:28.287623 24354 raft_consensus.cc:359] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.288980 24354 raft_consensus.cc:740] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.289680 24354 consensus_queue.cc:260] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.291138 24354 ts_tablet_manager.cc:1434] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.001s
I20260709 13:09:28.292551 24354 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.308038 24354 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.308946 24354 tablet_bootstrap.cc:492] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.309491 24354 ts_tablet_manager.cc:1403] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:09:28.311453 24354 raft_consensus.cc:359] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:28.311966 24354 raft_consensus.cc:740] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.312546 24354 consensus_queue.cc:260] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:28.314079 24354 ts_tablet_manager.cc:1434] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:09:28.314996 24354 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.327069 24354 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.327968 24354 tablet_bootstrap.cc:492] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.328503 24354 ts_tablet_manager.cc:1403] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 13:09:28.330340 24354 raft_consensus.cc:359] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.330825 24354 raft_consensus.cc:740] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.331387 24354 consensus_queue.cc:260] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.333315 24354 ts_tablet_manager.cc:1434] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:09:28.334285 24354 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.348392 24402 raft_consensus.cc:3060] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.350337 24354 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.351356 24354 tablet_bootstrap.cc:492] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.352041 24354 ts_tablet_manager.cc:1403] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 13:09:28.367960 24354 raft_consensus.cc:359] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.368945 24354 raft_consensus.cc:740] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.369752 24354 consensus_queue.cc:260] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.372638 24354 ts_tablet_manager.cc:1434] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:09:28.373574 24354 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.397810 24354 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.398837 24354 tablet_bootstrap.cc:492] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.399398 24354 ts_tablet_manager.cc:1403] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.004s
I20260709 13:09:28.402051 24354 raft_consensus.cc:359] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.402719 24354 raft_consensus.cc:740] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.403481 24354 consensus_queue.cc:260] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.405551 24354 ts_tablet_manager.cc:1434] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:28.406421 24354 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.422159 24354 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.423132 24354 tablet_bootstrap.cc:492] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.423837 24354 ts_tablet_manager.cc:1403] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:09:28.425776 24354 raft_consensus.cc:359] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.426276 24354 raft_consensus.cc:740] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.426852 24354 consensus_queue.cc:260] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.428831 24354 ts_tablet_manager.cc:1434] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.004s
I20260709 13:09:28.429904 24354 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.443737 24354 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.444514 24354 tablet_bootstrap.cc:492] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.445235 24354 ts_tablet_manager.cc:1403] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:09:28.447315 24354 raft_consensus.cc:359] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.447908 24354 raft_consensus.cc:740] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.448521 24354 consensus_queue.cc:260] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.451210 24354 ts_tablet_manager.cc:1434] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:28.453071 24354 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.467352 24354 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.468335 24354 tablet_bootstrap.cc:492] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.468989 24354 ts_tablet_manager.cc:1403] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 13:09:28.470947 24354 raft_consensus.cc:359] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.471391 24354 raft_consensus.cc:740] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.471940 24354 consensus_queue.cc:260] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.473485 24354 ts_tablet_manager.cc:1434] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:09:28.474244 24354 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.487702 24354 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.488626 24354 tablet_bootstrap.cc:492] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.489283 24354 ts_tablet_manager.cc:1403] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:09:28.491604 24354 raft_consensus.cc:359] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.492210 24354 raft_consensus.cc:740] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.492817 24354 consensus_queue.cc:260] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.494858 24354 ts_tablet_manager.cc:1434] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:28.495608 24354 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.511641 24354 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.512526 24354 tablet_bootstrap.cc:492] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.513047 24354 ts_tablet_manager.cc:1403] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 13:09:28.515439 24354 raft_consensus.cc:359] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.516116 24354 raft_consensus.cc:740] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.516815 24354 consensus_queue.cc:260] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.518823 24354 ts_tablet_manager.cc:1434] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:28.519603 24354 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.543910 24401 raft_consensus.cc:3060] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:09:28.546655 24354 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.547538 24354 tablet_bootstrap.cc:492] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.548208 24354 ts_tablet_manager.cc:1403] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 13:09:28.550886 24354 raft_consensus.cc:359] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.551682 24354 raft_consensus.cc:740] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.552438 24354 consensus_queue.cc:260] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:28.554845 24354 ts_tablet_manager.cc:1434] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:28.555787 24354 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.568240 24399 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:28.578357 24354 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.579476 24354 tablet_bootstrap.cc:492] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.580235 24354 ts_tablet_manager.cc:1403] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.008s
I20260709 13:09:28.583117 24354 raft_consensus.cc:359] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.583933 24354 raft_consensus.cc:740] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.584851 24354 consensus_queue.cc:260] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.588660 24354 ts_tablet_manager.cc:1434] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:28.589929 24354 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.607609 24354 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.608668 24354 tablet_bootstrap.cc:492] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.609776 24354 ts_tablet_manager.cc:1403] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 13:09:28.612267 24354 raft_consensus.cc:359] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.613023 24354 raft_consensus.cc:740] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.613890 24354 consensus_queue.cc:260] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:28.616565 24354 ts_tablet_manager.cc:1434] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:28.617625 24354 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Bootstrap starting.
I20260709 13:09:28.640705 24354 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:28.641666 24354 tablet_bootstrap.cc:492] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Bootstrap complete.
I20260709 13:09:28.642302 24354 ts_tablet_manager.cc:1403] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 13:09:28.644740 24354 raft_consensus.cc:359] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.645453 24354 raft_consensus.cc:740] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Initialized, Role: FOLLOWER
I20260709 13:09:28.646224 24354 consensus_queue.cc:260] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:28.648674 24354 ts_tablet_manager.cc:1434] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:28.780864 24399 raft_consensus.cc:3060] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:29.109025 24399 raft_consensus.cc:3060] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.760800 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.810088 23683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:37.810765 23683 raft_consensus.cc:606] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.813148 23683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:37.813548 23683 raft_consensus.cc:606] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.829008 23604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700"
dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:46990
I20260709 13:09:37.829536 23604 raft_consensus.cc:606] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.832257 23683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd51d50e9f64154965524bf64801024"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:37.832811 23683 raft_consensus.cc:606] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.837195 23683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:37.837702 23683 raft_consensus.cc:606] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.852711 23533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edabba6fc9934299a8366e57960d9733"
dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:54492
I20260709 13:09:37.853230 23533 raft_consensus.cc:606] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.855552 23683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:37.855985 23683 raft_consensus.cc:606] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:37.857061 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:09:37.858223 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:37.875238 24500 raft_consensus.cc:993] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:37.875875 24497 raft_consensus.cc:1081] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:37.877431 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:37.877957 24402 raft_consensus.cc:493] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.878315 24402 raft_consensus.cc:3060] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.884846 24402 raft_consensus.cc:515] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:37.886689 24402 leader_election.cc:290] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:37.900693 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:37.900693 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1170481acec64cbe9a79c5bf7f04b3f6" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:37.901616 23683 raft_consensus.cc:3055] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.901697 23604 raft_consensus.cc:3060] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.902004 23683 raft_consensus.cc:740] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:37.903021 23683 consensus_queue.cc:260] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:37.904695 23683 raft_consensus.cc:3060] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.911679 23604 raft_consensus.cc:2468] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:37.912995 24349 leader_election.cc:304] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:37.913514 23683 raft_consensus.cc:2468] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:37.914842 24511 raft_consensus.cc:2804] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.916308 24511 raft_consensus.cc:697] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:37.917660 24511 consensus_queue.cc:237] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:37.927218 24500 raft_consensus.cc:993] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:37.927723 24500 raft_consensus.cc:1081] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:37.927754 23360 catalog_manager.cc:5697] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:37.929347 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:37.929893 24402 raft_consensus.cc:493] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.930215 24402 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.937145 24402 raft_consensus.cc:515] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:37.938858 24402 leader_election.cc:290] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 3 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:37.939549 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:37.940194 23683 raft_consensus.cc:3055] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:37.940550 23683 raft_consensus.cc:740] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:37.941382 23683 consensus_queue.cc:260] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:37.942677 23683 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.948864 23683 raft_consensus.cc:2468] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 3.
I20260709 13:09:37.949797 24349 leader_election.cc:304] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449, 6f0851261b6d4832b826564f378ba69d; no voters: 
I20260709 13:09:37.950625 24511 raft_consensus.cc:2804] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:37.951129 24511 raft_consensus.cc:697] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 3 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:37.951272 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2b7234d417542daa1fa8313cc1ab199" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:37.951932 23533 raft_consensus.cc:3060] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:37.952142 24511 consensus_queue.cc:237] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:37.961695 23533 raft_consensus.cc:2468] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 3.
I20260709 13:09:37.965113 23360 catalog_manager.cc:5697] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 2 to 3, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 3 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:37.971007 24504 raft_consensus.cc:993] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:37.971618 24500 raft_consensus.cc:1081] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:37.973160 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:37.973644 24402 raft_consensus.cc:493] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:37.973985 24402 raft_consensus.cc:3060] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.978977 24402 raft_consensus.cc:515] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:37.980391 24402 leader_election.cc:290] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:37.980871 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:37.981360 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d579561ea4a0ba8abee89a0e60ef4" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:37.981509 23604 raft_consensus.cc:3060] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.981808 23683 raft_consensus.cc:3055] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:37.982016 23683 raft_consensus.cc:740] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:37.982607 23683 consensus_queue.cc:260] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:37.983564 23683 raft_consensus.cc:3060] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:37.987154 23604 raft_consensus.cc:2468] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:37.988296 24349 leader_election.cc:304] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:37.988942 24511 raft_consensus.cc:2804] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:37.989351 24511 raft_consensus.cc:697] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:37.990244 24511 consensus_queue.cc:237] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:37.999938 23360 catalog_manager.cc:5697] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.001489 24500 raft_consensus.cc:993] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.002025 24500 raft_consensus.cc:1081] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.003433 23683 raft_consensus.cc:2468] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.003875 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd51d50e9f64154965524bf64801024"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:38.004639 24402 raft_consensus.cc:493] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.005539 24402 raft_consensus.cc:3060] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.011351 24402 raft_consensus.cc:515] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:38.013757 24402 leader_election.cc:290] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:38.014905 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd51d50e9f64154965524bf64801024" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:38.016721 23683 raft_consensus.cc:3055] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.017011 23683 raft_consensus.cc:740] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:38.017215 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd51d50e9f64154965524bf64801024" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:38.017789 23533 raft_consensus.cc:3060] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.017769 23683 consensus_queue.cc:260] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:38.019254 23683 raft_consensus.cc:3060] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.024550 23533 raft_consensus.cc:2468] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.025828 24351 leader_election.cc:304] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:38.025985 23683 raft_consensus.cc:2468] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.026592 24511 raft_consensus.cc:2804] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.027019 24511 raft_consensus.cc:697] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:38.027904 24511 consensus_queue.cc:237] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:38.040318 23360 catalog_manager.cc:5697] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.191066 24500 raft_consensus.cc:993] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.191594 24504 raft_consensus.cc:1081] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.193466 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:38.193969 24402 raft_consensus.cc:493] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.194265 24402 raft_consensus.cc:3060] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.199234 24402 raft_consensus.cc:515] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:38.200874 24402 leader_election.cc:290] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:38.201416 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:38.201838 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1834b561b741d9a51e512f60b6f81b" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:38.202037 23683 raft_consensus.cc:3055] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.202369 23683 raft_consensus.cc:740] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:38.202396 23533 raft_consensus.cc:3060] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.203258 23683 consensus_queue.cc:260] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:38.204514 23683 raft_consensus.cc:3060] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.209381 23533 raft_consensus.cc:2468] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.210438 24351 leader_election.cc:304] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:38.210767 23683 raft_consensus.cc:2468] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.211218 24511 raft_consensus.cc:2804] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.211815 24511 raft_consensus.cc:697] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:38.212628 24511 consensus_queue.cc:237] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:38.226042 23360 catalog_manager.cc:5697] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.256574 24490 raft_consensus.cc:993] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.257133 24503 raft_consensus.cc:1081] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.258869 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33860
I20260709 13:09:38.259387 24399 raft_consensus.cc:493] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.259734 24399 raft_consensus.cc:3060] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.266574 24399 raft_consensus.cc:515] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:38.270722 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:38.271286 23532 raft_consensus.cc:3060] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.273455 24399 leader_election.cc:290] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:38.274403 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75d142d8c75c4547b54e489d38fda700" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:38.275005 23604 raft_consensus.cc:3055] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.275239 23604 raft_consensus.cc:740] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89c3e465d9db463a9d55c8a2e7c061ea, State: Running, Role: LEADER
I20260709 13:09:38.275918 23604 consensus_queue.cc:260] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:38.276813 23604 raft_consensus.cc:3060] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.277558 23532 raft_consensus.cc:2468] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.278501 24351 leader_election.cc:304] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:38.279340 24511 raft_consensus.cc:2804] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.279819 24511 raft_consensus.cc:697] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:38.280673 24511 consensus_queue.cc:237] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:38.282295 23604 raft_consensus.cc:2468] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:38.290040 23360 catalog_manager.cc:5697] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.312279 24489 raft_consensus.cc:993] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.312863 24502 raft_consensus.cc:1081] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:38.314409 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edabba6fc9934299a8366e57960d9733"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33844
I20260709 13:09:38.314990 24399 raft_consensus.cc:493] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.315339 24399 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.322563 24399 raft_consensus.cc:515] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:38.324496 24399 leader_election.cc:290] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 3 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:38.325196 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:38.325454 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edabba6fc9934299a8366e57960d9733" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:38.325781 23532 raft_consensus.cc:3055] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.326059 23604 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.326179 23532 raft_consensus.cc:740] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:38.327021 23532 consensus_queue.cc:260] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:38.328022 23532 raft_consensus.cc:3060] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.332130 23604 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 3.
I20260709 13:09:38.332969 24349 leader_election.cc:304] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:38.333333 23532 raft_consensus.cc:2468] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 3.
I20260709 13:09:38.333590 24511 raft_consensus.cc:2804] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.334168 24511 raft_consensus.cc:697] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 3 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:38.335011 24511 consensus_queue.cc:237] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:38.344836 23360 catalog_manager.cc:5697] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 2 to 3, leader changed from 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 3 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:38.348892 23683 raft_consensus.cc:1275] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.351158 24511 consensus_queue.cc:1048] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.368646 23532 raft_consensus.cc:1275] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.373389 23681 raft_consensus.cc:1275] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.373512 24512 consensus_queue.cc:1048] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:09:38.376643 24512 consensus_queue.cc:1048] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.397554 23604 raft_consensus.cc:1275] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.399184 24512 consensus_queue.cc:1048] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.422204 23604 raft_consensus.cc:1275] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.423820 24511 consensus_queue.cc:1048] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.452006 23681 raft_consensus.cc:1275] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.454260 24511 consensus_queue.cc:1048] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.603276 23683 raft_consensus.cc:1275] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.604416 24511 consensus_queue.cc:1048] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.612771 23532 raft_consensus.cc:1275] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.614351 24532 consensus_queue.cc:1048] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:38.634598 23683 raft_consensus.cc:1275] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.635982 24532 consensus_queue.cc:1048] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.645444 23532 raft_consensus.cc:1275] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.646756 24532 consensus_queue.cc:1048] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.725112 23533 raft_consensus.cc:1275] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.726220 24511 consensus_queue.cc:1048] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.736333 23604 raft_consensus.cc:1275] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.737663 24511 consensus_queue.cc:1048] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.768031 23604 raft_consensus.cc:1275] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.769129 24511 consensus_queue.cc:1048] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.778425 23533 raft_consensus.cc:1275] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.785431 24512 consensus_queue.cc:1048] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.859064 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.894656 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.928484 23681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "306e3c84432447f9be679573a0761c06"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:38.928936 23681 raft_consensus.cc:606] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:38.931186 23681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:38.931617 23681 raft_consensus.cc:606] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:38.933857 23681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:38.934396 23681 raft_consensus.cc:606] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:38.937619 23533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b7f78bc1f917479c95f330e249821717"
dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:54492
I20260709 13:09:38.938068 23533 raft_consensus.cc:606] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:38.940428 23681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:38.940811 23681 raft_consensus.cc:606] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:38.942705 23681 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c740becc06a7409891e4058e37695e2c"
dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:39270
I20260709 13:09:38.943053 23681 raft_consensus.cc:606] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:38.943989 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:09:38.945178 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:39.017287 24504 raft_consensus.cc:993] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.017899 24497 raft_consensus.cc:1081] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.019650 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:39.020201 24402 raft_consensus.cc:493] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.020546 24402 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.026396 24402 raft_consensus.cc:515] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:39.027848 24402 leader_election.cc:290] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 3 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:39.028556 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:39.028699 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd771a7f581f469db75c0b9d33768447" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:39.029310 23609 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.029402 23683 raft_consensus.cc:3055] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.030575 23683 raft_consensus.cc:740] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:39.031353 23683 consensus_queue.cc:260] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:39.032567 23683 raft_consensus.cc:3060] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.038954 23683 raft_consensus.cc:2468] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 3.
I20260709 13:09:39.038954 23609 raft_consensus.cc:2468] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 3.
I20260709 13:09:39.040362 24349 leader_election.cc:304] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:39.040948 24511 raft_consensus.cc:2804] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:39.041404 24511 raft_consensus.cc:697] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 3 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:39.042173 24511 consensus_queue.cc:237] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:39.051319 23355 catalog_manager.cc:5697] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 2 to 3, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 3 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.109582 24504 raft_consensus.cc:993] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.110028 24500 raft_consensus.cc:1081] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.111240 24402 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:39.111678 24402 raft_consensus.cc:493] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.111898 24402 raft_consensus.cc:3060] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.116168 24402 raft_consensus.cc:515] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:39.117770 24402 leader_election.cc:290] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:39.118698 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:39.118673 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b65d1bee3bb54b66998685be52e5bf04" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:39.119499 23683 raft_consensus.cc:3055] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.119602 23609 raft_consensus.cc:3060] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.119762 23683 raft_consensus.cc:740] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:39.120615 23683 consensus_queue.cc:260] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:39.121541 23683 raft_consensus.cc:3060] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.125005 23609 raft_consensus.cc:2468] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.126312 24349 leader_election.cc:304] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:39.126920 24511 raft_consensus.cc:2804] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.127310 24511 raft_consensus.cc:697] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:39.127322 23683 raft_consensus.cc:2468] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.128203 24511 consensus_queue.cc:237] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:39.137593 23355 catalog_manager.cc:5697] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.258072 24504 raft_consensus.cc:993] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.258571 24500 raft_consensus.cc:1081] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.260977 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c740becc06a7409891e4058e37695e2c"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:39.261538 24399 raft_consensus.cc:493] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.261819 24399 raft_consensus.cc:3060] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.266227 24399 raft_consensus.cc:515] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:39.267632 24399 leader_election.cc:290] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:39.268246 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:39.268603 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c740becc06a7409891e4058e37695e2c" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:39.268844 23683 raft_consensus.cc:3055] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.269150 23533 raft_consensus.cc:3060] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.269199 23683 raft_consensus.cc:740] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:39.269996 23683 consensus_queue.cc:260] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:39.270885 23683 raft_consensus.cc:3060] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.273746 23533 raft_consensus.cc:2468] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.274916 24351 leader_election.cc:304] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:39.275902 24532 raft_consensus.cc:2804] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.276389 23683 raft_consensus.cc:2468] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.276391 24532 raft_consensus.cc:697] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:39.278530 24532 consensus_queue.cc:237] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:39.288591 23355 catalog_manager.cc:5697] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.327617 24500 raft_consensus.cc:993] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.327993 24504 raft_consensus.cc:1081] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.329505 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:39.330003 24399 raft_consensus.cc:493] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.330345 24399 raft_consensus.cc:3060] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.336812 24399 raft_consensus.cc:515] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:39.338970 24399 leader_election.cc:290] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569), 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613)
I20260709 13:09:39.340484 23532 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:39.340847 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8291e2ee677e4f8780ef9c902583fb55" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:39.341091 23532 raft_consensus.cc:3060] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.341460 23683 raft_consensus.cc:3055] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.341792 23683 raft_consensus.cc:740] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:39.342453 23683 consensus_queue.cc:260] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:39.343443 23683 raft_consensus.cc:3060] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.345875 23532 raft_consensus.cc:2468] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.346832 24351 leader_election.cc:304] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:39.347635 24511 raft_consensus.cc:2804] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.348081 24511 raft_consensus.cc:697] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:39.348912 24511 consensus_queue.cc:237] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } }
I20260709 13:09:39.349346 23683 raft_consensus.cc:2468] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.357954 23355 catalog_manager.cc:5697] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.451115 24500 raft_consensus.cc:993] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.451622 24504 raft_consensus.cc:1081] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.453022 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "306e3c84432447f9be679573a0761c06"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33836
I20260709 13:09:39.453428 24399 raft_consensus.cc:493] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.453800 24399 raft_consensus.cc:3060] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.458583 24399 raft_consensus.cc:515] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:39.460067 24399 leader_election.cc:290] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887), 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4:44569)
I20260709 13:09:39.460929 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306e3c84432447f9be679573a0761c06" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:39.460829 23683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "306e3c84432447f9be679573a0761c06" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "18312e6c7d274b80b354ee1498cc3449"
I20260709 13:09:39.461621 23609 raft_consensus.cc:3060] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.461864 23683 raft_consensus.cc:3055] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.462219 23683 raft_consensus.cc:740] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 18312e6c7d274b80b354ee1498cc3449, State: Running, Role: LEADER
I20260709 13:09:39.462956 23683 consensus_queue.cc:260] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:39.464058 23683 raft_consensus.cc:3060] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.467098 23609 raft_consensus.cc:2468] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.468183 24349 leader_election.cc:304] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:39.468957 24511 raft_consensus.cc:2804] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.469453 24511 raft_consensus.cc:697] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:39.470460 23683 raft_consensus.cc:2468] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.470302 24511 consensus_queue.cc:237] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } }
I20260709 13:09:39.480096 23355 catalog_manager.cc:5697] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 18312e6c7d274b80b354ee1498cc3449 (127.13.120.4) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:39.548072 24502 raft_consensus.cc:993] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.548570 24502 raft_consensus.cc:1081] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:39.550390 24399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b7f78bc1f917479c95f330e249821717"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33844
I20260709 13:09:39.550930 24399 raft_consensus.cc:493] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.551214 24399 raft_consensus.cc:3060] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.555785 24399 raft_consensus.cc:515] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:39.558246 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:39.559031 23533 raft_consensus.cc:3055] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:39.559371 23533 raft_consensus.cc:740] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:39.559468 24399 leader_election.cc:290] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:39.561905 23604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7f78bc1f917479c95f330e249821717" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:39.564587 23604 raft_consensus.cc:3060] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.563513 23533 consensus_queue.cc:260] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:39.566812 23609 raft_consensus.cc:1275] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.567446 23533 raft_consensus.cc:3060] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:39.570942 23683 raft_consensus.cc:1275] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.572141 24511 consensus_queue.cc:1048] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.573969 23604 raft_consensus.cc:2468] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.575057 24349 leader_election.cc:304] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea; no voters: 
I20260709 13:09:39.577116 24512 consensus_queue.cc:1048] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.579208 24530 raft_consensus.cc:2804] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:39.586346 24530 raft_consensus.cc:697] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:39.587287 24530 consensus_queue.cc:237] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:39.592407 23533 raft_consensus.cc:2468] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:39.622524 23359 catalog_manager.cc:5697] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.651273 23685 raft_consensus.cc:1275] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.657415 24530 consensus_queue.cc:1048] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.663215 23604 raft_consensus.cc:1275] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.668021 24530 consensus_queue.cc:1048] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.688455 23533 raft_consensus.cc:1275] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.689873 24530 consensus_queue.cc:1048] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.709972 23683 raft_consensus.cc:1275] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.711498 24556 consensus_queue.cc:1048] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:39.808882 23683 raft_consensus.cc:1275] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.810158 24556 consensus_queue.cc:1048] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.818285 23533 raft_consensus.cc:1275] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.821702 24511 consensus_queue.cc:1048] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.880565 23683 raft_consensus.cc:1275] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.881772 24511 consensus_queue.cc:1048] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.897109 23609 raft_consensus.cc:1275] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:39.898484 24556 consensus_queue.cc:1048] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:39.946043 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:39.986122 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:40.022421 23533 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688"
dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
mode: GRACEFUL
new_leader_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:54492
I20260709 13:09:40.023087 23533 raft_consensus.cc:606] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Received request to transfer leadership to TS 6f0851261b6d4832b826564f378ba69d
I20260709 13:09:40.024377 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:09:40.025907 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:40.049960 24489 raft_consensus.cc:993] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: : Instructing follower 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:40.050503 24502 raft_consensus.cc:1081] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Signalling peer 6f0851261b6d4832b826564f378ba69d to start an election
I20260709 13:09:40.052131 24401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688"
dest_uuid: "6f0851261b6d4832b826564f378ba69d"
 from {username='slave'} at 127.0.0.1:33844
I20260709 13:09:40.052623 24401 raft_consensus.cc:493] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:40.052933 24401 raft_consensus.cc:3060] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.056353 23604 raft_consensus.cc:1275] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.057843 24556 consensus_queue.cc:1048] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.059724 24401 raft_consensus.cc:515] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:40.061981 24401 leader_election.cc:290] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Requested vote from peers 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:40.062919 23533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146"
I20260709 13:09:40.063570 23609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d64d538619c4e1ab146400dad7d1688" candidate_uuid: "6f0851261b6d4832b826564f378ba69d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89c3e465d9db463a9d55c8a2e7c061ea"
I20260709 13:09:40.064291 23609 raft_consensus.cc:3060] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.063583 23533 raft_consensus.cc:3055] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:40.064658 23533 raft_consensus.cc:740] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7a59e1270baa49b1b1c6ca3b1a4c3146, State: Running, Role: LEADER
I20260709 13:09:40.065515 23533 consensus_queue.cc:260] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:40.066704 23533 raft_consensus.cc:3060] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:40.074057 23609 raft_consensus.cc:2468] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:40.077370 23533 raft_consensus.cc:2468] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f0851261b6d4832b826564f378ba69d in term 2.
I20260709 13:09:40.078560 24351 leader_election.cc:304] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f0851261b6d4832b826564f378ba69d, 7a59e1270baa49b1b1c6ca3b1a4c3146; no voters: 
I20260709 13:09:40.080374 24511 raft_consensus.cc:2804] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:40.080861 24511 raft_consensus.cc:697] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Becoming Leader. State: Replica: 6f0851261b6d4832b826564f378ba69d, State: Running, Role: LEADER
I20260709 13:09:40.081795 24511 consensus_queue.cc:237] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } }
I20260709 13:09:40.086122 23533 raft_consensus.cc:1275] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.087513 24556 consensus_queue.cc:1048] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.105197 23355 catalog_manager.cc:5697] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d reported cstate change: term changed from 1 to 2, leader changed from 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2) to 6f0851261b6d4832b826564f378ba69d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "6f0851261b6d4832b826564f378ba69d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:40.507038 23604 raft_consensus.cc:1275] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.508180 24530 consensus_queue.cc:1048] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:40.519101 23533 raft_consensus.cc:1275] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Refusing update from remote peer 6f0851261b6d4832b826564f378ba69d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:40.520362 24511 consensus_queue.cc:1048] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a59e1270baa49b1b1c6ca3b1a4c3146" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 38613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:41.026764 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:41.067968 13792 tablet_server.cc:179] TabletServer@127.13.120.1:45163 shutting down...
W20260709 13:09:41.077207 23502 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 138 similar messages]
W20260709 13:09:41.080721 23502 consensus_peers.cc:597] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.098016 23502 consensus_peers.cc:597] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.100389 23502 consensus_peers.cc:597] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.106941 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:41.108394 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.109509 13792 raft_consensus.cc:2243] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.110481 13792 raft_consensus.cc:2272] T 75d142d8c75c4547b54e489d38fda700 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.113288 23576 consensus_peers.cc:597] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.114238 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.114970 13792 raft_consensus.cc:2243] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.115844 13792 raft_consensus.cc:2272] T c740becc06a7409891e4058e37695e2c P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.119882 13792 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:41.120229 23576 consensus_peers.cc:597] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.120915 13792 raft_consensus.cc:2243] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:41.121964 23650 consensus_peers.cc:597] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.122205 13792 raft_consensus.cc:2272] T f2b7234d417542daa1fa8313cc1ab199 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.124995 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.125705 13792 raft_consensus.cc:2243] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.126416 13792 raft_consensus.cc:2272] T 1170481acec64cbe9a79c5bf7f04b3f6 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.128759 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.129603 13792 raft_consensus.cc:2243] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.130187 13792 raft_consensus.cc:2272] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.133046 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.133889 13792 raft_consensus.cc:2243] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.134606 13792 raft_consensus.cc:2272] T b65d1bee3bb54b66998685be52e5bf04 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.136598 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.137153 13792 raft_consensus.cc:2243] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.137523 13792 raft_consensus.cc:2272] T cecd26fe571241608c608c52c4e6e4b1 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.139495 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.140038 13792 raft_consensus.cc:2243] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.140723 13792 raft_consensus.cc:2272] T 556d579561ea4a0ba8abee89a0e60ef4 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.142851 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.143718 13792 raft_consensus.cc:2243] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.144483 13792 raft_consensus.cc:2272] T 9cd51d50e9f64154965524bf64801024 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.146289 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.146857 13792 raft_consensus.cc:2243] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.147228 13792 raft_consensus.cc:2272] T fcef80a7a0d24b8886b0b356906a7bab P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.149222 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.149781 13792 raft_consensus.cc:2243] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.150174 13792 raft_consensus.cc:2272] T 8b9e4ec4723345c9bbdcc12fab0be284 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.152320 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.152879 13792 raft_consensus.cc:2243] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.153286 13792 raft_consensus.cc:2272] T aff520a7b42548a7a2e0e5ca849ec785 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.155268 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.155829 13792 raft_consensus.cc:2243] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.156240 13792 raft_consensus.cc:2272] T ef38dca00e5e45d194aa64b09b4a4271 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.158183 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.158759 13792 raft_consensus.cc:2243] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.159135 13792 raft_consensus.cc:2272] T eb9bce9a34294ef08a3a6e43d8b25b1a P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.161394 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.162243 13792 raft_consensus.cc:2243] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.162760 13792 raft_consensus.cc:2272] T c47a3456a44347848b814a90540324bc P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.165304 13792 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:41.165501 23502 consensus_peers.cc:597] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.165971 13792 raft_consensus.cc:2243] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.166464 13792 raft_consensus.cc:2272] T a22253dd90fd40809d13b1e79d2ea774 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.168493 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.169059 13792 raft_consensus.cc:2243] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.169416 13792 raft_consensus.cc:2272] T 8773bb3ecbee48738d3b1c65f086bf88 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.171325 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.171911 13792 raft_consensus.cc:2243] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.172320 13792 raft_consensus.cc:2272] T c28bba470bb64f2ea64dd235d43bf174 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.174530 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.175242 13792 raft_consensus.cc:2243] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.175800 13792 raft_consensus.cc:2272] T c86ffcfced3640e497a9ea757f67f9fa P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.178954 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.179814 13792 raft_consensus.cc:2243] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.180693 13792 raft_consensus.cc:2272] T b7f78bc1f917479c95f330e249821717 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.182917 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.183504 13792 raft_consensus.cc:2243] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.183924 13792 raft_consensus.cc:2272] T 70014355724949559ee372d7d1080178 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.185958 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.186512 13792 raft_consensus.cc:2243] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.186892 13792 raft_consensus.cc:2272] T 5872ed9104d54b1e88ce2e4c22f56596 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.189043 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.189567 13792 raft_consensus.cc:2243] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.189978 13792 raft_consensus.cc:2272] T 1785fa69f121467b8d300a0bb3cbc644 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.192147 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.192634 13792 raft_consensus.cc:2243] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.192975 13792 raft_consensus.cc:2272] T 0a7c02730daf418a8e9783caba996c49 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.194830 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.195622 13792 raft_consensus.cc:2243] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.196062 13792 raft_consensus.cc:2272] T d06495ae663546c0bba8a8faac68e49d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.198138 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.198655 13792 raft_consensus.cc:2243] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.199360 13792 raft_consensus.cc:2272] T bd771a7f581f469db75c0b9d33768447 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.201200 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.201710 13792 raft_consensus.cc:2243] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.202435 13792 raft_consensus.cc:2272] T af1834b561b741d9a51e512f60b6f81b P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.204581 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.205170 13792 raft_consensus.cc:2243] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.206028 13792 raft_consensus.cc:2272] T 306e3c84432447f9be679573a0761c06 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.207301 23502 consensus_peers.cc:597] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.208745 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.209722 13792 raft_consensus.cc:2243] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.210227 13792 raft_consensus.cc:2272] T a4fae8af871f40669a26b56a15979adf P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.213079 13792 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:41.213726 23576 consensus_peers.cc:597] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.213784 13792 raft_consensus.cc:2243] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.214741 13792 raft_consensus.cc:2272] T baa3243f757c4f6dac4677c739e8f145 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.222894 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.223546 13792 raft_consensus.cc:2243] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.224037 13792 raft_consensus.cc:2272] T 69fed89fed14448fa25983c72e7f1e64 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.226507 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.227070 13792 raft_consensus.cc:2243] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.227622 13792 raft_consensus.cc:2272] T cd525747a77e4b33a52ddb98c3dae259 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.230194 23650 consensus_peers.cc:597] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.230551 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.231431 13792 raft_consensus.cc:2243] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.232000 13792 raft_consensus.cc:2272] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.233608 23576 consensus_peers.cc:597] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.234740 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.235505 13792 raft_consensus.cc:2243] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.236044 13792 raft_consensus.cc:2272] T aa451ba4f51342709eee5e2296060483 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.238823 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.239554 13792 raft_consensus.cc:2243] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.240129 13792 raft_consensus.cc:2272] T ef32908f3a2d412090974bfa5caba496 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.240965 23502 consensus_peers.cc:597] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.242691 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.243497 13792 raft_consensus.cc:2243] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.243978 13792 raft_consensus.cc:2272] T 22b49ed532684aa3ae75017b8afe8475 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.246742 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.247443 13792 raft_consensus.cc:2243] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:09:41.247951 23576 consensus_peers.cc:597] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.248194 13792 raft_consensus.cc:2272] T edabba6fc9934299a8366e57960d9733 P 6f0851261b6d4832b826564f378ba69d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.250568 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.251297 13792 raft_consensus.cc:2243] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.251829 13792 raft_consensus.cc:2272] T 2575893fed284ec6ab4150b792b0b790 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.254952 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.255697 13792 raft_consensus.cc:2243] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.256201 13792 raft_consensus.cc:2272] T 925234f9de154af68ec326257968572d P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.259181 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.259971 13792 raft_consensus.cc:2243] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.260917 13792 raft_consensus.cc:2272] T 6d64d538619c4e1ab146400dad7d1688 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.263898 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.264663 13792 raft_consensus.cc:2243] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.265202 13792 raft_consensus.cc:2272] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.267637 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.268343 13792 raft_consensus.cc:2243] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.268839 13792 raft_consensus.cc:2272] T 9997887126674260a9b0753308029e17 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.269654 23502 consensus_peers.cc:597] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.271529 13792 tablet_replica.cc:333] stopping tablet replica
W20260709 13:09:41.272126 23650 consensus_peers.cc:597] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.272460 13792 raft_consensus.cc:2243] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.273137 13792 raft_consensus.cc:2272] T 4b662a4231d147f2b1090f982677eaef P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.275689 23650 consensus_peers.cc:597] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.276142 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.276700 13792 raft_consensus.cc:2243] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.277045 13792 raft_consensus.cc:2272] T ba066265aaf44df488ed17c1bb390276 P 6f0851261b6d4832b826564f378ba69d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.279289 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:41.280059 13792 raft_consensus.cc:2243] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.281112 13792 raft_consensus.cc:2272] T 8291e2ee677e4f8780ef9c902583fb55 P 6f0851261b6d4832b826564f378ba69d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.281808 23502 consensus_peers.cc:597] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.288813 23576 consensus_peers.cc:597] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.333315 23650 consensus_peers.cc:597] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.339495 24348 connection.cc:466] server connection from 127.0.0.1:33860 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33860 (request call id 300) could send its response
W20260709 13:09:41.344187 23576 consensus_peers.cc:597] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.349520 23576 consensus_peers.cc:597] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.352447 23502 consensus_peers.cc:597] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.357342 13792 tablet_server.cc:196] TabletServer@127.13.120.1:45163 shutdown complete.
W20260709 13:09:41.410001 23650 consensus_peers.cc:597] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.433959 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
W20260709 13:09:41.439353 23577 consensus_peers.cc:597] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.452207 23502 consensus_peers.cc:597] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.455793 23651 consensus_peers.cc:597] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.474314 23650 consensus_peers.cc:597] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.477626 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:41.478387 13792 tablet_replica.cc:333] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.479040 13792 raft_consensus.cc:2243] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.479557 13792 raft_consensus.cc:2272] T eb9bce9a34294ef08a3a6e43d8b25b1a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.482452 13792 tablet_replica.cc:333] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.483119 13792 raft_consensus.cc:2243] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.483994 13792 raft_consensus.cc:2272] T 38fe0d3b4c474223a67e5f053027bc51 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.486265 13792 tablet_replica.cc:333] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.486931 13792 raft_consensus.cc:2243] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.487390 13792 raft_consensus.cc:2272] T 1785fa69f121467b8d300a0bb3cbc644 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.489889 13792 tablet_replica.cc:333] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.490551 13792 raft_consensus.cc:2243] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.491004 13792 raft_consensus.cc:2272] T ccefc8653d6d40a98aa795e53e75e1e7 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.492568 23650 consensus_peers.cc:597] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.493505 13792 tablet_replica.cc:333] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.494223 13792 raft_consensus.cc:2243] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.494675 13792 raft_consensus.cc:2272] T 6d64d538619c4e1ab146400dad7d1688 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.497272 13792 tablet_replica.cc:333] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.497912 13792 raft_consensus.cc:2243] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.498728 13792 raft_consensus.cc:2272] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.501163 13792 tablet_replica.cc:333] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.502140 13792 raft_consensus.cc:2243] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.502780 13792 raft_consensus.cc:2272] T cb8713a52bae4dc3b7153d826f171c88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.505995 13792 tablet_replica.cc:333] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.507014 13792 raft_consensus.cc:2243] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.507596 13792 raft_consensus.cc:2272] T 22b49ed532684aa3ae75017b8afe8475 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.510649 13792 tablet_replica.cc:333] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.511615 13792 raft_consensus.cc:2243] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.513485 13792 raft_consensus.cc:2272] T 34e5e8374cc9436696a431388a452768 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.516646 13792 tablet_replica.cc:333] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.517486 13792 raft_consensus.cc:2243] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.518563 13792 raft_consensus.cc:2272] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.521751 23577 consensus_peers.cc:597] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.524389 13792 tablet_replica.cc:333] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.525501 13792 raft_consensus.cc:2243] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.526058 13792 raft_consensus.cc:2272] T b7f78bc1f917479c95f330e249821717 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.526788 23577 consensus_peers.cc:597] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.529072 13792 tablet_replica.cc:333] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.530071 13792 raft_consensus.cc:2243] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.530683 13792 raft_consensus.cc:2272] T ba066265aaf44df488ed17c1bb390276 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.533495 23650 consensus_peers.cc:597] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.533650 13792 tablet_replica.cc:333] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.534641 13792 raft_consensus.cc:2243] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.535842 13792 raft_consensus.cc:2272] T 31b8a011953547178d6c255a7b9a072f P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.538968 13792 tablet_replica.cc:333] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.539781 13792 raft_consensus.cc:2243] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:41.539785 23576 consensus_peers.cc:597] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.540433 13792 raft_consensus.cc:2272] T 05850e9b37994edb9bcd786b1bdbaccc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.543538 13792 tablet_replica.cc:333] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.544384 13792 raft_consensus.cc:2243] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.544955 13792 raft_consensus.cc:2272] T 75d142d8c75c4547b54e489d38fda700 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.546068 23650 consensus_peers.cc:597] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.547886 13792 tablet_replica.cc:333] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.548867 13792 raft_consensus.cc:2243] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.549428 13792 raft_consensus.cc:2272] T 8b9e4ec4723345c9bbdcc12fab0be284 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.552579 13792 tablet_replica.cc:333] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.553462 13792 raft_consensus.cc:2243] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.554028 13792 raft_consensus.cc:2272] T 9cd51d50e9f64154965524bf64801024 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.554432 23577 consensus_peers.cc:597] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.556622 13792 tablet_replica.cc:333] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.557582 13792 raft_consensus.cc:2243] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.558090 13792 raft_consensus.cc:2272] T fcef80a7a0d24b8886b0b356906a7bab P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.560551 13792 tablet_replica.cc:333] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.561203 13792 raft_consensus.cc:2243] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.561697 13792 raft_consensus.cc:2272] T 985baf5be41844358d43f30ddeee2e3d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.564023 13792 tablet_replica.cc:333] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.564666 13792 raft_consensus.cc:2243] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.565140 13792 raft_consensus.cc:2272] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.567936 13792 tablet_replica.cc:333] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.568770 13792 raft_consensus.cc:2243] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.569857 13792 raft_consensus.cc:2272] T aa451ba4f51342709eee5e2296060483 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.572789 13792 tablet_replica.cc:333] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
W20260709 13:09:41.573030 23651 consensus_peers.cc:597] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.573606 13792 raft_consensus.cc:2243] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.574767 13792 raft_consensus.cc:2272] T cd525747a77e4b33a52ddb98c3dae259 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.577701 13792 tablet_replica.cc:333] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.578493 13792 raft_consensus.cc:2243] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.579001 13792 raft_consensus.cc:2272] T edabba6fc9934299a8366e57960d9733 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.581650 13792 tablet_replica.cc:333] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.582379 13792 raft_consensus.cc:2243] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:09:41.582466 23577 consensus_peers.cc:597] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.582967 13792 raft_consensus.cc:2272] T ed7b08fe298a4c318662e7b54994912b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.583334 23577 consensus_peers.cc:597] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.585150 13792 tablet_replica.cc:333] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.585800 13792 raft_consensus.cc:2243] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.586225 13792 raft_consensus.cc:2272] T baa3243f757c4f6dac4677c739e8f145 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.588481 13792 tablet_replica.cc:333] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.589183 13792 raft_consensus.cc:2243] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.590168 13792 raft_consensus.cc:2272] T 69fed89fed14448fa25983c72e7f1e64 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.592135 13792 tablet_replica.cc:333] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
W20260709 13:09:41.592140 23576 consensus_peers.cc:597] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Couldn't send request to peer 6f0851261b6d4832b826564f378ba69d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:45163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.592748 13792 raft_consensus.cc:2243] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.593488 13792 raft_consensus.cc:2272] T 9e30e6ebdca44cbdb950b5df31f1e15a P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.595400 13792 tablet_replica.cc:333] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.596050 13792 raft_consensus.cc:2243] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.596443 13792 raft_consensus.cc:2272] T 05fee14e6e9a4abd9331249fe4afd97e P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.598731 13792 tablet_replica.cc:333] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.599462 13792 raft_consensus.cc:2243] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.600435 13792 raft_consensus.cc:2272] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.602303 13792 tablet_replica.cc:333] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.602798 13792 raft_consensus.cc:2243] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.603269 13792 raft_consensus.cc:2272] T f5fd63cafcbb4ac68010a87bab3f897d P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.605340 13792 tablet_replica.cc:333] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.605849 13792 raft_consensus.cc:2243] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.606261 13792 raft_consensus.cc:2272] T 2575893fed284ec6ab4150b792b0b790 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.608193 13792 tablet_replica.cc:333] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.608686 13792 raft_consensus.cc:2243] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.609086 13792 raft_consensus.cc:2272] T c47a3456a44347848b814a90540324bc P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.610945 13792 tablet_replica.cc:333] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.611590 13792 raft_consensus.cc:2243] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.612344 13792 raft_consensus.cc:2272] T a22253dd90fd40809d13b1e79d2ea774 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.614435 13792 tablet_replica.cc:333] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.614946 13792 raft_consensus.cc:2243] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.615367 13792 raft_consensus.cc:2272] T 8291e2ee677e4f8780ef9c902583fb55 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.617825 13792 tablet_replica.cc:333] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.618474 13792 raft_consensus.cc:2243] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.618953 13792 raft_consensus.cc:2272] T f2b7234d417542daa1fa8313cc1ab199 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.621165 13792 tablet_replica.cc:333] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.621881 13792 raft_consensus.cc:2243] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.622326 13792 raft_consensus.cc:2272] T f7e94b011aa846abb8f089c79400c51b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.624650 13792 tablet_replica.cc:333] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.625255 13792 raft_consensus.cc:2243] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.625735 13792 raft_consensus.cc:2272] T 2051e70e1839470b9d075467894aa8e8 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.627295 13792 tablet_replica.cc:333] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.627873 13792 raft_consensus.cc:2243] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.628531 13792 raft_consensus.cc:2272] T 4b662a4231d147f2b1090f982677eaef P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.630827 13792 tablet_replica.cc:333] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.631378 13792 raft_consensus.cc:2243] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.632236 13792 raft_consensus.cc:2272] T 9997887126674260a9b0753308029e17 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.632539 23651 consensus_peers.cc:597] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.634169 13792 tablet_replica.cc:333] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.634711 13792 raft_consensus.cc:2243] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.635370 13792 raft_consensus.cc:2272] T aff520a7b42548a7a2e0e5ca849ec785 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.637152 13792 tablet_replica.cc:333] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.637651 13792 raft_consensus.cc:2243] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.637995 13792 raft_consensus.cc:2272] T c740becc06a7409891e4058e37695e2c P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.639940 13792 tablet_replica.cc:333] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.640327 13792 raft_consensus.cc:2243] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.640657 13792 raft_consensus.cc:2272] T 8773bb3ecbee48738d3b1c65f086bf88 P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.642364 13792 tablet_replica.cc:333] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.642805 13792 raft_consensus.cc:2243] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.643540 13792 raft_consensus.cc:2272] T a4fae8af871f40669a26b56a15979adf P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.645344 13792 tablet_replica.cc:333] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146: stopping tablet replica
I20260709 13:09:41.645766 13792 raft_consensus.cc:2243] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.646157 13792 raft_consensus.cc:2272] T af1834b561b741d9a51e512f60b6f81b P 7a59e1270baa49b1b1c6ca3b1a4c3146 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.670185 23577 consensus_peers.cc:597] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.713552 23577 consensus_peers.cc:597] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.729945 23651 consensus_peers.cc:597] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.730021 23577 consensus_peers.cc:597] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.734220 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
W20260709 13:09:41.787082 23651 consensus_peers.cc:597] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.807619 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
W20260709 13:09:41.813256 23651 consensus_peers.cc:597] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:41.826671 23577 consensus_peers.cc:597] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.848989 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:41.850291 13792 tablet_replica.cc:333] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.851358 13792 raft_consensus.cc:2243] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.852034 13792 raft_consensus.cc:2272] T 38fe0d3b4c474223a67e5f053027bc51 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.853533 23649 consensus_peers.cc:597] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.854837 13792 tablet_replica.cc:333] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.855785 13792 raft_consensus.cc:2243] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.856300 13792 raft_consensus.cc:2272] T 925234f9de154af68ec326257968572d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.859098 23649 consensus_peers.cc:597] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.860103 13792 tablet_replica.cc:333] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.860976 13792 raft_consensus.cc:2243] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.861498 13792 raft_consensus.cc:2272] T 6d64d538619c4e1ab146400dad7d1688 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.862847 23649 consensus_peers.cc:597] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.863994 13792 tablet_replica.cc:333] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.864681 13792 raft_consensus.cc:2243] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.865238 13792 raft_consensus.cc:2272] T 10ef9b6dc3e34a46be40dc8a31c2dc57 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.865418 23651 consensus_peers.cc:597] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.867475 13792 tablet_replica.cc:333] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.868036 13792 raft_consensus.cc:2243] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.868711 13792 raft_consensus.cc:2272] T cb8713a52bae4dc3b7153d826f171c88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.870584 13792 tablet_replica.cc:333] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.871088 13792 raft_consensus.cc:2243] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.871481 13792 raft_consensus.cc:2272] T bd771a7f581f469db75c0b9d33768447 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.873135 13792 tablet_replica.cc:333] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.873659 13792 raft_consensus.cc:2243] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.874315 13792 raft_consensus.cc:2272] T ccefc8653d6d40a98aa795e53e75e1e7 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.876324 13792 tablet_replica.cc:333] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.876808 13792 raft_consensus.cc:2243] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.877499 13792 raft_consensus.cc:2272] T 22b49ed532684aa3ae75017b8afe8475 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.879586 13792 tablet_replica.cc:333] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.880131 13792 raft_consensus.cc:2243] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.880497 13792 raft_consensus.cc:2272] T cecd26fe571241608c608c52c4e6e4b1 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.881666 23651 consensus_peers.cc:597] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.882524 13792 tablet_replica.cc:333] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.883134 13792 raft_consensus.cc:2243] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.883595 13792 raft_consensus.cc:2272] T 34e5e8374cc9436696a431388a452768 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.885356 13792 tablet_replica.cc:333] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.885895 13792 raft_consensus.cc:2243] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.886611 13792 raft_consensus.cc:2272] T ef32908f3a2d412090974bfa5caba496 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.888504 13792 tablet_replica.cc:333] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.889146 13792 raft_consensus.cc:2243] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.889555 13792 raft_consensus.cc:2272] T b7f78bc1f917479c95f330e249821717 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.891350 13792 tablet_replica.cc:333] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.891903 13792 raft_consensus.cc:2243] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.892737 13792 raft_consensus.cc:2272] T ba066265aaf44df488ed17c1bb390276 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.895155 13792 tablet_replica.cc:333] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.895840 13792 raft_consensus.cc:2243] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.896374 13792 raft_consensus.cc:2272] T 31b8a011953547178d6c255a7b9a072f P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.896790 23577 consensus_peers.cc:597] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.898291 13792 tablet_replica.cc:333] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.898906 13792 raft_consensus.cc:2243] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.899685 13792 raft_consensus.cc:2272] T 05850e9b37994edb9bcd786b1bdbaccc P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.901643 13792 tablet_replica.cc:333] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.902194 13792 raft_consensus.cc:2243] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.902865 13792 raft_consensus.cc:2272] T c28bba470bb64f2ea64dd235d43bf174 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.904752 13792 tablet_replica.cc:333] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.905296 13792 raft_consensus.cc:2243] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.905997 13792 raft_consensus.cc:2272] T 8773bb3ecbee48738d3b1c65f086bf88 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.907869 13792 tablet_replica.cc:333] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.908375 13792 raft_consensus.cc:2243] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.909062 13792 raft_consensus.cc:2272] T c86ffcfced3640e497a9ea757f67f9fa P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.910835 13792 tablet_replica.cc:333] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.911362 13792 raft_consensus.cc:2243] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.911793 13792 raft_consensus.cc:2272] T 75d142d8c75c4547b54e489d38fda700 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.913563 13792 tablet_replica.cc:333] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.914070 13792 raft_consensus.cc:2243] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.914748 13792 raft_consensus.cc:2272] T 2f2d5e15657d4d9caeb89fd380cedcb3 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.916671 13792 tablet_replica.cc:333] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.917164 13792 raft_consensus.cc:2243] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.917560 13792 raft_consensus.cc:2272] T aa451ba4f51342709eee5e2296060483 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.919298 13792 tablet_replica.cc:333] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.919847 13792 raft_consensus.cc:2243] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.920224 13792 raft_consensus.cc:2272] T cd525747a77e4b33a52ddb98c3dae259 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.921981 13792 tablet_replica.cc:333] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.922586 13792 raft_consensus.cc:2243] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.923076 13792 raft_consensus.cc:2272] T edabba6fc9934299a8366e57960d9733 P 89c3e465d9db463a9d55c8a2e7c061ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.924969 13792 tablet_replica.cc:333] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.925508 13792 raft_consensus.cc:2243] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.925904 13792 raft_consensus.cc:2272] T ed7b08fe298a4c318662e7b54994912b P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.928215 13792 tablet_replica.cc:333] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.928958 13792 raft_consensus.cc:2243] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.929468 13792 raft_consensus.cc:2272] T 69fed89fed14448fa25983c72e7f1e64 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.931850 13792 tablet_replica.cc:333] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.932525 13792 raft_consensus.cc:2243] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.932997 13792 raft_consensus.cc:2272] T 9e30e6ebdca44cbdb950b5df31f1e15a P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.935283 13792 tablet_replica.cc:333] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.935966 13792 raft_consensus.cc:2243] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.936534 13792 raft_consensus.cc:2272] T 05fee14e6e9a4abd9331249fe4afd97e P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.939141 13792 tablet_replica.cc:333] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.939908 13792 raft_consensus.cc:2243] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.940346 13792 raft_consensus.cc:2272] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.942122 13792 tablet_replica.cc:333] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.942569 13792 raft_consensus.cc:2243] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.943209 13792 raft_consensus.cc:2272] T f5fd63cafcbb4ac68010a87bab3f897d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.945379 13792 tablet_replica.cc:333] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.945912 13792 raft_consensus.cc:2243] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.946600 13792 raft_consensus.cc:2272] T 2575893fed284ec6ab4150b792b0b790 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.948586 13792 tablet_replica.cc:333] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.949298 13792 raft_consensus.cc:2243] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.949770 13792 raft_consensus.cc:2272] T b65d1bee3bb54b66998685be52e5bf04 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.952232 13792 tablet_replica.cc:333] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.952860 13792 raft_consensus.cc:2243] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.953182 13792 raft_consensus.cc:2272] T f7e94b011aa846abb8f089c79400c51b P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.954774 13792 tablet_replica.cc:333] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.955220 13792 raft_consensus.cc:2243] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.955622 13792 raft_consensus.cc:2272] T 306e3c84432447f9be679573a0761c06 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.957201 13792 tablet_replica.cc:333] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.957653 13792 raft_consensus.cc:2243] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.958070 13792 raft_consensus.cc:2272] T 5872ed9104d54b1e88ce2e4c22f56596 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.960345 13792 tablet_replica.cc:333] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.961030 13792 raft_consensus.cc:2243] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.961501 13792 raft_consensus.cc:2272] T d06495ae663546c0bba8a8faac68e49d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:41.963061 23651 consensus_peers.cc:597] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 -> Peer 7a59e1270baa49b1b1c6ca3b1a4c3146 (127.13.120.2:38613): Couldn't send request to peer 7a59e1270baa49b1b1c6ca3b1a4c3146. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:38613: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:41.963732 13792 tablet_replica.cc:333] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.964301 13792 raft_consensus.cc:2243] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.964708 13792 raft_consensus.cc:2272] T 70014355724949559ee372d7d1080178 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.966459 13792 tablet_replica.cc:333] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.966941 13792 raft_consensus.cc:2243] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.967310 13792 raft_consensus.cc:2272] T 0a7c02730daf418a8e9783caba996c49 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.969115 13792 tablet_replica.cc:333] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.969624 13792 raft_consensus.cc:2243] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.969985 13792 raft_consensus.cc:2272] T 556d579561ea4a0ba8abee89a0e60ef4 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.971791 13792 tablet_replica.cc:333] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.972265 13792 raft_consensus.cc:2243] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.973009 13792 raft_consensus.cc:2272] T 2051e70e1839470b9d075467894aa8e8 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.974720 13792 tablet_replica.cc:333] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.975180 13792 raft_consensus.cc:2243] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.975920 13792 raft_consensus.cc:2272] T ef38dca00e5e45d194aa64b09b4a4271 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.977675 13792 tablet_replica.cc:333] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.978168 13792 raft_consensus.cc:2243] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.978534 13792 raft_consensus.cc:2272] T 9997887126674260a9b0753308029e17 P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.980347 13792 tablet_replica.cc:333] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.980821 13792 raft_consensus.cc:2243] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:41.981499 13792 raft_consensus.cc:2272] T fcef80a7a0d24b8886b0b356906a7bab P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.983270 13792 tablet_replica.cc:333] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.983734 13792 raft_consensus.cc:2243] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.984115 13792 raft_consensus.cc:2272] T 985baf5be41844358d43f30ddeee2e3d P 89c3e465d9db463a9d55c8a2e7c061ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:41.985896 13792 tablet_replica.cc:333] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea: stopping tablet replica
I20260709 13:09:41.986334 13792 raft_consensus.cc:2243] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:41.986742 13792 raft_consensus.cc:2272] T 1170481acec64cbe9a79c5bf7f04b3f6 P 89c3e465d9db463a9d55c8a2e7c061ea [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.026731 23649 consensus_peers.cc:597] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.049444 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
W20260709 13:09:42.058300 23649 consensus_peers.cc:597] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.067400 23649 consensus_peers.cc:597] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.077430 23649 consensus_peers.cc:597] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.109272 23649 consensus_peers.cc:597] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:42.121449 23649 consensus_peers.cc:597] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.122225 13792 tablet_server.cc:179] TabletServer@127.13.120.4:0 shutting down...
I20260709 13:09:42.157652 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:42.158499 13792 tablet_replica.cc:333] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.159514 13792 raft_consensus.cc:2243] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.160154 13792 raft_consensus.cc:2272] T 38fe0d3b4c474223a67e5f053027bc51 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.162240 13792 tablet_replica.cc:333] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.162745 13792 raft_consensus.cc:2243] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.163309 13792 raft_consensus.cc:2272] T eb9bce9a34294ef08a3a6e43d8b25b1a P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.165098 13792 tablet_replica.cc:333] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.165669 13792 raft_consensus.cc:2243] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.166239 13792 raft_consensus.cc:2272] T 925234f9de154af68ec326257968572d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.168133 13792 tablet_replica.cc:333] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.168747 13792 raft_consensus.cc:2243] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.169230 13792 raft_consensus.cc:2272] T cb8713a52bae4dc3b7153d826f171c88 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.171715 13792 tablet_replica.cc:333] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.172312 13792 raft_consensus.cc:2243] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.172973 13792 raft_consensus.cc:2272] T cecd26fe571241608c608c52c4e6e4b1 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.174705 13792 tablet_replica.cc:333] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.175194 13792 raft_consensus.cc:2243] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.175598 13792 raft_consensus.cc:2272] T bd771a7f581f469db75c0b9d33768447 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.177357 13792 tablet_replica.cc:333] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.177815 13792 raft_consensus.cc:2243] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.178160 13792 raft_consensus.cc:2272] T ccefc8653d6d40a98aa795e53e75e1e7 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.179896 13792 tablet_replica.cc:333] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.180337 13792 raft_consensus.cc:2243] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.180696 13792 raft_consensus.cc:2272] T 34e5e8374cc9436696a431388a452768 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.182432 13792 tablet_replica.cc:333] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.182911 13792 raft_consensus.cc:2243] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.183257 13792 raft_consensus.cc:2272] T ef32908f3a2d412090974bfa5caba496 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.184895 13792 tablet_replica.cc:333] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.185588 13792 raft_consensus.cc:2243] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.186117 13792 raft_consensus.cc:2272] T 05850e9b37994edb9bcd786b1bdbaccc P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.188192 13792 tablet_replica.cc:333] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.188787 13792 raft_consensus.cc:2243] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.189193 13792 raft_consensus.cc:2272] T c28bba470bb64f2ea64dd235d43bf174 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.189699 23649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:09:42.191180 13792 tablet_replica.cc:333] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.191778 13792 raft_consensus.cc:2243] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.192152 13792 raft_consensus.cc:2272] T c86ffcfced3640e497a9ea757f67f9fa P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.193794 13792 tablet_replica.cc:333] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.194270 13792 raft_consensus.cc:2243] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.194592 13792 raft_consensus.cc:2272] T 31b8a011953547178d6c255a7b9a072f P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.196264 13792 tablet_replica.cc:333] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.196762 13792 raft_consensus.cc:2243] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.197113 13792 raft_consensus.cc:2272] T 5d3a5fa062b44bf98d8c3c2ed4109355 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.198746 13792 tablet_replica.cc:333] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.199211 13792 raft_consensus.cc:2243] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.199615 13792 raft_consensus.cc:2272] T a4fae8af871f40669a26b56a15979adf P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.201231 13792 tablet_replica.cc:333] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.201696 13792 raft_consensus.cc:2243] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.202024 13792 raft_consensus.cc:2272] T 306e3c84432447f9be679573a0761c06 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.204257 13792 tablet_replica.cc:333] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.204917 13792 raft_consensus.cc:2243] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.205314 13792 raft_consensus.cc:2272] T af1834b561b741d9a51e512f60b6f81b P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.206591 23649 consensus_peers.cc:597] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 -> Peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Couldn't send request to peer 89c3e465d9db463a9d55c8a2e7c061ea. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:42.207314 13792 tablet_replica.cc:333] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.207258 24573 raft_consensus.cc:493] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f0851261b6d4832b826564f378ba69d)
I20260709 13:09:42.207916 24573 raft_consensus.cc:515] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f0851261b6d4832b826564f378ba69d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 45163 } } peers { permanent_uuid: "89c3e465d9db463a9d55c8a2e7c061ea" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 44887 } } peers { permanent_uuid: "18312e6c7d274b80b354ee1498cc3449" member_type: VOTER last_known_addr { host: "127.13.120.4" port: 44569 } }
I20260709 13:09:42.208267 13792 raft_consensus.cc:2243] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.209137 13792 raft_consensus.cc:2272] T 5872ed9104d54b1e88ce2e4c22f56596 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.210047 24573 leader_election.cc:290] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163), 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887)
I20260709 13:09:42.211596 13792 tablet_replica.cc:333] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.212185 13792 raft_consensus.cc:2243] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.212779 13792 raft_consensus.cc:2272] T 1785fa69f121467b8d300a0bb3cbc644 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.213455 23649 leader_election.cc:336] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 89c3e465d9db463a9d55c8a2e7c061ea (127.13.120.3:44887): Network error: Client connection negotiation failed: client connection to 127.13.120.3:44887: connect: Connection refused (error 111)
I20260709 13:09:42.214623 13792 tablet_replica.cc:333] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.215225 13792 raft_consensus.cc:2243] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.215852 13792 raft_consensus.cc:2272] T d06495ae663546c0bba8a8faac68e49d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.217563 13792 tablet_replica.cc:333] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.218071 13792 raft_consensus.cc:2243] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.218665 13792 raft_consensus.cc:2272] T 0a7c02730daf418a8e9783caba996c49 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.220446 13792 tablet_replica.cc:333] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.220963 13792 raft_consensus.cc:2243] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.221547 13792 raft_consensus.cc:2272] T 70014355724949559ee372d7d1080178 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.223325 13792 tablet_replica.cc:333] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.223932 13792 raft_consensus.cc:2243] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.224313 13792 raft_consensus.cc:2272] T c740becc06a7409891e4058e37695e2c P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.226048 13792 tablet_replica.cc:333] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.226562 13792 raft_consensus.cc:2243] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.227130 13792 raft_consensus.cc:2272] T baa3243f757c4f6dac4677c739e8f145 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.228976 13792 tablet_replica.cc:333] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.229486 13792 raft_consensus.cc:2243] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.229900 13792 raft_consensus.cc:2272] T 9e30e6ebdca44cbdb950b5df31f1e15a P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.231729 13792 tablet_replica.cc:333] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.232229 13792 raft_consensus.cc:2243] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.232919 13792 raft_consensus.cc:2272] T ed7b08fe298a4c318662e7b54994912b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.234714 13792 tablet_replica.cc:333] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.235230 13792 raft_consensus.cc:2243] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.235843 13792 raft_consensus.cc:2272] T c47a3456a44347848b814a90540324bc P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.237587 13792 tablet_replica.cc:333] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.238101 13792 raft_consensus.cc:2243] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.238485 13792 raft_consensus.cc:2272] T a22253dd90fd40809d13b1e79d2ea774 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.240233 13792 tablet_replica.cc:333] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.240732 13792 raft_consensus.cc:2243] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.241120 13792 raft_consensus.cc:2272] T 8291e2ee677e4f8780ef9c902583fb55 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.242803 13792 tablet_replica.cc:333] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.243309 13792 raft_consensus.cc:2243] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.243705 13792 raft_consensus.cc:2272] T f2b7234d417542daa1fa8313cc1ab199 P 18312e6c7d274b80b354ee1498cc3449 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.245411 13792 tablet_replica.cc:333] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.245918 13792 raft_consensus.cc:2243] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.246593 13792 raft_consensus.cc:2272] T f7e94b011aa846abb8f089c79400c51b P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.248401 13792 tablet_replica.cc:333] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.248900 13792 raft_consensus.cc:2243] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.249451 13792 raft_consensus.cc:2272] T 8b9e4ec4723345c9bbdcc12fab0be284 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.251430 13792 tablet_replica.cc:333] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.251991 13792 raft_consensus.cc:2243] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.252442 13792 raft_consensus.cc:2272] T 556d579561ea4a0ba8abee89a0e60ef4 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.254213 13792 tablet_replica.cc:333] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.254698 13792 raft_consensus.cc:2243] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.255126 13792 raft_consensus.cc:2272] T 2051e70e1839470b9d075467894aa8e8 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.256793 13792 tablet_replica.cc:333] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.257277 13792 raft_consensus.cc:2243] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.257659 13792 raft_consensus.cc:2272] T ef38dca00e5e45d194aa64b09b4a4271 P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.259310 13792 tablet_replica.cc:333] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.260046 13792 raft_consensus.cc:2243] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.260461 13792 raft_consensus.cc:2272] T aff520a7b42548a7a2e0e5ca849ec785 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.262177 13792 tablet_replica.cc:333] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.262622 13792 raft_consensus.cc:2243] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.263259 13792 raft_consensus.cc:2272] T 05fee14e6e9a4abd9331249fe4afd97e P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.264971 13792 tablet_replica.cc:333] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.265400 13792 raft_consensus.cc:2243] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.265775 13792 raft_consensus.cc:2272] T 2a3a6fbf390f4379ad04ceb78ab203b6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.267549 13792 tablet_replica.cc:333] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.267985 13792 raft_consensus.cc:2243] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.268307 13792 raft_consensus.cc:2272] T f5fd63cafcbb4ac68010a87bab3f897d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.269985 13792 tablet_replica.cc:333] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.270426 13792 raft_consensus.cc:2243] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.270743 13792 raft_consensus.cc:2272] T 9cd51d50e9f64154965524bf64801024 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.272403 13792 tablet_replica.cc:333] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.272815 13792 raft_consensus.cc:2243] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.273442 13792 raft_consensus.cc:2272] T 985baf5be41844358d43f30ddeee2e3d P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.275110 13792 tablet_replica.cc:333] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.275583 13792 raft_consensus.cc:2243] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.275924 13792 raft_consensus.cc:2272] T 1170481acec64cbe9a79c5bf7f04b3f6 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.277647 13792 tablet_replica.cc:333] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.278045 13792 raft_consensus.cc:2243] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.278366 13792 raft_consensus.cc:2272] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.280026 13792 tablet_replica.cc:333] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449: stopping tablet replica
I20260709 13:09:42.280385 13792 raft_consensus.cc:2243] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:42.280699 13792 raft_consensus.cc:2272] T 4b662a4231d147f2b1090f982677eaef P 18312e6c7d274b80b354ee1498cc3449 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:42.398808 23650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.470844 23648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.512648 23648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.519225 23648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.539400 23650 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.568730 23649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.590205 23648 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.601691 23649 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:09:42.618710 23650 leader_election.cc:336] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 6f0851261b6d4832b826564f378ba69d (127.13.120.1:45163): Service unavailable: Unable to start connection negotiation thread: The pool has been shut down.
I20260709 13:09:42.619113 23650 leader_election.cc:304] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 18312e6c7d274b80b354ee1498cc3449; no voters: 6f0851261b6d4832b826564f378ba69d, 89c3e465d9db463a9d55c8a2e7c061ea
W20260709 13:09:42.619778 23650 raft_consensus.cc:2686] T b65d1bee3bb54b66998685be52e5bf04 P 18312e6c7d274b80b354ee1498cc3449: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 13:09:42.639039 13792 tablet_server.cc:196] TabletServer@127.13.120.4:0 shutdown complete.
I20260709 13:09:42.698506 13792 master.cc:562] Master@127.13.120.62:34857 shutting down...
W20260709 13:09:42.734337 23407 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
I20260709 13:09:42.735345 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:42.735889 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:42.736151 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P d74c45bec35146d3ad75701666141fab: stopping tablet replica
I20260709 13:09:42.757391 13792 master.cc:584] Master@127.13.120.62:34857 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (35469 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:09:42.848783 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:45317
I20260709 13:09:42.849915 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:42.855799 24590 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.855876 24591 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:42.856745 24593 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:42.858439 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:42.859602 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:42.859778 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:42.859892 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602582859882 us; error 0 us; skew 500 ppm
I20260709 13:09:42.860342 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:42.862672 13792 webserver.cc:533] Webserver started at http://127.13.120.62:39997/ using document root <none> and password file <none>
I20260709 13:09:42.863166 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:42.863354 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:42.863680 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:42.864756 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "abf3d5979824404391b4fb35a45a2800"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-mcck"
I20260709 13:09:42.869217 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:42.872323 24598 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:42.872993 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:42.873286 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "abf3d5979824404391b4fb35a45a2800"
format_stamp: "Formatted at 2026-07-09 13:09:42 on dist-test-slave-mcck"
I20260709 13:09:42.873536 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:42.884315 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:42.885382 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:42.921623 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:45317
I20260709 13:09:42.921721 24649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:45317 every 8 connection(s)
I20260709 13:09:42.925426 24650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:42.935554 24650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800: Bootstrap starting.
I20260709 13:09:42.940109 24650 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:42.944149 24650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800: No bootstrap required, opened a new log
I20260709 13:09:42.946213 24650 raft_consensus.cc:359] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf3d5979824404391b4fb35a45a2800" member_type: VOTER }
I20260709 13:09:42.946574 24650 raft_consensus.cc:385] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:42.946820 24650 raft_consensus.cc:740] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abf3d5979824404391b4fb35a45a2800, State: Initialized, Role: FOLLOWER
I20260709 13:09:42.947443 24650 consensus_queue.cc:260] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf3d5979824404391b4fb35a45a2800" member_type: VOTER }
I20260709 13:09:42.947908 24650 raft_consensus.cc:399] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:42.948151 24650 raft_consensus.cc:493] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:42.948418 24650 raft_consensus.cc:3060] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:42.952764 24650 raft_consensus.cc:515] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf3d5979824404391b4fb35a45a2800" member_type: VOTER }
I20260709 13:09:42.953253 24650 leader_election.cc:304] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: abf3d5979824404391b4fb35a45a2800; no voters: 
I20260709 13:09:42.954308 24650 leader_election.cc:290] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:42.954707 24653 raft_consensus.cc:2804] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:42.956085 24653 raft_consensus.cc:697] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 1 LEADER]: Becoming Leader. State: Replica: abf3d5979824404391b4fb35a45a2800, State: Running, Role: LEADER
I20260709 13:09:42.956650 24653 consensus_queue.cc:237] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf3d5979824404391b4fb35a45a2800" member_type: VOTER }
I20260709 13:09:42.957279 24650 sys_catalog.cc:565] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:42.961537 24654 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "abf3d5979824404391b4fb35a45a2800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf3d5979824404391b4fb35a45a2800" member_type: VOTER } }
I20260709 13:09:42.962262 24654 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:42.963752 24655 sys_catalog.cc:455] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [sys.catalog]: SysCatalogTable state changed. Reason: New leader abf3d5979824404391b4fb35a45a2800. Latest consensus state: current_term: 1 leader_uuid: "abf3d5979824404391b4fb35a45a2800" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "abf3d5979824404391b4fb35a45a2800" member_type: VOTER } }
I20260709 13:09:42.964110 24660 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:42.964401 24655 sys_catalog.cc:458] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:42.969025 24660 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:42.973408 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:42.977619 24660 catalog_manager.cc:1383] Generated new cluster ID: 084e933e056a4a20933987852d496852
I20260709 13:09:42.977880 24660 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:42.989467 24660 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:42.990685 24660 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:43.004072 24660 catalog_manager.cc:6070] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800: Generated new TSK 0
I20260709 13:09:43.004673 24660 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:43.039518 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.045222 24671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.046252 24672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.048012 24674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.050508 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:43.051606 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:43.051820 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.052021 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602583051997 us; error 0 us; skew 500 ppm
I20260709 13:09:43.052539 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.054664 13792 webserver.cc:533] Webserver started at http://127.13.120.1:42447/ using document root <none> and password file <none>
I20260709 13:09:43.055152 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.055364 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.055699 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.056744 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "9548492e26e547db83f55f142682cd4c"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:43.061044 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:43.064280 24679 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.065052 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:43.065332 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "9548492e26e547db83f55f142682cd4c"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:43.065634 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.080942 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.082149 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.083639 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:43.085778 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:43.085994 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.086225 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:43.086418 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.124375 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:34145
I20260709 13:09:43.124505 24741 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:34145 every 8 connection(s)
I20260709 13:09:43.128943 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.136410 24746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.137946 24747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.139389 24749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.140569 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:43.141659 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:43.141855 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.142074 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602583142054 us; error 0 us; skew 500 ppm
I20260709 13:09:43.142659 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.145673 13792 webserver.cc:533] Webserver started at http://127.13.120.2:33551/ using document root <none> and password file <none>
I20260709 13:09:43.146271 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.146513 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.146832 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.147083 24742 heartbeater.cc:344] Connected to a master server at 127.13.120.62:45317
I20260709 13:09:43.147513 24742 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:43.148132 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "0bc810251f5c422b842cd89e58407aed"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:43.148204 24742 heartbeater.cc:507] Master 127.13.120.62:45317 requested a full tablet report, sending...
I20260709 13:09:43.150269 24615 ts_manager.cc:194] Registered new tserver with Master: 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145)
I20260709 13:09:43.151968 24615 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41008
I20260709 13:09:43.153326 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:43.156611 24754 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.157326 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:43.157615 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "0bc810251f5c422b842cd89e58407aed"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:43.157895 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.169296 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.170433 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.171878 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:43.173987 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:43.174206 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.174439 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:43.174602 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.212363 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:42001
I20260709 13:09:43.212498 24816 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:42001 every 8 connection(s)
I20260709 13:09:43.217054 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.223793 24820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.225605 24821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.227967 24823 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.228636 24817 heartbeater.cc:344] Connected to a master server at 127.13.120.62:45317
I20260709 13:09:43.228922 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:43.229054 24817 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:43.229909 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:09:43.229925 24817 heartbeater.cc:507] Master 127.13.120.62:45317 requested a full tablet report, sending...
W20260709 13:09:43.230222 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.230515 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602583230491 us; error 0 us; skew 500 ppm
I20260709 13:09:43.231151 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.232386 24615 ts_manager.cc:194] Registered new tserver with Master: 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:43.233873 13792 webserver.cc:533] Webserver started at http://127.13.120.3:38697/ using document root <none> and password file <none>
I20260709 13:09:43.234270 24615 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41022
I20260709 13:09:43.234542 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.234845 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.235512 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.236644 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:43.240917 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:43.244052 24828 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.244755 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:43.245059 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:43.245332 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.261153 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.262296 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.263715 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:43.265818 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:43.266047 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.266276 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:43.266448 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.305045 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:38027
I20260709 13:09:43.305128 24890 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:38027 every 8 connection(s)
I20260709 13:09:43.318042 24891 heartbeater.cc:344] Connected to a master server at 127.13.120.62:45317
I20260709 13:09:43.318397 24891 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:43.319096 24891 heartbeater.cc:507] Master 127.13.120.62:45317 requested a full tablet report, sending...
I20260709 13:09:43.321033 24615 ts_manager.cc:194] Registered new tserver with Master: ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:43.321666 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013432313s
I20260709 13:09:43.322705 24615 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41034
I20260709 13:09:43.347246 24615 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41050:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:43.349958 24615 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:43.430015 24856 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9cf532d5294ffbad5ee03717735b2c (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:43.430478 24855 tablet_service.cc:1511] Processing CreateTablet for tablet 563a75b0e29c4af0a44036988b90108d (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:43.431541 24856 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9cf532d5294ffbad5ee03717735b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.432145 24855 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563a75b0e29c4af0a44036988b90108d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.438143 24782 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9cf532d5294ffbad5ee03717735b2c (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:43.440610 24781 tablet_service.cc:1511] Processing CreateTablet for tablet 563a75b0e29c4af0a44036988b90108d (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:43.440939 24854 tablet_service.cc:1511] Processing CreateTablet for tablet d770bb7cc70744e6bf25aeb29fe408ab (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:43.442338 24854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d770bb7cc70744e6bf25aeb29fe408ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.445041 24853 tablet_service.cc:1511] Processing CreateTablet for tablet e53b3a4712aa4239a2493bbded533a6d (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:43.445279 24779 tablet_service.cc:1511] Processing CreateTablet for tablet e53b3a4712aa4239a2493bbded533a6d (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:43.446931 24853 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53b3a4712aa4239a2493bbded533a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.447052 24704 tablet_service.cc:1511] Processing CreateTablet for tablet e53b3a4712aa4239a2493bbded533a6d (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:43.448753 24704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53b3a4712aa4239a2493bbded533a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.448614 24852 tablet_service.cc:1511] Processing CreateTablet for tablet e703030e3d724d5c8ad78035468d2434 (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:43.449947 24852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e703030e3d724d5c8ad78035468d2434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.449806 24776 tablet_service.cc:1511] Processing CreateTablet for tablet b0191ce25d6d4de7a74fc343ad71d55a (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:43.450250 24778 tablet_service.cc:1511] Processing CreateTablet for tablet e703030e3d724d5c8ad78035468d2434 (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:43.442831 24780 tablet_service.cc:1511] Processing CreateTablet for tablet d770bb7cc70744e6bf25aeb29fe408ab (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:43.443884 24705 tablet_service.cc:1511] Processing CreateTablet for tablet d770bb7cc70744e6bf25aeb29fe408ab (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:43.452060 24782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9cf532d5294ffbad5ee03717735b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.452821 24780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d770bb7cc70744e6bf25aeb29fe408ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.452566 24707 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9cf532d5294ffbad5ee03717735b2c (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:43.453486 24778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e703030e3d724d5c8ad78035468d2434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.454087 24781 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563a75b0e29c4af0a44036988b90108d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.454718 24776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0191ce25d6d4de7a74fc343ad71d55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.448653 24777 tablet_service.cc:1511] Processing CreateTablet for tablet 1330664d52bd4fb79a44fbc4640dec1b (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:43.454741 24706 tablet_service.cc:1511] Processing CreateTablet for tablet 563a75b0e29c4af0a44036988b90108d (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:43.452127 24705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d770bb7cc70744e6bf25aeb29fe408ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.456233 24777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1330664d52bd4fb79a44fbc4640dec1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.456732 24703 tablet_service.cc:1511] Processing CreateTablet for tablet e703030e3d724d5c8ad78035468d2434 (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:43.457732 24706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 563a75b0e29c4af0a44036988b90108d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.458408 24707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9cf532d5294ffbad5ee03717735b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.459857 24779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e53b3a4712aa4239a2493bbded533a6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.460124 24703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e703030e3d724d5c8ad78035468d2434. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.459794 24702 tablet_service.cc:1511] Processing CreateTablet for tablet 1330664d52bd4fb79a44fbc4640dec1b (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:43.461380 24702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1330664d52bd4fb79a44fbc4640dec1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.499461 24775 tablet_service.cc:1511] Processing CreateTablet for tablet fae5b421a8374818bff1084f30eff82b (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:43.501314 24775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae5b421a8374818bff1084f30eff82b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.515192 24906 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.517198 24774 tablet_service.cc:1511] Processing CreateTablet for tablet 9aca5c8382c34d00a293b1af58bc1489 (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:43.518651 24774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aca5c8382c34d00a293b1af58bc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.523779 24851 tablet_service.cc:1511] Processing CreateTablet for tablet 1330664d52bd4fb79a44fbc4640dec1b (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:43.525177 24851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1330664d52bd4fb79a44fbc4640dec1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.528496 24701 tablet_service.cc:1511] Processing CreateTablet for tablet fae5b421a8374818bff1084f30eff82b (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:43.530206 24701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae5b421a8374818bff1084f30eff82b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.531301 24773 tablet_service.cc:1511] Processing CreateTablet for tablet fde03517266c473bb828ca35ba0e0a7f (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:43.532289 24700 tablet_service.cc:1511] Processing CreateTablet for tablet 9aca5c8382c34d00a293b1af58bc1489 (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:43.533629 24700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aca5c8382c34d00a293b1af58bc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.539305 24850 tablet_service.cc:1511] Processing CreateTablet for tablet b0191ce25d6d4de7a74fc343ad71d55a (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:43.552277 24850 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0191ce25d6d4de7a74fc343ad71d55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.541101 24849 tablet_service.cc:1511] Processing CreateTablet for tablet fae5b421a8374818bff1084f30eff82b (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:43.556236 24849 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fae5b421a8374818bff1084f30eff82b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.542810 24848 tablet_service.cc:1511] Processing CreateTablet for tablet 9aca5c8382c34d00a293b1af58bc1489 (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:43.560235 24848 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9aca5c8382c34d00a293b1af58bc1489. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.544457 24847 tablet_service.cc:1511] Processing CreateTablet for tablet fde03517266c473bb828ca35ba0e0a7f (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:43.546687 24699 tablet_service.cc:1511] Processing CreateTablet for tablet fde03517266c473bb828ca35ba0e0a7f (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:43.532691 24773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde03517266c473bb828ca35ba0e0a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.564785 24847 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde03517266c473bb828ca35ba0e0a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.567595 24699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fde03517266c473bb828ca35ba0e0a7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.576368 24702 tablet_service.cc:1511] Processing CreateTablet for tablet b0191ce25d6d4de7a74fc343ad71d55a (DEFAULT_TABLE table=test-workload [id=5f0e0cc9835a4954ac8e739d3a82a8e0]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:43.577728 24702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0191ce25d6d4de7a74fc343ad71d55a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.601466 24906 tablet_bootstrap.cc:654] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.624209 24908 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.635368 24908 tablet_bootstrap.cc:654] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.652091 24907 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:43.658113 24906 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.659597 24907 tablet_bootstrap.cc:654] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.660781 24906 ts_tablet_manager.cc:1403] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.008s
I20260709 13:09:43.662129 24908 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.662653 24908 ts_tablet_manager.cc:1403] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.039s	user 0.003s	sys 0.009s
I20260709 13:09:43.664898 24906 raft_consensus.cc:359] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.665411 24908 raft_consensus.cc:359] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.665700 24906 raft_consensus.cc:385] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.666121 24908 raft_consensus.cc:385] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.666185 24906 raft_consensus.cc:740] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.666463 24908 raft_consensus.cc:740] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.666548 24907 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:43.667187 24907 ts_tablet_manager.cc:1403] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 13:09:43.667187 24906 consensus_queue.cc:260] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.667451 24908 consensus_queue.cc:260] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.671108 24907 raft_consensus.cc:359] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.672060 24907 raft_consensus.cc:385] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.672434 24907 raft_consensus.cc:740] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.673652 24907 consensus_queue.cc:260] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.676419 24817 heartbeater.cc:499] Master 127.13.120.62:45317 was elected leader, sending a full tablet report...
I20260709 13:09:43.676932 24908 ts_tablet_manager.cc:1434] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.007s
I20260709 13:09:43.677244 24742 heartbeater.cc:499] Master 127.13.120.62:45317 was elected leader, sending a full tablet report...
I20260709 13:09:43.678097 24908 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.676409 24913 raft_consensus.cc:493] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.679669 24913 raft_consensus.cc:515] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.687469 24908 tablet_bootstrap.cc:654] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.689944 24907 ts_tablet_manager.cc:1434] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.002s
I20260709 13:09:43.676975 24906 ts_tablet_manager.cc:1434] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.008s
I20260709 13:09:43.692481 24906 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.699007 24906 tablet_bootstrap.cc:654] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.705483 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
W20260709 13:09:43.707381 24757 leader_election.cc:343] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.709828 24891 heartbeater.cc:499] Master 127.13.120.62:45317 was elected leader, sending a full tablet report...
W20260709 13:09:43.717113 24818 tablet.cc:2406] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:43.726578 24906 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.727104 24906 ts_tablet_manager.cc:1403] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.007s
I20260709 13:09:43.730084 24906 raft_consensus.cc:359] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.730815 24906 raft_consensus.cc:385] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.731144 24906 raft_consensus.cc:740] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.731444 24907 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:43.732059 24906 consensus_queue.cc:260] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.734237 24906 ts_tablet_manager.cc:1434] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:43.735155 24906 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.741466 24906 tablet_bootstrap.cc:654] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.741688 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
W20260709 13:09:43.743366 24757 leader_election.cc:343] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:43.744761 24757 leader_election.cc:304] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed; no voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:43.745894 24914 raft_consensus.cc:2749] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:43.746322 24913 leader_election.cc:290] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:43.750118 24908 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.750656 24908 ts_tablet_manager.cc:1403] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.073s	user 0.027s	sys 0.043s
I20260709 13:09:43.751477 24906 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.751983 24906 ts_tablet_manager.cc:1403] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.017s	user 0.015s	sys 0.000s
I20260709 13:09:43.770959 24908 raft_consensus.cc:359] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.771111 24906 raft_consensus.cc:359] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.771903 24908 raft_consensus.cc:385] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.772017 24906 raft_consensus.cc:385] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.772315 24908 raft_consensus.cc:740] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.772455 24906 raft_consensus.cc:740] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.773298 24908 consensus_queue.cc:260] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.773370 24906 consensus_queue.cc:260] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.775876 24906 ts_tablet_manager.cc:1434] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.003s
I20260709 13:09:43.776945 24908 ts_tablet_manager.cc:1434] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.026s	user 0.017s	sys 0.009s
I20260709 13:09:43.777657 24908 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.781922 24907 tablet_bootstrap.cc:654] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.782971 24908 tablet_bootstrap.cc:654] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.783974 24906 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.791782 24906 tablet_bootstrap.cc:654] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.798094 24908 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.798568 24908 ts_tablet_manager.cc:1403] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:09:43.801136 24907 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:43.801584 24907 ts_tablet_manager.cc:1403] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.007s
I20260709 13:09:43.801397 24908 raft_consensus.cc:359] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.801891 24906 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.802260 24908 raft_consensus.cc:385] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.802525 24906 ts_tablet_manager.cc:1403] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:09:43.802582 24908 raft_consensus.cc:740] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.803548 24908 consensus_queue.cc:260] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.804582 24907 raft_consensus.cc:359] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.805311 24907 raft_consensus.cc:385] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.805503 24908 ts_tablet_manager.cc:1434] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:43.805612 24907 raft_consensus.cc:740] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.805604 24906 raft_consensus.cc:359] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.806650 24908 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.806708 24906 raft_consensus.cc:385] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.807293 24906 raft_consensus.cc:740] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.806842 24907 consensus_queue.cc:260] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.808182 24906 consensus_queue.cc:260] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.809412 24907 ts_tablet_manager.cc:1434] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:09:43.810340 24907 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:43.812564 24906 ts_tablet_manager.cc:1434] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.010s	user 0.000s	sys 0.007s
I20260709 13:09:43.813601 24906 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.813725 24908 tablet_bootstrap.cc:654] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.816624 24907 tablet_bootstrap.cc:654] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.828155 24906 tablet_bootstrap.cc:654] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.836024 24907 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:43.836678 24907 ts_tablet_manager.cc:1403] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.015s
I20260709 13:09:43.838972 24908 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.839689 24908 ts_tablet_manager.cc:1403] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.015s
I20260709 13:09:43.839226 24907 raft_consensus.cc:359] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.840219 24907 raft_consensus.cc:385] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.840528 24907 raft_consensus.cc:740] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.841439 24907 consensus_queue.cc:260] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.842126 24906 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.842626 24906 ts_tablet_manager.cc:1403] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 13:09:43.843379 24907 ts_tablet_manager.cc:1434] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:09:43.843096 24908 raft_consensus.cc:359] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.843886 24908 raft_consensus.cc:385] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.844178 24908 raft_consensus.cc:740] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.844422 24907 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:43.844995 24908 consensus_queue.cc:260] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.845459 24906 raft_consensus.cc:359] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.846155 24906 raft_consensus.cc:385] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.846524 24906 raft_consensus.cc:740] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.847357 24906 consensus_queue.cc:260] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.850080 24908 ts_tablet_manager.cc:1434] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:43.851104 24908 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.851110 24907 tablet_bootstrap.cc:654] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.856393 24906 ts_tablet_manager.cc:1434] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:09:43.858130 24908 tablet_bootstrap.cc:654] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.861577 24906 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.869310 24907 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:43.869807 24907 ts_tablet_manager.cc:1403] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.009s
I20260709 13:09:43.870107 24906 tablet_bootstrap.cc:654] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.871335 24908 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.871877 24908 ts_tablet_manager.cc:1403] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:09:43.872491 24907 raft_consensus.cc:359] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.873111 24907 raft_consensus.cc:385] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.873411 24907 raft_consensus.cc:740] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.874215 24907 consensus_queue.cc:260] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.874876 24908 raft_consensus.cc:359] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.875694 24906 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.875643 24908 raft_consensus.cc:385] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.876099 24908 raft_consensus.cc:740] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.876250 24906 ts_tablet_manager.cc:1403] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.003s
I20260709 13:09:43.876652 24907 ts_tablet_manager.cc:1434] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 13:09:43.877003 24908 consensus_queue.cc:260] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.878132 24907 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:43.879277 24906 raft_consensus.cc:359] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.880026 24906 raft_consensus.cc:385] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.880307 24906 raft_consensus.cc:740] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.881327 24906 consensus_queue.cc:260] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.882052 24908 ts_tablet_manager.cc:1434] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:43.883018 24908 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.887627 24906 ts_tablet_manager.cc:1434] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:43.888377 24907 tablet_bootstrap.cc:654] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.888636 24906 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.889307 24908 tablet_bootstrap.cc:654] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.898710 24906 tablet_bootstrap.cc:654] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.901518 24907 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:43.901993 24907 ts_tablet_manager.cc:1403] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:09:43.905109 24907 raft_consensus.cc:359] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.905818 24906 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.906385 24906 ts_tablet_manager.cc:1403] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 13:09:43.905834 24907 raft_consensus.cc:385] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.907902 24907 raft_consensus.cc:740] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.908317 24908 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.908808 24908 ts_tablet_manager.cc:1403] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.011s
I20260709 13:09:43.908674 24907 consensus_queue.cc:260] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.909112 24906 raft_consensus.cc:359] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.909859 24906 raft_consensus.cc:385] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.910132 24906 raft_consensus.cc:740] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.910823 24907 ts_tablet_manager.cc:1434] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:43.910934 24906 consensus_queue.cc:260] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.911855 24907 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:43.911783 24908 raft_consensus.cc:359] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.912659 24908 raft_consensus.cc:385] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.912969 24908 raft_consensus.cc:740] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.913797 24908 consensus_queue.cc:260] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.917941 24908 ts_tablet_manager.cc:1434] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 13:09:43.919008 24907 tablet_bootstrap.cc:654] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.918927 24906 ts_tablet_manager.cc:1434] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:09:43.918900 24908 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.920096 24912 raft_consensus.cc:493] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.920660 24912 raft_consensus.cc:515] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.922190 24906 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:43.926672 24908 tablet_bootstrap.cc:654] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.933720 24912 leader_election.cc:290] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:43.935345 24907 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:43.935921 24907 ts_tablet_manager.cc:1403] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 13:09:43.936005 24915 raft_consensus.cc:493] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.936514 24915 raft_consensus.cc:515] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.936046 24906 tablet_bootstrap.cc:654] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.938304 24908 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.938822 24908 ts_tablet_manager.cc:1403] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:09:43.938995 24907 raft_consensus.cc:359] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.939832 24907 raft_consensus.cc:385] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.940179 24907 raft_consensus.cc:740] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.940949 24907 consensus_queue.cc:260] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.946684 24915 leader_election.cc:290] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:43.948823 24915 raft_consensus.cc:493] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:43.948589 24908 raft_consensus.cc:359] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.951819 24908 raft_consensus.cc:385] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.952195 24908 raft_consensus.cc:740] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.954787 24908 consensus_queue.cc:260] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.950991 24915 raft_consensus.cc:515] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:43.961760 24908 ts_tablet_manager.cc:1434] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 13:09:43.963773 24908 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:43.963958 24915 leader_election.cc:290] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:43.971305 24908 tablet_bootstrap.cc:654] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:43.983924 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:43.984351 24906 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:43.984853 24906 ts_tablet_manager.cc:1403] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.000s
I20260709 13:09:43.985245 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:43.985890 24866 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 0.
I20260709 13:09:43.987115 24682 leader_election.cc:304] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:43.988016 24912 raft_consensus.cc:2804] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:43.988358 24912 raft_consensus.cc:493] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:43.988731 24912 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.982853 24908 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:43.995765 24908 ts_tablet_manager.cc:1403] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.001s
I20260709 13:09:43.997169 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:43.998082 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:43.998174 24792 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 0.
I20260709 13:09:43.998505 24908 raft_consensus.cc:359] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:43.998768 24717 raft_consensus.cc:2468] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.000015 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.000731 24716 raft_consensus.cc:2468] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.000038 24831 leader_election.cc:304] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.002882 24912 raft_consensus.cc:515] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.003209 24831 leader_election.cc:304] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.003502 24907 ts_tablet_manager.cc:1434] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.067s	user 0.027s	sys 0.032s
I20260709 13:09:44.004135 24915 raft_consensus.cc:2804] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.004472 24915 raft_consensus.cc:493] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.004813 24915 raft_consensus.cc:3060] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.002189 24906 raft_consensus.cc:359] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.006073 24906 raft_consensus.cc:385] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.005997 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:44.006477 24906 raft_consensus.cc:740] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.006656 24866 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.007120 24906 consensus_queue.cc:260] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.007793 24913 raft_consensus.cc:493] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.008306 24913 raft_consensus.cc:515] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.010273 24913 leader_election.cc:290] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.011080 24907 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:44.012107 24865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:44.014576 24866 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 1.
I20260709 13:09:44.014784 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.015583 24791 raft_consensus.cc:2468] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.015647 24912 leader_election.cc:290] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 election: Requested vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.016438 24912 raft_consensus.cc:493] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:44.016626 24757 leader_election.cc:343] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.017933 24936 raft_consensus.cc:493] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.018159 24907 tablet_bootstrap.cc:654] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.018577 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.019302 24792 raft_consensus.cc:2468] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.019832 24682 leader_election.cc:304] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.018695 24908 raft_consensus.cc:385] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.018589 24936 raft_consensus.cc:515] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.022989 24936 leader_election.cc:290] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.024107 24908 raft_consensus.cc:740] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.017019 24912 raft_consensus.cc:515] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.025935 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.026917 24792 raft_consensus.cc:2468] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.030721 24912 leader_election.cc:290] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.032541 24829 leader_election.cc:304] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.034237 24936 raft_consensus.cc:2804] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.034736 24936 raft_consensus.cc:493] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.035181 24936 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.035434 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.036285 24791 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.030059 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:44.025410 24908 consensus_queue.cc:260] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.008688 24937 raft_consensus.cc:2804] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.044709 24937 raft_consensus.cc:493] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.048837 24937 raft_consensus.cc:3060] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.056612 24908 ts_tablet_manager.cc:1434] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.003s
I20260709 13:09:44.048062 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
W20260709 13:09:44.048091 24682 leader_election.cc:343] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.057485 24912 raft_consensus.cc:2804] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.058976 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
W20260709 13:09:44.060552 24680 leader_election.cc:343] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.060631 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.071991 24717 raft_consensus.cc:2468] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 0.
I20260709 13:09:44.072233 24912 raft_consensus.cc:697] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 LEADER]: Becoming Leader. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Running, Role: LEADER
I20260709 13:09:44.073105 24680 leader_election.cc:304] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9548492e26e547db83f55f142682cd4c; no voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:44.052147 24915 raft_consensus.cc:515] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.069140 24908 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:44.077723 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.079591 24792 raft_consensus.cc:3060] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.080405 24945 raft_consensus.cc:493] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.081082 24945 raft_consensus.cc:515] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.078440 24936 raft_consensus.cc:515] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.073494 24912 consensus_queue.cc:237] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
W20260709 13:09:44.084417 24831 leader_election.cc:343] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.084669 24757 leader_election.cc:304] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:44.085879 24913 raft_consensus.cc:2804] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.086380 24913 raft_consensus.cc:493] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.086792 24913 raft_consensus.cc:3060] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.097365 24915 leader_election.cc:290] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.097379 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d770bb7cc70744e6bf25aeb29fe408ab" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.099277 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.100163 24717 raft_consensus.cc:3060] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.104847 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.105638 24790 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.109954 24717 raft_consensus.cc:2468] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.112784 24942 raft_consensus.cc:2749] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.114267 24943 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.114989 24906 ts_tablet_manager.cc:1434] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.130s	user 0.043s	sys 0.064s
I20260709 13:09:44.071250 24791 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 1.
I20260709 13:09:44.135763 24906 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:44.121943 24936 leader_election.cc:290] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.115044 24790 raft_consensus.cc:2468] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.139398 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d770bb7cc70744e6bf25aeb29fe408ab" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:44.139937 24829 leader_election.cc:304] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.124114 24913 raft_consensus.cc:515] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.142300 24906 tablet_bootstrap.cc:654] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.142858 24913 leader_election.cc:290] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
W20260709 13:09:44.131196 24680 leader_election.cc:343] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:44.143666 24682 leader_election.cc:343] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.144294 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
W20260709 13:09:44.146032 24757 leader_election.cc:343] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.146001 24682 leader_election.cc:304] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9548492e26e547db83f55f142682cd4c; no voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:44.147470 24942 raft_consensus.cc:2749] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.119607 24915 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.141115 24936 raft_consensus.cc:2804] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.136255 24943 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.150115 24915 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.148321 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.148936 24945 leader_election.cc:290] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.122048 24831 leader_election.cc:304] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.115939 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.154274 24915 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.155535 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.156464 24790 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.157895 24829 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.158088 24915 raft_consensus.cc:2804] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.162153 24908 tablet_bootstrap.cc:654] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.153261 24717 raft_consensus.cc:3060] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.152074 24936 raft_consensus.cc:697] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
W20260709 13:09:44.166967 24831 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:34145, user_credentials={real_user=slave}} blocked reactor thread for 45041.8us
I20260709 13:09:44.152757 24943 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.187326 24936 consensus_queue.cc:237] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
W20260709 13:09:44.187943 24831 leader_election.cc:343] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.186355 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:44.188537 24937 raft_consensus.cc:515] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:44.185717 24948 raft_consensus.cc:2804] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.174576 24915 raft_consensus.cc:697] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:44.191908 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.192524 24790 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 0.
I20260709 13:09:44.193203 24937 leader_election.cc:290] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.193460 24866 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 0.
I20260709 13:09:44.193957 24948 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.194315 24948 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.194749 24682 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.194708 24915 consensus_queue.cc:237] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.190002 24613 catalog_manager.cc:5697] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9548492e26e547db83f55f142682cd4c (127.13.120.1). New cstate: current_term: 1 leader_uuid: "9548492e26e547db83f55f142682cd4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.195919 24943 raft_consensus.cc:2804] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.196300 24943 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.196650 24943 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.198680 24907 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:44.199747 24907 ts_tablet_manager.cc:1403] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.189s	user 0.059s	sys 0.099s
I20260709 13:09:44.204531 24907 raft_consensus.cc:359] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.204916 24943 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.198052 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.191098 24792 raft_consensus.cc:2468] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.206705 24937 raft_consensus.cc:493] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.211910 24791 raft_consensus.cc:3060] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.212188 24937 raft_consensus.cc:515] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.215716 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.217514 24790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.218163 24790 raft_consensus.cc:2468] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.219431 24829 leader_election.cc:304] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.219863 24716 raft_consensus.cc:2393] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea1ffc9b1cd64d48a3723a6c4745d39d in current term 1: Already voted for candidate 9548492e26e547db83f55f142682cd4c in this term.
I20260709 13:09:44.220415 24949 raft_consensus.cc:2804] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.220831 24949 raft_consensus.cc:493] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.221211 24949 raft_consensus.cc:3060] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.221647 24948 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.222713 24717 raft_consensus.cc:2468] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 1.
I20260709 13:09:44.224762 24937 leader_election.cc:290] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.211211 24907 raft_consensus.cc:385] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.228770 24907 raft_consensus.cc:740] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.229245 24906 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:44.229775 24906 ts_tablet_manager.cc:1403] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.094s	user 0.009s	sys 0.040s
I20260709 13:09:44.229812 24907 consensus_queue.cc:260] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.235395 24791 raft_consensus.cc:2468] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.236284 24908 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:44.236716 24829 leader_election.cc:304] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.236807 24906 raft_consensus.cc:359] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.237541 24907 ts_tablet_manager.cc:1434] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.003s
I20260709 13:09:44.237735 24906 raft_consensus.cc:385] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.237962 24936 raft_consensus.cc:2804] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.238188 24906 raft_consensus.cc:740] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.238533 24936 raft_consensus.cc:697] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:44.238685 24907 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:44.239029 24906 consensus_queue.cc:260] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.239780 24936 consensus_queue.cc:237] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:44.241218 24906 ts_tablet_manager.cc:1434] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:44.242131 24906 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:44.245808 24907 tablet_bootstrap.cc:654] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.236769 24908 ts_tablet_manager.cc:1403] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.168s	user 0.019s	sys 0.002s
I20260709 13:09:44.245353 24612 catalog_manager.cc:5697] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 1 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.249226 24943 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 election: Requested vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.253607 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.253916 24948 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.254274 24717 raft_consensus.cc:2468] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.255276 24757 leader_election.cc:304] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:44.256506 24906 tablet_bootstrap.cc:654] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.259418 24913 raft_consensus.cc:2804] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.259526 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.260478 24792 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.261474 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:44.262511 24866 raft_consensus.cc:2393] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9548492e26e547db83f55f142682cd4c in current term 1: Already voted for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in this term.
I20260709 13:09:44.264007 24949 raft_consensus.cc:515] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.266495 24908 raft_consensus.cc:359] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.267212 24908 raft_consensus.cc:385] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.267930 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.268210 24949 leader_election.cc:290] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.267513 24908 raft_consensus.cc:740] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.266748 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.269840 24716 raft_consensus.cc:3060] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.269655 24908 consensus_queue.cc:260] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.270689 24913 raft_consensus.cc:697] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:44.283022 24913 consensus_queue.cc:237] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.270628 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.296021 24791 raft_consensus.cc:3060] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.299643 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.300731 24717 raft_consensus.cc:2393] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ea1ffc9b1cd64d48a3723a6c4745d39d in current term 1: Already voted for candidate 9548492e26e547db83f55f142682cd4c in this term.
I20260709 13:09:44.302624 24831 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c
I20260709 13:09:44.304452 24936 raft_consensus.cc:2749] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.307641 24792 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9548492e26e547db83f55f142682cd4c in term 1.
I20260709 13:09:44.309280 24680 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:44.310364 24943 raft_consensus.cc:2804] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.310983 24943 raft_consensus.cc:697] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 LEADER]: Becoming Leader. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Running, Role: LEADER
I20260709 13:09:44.311232 24717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.312165 24717 raft_consensus.cc:3060] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.312115 24943 consensus_queue.cc:237] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.316888 24906 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: No bootstrap required, opened a new log
I20260709 13:09:44.317325 24906 ts_tablet_manager.cc:1403] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.001s
I20260709 13:09:44.323894 24908 ts_tablet_manager.cc:1434] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.076s	user 0.015s	sys 0.025s
I20260709 13:09:44.328545 24717 raft_consensus.cc:2468] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.331202 24908 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed: Bootstrap starting.
I20260709 13:09:44.331302 24907 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:44.332331 24907 ts_tablet_manager.cc:1403] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.094s	user 0.038s	sys 0.032s
I20260709 13:09:44.331619 24791 raft_consensus.cc:2468] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.336004 24829 leader_election.cc:304] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.337960 24936 raft_consensus.cc:2804] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.339460 24936 raft_consensus.cc:697] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:44.340904 24936 consensus_queue.cc:237] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.342962 24906 raft_consensus.cc:359] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.343675 24906 raft_consensus.cc:385] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.343947 24906 raft_consensus.cc:740] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.344815 24906 consensus_queue.cc:260] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.349402 24907 raft_consensus.cc:359] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.354561 24907 raft_consensus.cc:385] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.354966 24907 raft_consensus.cc:740] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.350715 24906 ts_tablet_manager.cc:1434] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260709 13:09:44.350221 24611 catalog_manager.cc:5697] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 1 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.355382 24716 raft_consensus.cc:2468] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.356027 24907 consensus_queue.cc:260] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.358693 24907 ts_tablet_manager.cc:1434] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 13:09:44.360071 24907 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:44.354117 24908 tablet_bootstrap.cc:654] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.368455 24907 tablet_bootstrap.cc:654] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.377419 24613 catalog_manager.cc:5697] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c reported cstate change: term changed from 0 to 1, leader changed from <none> to 9548492e26e547db83f55f142682cd4c (127.13.120.1). New cstate: current_term: 1 leader_uuid: "9548492e26e547db83f55f142682cd4c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.384297 24908 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed: No bootstrap required, opened a new log
I20260709 13:09:44.384343 24907 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:44.384961 24908 ts_tablet_manager.cc:1403] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.013s
I20260709 13:09:44.384989 24907 ts_tablet_manager.cc:1403] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260709 13:09:44.387395 24907 raft_consensus.cc:359] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.388104 24907 raft_consensus.cc:385] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.387784 24908 raft_consensus.cc:359] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.388425 24907 raft_consensus.cc:740] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.388564 24908 raft_consensus.cc:385] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.388954 24908 raft_consensus.cc:740] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.389303 24907 consensus_queue.cc:260] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.389773 24908 consensus_queue.cc:260] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.390641 24949 raft_consensus.cc:493] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.391100 24949 raft_consensus.cc:515] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.391597 24907 ts_tablet_manager.cc:1434] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:44.392493 24907 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d: Bootstrap starting.
I20260709 13:09:44.393146 24949 leader_election.cc:290] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.392539 24611 catalog_manager.cc:5697] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 1 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.394461 24611 catalog_manager.cc:5697] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 1 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.396781 24908 ts_tablet_manager.cc:1434] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:44.396626 24611 catalog_manager.cc:5697] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 1 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.399041 24907 tablet_bootstrap.cc:654] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.399326 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.399986 24716 raft_consensus.cc:2468] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.400172 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.400838 24791 raft_consensus.cc:2468] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.401240 24831 leader_election.cc:304] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.402144 24936 raft_consensus.cc:2804] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.402513 24936 raft_consensus.cc:493] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.402839 24936 raft_consensus.cc:3060] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.405444 24907 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d: No bootstrap required, opened a new log
I20260709 13:09:44.405797 24907 ts_tablet_manager.cc:1403] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:09:44.408910 24907 raft_consensus.cc:359] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.409502 24907 raft_consensus.cc:385] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.409835 24907 raft_consensus.cc:740] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.409615 24936 raft_consensus.cc:515] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.410594 24907 consensus_queue.cc:260] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.411811 24936 leader_election.cc:290] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.412575 24907 ts_tablet_manager.cc:1434] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:44.413718 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.413687 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.414428 24791 raft_consensus.cc:3060] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.414458 24716 raft_consensus.cc:3060] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.421345 24716 raft_consensus.cc:2468] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.421345 24791 raft_consensus.cc:2468] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.423105 24831 leader_election.cc:304] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.423825 24936 raft_consensus.cc:2804] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.424295 24936 raft_consensus.cc:697] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:44.425060 24936 consensus_queue.cc:237] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.431913 24611 catalog_manager.cc:5697] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 1 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.466635 24913 raft_consensus.cc:493] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.467185 24913 raft_consensus.cc:515] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.469105 24913 leader_election.cc:290] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.469897 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d770bb7cc70744e6bf25aeb29fe408ab" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.470062 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d770bb7cc70744e6bf25aeb29fe408ab" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:44.470501 24716 raft_consensus.cc:2468] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 0.
I20260709 13:09:44.470675 24866 raft_consensus.cc:2468] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 0.
I20260709 13:09:44.471475 24757 leader_election.cc:304] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:44.472047 24913 raft_consensus.cc:2804] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.472355 24913 raft_consensus.cc:493] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.472626 24913 raft_consensus.cc:3060] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.479173 24913 raft_consensus.cc:515] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.480716 24913 leader_election.cc:290] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.481454 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d770bb7cc70744e6bf25aeb29fe408ab" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.481779 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d770bb7cc70744e6bf25aeb29fe408ab" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:44.482048 24716 raft_consensus.cc:3060] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.482334 24866 raft_consensus.cc:3060] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.487311 24716 raft_consensus.cc:2468] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 1.
I20260709 13:09:44.487707 24866 raft_consensus.cc:2468] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 1.
I20260709 13:09:44.488340 24757 leader_election.cc:304] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:44.489231 24913 raft_consensus.cc:2804] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.489717 24913 raft_consensus.cc:697] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:44.490480 24913 consensus_queue.cc:237] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.497474 24611 catalog_manager.cc:5697] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 1 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:44.526847 24943 raft_consensus.cc:493] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.527448 24943 raft_consensus.cc:515] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.529371 24943 leader_election.cc:290] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:44.530055 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.530398 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "9548492e26e547db83f55f142682cd4c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:44.530745 24791 raft_consensus.cc:2393] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9548492e26e547db83f55f142682cd4c in current term 1: Already voted for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in this term.
I20260709 13:09:44.531733 24680 leader_election.cc:304] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9548492e26e547db83f55f142682cd4c; no voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:44.532352 24943 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.537082 24943 raft_consensus.cc:2749] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.610270 24943 consensus_queue.cc:1048] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.615068 24943 consensus_queue.cc:1048] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.666898 24936 raft_consensus.cc:493] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.667493 24936 raft_consensus.cc:515] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.669209 24936 leader_election.cc:290] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.670042 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.670168 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.670673 24716 raft_consensus.cc:2468] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.670782 24791 raft_consensus.cc:2468] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 0.
I20260709 13:09:44.671712 24831 leader_election.cc:304] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.672392 24936 raft_consensus.cc:2804] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:44.672758 24936 raft_consensus.cc:493] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:44.673046 24936 raft_consensus.cc:3060] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.678221 24936 raft_consensus.cc:515] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.679896 24936 leader_election.cc:290] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.680490 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:44.680876 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:44.681125 24716 raft_consensus.cc:3060] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.681458 24791 raft_consensus.cc:3060] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.688051 24716 raft_consensus.cc:2468] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.688051 24791 raft_consensus.cc:2468] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 1.
I20260709 13:09:44.689453 24829 leader_election.cc:304] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:44.690150 24936 raft_consensus.cc:2804] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:44.690586 24936 raft_consensus.cc:697] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:44.691277 24936 consensus_queue.cc:237] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.698669 24611 catalog_manager.cc:5697] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 0 to 1, leader changed from <none> to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 1 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:44.699622 24936 consensus_queue.cc:1048] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.710635 24949 consensus_queue.cc:1048] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.711558 24948 raft_consensus.cc:493] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.712080 24948 raft_consensus.cc:515] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:44.714196 24948 leader_election.cc:290] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:44.715762 24792 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
I20260709 13:09:44.717163 24949 consensus_queue.cc:1048] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.719843 24716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9548492e26e547db83f55f142682cd4c" is_pre_election: true
I20260709 13:09:44.720624 24716 raft_consensus.cc:2393] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea1ffc9b1cd64d48a3723a6c4745d39d in current term 1: Already voted for candidate 0bc810251f5c422b842cd89e58407aed in this term.
I20260709 13:09:44.723680 24831 leader_election.cc:304] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c
I20260709 13:09:44.725001 24948 raft_consensus.cc:3060] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:44.727074 24937 consensus_queue.cc:1048] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.733706 24948 raft_consensus.cc:2749] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:44.742993 13792 ts_manager.cc:295] Set tserver state for 9548492e26e547db83f55f142682cd4c to MAINTENANCE_MODE
I20260709 13:09:44.743837 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
I20260709 13:09:44.760249 24948 consensus_queue.cc:1048] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:44.772344 24949 consensus_queue.cc:1048] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:44.779538 24831 consensus_peers.cc:597] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:44.792932 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:09:44.794116 24831 consensus_peers.cc:597] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:44.796710 13792 tablet_replica.cc:333] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.797816 13792 raft_consensus.cc:2243] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.798210 13792 raft_consensus.cc:2272] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.799955 13792 tablet_replica.cc:333] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.800661 13792 raft_consensus.cc:2243] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.801033 13792 raft_consensus.cc:2272] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.802563 13792 tablet_replica.cc:333] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.803059 13792 raft_consensus.cc:2243] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.803449 13792 raft_consensus.cc:2272] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.804930 13792 tablet_replica.cc:333] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.805600 13792 raft_consensus.cc:2243] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.806041 13792 raft_consensus.cc:2272] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.808012 13792 tablet_replica.cc:333] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.808693 13792 raft_consensus.cc:2243] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:44.809463 13792 pending_rounds.cc:70] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Trying to abort 1 pending ops.
I20260709 13:09:44.809697 13792 pending_rounds.cc:77] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636185406087168 op_type: NO_OP noop_request { }
I20260709 13:09:44.810086 13792 raft_consensus.cc:2889] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:44.810415 13792 raft_consensus.cc:2272] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.812677 13792 tablet_replica.cc:333] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.813141 13792 raft_consensus.cc:2243] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:44.813758 13792 raft_consensus.cc:2272] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.815652 13792 tablet_replica.cc:333] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.816098 13792 raft_consensus.cc:2243] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.816423 13792 raft_consensus.cc:2272] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.818356 13792 tablet_replica.cc:333] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.818795 13792 raft_consensus.cc:2243] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.819113 13792 raft_consensus.cc:2272] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.821237 13792 tablet_replica.cc:333] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.821659 13792 raft_consensus.cc:2243] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.821959 13792 raft_consensus.cc:2272] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:44.823586 13792 tablet_replica.cc:333] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: stopping tablet replica
I20260709 13:09:44.823990 13792 raft_consensus.cc:2243] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:44.824275 13792 raft_consensus.cc:2272] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:44.832046 24757 consensus_peers.cc:597] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:44.844247 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:09:44.857389 24913 consensus_queue.cc:1048] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:44.922556 24949 consensus_queue.cc:1048] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:44.936661 24831 consensus_peers.cc:597] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:44.978256 24757 consensus_peers.cc:597] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:44.984966 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:45.074795 24831 consensus_peers.cc:597] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.098999 24985 consensus_queue.cc:1048] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:45.266844 24831 consensus_peers.cc:597] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:45.291072 24831 consensus_peers.cc:597] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:45.294059 24936 consensus_queue.cc:1048] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:45.986270 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:46.079531 24757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111) [suppressed 106 similar messages]
I20260709 13:09:46.121440 24937 raft_consensus.cc:493] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9548492e26e547db83f55f142682cd4c)
I20260709 13:09:46.122225 24937 raft_consensus.cc:515] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.124466 24937 leader_election.cc:290] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:46.125923 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0bc810251f5c422b842cd89e58407aed" is_pre_election: true
W20260709 13:09:46.128319 24831 leader_election.cc:336] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111)
I20260709 13:09:46.128415 24985 raft_consensus.cc:493] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9548492e26e547db83f55f142682cd4c)
I20260709 13:09:46.128780 24831 leader_election.cc:304] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c
I20260709 13:09:46.129251 24985 raft_consensus.cc:515] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.129711 24937 raft_consensus.cc:2749] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:46.131528 24985 leader_election.cc:290] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:46.133000 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:46.133606 24866 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 1.
I20260709 13:09:46.135142 24757 leader_election.cc:304] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:46.135829 24985 raft_consensus.cc:2804] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:46.135845 24757 leader_election.cc:336] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111)
I20260709 13:09:46.136178 24985 raft_consensus.cc:493] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9548492e26e547db83f55f142682cd4c)
I20260709 13:09:46.136670 24985 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.144131 24985 raft_consensus.cc:515] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.145614 24985 leader_election.cc:290] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:46.147114 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:46.147744 24866 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:46.149257 24757 leader_election.cc:336] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111)
I20260709 13:09:46.153785 24866 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:46.154721 24757 leader_election.cc:304] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 9548492e26e547db83f55f142682cd4c
I20260709 13:09:46.155319 24985 raft_consensus.cc:2804] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.156237 24985 raft_consensus.cc:697] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:46.157241 24985 consensus_queue.cc:237] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.165912 24611 catalog_manager.cc:5697] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from 9548492e26e547db83f55f142682cd4c (127.13.120.1) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.237908 24985 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.238431 24985 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.240196 24985 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:46.241716 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" is_pre_election: true
I20260709 13:09:46.242527 24866 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 1.
I20260709 13:09:46.243561 24757 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:46.244237 24985 raft_consensus.cc:2804] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:09:46.244282 24757 leader_election.cc:336] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111)
I20260709 13:09:46.244551 24985 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.244925 24985 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:46.251302 24985 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.252895 24985 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:46.254443 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:46.255029 24866 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:09:46.256316 24757 leader_election.cc:336] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111)
I20260709 13:09:46.260897 24866 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:46.261938 24757 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 9548492e26e547db83f55f142682cd4c
I20260709 13:09:46.262609 24985 raft_consensus.cc:2804] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:46.263090 24985 raft_consensus.cc:697] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:46.264098 24985 consensus_queue.cc:237] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:46.274896 24611 catalog_manager.cc:5697] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from 9548492e26e547db83f55f142682cd4c (127.13.120.1) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.695729 24866 raft_consensus.cc:1275] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:46.697185 24985 consensus_queue.cc:1048] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:46.710853 24757 consensus_peers.cc:597] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:46.763170 24866 raft_consensus.cc:1275] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:46.764452 24985 consensus_queue.cc:1048] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:46.778779 24757 consensus_peers.cc:597] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:46.987309 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:47.267251 24831 consensus_peers.cc:597] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.377240 24831 consensus_peers.cc:597] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.398466 24757 consensus_peers.cc:597] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.480911 24831 consensus_peers.cc:597] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.548491 24757 consensus_peers.cc:597] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.584834 24831 consensus_peers.cc:597] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.712879 24831 consensus_peers.cc:597] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.832557 24831 consensus_peers.cc:597] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:47.988366 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:48.989395 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:49.035241 24757 consensus_peers.cc:597] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.544210 24757 consensus_peers.cc:597] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:49.750765 24831 consensus_peers.cc:597] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.863744 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:49.870910 25004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:49.871522 25005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:49.872658 25007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:49.876477 13792 server_base.cc:1061] running on GCE node
I20260709 13:09:49.880827 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:49.881080 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:49.881285 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602589881266 us; error 0 us; skew 500 ppm
I20260709 13:09:49.881906 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:49.884606 13792 webserver.cc:533] Webserver started at http://127.13.120.1:42447/ using document root <none> and password file <none>
I20260709 13:09:49.885133 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:49.885289 13792 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:09:49.889789 13792 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 13:09:49.895120 25012 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:49.896027 13792 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:09:49.896328 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "9548492e26e547db83f55f142682cd4c"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-mcck"
I20260709 13:09:49.896816 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 13:09:49.898775 24831 consensus_peers.cc:597] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:09:49.903069 24757 consensus_peers.cc:597] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.907622 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:49.908890 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:49.910408 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:49.913904 25019 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 13:09:49.960613 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:09:49.960887 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.048s	user 0.002s	sys 0.000s
I20260709 13:09:49.961247 13792 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:09:49.966552 25019 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
W20260709 13:09:49.968307 24831 consensus_peers.cc:597] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:49.983343 25019 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:49.984185 25019 tablet_bootstrap.cc:492] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:49.984728 25019 ts_tablet_manager.cc:1403] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:09:49.986886 25019 raft_consensus.cc:359] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:49.987396 25019 raft_consensus.cc:740] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.987993 25019 consensus_queue.cc:260] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
W20260709 13:09:49.990345 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:49.990454 25019 ts_tablet_manager.cc:1434] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.005s
I20260709 13:09:49.991264 25019 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.001607 25019 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.002295 25019 tablet_bootstrap.cc:492] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.002827 25019 ts_tablet_manager.cc:1403] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:09:50.004355 13792 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:09:50.004669 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.043s	user 0.039s	sys 0.004s
I20260709 13:09:50.004988 25019 raft_consensus.cc:359] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.005604 25019 raft_consensus.cc:740] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.006247 25019 consensus_queue.cc:260] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.007848 25019 ts_tablet_manager.cc:1434] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:09:50.008496 25019 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.019819 25019 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.020509 25019 tablet_bootstrap.cc:492] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.021054 25019 ts_tablet_manager.cc:1403] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:09:50.023615 25019 raft_consensus.cc:359] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:50.024216 25019 raft_consensus.cc:740] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.024880 25019 consensus_queue.cc:260] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:50.026674 25019 ts_tablet_manager.cc:1434] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:09:50.027345 25019 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.037264 25019 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.037869 25019 tablet_bootstrap.cc:492] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.038374 25019 ts_tablet_manager.cc:1403] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:09:50.040452 25019 raft_consensus.cc:359] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.040933 25019 raft_consensus.cc:740] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.041545 25019 consensus_queue.cc:260] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.043605 25019 ts_tablet_manager.cc:1434] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.004s
I20260709 13:09:50.044394 25019 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
W20260709 13:09:50.049777 24831 consensus_peers.cc:597] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:50.056923 25019 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.057614 25019 tablet_bootstrap.cc:492] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.058224 25019 ts_tablet_manager.cc:1403] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:09:50.060946 25019 raft_consensus.cc:359] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.061666 25019 raft_consensus.cc:740] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.062901 25019 consensus_queue.cc:260] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.064544 25019 ts_tablet_manager.cc:1434] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:50.065153 25019 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.070595 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:34145
I20260709 13:09:50.070713 25081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:34145 every 8 connection(s)
I20260709 13:09:50.075951 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.076562 25019 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.077469 25019 tablet_bootstrap.cc:492] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.078130 25019 ts_tablet_manager.cc:1403] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:09:50.081461 25019 raft_consensus.cc:359] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.082373 25019 raft_consensus.cc:740] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.083539 25019 consensus_queue.cc:260] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.086568 25019 ts_tablet_manager.cc:1434] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:50.087719 25019 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.116555 25019 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.117230 25019 tablet_bootstrap.cc:492] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.117769 25019 ts_tablet_manager.cc:1403] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.016s
I20260709 13:09:50.120281 25019 raft_consensus.cc:359] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
W20260709 13:09:50.120870 24831 consensus_peers.cc:597] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 13:09:50.121016 25019 raft_consensus.cc:740] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.121829 25019 consensus_queue.cc:260] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.123785 25019 ts_tablet_manager.cc:1434] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:09:50.124572 25019 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.125558 25083 heartbeater.cc:344] Connected to a master server at 127.13.120.62:45317
I20260709 13:09:50.126058 25083 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:50.127038 25083 heartbeater.cc:507] Master 127.13.120.62:45317 requested a full tablet report, sending...
I20260709 13:09:50.127192 24866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
mode: GRACEFUL
new_leader_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:58392
I20260709 13:09:50.128027 24866 raft_consensus.cc:606] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Received request to transfer leadership to TS 0bc810251f5c422b842cd89e58407aed
I20260709 13:09:50.130877 24866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
mode: GRACEFUL
new_leader_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:58392
I20260709 13:09:50.131445 24866 raft_consensus.cc:606] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Received request to transfer leadership to TS 0bc810251f5c422b842cd89e58407aed
I20260709 13:09:50.132568 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:50.133195 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:50.133263 24611 ts_manager.cc:194] Re-registered known tserver with Master: 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145)
I20260709 13:09:50.134110 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:50.139164 25019 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:09:50.140125 25019 tablet_bootstrap.cc:492] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.140705 25019 ts_tablet_manager.cc:1403] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260709 13:09:50.141551 24611 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48950
I20260709 13:09:50.143272 25019 raft_consensus.cc:359] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.144145 25019 raft_consensus.cc:740] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.144775 25019 consensus_queue.cc:260] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.144866 25083 heartbeater.cc:499] Master 127.13.120.62:45317 was elected leader, sending a full tablet report...
I20260709 13:09:50.146365 25019 ts_tablet_manager.cc:1434] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:50.147069 25019 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.162572 25019 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.163278 25019 tablet_bootstrap.cc:492] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.163909 25019 ts_tablet_manager.cc:1403] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.003s
I20260709 13:09:50.165706 25019 raft_consensus.cc:359] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.166226 25019 raft_consensus.cc:740] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.166836 25019 consensus_queue.cc:260] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.168550 25019 ts_tablet_manager.cc:1434] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:09:50.169185 25019 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Bootstrap starting.
I20260709 13:09:50.181373 25019 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:50.182109 25019 tablet_bootstrap.cc:492] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Bootstrap complete.
I20260709 13:09:50.182627 25019 ts_tablet_manager.cc:1403] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Time spent bootstrapping tablet: real 0.014s	user 0.006s	sys 0.004s
I20260709 13:09:50.184655 25019 raft_consensus.cc:359] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.185365 25019 raft_consensus.cc:740] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9548492e26e547db83f55f142682cd4c, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.185992 25019 consensus_queue.cc:260] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.188289 25019 ts_tablet_manager.cc:1434] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:09:50.338864 25056 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.358605 25100 raft_consensus.cc:993] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: : Instructing follower 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:50.359194 24937 raft_consensus.cc:1081] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Signalling peer 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:50.360888 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:56750
I20260709 13:09:50.361477 24791 raft_consensus.cc:493] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.361855 24791 raft_consensus.cc:3060] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.368108 24791 raft_consensus.cc:515] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.369767 24791 leader_election.cc:290] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:50.370348 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:50.370807 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0191ce25d6d4de7a74fc343ad71d55a" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:50.371025 25056 raft_consensus.cc:3060] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.371464 24866 raft_consensus.cc:3055] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.371798 24866 raft_consensus.cc:740] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:50.372699 24866 consensus_queue.cc:260] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.374020 24866 raft_consensus.cc:3060] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.378079 25056 raft_consensus.cc:2468] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:50.379252 24757 leader_election.cc:304] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:50.380191 24992 raft_consensus.cc:2804] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.381474 24866 raft_consensus.cc:2468] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:50.381518 24992 raft_consensus.cc:697] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:50.383231 24992 consensus_queue.cc:237] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.391554 24611 catalog_manager.cc:5697] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.550988 25100 raft_consensus.cc:993] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: : Instructing follower 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:50.551429 24937 raft_consensus.cc:1081] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Signalling peer 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:50.552757 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:56750
I20260709 13:09:50.553143 24791 raft_consensus.cc:493] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:50.553364 24791 raft_consensus.cc:3060] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.558123 24791 raft_consensus.cc:515] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.559902 24791 leader_election.cc:290] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:50.561084 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:50.561668 25056 raft_consensus.cc:3060] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.561571 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fde03517266c473bb828ca35ba0e0a7f" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:50.562302 24866 raft_consensus.cc:3055] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:50.562562 24866 raft_consensus.cc:740] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:50.563247 24866 consensus_queue.cc:260] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.564284 24866 raft_consensus.cc:3060] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.566798 25056 raft_consensus.cc:2468] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:50.567836 24757 leader_election.cc:304] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:50.568594 24992 raft_consensus.cc:2804] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:50.568966 24992 raft_consensus.cc:697] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:50.569593 24866 raft_consensus.cc:2468] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:50.569870 24992 consensus_queue.cc:237] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:50.576691 24611 catalog_manager.cc:5697] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.640882 25056 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:50.646669 25056 pending_rounds.cc:85] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Aborting all ops after (but not including) 0
I20260709 13:09:50.647035 25056 pending_rounds.cc:107] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:50.647324 25056 raft_consensus.cc:2889] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:50.804781 24866 raft_consensus.cc:1275] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.805888 25101 consensus_queue.cc:1048] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:50.815857 25056 raft_consensus.cc:1275] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:50.817793 25111 consensus_queue.cc:1048] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:50.991468 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:51.021577 24866 raft_consensus.cc:1275] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.022866 25111 consensus_queue.cc:1048] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.033707 25056 raft_consensus.cc:1275] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.035082 25111 consensus_queue.cc:1048] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.144711 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.161917 24791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
mode: GRACEFUL
new_leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:44100
I20260709 13:09:51.162420 24791 raft_consensus.cc:606] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Received request to transfer leadership to TS ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:51.164876 24791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
mode: GRACEFUL
new_leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:44100
I20260709 13:09:51.165297 24791 raft_consensus.cc:606] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Received request to transfer leadership to TS ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:51.166172 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:51.166641 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:51.167176 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:51.377785 24992 raft_consensus.cc:993] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: : Instructing follower ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:51.378222 25111 raft_consensus.cc:1081] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Signalling peer ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:51.379582 24866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:47384
I20260709 13:09:51.380052 24866 raft_consensus.cc:493] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.380357 24866 raft_consensus.cc:3060] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.385643 24866 raft_consensus.cc:515] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:51.387669 24866 leader_election.cc:290] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:51.388423 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:51.388581 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9aca5c8382c34d00a293b1af58bc1489" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:51.389043 25056 raft_consensus.cc:3060] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.389153 24791 raft_consensus.cc:3055] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:51.389869 24791 raft_consensus.cc:740] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:51.390727 24791 consensus_queue.cc:260] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:51.391776 24791 raft_consensus.cc:3060] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:51.396828 25111 raft_consensus.cc:993] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: : Instructing follower ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:51.396633 25056 raft_consensus.cc:2468] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 2.
I20260709 13:09:51.397349 24992 raft_consensus.cc:1081] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Signalling peer ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:51.397291 24791 raft_consensus.cc:2468] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 2.
I20260709 13:09:51.398099 24831 leader_election.cc:304] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:51.398944 25100 raft_consensus.cc:2804] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:51.399442 25100 raft_consensus.cc:697] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:51.399860 24866 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:47384
I20260709 13:09:51.400444 24866 raft_consensus.cc:493] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:51.400928 24866 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.400444 25100 consensus_queue.cc:237] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:51.406451 24866 raft_consensus.cc:515] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:51.408344 24866 leader_election.cc:290] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 3 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:51.408608 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:51.408883 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "563a75b0e29c4af0a44036988b90108d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:51.409346 25056 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.409425 24791 raft_consensus.cc:3055] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:51.408577 24611 catalog_manager.cc:5697] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 1 to 2, leader changed from 0bc810251f5c422b842cd89e58407aed (127.13.120.2) to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 2 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.409865 24791 raft_consensus.cc:740] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:51.410598 24791 consensus_queue.cc:260] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:51.411725 24791 raft_consensus.cc:3060] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:51.418210 25056 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 3.
I20260709 13:09:51.420866 24791 raft_consensus.cc:2468] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 3.
I20260709 13:09:51.422261 24829 leader_election.cc:304] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:51.423653 25100 raft_consensus.cc:2804] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:51.424235 25100 raft_consensus.cc:697] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:51.425434 25100 consensus_queue.cc:237] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:51.437757 24611 catalog_manager.cc:5697] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 2 to 3, leader changed from 0bc810251f5c422b842cd89e58407aed (127.13.120.2) to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 3 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:51.948920 24791 raft_consensus.cc:1275] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.950186 25112 consensus_queue.cc:1048] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.960889 25056 raft_consensus.cc:1275] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:51.963284 25128 consensus_queue.cc:1048] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:51.964151 24791 raft_consensus.cc:1275] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:51.966001 25128 consensus_queue.cc:1048] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:51.978463 25055 raft_consensus.cc:1275] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:51.981667 25100 consensus_queue.cc:1048] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:51.992503 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:52.173516 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.180820 24866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
mode: GRACEFUL
new_leader_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:58392
I20260709 13:09:52.181360 24866 raft_consensus.cc:606] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Received request to transfer leadership to TS 0bc810251f5c422b842cd89e58407aed
I20260709 13:09:52.183691 24866 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
mode: GRACEFUL
new_leader_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:58392
I20260709 13:09:52.184110 24866 raft_consensus.cc:606] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Received request to transfer leadership to TS 0bc810251f5c422b842cd89e58407aed
I20260709 13:09:52.185132 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:52.185597 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:52.186121 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:52.293982 25112 raft_consensus.cc:993] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: : Instructing follower 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:52.294493 25100 raft_consensus.cc:1081] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Signalling peer 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:52.295903 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:56750
I20260709 13:09:52.296352 24791 raft_consensus.cc:493] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.296635 24791 raft_consensus.cc:3060] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.301476 24791 raft_consensus.cc:515] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:52.303082 24791 leader_election.cc:290] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:52.303844 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:52.304457 25056 raft_consensus.cc:3060] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.304546 24865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1330664d52bd4fb79a44fbc4640dec1b" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:52.305239 24865 raft_consensus.cc:3055] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.305558 24865 raft_consensus.cc:740] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:52.306442 24865 consensus_queue.cc:260] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:52.307717 24865 raft_consensus.cc:3060] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.310711 25056 raft_consensus.cc:2468] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:52.311754 24757 leader_election.cc:304] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:52.312477 25111 raft_consensus.cc:2804] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.313340 25111 raft_consensus.cc:697] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:52.314175 24865 raft_consensus.cc:2468] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:52.314298 25111 consensus_queue.cc:237] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:52.320848 24613 catalog_manager.cc:5697] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.438687 25100 raft_consensus.cc:993] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: : Instructing follower 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:52.439153 25112 raft_consensus.cc:1081] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Signalling peer 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:52.440824 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:56750
I20260709 13:09:52.441354 24791 raft_consensus.cc:493] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:52.441788 24791 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.446481 24791 raft_consensus.cc:515] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:52.447954 24791 leader_election.cc:290] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:52.448820 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:52.448975 24865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:52.449354 25056 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.449549 24865 raft_consensus.cc:3055] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:52.449919 24865 raft_consensus.cc:740] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:52.450654 24865 consensus_queue.cc:260] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:52.451742 24865 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:52.454643 25056 raft_consensus.cc:2468] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:52.455790 24757 leader_election.cc:304] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:52.456439 25111 raft_consensus.cc:2804] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:52.456941 25111 raft_consensus.cc:697] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:52.456955 24865 raft_consensus.cc:2468] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:52.457985 25111 consensus_queue.cc:237] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:52.464781 24613 catalog_manager.cc:5697] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.851537 25056 raft_consensus.cc:1275] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.852790 25111 consensus_queue.cc:1048] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.864236 24865 raft_consensus.cc:1275] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.870796 25111 consensus_queue.cc:1048] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.885902 25056 raft_consensus.cc:1275] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.887147 25134 consensus_queue.cc:1048] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:52.896633 24865 raft_consensus.cc:1275] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:52.898043 25134 consensus_queue.cc:1048] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:52.993485 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:53.192178 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.199501 24791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
mode: GRACEFUL
new_leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:44100
I20260709 13:09:53.200052 24791 raft_consensus.cc:606] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Received request to transfer leadership to TS ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:53.202445 24791 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
mode: GRACEFUL
new_leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:44100
I20260709 13:09:53.202900 24791 raft_consensus.cc:606] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Received request to transfer leadership to TS ea1ffc9b1cd64d48a3723a6c4745d39d
I20260709 13:09:53.203876 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:53.204370 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:53.204902 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:53.443271 25134 raft_consensus.cc:993] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: : Instructing follower ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:53.443866 25151 raft_consensus.cc:1081] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Signalling peer ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:53.445250 24865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:47384
I20260709 13:09:53.445757 24865 raft_consensus.cc:493] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.446682 24865 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.452378 24865 raft_consensus.cc:515] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:53.454038 24865 leader_election.cc:290] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 3 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:53.454787 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:53.455018 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e53b3a4712aa4239a2493bbded533a6d" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:53.455384 25056 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.455629 24791 raft_consensus.cc:3055] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.455955 24791 raft_consensus.cc:740] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:53.456589 24791 consensus_queue.cc:260] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:53.457419 24791 raft_consensus.cc:3060] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.460480 25056 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 3.
I20260709 13:09:53.461498 24831 leader_election.cc:304] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:53.462210 25152 raft_consensus.cc:2804] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.462484 24791 raft_consensus.cc:2468] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 3.
I20260709 13:09:53.462628 25152 raft_consensus.cc:697] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:53.463599 25152 consensus_queue.cc:237] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:53.469995 24611 catalog_manager.cc:5697] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 2 to 3, leader changed from 0bc810251f5c422b842cd89e58407aed (127.13.120.2) to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 3 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.485149 25134 raft_consensus.cc:993] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: : Instructing follower ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:53.485736 25158 raft_consensus.cc:1081] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Signalling peer ea1ffc9b1cd64d48a3723a6c4745d39d to start an election
I20260709 13:09:53.487244 24865 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
 from {username='slave'} at 127.0.0.1:47384
I20260709 13:09:53.487730 24865 raft_consensus.cc:493] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:53.488021 24865 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.493290 24865 raft_consensus.cc:515] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:53.495244 24865 leader_election.cc:290] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 3 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001)
I20260709 13:09:53.495919 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:53.496443 25056 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.496502 24791 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fae5b421a8374818bff1084f30eff82b" candidate_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bc810251f5c422b842cd89e58407aed"
I20260709 13:09:53.497071 24791 raft_consensus.cc:3055] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:53.497327 24791 raft_consensus.cc:740] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:53.498015 24791 consensus_queue.cc:260] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:53.499169 24791 raft_consensus.cc:3060] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:53.502862 25056 raft_consensus.cc:2468] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 3.
I20260709 13:09:53.503949 24831 leader_election.cc:304] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9548492e26e547db83f55f142682cd4c, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:53.504774 25152 raft_consensus.cc:2804] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:53.505255 24791 raft_consensus.cc:2468] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea1ffc9b1cd64d48a3723a6c4745d39d in term 3.
I20260709 13:09:53.505559 25152 raft_consensus.cc:697] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 LEADER]: Becoming Leader. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:53.506783 25152 consensus_queue.cc:237] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:53.513383 24611 catalog_manager.cc:5697] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d reported cstate change: term changed from 2 to 3, leader changed from 0bc810251f5c422b842cd89e58407aed (127.13.120.2) to ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3). New cstate: current_term: 3 leader_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:53.900291 25056 raft_consensus.cc:1275] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.901463 25152 consensus_queue.cc:1048] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.908437 24791 raft_consensus.cc:1275] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.910315 25112 consensus_queue.cc:1048] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.913411 24791 raft_consensus.cc:1275] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.915293 25163 consensus_queue.cc:1048] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:53.926700 25055 raft_consensus.cc:1275] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Refusing update from remote peer ea1ffc9b1cd64d48a3723a6c4745d39d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:53.931578 25152 consensus_queue.cc:1048] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:09:53.994365 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:54.210959 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:54.218065 24865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
mode: GRACEFUL
new_leader_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:58392
I20260709 13:09:54.218535 24865 raft_consensus.cc:606] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Received request to transfer leadership to TS 0bc810251f5c422b842cd89e58407aed
I20260709 13:09:54.220846 24865 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434"
dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
mode: GRACEFUL
new_leader_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:58392
I20260709 13:09:54.221242 24865 raft_consensus.cc:606] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Received request to transfer leadership to TS 0bc810251f5c422b842cd89e58407aed
I20260709 13:09:54.222183 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:54.222636 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:54.223166 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:54.296710 25112 raft_consensus.cc:993] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: : Instructing follower 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:54.297287 25152 raft_consensus.cc:1081] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Signalling peer 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:54.299078 24792 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:56750
I20260709 13:09:54.299695 24792 raft_consensus.cc:493] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:54.300047 24792 raft_consensus.cc:3060] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.300074 25162 raft_consensus.cc:993] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: : Instructing follower 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:54.300652 25152 raft_consensus.cc:1081] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Signalling peer 0bc810251f5c422b842cd89e58407aed to start an election
I20260709 13:09:54.302129 24791 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c"
dest_uuid: "0bc810251f5c422b842cd89e58407aed"
 from {username='slave'} at 127.0.0.1:56750
I20260709 13:09:54.302767 24791 raft_consensus.cc:493] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:54.303148 24791 raft_consensus.cc:3060] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.308308 24792 raft_consensus.cc:515] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:54.309834 24791 raft_consensus.cc:515] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:54.310628 24792 leader_election.cc:290] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:54.311286 25055 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:54.312005 24791 leader_election.cc:290] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Requested vote from peers 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145), ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3:38027)
I20260709 13:09:54.312316 25055 raft_consensus.cc:3060] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.312764 25056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9548492e26e547db83f55f142682cd4c"
I20260709 13:09:54.313035 24866 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9cf532d5294ffbad5ee03717735b2c" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:54.313354 25056 raft_consensus.cc:3060] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.311672 24865 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e703030e3d724d5c8ad78035468d2434" candidate_uuid: "0bc810251f5c422b842cd89e58407aed" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d"
I20260709 13:09:54.313575 24866 raft_consensus.cc:3055] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.313906 24866 raft_consensus.cc:740] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:54.313906 24865 raft_consensus.cc:3055] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:54.314438 24865 raft_consensus.cc:740] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ea1ffc9b1cd64d48a3723a6c4745d39d, State: Running, Role: LEADER
I20260709 13:09:54.314780 24866 consensus_queue.cc:260] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:54.315953 24866 raft_consensus.cc:3060] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.315320 24865 consensus_queue.cc:260] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:54.317029 24865 raft_consensus.cc:3060] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:54.320358 25055 raft_consensus.cc:2468] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:54.321851 24757 leader_election.cc:304] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, 9548492e26e547db83f55f142682cd4c; no voters: 
I20260709 13:09:54.322544 24866 raft_consensus.cc:2468] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:54.322676 25151 raft_consensus.cc:2804] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:54.322726 25056 raft_consensus.cc:2468] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:54.323427 25151 raft_consensus.cc:697] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:54.324390 25151 consensus_queue.cc:237] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } }
I20260709 13:09:54.325177 24757 leader_election.cc:304] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bc810251f5c422b842cd89e58407aed, ea1ffc9b1cd64d48a3723a6c4745d39d; no voters: 
I20260709 13:09:54.326071 25158 raft_consensus.cc:2804] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:54.326749 24865 raft_consensus.cc:2468] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bc810251f5c422b842cd89e58407aed in term 2.
I20260709 13:09:54.327275 25158 raft_consensus.cc:697] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Becoming Leader. State: Replica: 0bc810251f5c422b842cd89e58407aed, State: Running, Role: LEADER
I20260709 13:09:54.328387 25158 consensus_queue.cc:237] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } }
I20260709 13:09:54.333108 24611 catalog_manager.cc:5697] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:54.346997 24611 catalog_manager.cc:5697] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed reported cstate change: term changed from 1 to 2, leader changed from ea1ffc9b1cd64d48a3723a6c4745d39d (127.13.120.3) to 0bc810251f5c422b842cd89e58407aed (127.13.120.2). New cstate: current_term: 2 leader_uuid: "0bc810251f5c422b842cd89e58407aed" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0bc810251f5c422b842cd89e58407aed" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:54.801357 25055 raft_consensus.cc:1275] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.802645 25158 consensus_queue.cc:1048] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:54.812713 24865 raft_consensus.cc:1275] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.814102 25151 consensus_queue.cc:1048] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:54.882688 25055 raft_consensus.cc:1275] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.883745 25151 consensus_queue.cc:1048] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "9548492e26e547db83f55f142682cd4c" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34145 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:54.892995 24865 raft_consensus.cc:1275] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Refusing update from remote peer 0bc810251f5c422b842cd89e58407aed: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:54.894253 25151 consensus_queue.cc:1048] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea1ffc9b1cd64d48a3723a6c4745d39d" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 38027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:54.995371 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:55.229005 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:55.870023 13792 tablet_server.cc:179] TabletServer@127.13.120.1:34145 shutting down...
W20260709 13:09:55.924008 24831 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 84 similar messages]
W20260709 13:09:55.933490 24831 consensus_peers.cc:597] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.934710 24831 consensus_peers.cc:597] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.935714 24831 consensus_peers.cc:597] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:55.936641 24831 consensus_peers.cc:597] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.968519 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:55.969379 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.970160 13792 raft_consensus.cc:2243] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.970829 13792 raft_consensus.cc:2272] T e53b3a4712aa4239a2493bbded533a6d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.973642 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.974293 13792 raft_consensus.cc:2243] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.974865 13792 raft_consensus.cc:2272] T 563a75b0e29c4af0a44036988b90108d P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.977638 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.978223 13792 raft_consensus.cc:2243] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.978742 13792 raft_consensus.cc:2272] T fde03517266c473bb828ca35ba0e0a7f P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.981257 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.981827 13792 raft_consensus.cc:2243] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.982329 13792 raft_consensus.cc:2272] T d770bb7cc70744e6bf25aeb29fe408ab P 9548492e26e547db83f55f142682cd4c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.984779 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.985380 13792 raft_consensus.cc:2243] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.985944 13792 raft_consensus.cc:2272] T 9aca5c8382c34d00a293b1af58bc1489 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.988569 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.989084 13792 raft_consensus.cc:2243] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.989589 13792 raft_consensus.cc:2272] T 0f9cf532d5294ffbad5ee03717735b2c P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.991840 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.992398 13792 raft_consensus.cc:2243] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.992947 13792 raft_consensus.cc:2272] T b0191ce25d6d4de7a74fc343ad71d55a P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:55.995626 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:55.996192 13792 raft_consensus.cc:2243] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:55.996853 13792 raft_consensus.cc:2272] T 1330664d52bd4fb79a44fbc4640dec1b P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:55.996891 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:09:55.999496 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.000202 13792 raft_consensus.cc:2243] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.000697 13792 raft_consensus.cc:2272] T e703030e3d724d5c8ad78035468d2434 P 9548492e26e547db83f55f142682cd4c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:56.003252 13792 tablet_replica.cc:333] stopping tablet replica
I20260709 13:09:56.003978 13792 raft_consensus.cc:2243] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:56.004607 13792 raft_consensus.cc:2272] T fae5b421a8374818bff1084f30eff82b P 9548492e26e547db83f55f142682cd4c [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:56.217131 24757 consensus_peers.cc:597] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.255200 24757 consensus_peers.cc:597] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.281594 24757 consensus_peers.cc:597] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.363781 24757 consensus_peers.cc:597] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.437043 24757 consensus_peers.cc:597] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.447584 24757 consensus_peers.cc:597] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:56.916702 25078 debug-util.cc:398] Leaking SignalData structure 0x7b08000d05e0 after lost signal to thread 13795
W20260709 13:09:56.917791 25078 debug-util.cc:398] Leaking SignalData structure 0x7b08001762e0 after lost signal to thread 24649
W20260709 13:09:56.918897 25078 debug-util.cc:398] Leaking SignalData structure 0x7b080008a1a0 after lost signal to thread 24816
W20260709 13:09:56.919895 25078 debug-util.cc:398] Leaking SignalData structure 0x7b080020c500 after lost signal to thread 24890
W20260709 13:09:56.998018 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:57.037906 13792 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 25078)
W20260709 13:09:57.999198 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:58.038403 13792 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 25078)
W20260709 13:09:58.254698 24831 consensus_peers.cc:597] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.453008 24831 consensus_peers.cc:597] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.505791 24831 consensus_peers.cc:597] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.527154 24757 consensus_peers.cc:597] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.544275 24831 consensus_peers.cc:597] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.634712 24757 consensus_peers.cc:597] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.695967 24757 consensus_peers.cc:597] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:58.909313 24757 consensus_peers.cc:597] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:59.000221 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:09:59.039084 13792 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 25078)
W20260709 13:09:59.064895 24757 consensus_peers.cc:597] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:09:59.096984 24757 consensus_peers.cc:597] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed -> Peer 9548492e26e547db83f55f142682cd4c (127.13.120.1:34145): Couldn't send request to peer 9548492e26e547db83f55f142682cd4c. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34145: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:09:59.764433 13792 tablet_server.cc:196] TabletServer@127.13.120.1:34145 shutdown complete.
I20260709 13:09:59.793874 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
I20260709 13:09:59.815688 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:59.816457 13792 tablet_replica.cc:333] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.817313 13792 raft_consensus.cc:2243] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.817835 13792 raft_consensus.cc:2272] T 563a75b0e29c4af0a44036988b90108d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.820279 13792 tablet_replica.cc:333] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.820812 13792 raft_consensus.cc:2243] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.821619 13792 raft_consensus.cc:2272] T fde03517266c473bb828ca35ba0e0a7f P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.823966 13792 tablet_replica.cc:333] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.824534 13792 raft_consensus.cc:2243] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.825122 13792 raft_consensus.cc:2272] T e53b3a4712aa4239a2493bbded533a6d P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.828269 13792 tablet_replica.cc:333] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.828847 13792 raft_consensus.cc:2243] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.829329 13792 raft_consensus.cc:2272] T fae5b421a8374818bff1084f30eff82b P 0bc810251f5c422b842cd89e58407aed [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.831652 13792 tablet_replica.cc:333] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.832161 13792 raft_consensus.cc:2243] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.833005 13792 raft_consensus.cc:2272] T e703030e3d724d5c8ad78035468d2434 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.835228 13792 tablet_replica.cc:333] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.835783 13792 raft_consensus.cc:2243] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.836599 13792 raft_consensus.cc:2272] T 0f9cf532d5294ffbad5ee03717735b2c P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.838893 13792 tablet_replica.cc:333] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.839401 13792 raft_consensus.cc:2243] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.840209 13792 raft_consensus.cc:2272] T d770bb7cc70744e6bf25aeb29fe408ab P 0bc810251f5c422b842cd89e58407aed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.842741 13792 tablet_replica.cc:333] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.843492 13792 raft_consensus.cc:2243] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.844085 13792 raft_consensus.cc:2272] T 9aca5c8382c34d00a293b1af58bc1489 P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.846601 13792 tablet_replica.cc:333] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.847041 13792 raft_consensus.cc:2243] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.847805 13792 raft_consensus.cc:2272] T 1330664d52bd4fb79a44fbc4640dec1b P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.849704 13792 tablet_replica.cc:333] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed: stopping tablet replica
I20260709 13:09:59.850126 13792 raft_consensus.cc:2243] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.850852 13792 raft_consensus.cc:2272] T b0191ce25d6d4de7a74fc343ad71d55a P 0bc810251f5c422b842cd89e58407aed [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.883285 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
W20260709 13:09:59.900723 24829 consensus_peers.cc:597] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d -> Peer 0bc810251f5c422b842cd89e58407aed (127.13.120.2:42001): Couldn't send request to peer 0bc810251f5c422b842cd89e58407aed. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:42001: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.912521 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
I20260709 13:09:59.946444 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:59.947327 13792 tablet_replica.cc:333] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.948297 13792 raft_consensus.cc:2243] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.949007 13792 raft_consensus.cc:2272] T b0191ce25d6d4de7a74fc343ad71d55a P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.952052 13792 tablet_replica.cc:333] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.952677 13792 raft_consensus.cc:2243] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.953274 13792 raft_consensus.cc:2272] T 1330664d52bd4fb79a44fbc4640dec1b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.955700 13792 tablet_replica.cc:333] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.956211 13792 raft_consensus.cc:2243] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.957026 13792 raft_consensus.cc:2272] T 9aca5c8382c34d00a293b1af58bc1489 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.959095 13792 tablet_replica.cc:333] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.959648 13792 raft_consensus.cc:2243] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.960065 13792 raft_consensus.cc:2272] T d770bb7cc70744e6bf25aeb29fe408ab P ea1ffc9b1cd64d48a3723a6c4745d39d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.962182 13792 tablet_replica.cc:333] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.962739 13792 raft_consensus.cc:2243] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.963195 13792 raft_consensus.cc:2272] T e703030e3d724d5c8ad78035468d2434 P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.965240 13792 tablet_replica.cc:333] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.965777 13792 raft_consensus.cc:2243] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.966554 13792 raft_consensus.cc:2272] T fae5b421a8374818bff1084f30eff82b P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.968940 13792 tablet_replica.cc:333] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.969477 13792 raft_consensus.cc:2243] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.970024 13792 raft_consensus.cc:2272] T fde03517266c473bb828ca35ba0e0a7f P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.972074 13792 tablet_replica.cc:333] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.972568 13792 raft_consensus.cc:2243] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.973373 13792 raft_consensus.cc:2272] T e53b3a4712aa4239a2493bbded533a6d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.975449 13792 tablet_replica.cc:333] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.975986 13792 raft_consensus.cc:2243] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:59.977236 13792 raft_consensus.cc:2272] T 563a75b0e29c4af0a44036988b90108d P ea1ffc9b1cd64d48a3723a6c4745d39d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:59.979159 13792 tablet_replica.cc:333] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d: stopping tablet replica
I20260709 13:09:59.979743 13792 raft_consensus.cc:2243] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:59.980170 13792 raft_consensus.cc:2272] T 0f9cf532d5294ffbad5ee03717735b2c P ea1ffc9b1cd64d48a3723a6c4745d39d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:00.001339 24663 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:10:00.014573 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
I20260709 13:10:00.039351 13792 master.cc:562] Master@127.13.120.62:45317 shutting down...
I20260709 13:10:00.064178 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:00.064872 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:00.065207 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P abf3d5979824404391b4fb35a45a2800: stopping tablet replica
I20260709 13:10:00.086232 13792 master.cc:584] Master@127.13.120.62:45317 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (17282 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:10:00.131974 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:46011
I20260709 13:10:00.133086 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.138386 25203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.138453 25204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.141171 13792 server_base.cc:1061] running on GCE node
W20260709 13:10:00.141237 25206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.142335 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.142514 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.142688 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602600142673 us; error 0 us; skew 500 ppm
I20260709 13:10:00.143250 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.145833 13792 webserver.cc:533] Webserver started at http://127.13.120.62:46459/ using document root <none> and password file <none>
I20260709 13:10:00.146360 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.146548 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.146837 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.148032 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "4c9baf522600453db219def7f9a88a58"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.152565 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:10:00.156005 25211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.156788 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:00.157073 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "4c9baf522600453db219def7f9a88a58"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.157371 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.185531 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.186764 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.224678 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:46011
I20260709 13:10:00.224795 25262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:46011 every 8 connection(s)
I20260709 13:10:00.228647 25263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.240454 25263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58: Bootstrap starting.
I20260709 13:10:00.245277 25263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.249287 25263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58: No bootstrap required, opened a new log
I20260709 13:10:00.251385 25263 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c9baf522600453db219def7f9a88a58" member_type: VOTER }
I20260709 13:10:00.251830 25263 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.252009 25263 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c9baf522600453db219def7f9a88a58, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.252576 25263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c9baf522600453db219def7f9a88a58" member_type: VOTER }
I20260709 13:10:00.253010 25263 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:00.253197 25263 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:00.253412 25263 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.258229 25263 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c9baf522600453db219def7f9a88a58" member_type: VOTER }
I20260709 13:10:00.258772 25263 leader_election.cc:304] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4c9baf522600453db219def7f9a88a58; no voters: 
I20260709 13:10:00.259892 25263 leader_election.cc:290] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:00.260288 25266 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.261615 25266 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 1 LEADER]: Becoming Leader. State: Replica: 4c9baf522600453db219def7f9a88a58, State: Running, Role: LEADER
I20260709 13:10:00.262305 25266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c9baf522600453db219def7f9a88a58" member_type: VOTER }
I20260709 13:10:00.262812 25263 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:00.267189 25267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4c9baf522600453db219def7f9a88a58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c9baf522600453db219def7f9a88a58" member_type: VOTER } }
I20260709 13:10:00.267719 25268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c9baf522600453db219def7f9a88a58. Latest consensus state: current_term: 1 leader_uuid: "4c9baf522600453db219def7f9a88a58" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4c9baf522600453db219def7f9a88a58" member_type: VOTER } }
I20260709 13:10:00.268162 25267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:00.268818 25268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:00.275395 25273 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:00.280314 25273 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:00.281271 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:00.288947 25273 catalog_manager.cc:1383] Generated new cluster ID: 2556f1d81c9d46f3857e801767326072
I20260709 13:10:00.289218 25273 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:00.301434 25273 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:00.302704 25273 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:00.322387 25273 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58: Generated new TSK 0
I20260709 13:10:00.322984 25273 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:00.348133 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.353904 25284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.355388 25285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.356626 25287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.357573 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:00.359299 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.359575 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.359781 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602600359761 us; error 0 us; skew 500 ppm
I20260709 13:10:00.360327 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.362527 13792 webserver.cc:533] Webserver started at http://127.13.120.1:45763/ using document root <none> and password file <none>
I20260709 13:10:00.363026 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.363226 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.363561 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.364882 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "762d1a2d69654d8fa2d98eb3ecd78e37"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.369303 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:00.372479 25292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.373188 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:00.373474 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "762d1a2d69654d8fa2d98eb3ecd78e37"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.373744 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.404111 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.405269 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.406664 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:00.408898 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:00.409096 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.409373 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:00.409543 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.448835 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:36795
I20260709 13:10:00.448942 25354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:36795 every 8 connection(s)
I20260709 13:10:00.454002 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.460978 25359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.461513 25360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.465193 25362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.466017 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:00.467463 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.467729 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.467947 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602600467909 us; error 0 us; skew 500 ppm
I20260709 13:10:00.468580 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.470312 25355 heartbeater.cc:344] Connected to a master server at 127.13.120.62:46011
I20260709 13:10:00.470660 25355 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:00.471364 25355 heartbeater.cc:507] Master 127.13.120.62:46011 requested a full tablet report, sending...
I20260709 13:10:00.471465 13792 webserver.cc:533] Webserver started at http://127.13.120.2:44407/ using document root <none> and password file <none>
I20260709 13:10:00.472129 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.472330 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.472623 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.473515 25228 ts_manager.cc:194] Registered new tserver with Master: 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1:36795)
I20260709 13:10:00.473881 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.475787 25228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56734
I20260709 13:10:00.479071 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:10:00.482475 25367 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.483192 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:00.483525 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.483805 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.498539 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.499751 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.501204 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:00.503325 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:00.503564 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.503803 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:00.503975 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.542371 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:36363
I20260709 13:10:00.542496 25429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:36363 every 8 connection(s)
I20260709 13:10:00.547504 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:00.554858 25433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:00.556114 25434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.558125 25430 heartbeater.cc:344] Connected to a master server at 127.13.120.62:46011
I20260709 13:10:00.558743 25430 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:00.559919 25430 heartbeater.cc:507] Master 127.13.120.62:46011 requested a full tablet report, sending...
I20260709 13:10:00.562711 25228 ts_manager.cc:194] Registered new tserver with Master: 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363)
I20260709 13:10:00.562861 13792 server_base.cc:1061] running on GCE node
W20260709 13:10:00.563875 25436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:00.564668 25228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56742
I20260709 13:10:00.565058 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:00.565353 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:00.565590 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602600565570 us; error 0 us; skew 500 ppm
I20260709 13:10:00.566262 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:00.568624 13792 webserver.cc:533] Webserver started at http://127.13.120.3:46387/ using document root <none> and password file <none>
I20260709 13:10:00.569226 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:00.569444 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:00.569715 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:00.570996 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "475a04fdb4a44bb3addb5914a70674a6"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.575588 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:10:00.579319 25441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.580363 13792 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:10:00.580662 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "475a04fdb4a44bb3addb5914a70674a6"
format_stamp: "Formatted at 2026-07-09 13:10:00 on dist-test-slave-mcck"
I20260709 13:10:00.580945 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:00.606256 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:00.607478 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:00.608906 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:00.611095 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:00.611313 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.611608 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:00.611790 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:00.652451 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:40449
I20260709 13:10:00.652571 25503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:40449 every 8 connection(s)
I20260709 13:10:00.665832 25504 heartbeater.cc:344] Connected to a master server at 127.13.120.62:46011
I20260709 13:10:00.666224 25504 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:00.666879 25504 heartbeater.cc:507] Master 127.13.120.62:46011 requested a full tablet report, sending...
I20260709 13:10:00.668682 25228 ts_manager.cc:194] Registered new tserver with Master: 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:00.669046 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013293175s
I20260709 13:10:00.670121 25228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56756
I20260709 13:10:00.694581 25228 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56758:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:00.696751 25228 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:00.741591 25395 tablet_service.cc:1511] Processing CreateTablet for tablet 05a6a6e60680479981d47c3ac7f0cc7e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6791c744c0b445ba9f5f3f55764c6eac]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:00.741806 25394 tablet_service.cc:1511] Processing CreateTablet for tablet 4f060965884345b398bd67861e2c5f8e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6791c744c0b445ba9f5f3f55764c6eac]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:00.742264 25320 tablet_service.cc:1511] Processing CreateTablet for tablet 05a6a6e60680479981d47c3ac7f0cc7e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6791c744c0b445ba9f5f3f55764c6eac]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:00.743111 25395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a6a6e60680479981d47c3ac7f0cc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.743602 25320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a6a6e60680479981d47c3ac7f0cc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.744628 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f060965884345b398bd67861e2c5f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.748602 25319 tablet_service.cc:1511] Processing CreateTablet for tablet 4f060965884345b398bd67861e2c5f8e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6791c744c0b445ba9f5f3f55764c6eac]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:00.749892 25319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f060965884345b398bd67861e2c5f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.751183 25469 tablet_service.cc:1511] Processing CreateTablet for tablet 05a6a6e60680479981d47c3ac7f0cc7e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6791c744c0b445ba9f5f3f55764c6eac]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:00.752524 25469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05a6a6e60680479981d47c3ac7f0cc7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.761250 25468 tablet_service.cc:1511] Processing CreateTablet for tablet 4f060965884345b398bd67861e2c5f8e (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=6791c744c0b445ba9f5f3f55764c6eac]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:00.762569 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f060965884345b398bd67861e2c5f8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.776230 25520 tablet_bootstrap.cc:492] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a: Bootstrap starting.
I20260709 13:10:00.795432 25519 tablet_bootstrap.cc:492] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37: Bootstrap starting.
I20260709 13:10:00.799062 25521 tablet_bootstrap.cc:492] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6: Bootstrap starting.
I20260709 13:10:00.802332 25519 tablet_bootstrap.cc:654] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.805261 25520 tablet_bootstrap.cc:654] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.807699 25519 tablet_bootstrap.cc:492] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37: No bootstrap required, opened a new log
I20260709 13:10:00.808149 25519 ts_tablet_manager.cc:1403] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent bootstrapping tablet: real 0.017s	user 0.003s	sys 0.008s
I20260709 13:10:00.808229 25521 tablet_bootstrap.cc:654] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.810482 25519 raft_consensus.cc:359] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.811048 25519 raft_consensus.cc:385] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.811357 25519 raft_consensus.cc:740] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.812104 25519 consensus_queue.cc:260] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.814435 25521 tablet_bootstrap.cc:492] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6: No bootstrap required, opened a new log
I20260709 13:10:00.814890 25521 ts_tablet_manager.cc:1403] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 13:10:00.815485 25520 tablet_bootstrap.cc:492] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a: No bootstrap required, opened a new log
I20260709 13:10:00.816121 25520 ts_tablet_manager.cc:1403] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent bootstrapping tablet: real 0.042s	user 0.007s	sys 0.011s
I20260709 13:10:00.817463 25521 raft_consensus.cc:359] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.818034 25521 raft_consensus.cc:385] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.818284 25521 raft_consensus.cc:740] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475a04fdb4a44bb3addb5914a70674a6, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.818987 25521 consensus_queue.cc:260] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.819878 25520 raft_consensus.cc:359] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.820637 25520 raft_consensus.cc:385] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.820946 25520 raft_consensus.cc:740] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c80ee42afcc4461a2448f0ab4bfda6a, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.821375 25504 heartbeater.cc:499] Master 127.13.120.62:46011 was elected leader, sending a full tablet report...
I20260709 13:10:00.821862 25521 ts_tablet_manager.cc:1434] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 13:10:00.821751 25520 consensus_queue.cc:260] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.822768 25521 tablet_bootstrap.cc:492] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: Bootstrap starting.
I20260709 13:10:00.824676 25520 ts_tablet_manager.cc:1434] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:00.825868 25520 tablet_bootstrap.cc:492] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a: Bootstrap starting.
I20260709 13:10:00.827447 25430 heartbeater.cc:499] Master 127.13.120.62:46011 was elected leader, sending a full tablet report...
I20260709 13:10:00.829151 25521 tablet_bootstrap.cc:654] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.832500 25520 tablet_bootstrap.cc:654] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.832912 25519 ts_tablet_manager.cc:1434] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.007s
I20260709 13:10:00.833909 25355 heartbeater.cc:499] Master 127.13.120.62:46011 was elected leader, sending a full tablet report...
I20260709 13:10:00.837376 25519 tablet_bootstrap.cc:492] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: Bootstrap starting.
I20260709 13:10:00.839443 25525 raft_consensus.cc:493] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:00.839970 25525 raft_consensus.cc:515] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.844460 25525 leader_election.cc:290] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:00.846505 25519 tablet_bootstrap.cc:654] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:00.850080 25521 tablet_bootstrap.cc:492] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: No bootstrap required, opened a new log
I20260709 13:10:00.850718 25521 ts_tablet_manager.cc:1403] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.004s
I20260709 13:10:00.854615 25521 raft_consensus.cc:359] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.859773 25521 raft_consensus.cc:385] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.860152 25521 raft_consensus.cc:740] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475a04fdb4a44bb3addb5914a70674a6, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.861267 25521 consensus_queue.cc:260] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.864521 25521 ts_tablet_manager.cc:1434] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.009s
I20260709 13:10:00.889319 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a6a6e60680479981d47c3ac7f0cc7e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" is_pre_election: true
W20260709 13:10:00.890938 25293 leader_election.cc:343] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:00.895109 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a6a6e60680479981d47c3ac7f0cc7e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6" is_pre_election: true
I20260709 13:10:00.895750 25479 raft_consensus.cc:2468] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:00.896862 25293 leader_election.cc:304] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 475a04fdb4a44bb3addb5914a70674a6, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 4c80ee42afcc4461a2448f0ab4bfda6a
I20260709 13:10:00.897989 25525 raft_consensus.cc:2804] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:00.898311 25525 raft_consensus.cc:493] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:00.898607 25525 raft_consensus.cc:3060] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.898784 25520 tablet_bootstrap.cc:492] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a: No bootstrap required, opened a new log
I20260709 13:10:00.898809 25519 tablet_bootstrap.cc:492] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: No bootstrap required, opened a new log
I20260709 13:10:00.899461 25520 ts_tablet_manager.cc:1403] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent bootstrapping tablet: real 0.074s	user 0.027s	sys 0.035s
I20260709 13:10:00.899580 25519 ts_tablet_manager.cc:1403] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent bootstrapping tablet: real 0.063s	user 0.030s	sys 0.024s
I20260709 13:10:00.902200 25520 raft_consensus.cc:359] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.902870 25520 raft_consensus.cc:385] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.902784 25519 raft_consensus.cc:359] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.903251 25520 raft_consensus.cc:740] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c80ee42afcc4461a2448f0ab4bfda6a, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.903640 25519 raft_consensus.cc:385] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:00.904011 25519 raft_consensus.cc:740] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Initialized, Role: FOLLOWER
I20260709 13:10:00.904162 25520 consensus_queue.cc:260] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.904815 25519 consensus_queue.cc:260] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.906369 25520 ts_tablet_manager.cc:1434] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:00.907521 25525 raft_consensus.cc:515] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.909909 25519 ts_tablet_manager.cc:1434] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:10:00.910571 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a6a6e60680479981d47c3ac7f0cc7e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
I20260709 13:10:00.910768 25525 leader_election.cc:290] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Requested vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:00.911190 25405 raft_consensus.cc:3060] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.911911 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05a6a6e60680479981d47c3ac7f0cc7e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6"
I20260709 13:10:00.912343 25479 raft_consensus.cc:3060] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:00.917909 25479 raft_consensus.cc:2468] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:00.918934 25293 leader_election.cc:304] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475a04fdb4a44bb3addb5914a70674a6, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:00.919297 25405 raft_consensus.cc:2468] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:00.919785 25532 raft_consensus.cc:2804] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:00.920325 25532 raft_consensus.cc:697] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Becoming Leader. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Running, Role: LEADER
I20260709 13:10:00.921159 25532 consensus_queue.cc:237] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:00.929821 25225 catalog_manager.cc:5697] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.130417 25532 raft_consensus.cc:493] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.130981 25532 raft_consensus.cc:515] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.132632 25532 leader_election.cc:290] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.133494 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" is_pre_election: true
I20260709 13:10:01.133813 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6" is_pre_election: true
I20260709 13:10:01.134061 25405 raft_consensus.cc:2468] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:01.134502 25479 raft_consensus.cc:2468] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:01.135138 25293 leader_election.cc:304] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c80ee42afcc4461a2448f0ab4bfda6a, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.135838 25532 raft_consensus.cc:2804] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.136157 25532 raft_consensus.cc:493] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.136432 25532 raft_consensus.cc:3060] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.141685 25532 raft_consensus.cc:515] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.143172 25532 leader_election.cc:290] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Requested vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.144011 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
I20260709 13:10:01.144287 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6"
I20260709 13:10:01.144616 25405 raft_consensus.cc:3060] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.144887 25479 raft_consensus.cc:3060] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.149652 25479 raft_consensus.cc:2468] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:01.149804 25405 raft_consensus.cc:2468] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:01.150642 25293 leader_election.cc:304] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475a04fdb4a44bb3addb5914a70674a6, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.151367 25532 raft_consensus.cc:2804] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.151855 25532 raft_consensus.cc:697] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Becoming Leader. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Running, Role: LEADER
I20260709 13:10:01.152657 25532 consensus_queue.cc:237] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.159322 25225 catalog_manager.cc:5697] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.194826 25225 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56760:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:01.196767 25225 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:01.218500 25319 tablet_service.cc:1511] Processing CreateTablet for tablet 5abc33e9f073491a951da945309e9da1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d57c08f9429d4fe0a097888ecf9f1d0a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:01.219796 25319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5abc33e9f073491a951da945309e9da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.219674 25395 tablet_service.cc:1511] Processing CreateTablet for tablet 5abc33e9f073491a951da945309e9da1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d57c08f9429d4fe0a097888ecf9f1d0a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:01.221064 25395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5abc33e9f073491a951da945309e9da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.221252 25469 tablet_service.cc:1511] Processing CreateTablet for tablet 5abc33e9f073491a951da945309e9da1 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d57c08f9429d4fe0a097888ecf9f1d0a]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:10:01.222416 25469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5abc33e9f073491a951da945309e9da1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.225580 25320 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4f141f588e4b5589b57b5f63a9a31b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d57c08f9429d4fe0a097888ecf9f1d0a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:01.226775 25320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4f141f588e4b5589b57b5f63a9a31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.227103 25468 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4f141f588e4b5589b57b5f63a9a31b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d57c08f9429d4fe0a097888ecf9f1d0a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:01.227566 25394 tablet_service.cc:1511] Processing CreateTablet for tablet 4d4f141f588e4b5589b57b5f63a9a31b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=d57c08f9429d4fe0a097888ecf9f1d0a]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:10:01.228343 25468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4f141f588e4b5589b57b5f63a9a31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.228819 25394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d4f141f588e4b5589b57b5f63a9a31b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:01.243012 25521 tablet_bootstrap.cc:492] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6: Bootstrap starting.
I20260709 13:10:01.249341 25521 tablet_bootstrap.cc:654] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.252233 25520 tablet_bootstrap.cc:492] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a: Bootstrap starting.
I20260709 13:10:01.252688 25519 tablet_bootstrap.cc:492] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: Bootstrap starting.
I20260709 13:10:01.258451 25520 tablet_bootstrap.cc:654] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.258563 25521 tablet_bootstrap.cc:492] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6: No bootstrap required, opened a new log
I20260709 13:10:01.259299 25521 ts_tablet_manager.cc:1403] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.003s
I20260709 13:10:01.259835 25519 tablet_bootstrap.cc:654] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.263137 25521 raft_consensus.cc:359] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.264647 25521 raft_consensus.cc:385] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.264956 25521 raft_consensus.cc:740] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475a04fdb4a44bb3addb5914a70674a6, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.265545 25519 tablet_bootstrap.cc:492] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: No bootstrap required, opened a new log
I20260709 13:10:01.266088 25519 ts_tablet_manager.cc:1403] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.002s
I20260709 13:10:01.265689 25521 consensus_queue.cc:260] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.267678 25520 tablet_bootstrap.cc:492] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a: No bootstrap required, opened a new log
I20260709 13:10:01.268172 25520 ts_tablet_manager.cc:1403] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:10:01.268671 25519 raft_consensus.cc:359] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.269460 25519 raft_consensus.cc:385] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.269682 25521 ts_tablet_manager.cc:1434] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:10:01.269840 25519 raft_consensus.cc:740] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.270913 25521 tablet_bootstrap.cc:492] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6: Bootstrap starting.
I20260709 13:10:01.270996 25519 consensus_queue.cc:260] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.271202 25520 raft_consensus.cc:359] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.272101 25520 raft_consensus.cc:385] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.272459 25520 raft_consensus.cc:740] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c80ee42afcc4461a2448f0ab4bfda6a, State: Initialized, Role: FOLLOWER
W20260709 13:10:01.275014 25276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:01.275265 25519 ts_tablet_manager.cc:1434] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:01.276461 25519 tablet_bootstrap.cc:492] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: Bootstrap starting.
I20260709 13:10:01.273313 25520 consensus_queue.cc:260] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.286834 25520 ts_tablet_manager.cc:1434] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.001s
I20260709 13:10:01.288002 25521 tablet_bootstrap.cc:654] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.288341 25520 tablet_bootstrap.cc:492] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: Bootstrap starting.
I20260709 13:10:01.290005 25519 tablet_bootstrap.cc:654] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.293514 25521 tablet_bootstrap.cc:492] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6: No bootstrap required, opened a new log
I20260709 13:10:01.295617 25521 ts_tablet_manager.cc:1403] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 13:10:01.296213 25520 tablet_bootstrap.cc:654] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:01.300894 25521 raft_consensus.cc:359] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.301865 25521 raft_consensus.cc:385] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.302137 25521 raft_consensus.cc:740] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 475a04fdb4a44bb3addb5914a70674a6, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.303010 25521 consensus_queue.cc:260] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.307850 25521 ts_tablet_manager.cc:1434] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:01.309197 25519 tablet_bootstrap.cc:492] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: No bootstrap required, opened a new log
I20260709 13:10:01.309737 25519 ts_tablet_manager.cc:1403] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.004s
I20260709 13:10:01.311161 25520 tablet_bootstrap.cc:492] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: No bootstrap required, opened a new log
I20260709 13:10:01.311741 25520 ts_tablet_manager.cc:1403] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.005s
I20260709 13:10:01.312131 25519 raft_consensus.cc:359] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.312850 25519 raft_consensus.cc:385] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.313153 25519 raft_consensus.cc:740] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.314112 25519 consensus_queue.cc:260] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.314424 25520 raft_consensus.cc:359] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.315076 25520 raft_consensus.cc:385] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:01.315478 25520 raft_consensus.cc:740] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c80ee42afcc4461a2448f0ab4bfda6a, State: Initialized, Role: FOLLOWER
I20260709 13:10:01.316143 25520 consensus_queue.cc:260] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.319919 25520 ts_tablet_manager.cc:1434] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:01.322597 25532 consensus_queue.cc:1048] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.324554 25519 ts_tablet_manager.cc:1434] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 13:10:01.330230 25532 consensus_queue.cc:1048] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.334987 25532 raft_consensus.cc:493] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.335534 25532 raft_consensus.cc:515] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.337478 25532 leader_election.cc:290] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.338711 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" is_pre_election: true
I20260709 13:10:01.339159 25479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6" is_pre_election: true
I20260709 13:10:01.339370 25405 raft_consensus.cc:2468] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:01.339826 25479 raft_consensus.cc:2468] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:01.340490 25293 leader_election.cc:304] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c80ee42afcc4461a2448f0ab4bfda6a, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.343964 25550 raft_consensus.cc:2804] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.344384 25550 raft_consensus.cc:493] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.344753 25550 raft_consensus.cc:3060] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.352346 25550 raft_consensus.cc:515] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.354380 25550 leader_election.cc:290] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Requested vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.356287 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
I20260709 13:10:01.356683 25478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6"
I20260709 13:10:01.356966 25405 raft_consensus.cc:3060] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.357293 25478 raft_consensus.cc:3060] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.364430 25405 raft_consensus.cc:2468] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:01.365674 25293 leader_election.cc:304] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c80ee42afcc4461a2448f0ab4bfda6a, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.366426 25550 raft_consensus.cc:2804] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.366369 25478 raft_consensus.cc:2468] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:01.367080 25550 raft_consensus.cc:697] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Becoming Leader. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Running, Role: LEADER
I20260709 13:10:01.368032 25550 consensus_queue.cc:237] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.375226 25225 catalog_manager.cc:5697] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.473704 25550 raft_consensus.cc:493] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:01.474326 25550 raft_consensus.cc:515] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.476243 25550 leader_election.cc:290] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.476934 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5abc33e9f073491a951da945309e9da1" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" is_pre_election: true
I20260709 13:10:01.477226 25478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5abc33e9f073491a951da945309e9da1" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6" is_pre_election: true
I20260709 13:10:01.477523 25405 raft_consensus.cc:2468] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:01.477896 25478 raft_consensus.cc:2468] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 0.
I20260709 13:10:01.478562 25293 leader_election.cc:304] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c80ee42afcc4461a2448f0ab4bfda6a, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.479313 25550 raft_consensus.cc:2804] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:01.479694 25550 raft_consensus.cc:493] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:01.480007 25550 raft_consensus.cc:3060] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.484990 25550 raft_consensus.cc:515] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.486433 25550 leader_election.cc:290] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Requested vote from peers 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.487166 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5abc33e9f073491a951da945309e9da1" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
I20260709 13:10:01.487375 25478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5abc33e9f073491a951da945309e9da1" candidate_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "475a04fdb4a44bb3addb5914a70674a6"
I20260709 13:10:01.487730 25405 raft_consensus.cc:3060] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.488073 25478 raft_consensus.cc:3060] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:01.492578 25405 raft_consensus.cc:2468] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:01.492630 25478 raft_consensus.cc:2468] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 762d1a2d69654d8fa2d98eb3ecd78e37 in term 1.
I20260709 13:10:01.493719 25293 leader_election.cc:304] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475a04fdb4a44bb3addb5914a70674a6, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.494314 25550 raft_consensus.cc:2804] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:01.494728 25550 raft_consensus.cc:697] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Becoming Leader. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Running, Role: LEADER
I20260709 13:10:01.495467 25550 consensus_queue.cc:237] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.502980 25226 catalog_manager.cc:5697] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 reported cstate change: term changed from 0 to 1, leader changed from <none> to 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1). New cstate: current_term: 1 leader_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.576063 25330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e"
dest_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37"
mode: GRACEFUL
new_leader_uuid: "475a04fdb4a44bb3addb5914a70674a6"
 from {username='slave'} at 127.0.0.1:58364
I20260709 13:10:01.576694 25330 raft_consensus.cc:606] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Received request to transfer leadership to TS 475a04fdb4a44bb3addb5914a70674a6
I20260709 13:10:01.639557 25550 consensus_queue.cc:1048] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.651990 25525 consensus_queue.cc:1048] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.662302 25548 raft_consensus.cc:993] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: : Instructing follower 475a04fdb4a44bb3addb5914a70674a6 to start an election
I20260709 13:10:01.662810 25525 raft_consensus.cc:1081] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Signalling peer 475a04fdb4a44bb3addb5914a70674a6 to start an election
I20260709 13:10:01.664891 25478 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e"
dest_uuid: "475a04fdb4a44bb3addb5914a70674a6"
 from {username='slave'} at 127.0.0.1:55824
I20260709 13:10:01.665509 25478 raft_consensus.cc:493] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.665998 25478 raft_consensus.cc:3060] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.671197 25478 raft_consensus.cc:515] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.673540 25478 leader_election.cc:290] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [CANDIDATE]: Term 2 election: Requested vote from peers 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1:36795), 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2:36363)
I20260709 13:10:01.684927 25330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e" candidate_uuid: "475a04fdb4a44bb3addb5914a70674a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37"
I20260709 13:10:01.685595 25330 raft_consensus.cc:3055] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.685941 25330 raft_consensus.cc:740] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Running, Role: LEADER
I20260709 13:10:01.686767 25330 consensus_queue.cc:260] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.688181 25330 raft_consensus.cc:3060] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.688035 25405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f060965884345b398bd67861e2c5f8e" candidate_uuid: "475a04fdb4a44bb3addb5914a70674a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
I20260709 13:10:01.688773 25405 raft_consensus.cc:3060] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.695199 25405 raft_consensus.cc:2468] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475a04fdb4a44bb3addb5914a70674a6 in term 2.
I20260709 13:10:01.695470 25330 raft_consensus.cc:2468] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 475a04fdb4a44bb3addb5914a70674a6 in term 2.
I20260709 13:10:01.696447 25442 leader_election.cc:304] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 475a04fdb4a44bb3addb5914a70674a6, 4c80ee42afcc4461a2448f0ab4bfda6a; no voters: 
I20260709 13:10:01.697399 25526 raft_consensus.cc:2804] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.698426 25526 raft_consensus.cc:697] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 2 LEADER]: Becoming Leader. State: Replica: 475a04fdb4a44bb3addb5914a70674a6, State: Running, Role: LEADER
I20260709 13:10:01.699313 25526 consensus_queue.cc:237] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.705395 25227 catalog_manager.cc:5697] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 reported cstate change: term changed from 1 to 2, leader changed from 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1) to 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3). New cstate: current_term: 2 leader_uuid: "475a04fdb4a44bb3addb5914a70674a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.739287 13792 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:10:01.741429 13792 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:10:01.741816 13792 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:10:01.752435 25330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b"
dest_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37"
mode: GRACEFUL
new_leader_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
 from {username='slave'} at 127.0.0.1:58394
I20260709 13:10:01.752930 25330 raft_consensus.cc:606] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Received request to transfer leadership to TS 4c80ee42afcc4461a2448f0ab4bfda6a
I20260709 13:10:01.754016 13792 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:10:01.754221 25525 consensus_queue.cc:1048] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.761201 25548 raft_consensus.cc:993] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: : Instructing follower 4c80ee42afcc4461a2448f0ab4bfda6a to start an election
I20260709 13:10:01.761629 25548 raft_consensus.cc:1081] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Signalling peer 4c80ee42afcc4461a2448f0ab4bfda6a to start an election
I20260709 13:10:01.765501 25404 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b"
dest_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a"
 from {username='slave'} at 127.0.0.1:55238
I20260709 13:10:01.767946 25404 raft_consensus.cc:493] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:01.768448 25404 raft_consensus.cc:3060] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.769656 25548 consensus_queue.cc:1048] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [LEADER]: Connected to new peer: Peer: permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:01.776768 25404 raft_consensus.cc:515] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.783968 25404 leader_election.cc:290] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [CANDIDATE]: Term 2 election: Requested vote from peers 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1:36795), 475a04fdb4a44bb3addb5914a70674a6 (127.13.120.3:40449)
I20260709 13:10:01.800077 25330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b" candidate_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37"
I20260709 13:10:01.800694 25330 raft_consensus.cc:3055] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:01.801023 25330 raft_consensus.cc:740] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 762d1a2d69654d8fa2d98eb3ecd78e37, State: Running, Role: LEADER
I20260709 13:10:01.801831 25330 consensus_queue.cc:260] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.802914 25330 raft_consensus.cc:3060] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.803499 25478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d4f141f588e4b5589b57b5f63a9a31b" candidate_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "475a04fdb4a44bb3addb5914a70674a6"
I20260709 13:10:01.804103 25478 raft_consensus.cc:3060] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:01.808867 25330 raft_consensus.cc:2468] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c80ee42afcc4461a2448f0ab4bfda6a in term 2.
I20260709 13:10:01.810098 25368 leader_election.cc:304] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c80ee42afcc4461a2448f0ab4bfda6a, 762d1a2d69654d8fa2d98eb3ecd78e37; no voters: 
I20260709 13:10:01.810171 25478 raft_consensus.cc:2468] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c80ee42afcc4461a2448f0ab4bfda6a in term 2.
I20260709 13:10:01.811142 25527 raft_consensus.cc:2804] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:01.812834 25527 raft_consensus.cc:697] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 LEADER]: Becoming Leader. State: Replica: 4c80ee42afcc4461a2448f0ab4bfda6a, State: Running, Role: LEADER
I20260709 13:10:01.813562 25527 consensus_queue.cc:237] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } }
I20260709 13:10:01.819128 25225 catalog_manager.cc:5697] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a reported cstate change: term changed from 1 to 2, leader changed from 762d1a2d69654d8fa2d98eb3ecd78e37 (127.13.120.1) to 4c80ee42afcc4461a2448f0ab4bfda6a (127.13.120.2). New cstate: current_term: 2 leader_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "762d1a2d69654d8fa2d98eb3ecd78e37" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4c80ee42afcc4461a2448f0ab4bfda6a" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "475a04fdb4a44bb3addb5914a70674a6" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 40449 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:01.833334 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
I20260709 13:10:01.852126 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:01.852739 13792 tablet_replica.cc:333] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37: stopping tablet replica
I20260709 13:10:01.853360 13792 raft_consensus.cc:2243] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.853983 13792 raft_consensus.cc:2272] T 4f060965884345b398bd67861e2c5f8e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.856217 13792 tablet_replica.cc:333] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37: stopping tablet replica
I20260709 13:10:01.856746 13792 raft_consensus.cc:2243] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.857142 13792 raft_consensus.cc:2272] T 4d4f141f588e4b5589b57b5f63a9a31b P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.859061 13792 tablet_replica.cc:333] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: stopping tablet replica
I20260709 13:10:01.859654 13792 raft_consensus.cc:2243] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.860211 13792 pending_rounds.cc:70] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: Trying to abort 1 pending ops.
I20260709 13:10:01.860381 13792 pending_rounds.cc:77] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636255732277248 op_type: NO_OP noop_request { }
I20260709 13:10:01.860666 13792 raft_consensus.cc:2889] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:01.860949 13792 raft_consensus.cc:2272] T 5abc33e9f073491a951da945309e9da1 P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.862748 13792 tablet_replica.cc:333] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37: stopping tablet replica
I20260709 13:10:01.863215 13792 raft_consensus.cc:2243] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.863929 13792 raft_consensus.cc:2272] T 05a6a6e60680479981d47c3ac7f0cc7e P 762d1a2d69654d8fa2d98eb3ecd78e37 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.886168 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:10:01.898356 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
I20260709 13:10:01.916092 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:01.916731 13792 tablet_replica.cc:333] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: stopping tablet replica
I20260709 13:10:01.917268 13792 raft_consensus.cc:2243] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.917891 13792 pending_rounds.cc:70] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: Trying to abort 1 pending ops.
I20260709 13:10:01.918104 13792 pending_rounds.cc:77] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636257035177984 op_type: NO_OP noop_request { }
I20260709 13:10:01.918385 13792 raft_consensus.cc:2889] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:01.918661 13792 raft_consensus.cc:2272] T 4d4f141f588e4b5589b57b5f63a9a31b P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.920830 13792 tablet_replica.cc:333] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a: stopping tablet replica
I20260709 13:10:01.921347 13792 raft_consensus.cc:2243] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.921756 13792 raft_consensus.cc:2272] T 5abc33e9f073491a951da945309e9da1 P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.923374 13792 tablet_replica.cc:333] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a: stopping tablet replica
I20260709 13:10:01.923890 13792 raft_consensus.cc:2243] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.924278 13792 raft_consensus.cc:2272] T 05a6a6e60680479981d47c3ac7f0cc7e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.926678 13792 tablet_replica.cc:333] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a: stopping tablet replica
I20260709 13:10:01.927141 13792 raft_consensus.cc:2243] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.927605 13792 raft_consensus.cc:2272] T 4f060965884345b398bd67861e2c5f8e P 4c80ee42afcc4461a2448f0ab4bfda6a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.939252 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
I20260709 13:10:01.950031 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
I20260709 13:10:01.966101 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:01.966758 13792 tablet_replica.cc:333] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: stopping tablet replica
I20260709 13:10:01.967392 13792 raft_consensus.cc:2243] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:01.968056 13792 pending_rounds.cc:70] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: Trying to abort 1 pending ops.
I20260709 13:10:01.968254 13792 pending_rounds.cc:77] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305636256568115200 op_type: NO_OP noop_request { }
I20260709 13:10:01.968528 13792 raft_consensus.cc:2889] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:10:01.968815 13792 raft_consensus.cc:2272] T 4f060965884345b398bd67861e2c5f8e P 475a04fdb4a44bb3addb5914a70674a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.971311 13792 tablet_replica.cc:333] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6: stopping tablet replica
I20260709 13:10:01.971889 13792 raft_consensus.cc:2243] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.972381 13792 raft_consensus.cc:2272] T 4d4f141f588e4b5589b57b5f63a9a31b P 475a04fdb4a44bb3addb5914a70674a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.974418 13792 tablet_replica.cc:333] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6: stopping tablet replica
I20260709 13:10:01.974963 13792 raft_consensus.cc:2243] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.975337 13792 raft_consensus.cc:2272] T 5abc33e9f073491a951da945309e9da1 P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.976926 13792 tablet_replica.cc:333] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6: stopping tablet replica
I20260709 13:10:01.977360 13792 raft_consensus.cc:2243] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.977741 13792 raft_consensus.cc:2272] T 05a6a6e60680479981d47c3ac7f0cc7e P 475a04fdb4a44bb3addb5914a70674a6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.998903 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
I20260709 13:10:02.010102 13792 master.cc:562] Master@127.13.120.62:46011 shutting down...
I20260709 13:10:02.024874 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:02.025362 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:02.025630 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4c9baf522600453db219def7f9a88a58: stopping tablet replica
I20260709 13:10:02.043843 13792 master.cc:584] Master@127.13.120.62:46011 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (1939 ms)
[----------] 6 tests from LeaderRebalancerTest (358884 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:10:02.071941 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:42707
I20260709 13:10:02.073091 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.077766 25570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.078543 25571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.086289 25573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.086469 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:02.087383 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.087620 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.087742 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602602087730 us; error 0 us; skew 500 ppm
I20260709 13:10:02.088225 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.090404 13792 webserver.cc:533] Webserver started at http://127.13.120.62:40825/ using document root <none> and password file <none>
I20260709 13:10:02.090848 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.091001 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.091209 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.092289 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "b03c2f96e62a406eae853972e58e2bc3"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.096577 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 13:10:02.099813 25578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.100612 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:02.100945 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "b03c2f96e62a406eae853972e58e2bc3"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.101207 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.125355 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.126363 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.164932 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:42707
I20260709 13:10:02.165035 25629 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:42707 every 8 connection(s)
I20260709 13:10:02.168723 25630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.179287 25630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3: Bootstrap starting.
I20260709 13:10:02.183537 25630 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.187345 25630 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3: No bootstrap required, opened a new log
I20260709 13:10:02.189471 25630 raft_consensus.cc:359] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b03c2f96e62a406eae853972e58e2bc3" member_type: VOTER }
I20260709 13:10:02.189873 25630 raft_consensus.cc:385] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.190111 25630 raft_consensus.cc:740] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b03c2f96e62a406eae853972e58e2bc3, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.190689 25630 consensus_queue.cc:260] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b03c2f96e62a406eae853972e58e2bc3" member_type: VOTER }
I20260709 13:10:02.191149 25630 raft_consensus.cc:399] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:02.191352 25630 raft_consensus.cc:493] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:02.191666 25630 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:02.196372 25630 raft_consensus.cc:515] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b03c2f96e62a406eae853972e58e2bc3" member_type: VOTER }
I20260709 13:10:02.196871 25630 leader_election.cc:304] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b03c2f96e62a406eae853972e58e2bc3; no voters: 
I20260709 13:10:02.197947 25630 leader_election.cc:290] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:02.198287 25633 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:02.199682 25633 raft_consensus.cc:697] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 1 LEADER]: Becoming Leader. State: Replica: b03c2f96e62a406eae853972e58e2bc3, State: Running, Role: LEADER
I20260709 13:10:02.200260 25633 consensus_queue.cc:237] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b03c2f96e62a406eae853972e58e2bc3" member_type: VOTER }
I20260709 13:10:02.200789 25630 sys_catalog.cc:565] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:02.202996 25635 sys_catalog.cc:455] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b03c2f96e62a406eae853972e58e2bc3. Latest consensus state: current_term: 1 leader_uuid: "b03c2f96e62a406eae853972e58e2bc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b03c2f96e62a406eae853972e58e2bc3" member_type: VOTER } }
I20260709 13:10:02.202936 25634 sys_catalog.cc:455] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b03c2f96e62a406eae853972e58e2bc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b03c2f96e62a406eae853972e58e2bc3" member_type: VOTER } }
I20260709 13:10:02.203667 25635 sys_catalog.cc:458] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:02.203755 25634 sys_catalog.cc:458] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:02.206617 25638 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:02.212888 25638 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:02.214082 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:02.221259 25638 catalog_manager.cc:1383] Generated new cluster ID: b85edcfad2d24ecc8354ba91de27f9e7
I20260709 13:10:02.221539 25638 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:02.235699 25638 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:02.236974 25638 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:02.253783 25638 catalog_manager.cc:6070] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3: Generated new TSK 0
I20260709 13:10:02.254361 25638 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:02.280572 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.286240 25651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.287299 25652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.288592 25654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.288858 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:02.290655 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.290834 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.291044 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602602291007 us; error 0 us; skew 500 ppm
I20260709 13:10:02.291664 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.293906 13792 webserver.cc:533] Webserver started at http://127.13.120.1:33851/ using document root <none> and password file <none>
I20260709 13:10:02.294389 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.294571 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.294865 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.295970 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "fc03370c02ef4a6baa8639f906396b8d"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.300210 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:10:02.303565 25659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.304277 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:02.304569 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "fc03370c02ef4a6baa8639f906396b8d"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.304832 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.336400 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.337487 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.338883 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.341053 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.341272 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.341533 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.341707 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.378583 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:34007
I20260709 13:10:02.378712 25721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:34007 every 8 connection(s)
I20260709 13:10:02.383569 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.390534 25726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.391697 25727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.394477 13792 server_base.cc:1061] running on GCE node
W20260709 13:10:02.395993 25730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.396533 25722 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42707
I20260709 13:10:02.396986 25722 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.397015 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.397387 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.397583 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602602397565 us; error 0 us; skew 500 ppm
I20260709 13:10:02.397941 25722 heartbeater.cc:507] Master 127.13.120.62:42707 requested a full tablet report, sending...
I20260709 13:10:02.398355 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.400431 25595 ts_manager.cc:194] Registered new tserver with Master: fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007)
I20260709 13:10:02.401167 13792 webserver.cc:533] Webserver started at http://127.13.120.2:34143/ using document root <none> and password file <none>
I20260709 13:10:02.401683 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.401870 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.402182 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.402599 25595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58100
I20260709 13:10:02.403534 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.408244 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:10:02.411405 25734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.412503 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:02.412832 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.413102 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.438731 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.439930 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.441388 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.443775 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.444008 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.444267 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.444445 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.482676 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:35461
I20260709 13:10:02.482776 25796 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:35461 every 8 connection(s)
I20260709 13:10:02.487462 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:02.494647 25800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.495968 25801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:02.499241 25803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:02.499589 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:02.500137 25797 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42707
I20260709 13:10:02.500607 25797 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.500756 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:02.501068 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:02.501253 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602602501236 us; error 0 us; skew 500 ppm
I20260709 13:10:02.501407 25797 heartbeater.cc:507] Master 127.13.120.62:42707 requested a full tablet report, sending...
I20260709 13:10:02.501937 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:02.503846 25595 ts_manager.cc:194] Registered new tserver with Master: 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:02.504948 13792 webserver.cc:533] Webserver started at http://127.13.120.3:34719/ using document root <none> and password file <none>
I20260709 13:10:02.505661 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:02.505779 25595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58114
I20260709 13:10:02.505918 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:02.506402 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:02.507943 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "0d69a3beb260470ab4bf08a90883fa46"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.512626 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:02.515836 25808 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.516577 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:10:02.516902 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "0d69a3beb260470ab4bf08a90883fa46"
format_stamp: "Formatted at 2026-07-09 13:10:02 on dist-test-slave-mcck"
I20260709 13:10:02.517165 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:02.536345 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:02.537321 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:02.538635 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:02.540870 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:02.541210 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.541481 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:02.541697 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:02.578718 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:41353
I20260709 13:10:02.578821 25870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:41353 every 8 connection(s)
I20260709 13:10:02.593070 25871 heartbeater.cc:344] Connected to a master server at 127.13.120.62:42707
I20260709 13:10:02.593441 25871 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:02.594167 25871 heartbeater.cc:507] Master 127.13.120.62:42707 requested a full tablet report, sending...
I20260709 13:10:02.596210 25595 ts_manager.cc:194] Registered new tserver with Master: 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:02.596698 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014645004s
I20260709 13:10:02.597543 25595 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58128
I20260709 13:10:02.622967 25595 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58140:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:02.625607 25595 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:02.693172 25836 tablet_service.cc:1511] Processing CreateTablet for tablet ed635ba51d274fee9727087cc7600478 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:02.694589 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed635ba51d274fee9727087cc7600478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.694242 25687 tablet_service.cc:1511] Processing CreateTablet for tablet ed635ba51d274fee9727087cc7600478 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:02.695665 25687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed635ba51d274fee9727087cc7600478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.696076 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 07e385ee47a74cc39ec5287c16cfd98b (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:02.697549 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e385ee47a74cc39ec5287c16cfd98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.698691 25835 tablet_service.cc:1511] Processing CreateTablet for tablet ed79066fd552484cb12055ab6db221e2 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:02.700047 25835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed79066fd552484cb12055ab6db221e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.700544 25685 tablet_service.cc:1511] Processing CreateTablet for tablet fc8902a206ef4f5e867faa368e1323e9 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:02.701947 25685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8902a206ef4f5e867faa368e1323e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.703677 25833 tablet_service.cc:1511] Processing CreateTablet for tablet 07e385ee47a74cc39ec5287c16cfd98b (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:02.705191 25833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e385ee47a74cc39ec5287c16cfd98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.707837 25686 tablet_service.cc:1511] Processing CreateTablet for tablet ed79066fd552484cb12055ab6db221e2 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:02.709265 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed79066fd552484cb12055ab6db221e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.700590 25834 tablet_service.cc:1511] Processing CreateTablet for tablet fc8902a206ef4f5e867faa368e1323e9 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:02.712927 25834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8902a206ef4f5e867faa368e1323e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.725030 25886 tablet_bootstrap.cc:492] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:02.732465 25887 tablet_bootstrap.cc:492] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:02.738395 25887 tablet_bootstrap.cc:654] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.740126 25886 tablet_bootstrap.cc:654] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.746364 25762 tablet_service.cc:1511] Processing CreateTablet for tablet ed635ba51d274fee9727087cc7600478 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:02.747792 25762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed635ba51d274fee9727087cc7600478. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.752148 25761 tablet_service.cc:1511] Processing CreateTablet for tablet ed79066fd552484cb12055ab6db221e2 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:02.753625 25761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed79066fd552484cb12055ab6db221e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.754060 25687 tablet_service.cc:1511] Processing CreateTablet for tablet a6dee2f724734361ace92e3321a0db9a (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:02.755443 25687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dee2f724734361ace92e3321a0db9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.755287 25760 tablet_service.cc:1511] Processing CreateTablet for tablet fc8902a206ef4f5e867faa368e1323e9 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:02.756803 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc8902a206ef4f5e867faa368e1323e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.757850 25759 tablet_service.cc:1511] Processing CreateTablet for tablet 07e385ee47a74cc39ec5287c16cfd98b (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:02.758740 25886 tablet_bootstrap.cc:492] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:02.759137 25759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07e385ee47a74cc39ec5287c16cfd98b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.759274 25886 ts_tablet_manager.cc:1403] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.034s	user 0.009s	sys 0.013s
I20260709 13:10:02.762346 25886 raft_consensus.cc:359] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.763068 25886 raft_consensus.cc:385] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.763424 25886 raft_consensus.cc:740] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.764369 25886 consensus_queue.cc:260] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.765393 25758 tablet_service.cc:1511] Processing CreateTablet for tablet a6dee2f724734361ace92e3321a0db9a (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:02.766763 25758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dee2f724734361ace92e3321a0db9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.755712 25887 tablet_bootstrap.cc:492] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:02.779867 25887 ts_tablet_manager.cc:1403] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.005s
I20260709 13:10:02.782929 25685 tablet_service.cc:1511] Processing CreateTablet for tablet a715cac09f2a44a0b030498e94b41c15 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:02.784482 25685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a715cac09f2a44a0b030498e94b41c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.785516 25757 tablet_service.cc:1511] Processing CreateTablet for tablet a715cac09f2a44a0b030498e94b41c15 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:02.787010 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a715cac09f2a44a0b030498e94b41c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.752208 25833 tablet_service.cc:1511] Processing CreateTablet for tablet a6dee2f724734361ace92e3321a0db9a (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:02.789170 25833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6dee2f724734361ace92e3321a0db9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.803059 25836 tablet_service.cc:1511] Processing CreateTablet for tablet a715cac09f2a44a0b030498e94b41c15 (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:02.804910 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a715cac09f2a44a0b030498e94b41c15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.806982 25756 tablet_service.cc:1511] Processing CreateTablet for tablet 86134bbb5306407895103c2b3670890c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:02.807933 25887 raft_consensus.cc:359] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.808745 25887 raft_consensus.cc:385] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.809062 25887 raft_consensus.cc:740] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.808822 25683 tablet_service.cc:1511] Processing CreateTablet for tablet 86134bbb5306407895103c2b3670890c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:02.810142 25683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86134bbb5306407895103c2b3670890c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.811461 25835 tablet_service.cc:1511] Processing CreateTablet for tablet 86134bbb5306407895103c2b3670890c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:02.812831 25835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86134bbb5306407895103c2b3670890c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.816946 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 33696087fb5947139c0694d00532057c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:02.818297 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33696087fb5947139c0694d00532057c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.824234 25887 consensus_queue.cc:260] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.828426 25755 tablet_service.cc:1511] Processing CreateTablet for tablet 33696087fb5947139c0694d00532057c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:02.828910 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86134bbb5306407895103c2b3670890c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.829785 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33696087fb5947139c0694d00532057c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.832355 25886 ts_tablet_manager.cc:1434] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.073s	user 0.027s	sys 0.015s
I20260709 13:10:02.833346 25871 heartbeater.cc:499] Master 127.13.120.62:42707 was elected leader, sending a full tablet report...
I20260709 13:10:02.840246 25886 tablet_bootstrap.cc:492] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:02.854557 25891 tablet_bootstrap.cc:492] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:02.860627 25891 tablet_bootstrap.cc:654] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.874313 25836 tablet_service.cc:1511] Processing CreateTablet for tablet 33696087fb5947139c0694d00532057c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:02.876542 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33696087fb5947139c0694d00532057c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.877250 25887 ts_tablet_manager.cc:1434] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.097s	user 0.020s	sys 0.015s
I20260709 13:10:02.878088 25685 tablet_service.cc:1511] Processing CreateTablet for tablet 64714bfe2ce54fabba82353a5f20d76c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:02.880981 25685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64714bfe2ce54fabba82353a5f20d76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.885841 25760 tablet_service.cc:1511] Processing CreateTablet for tablet 64714bfe2ce54fabba82353a5f20d76c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:02.887089 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64714bfe2ce54fabba82353a5f20d76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.887480 25722 heartbeater.cc:499] Master 127.13.120.62:42707 was elected leader, sending a full tablet report...
I20260709 13:10:02.890652 25833 tablet_service.cc:1511] Processing CreateTablet for tablet 64714bfe2ce54fabba82353a5f20d76c (DEFAULT_TABLE table=test-workload [id=80805e59581a4e078fd014ceeebfffef]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:02.892068 25833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64714bfe2ce54fabba82353a5f20d76c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:02.908274 25887 tablet_bootstrap.cc:492] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:02.927883 25891 tablet_bootstrap.cc:492] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:02.928522 25891 ts_tablet_manager.cc:1403] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.020s
I20260709 13:10:02.931560 25891 raft_consensus.cc:359] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.932360 25891 raft_consensus.cc:385] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.932721 25891 raft_consensus.cc:740] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.933883 25887 tablet_bootstrap.cc:654] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.933656 25891 consensus_queue.cc:260] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.945497 25886 tablet_bootstrap.cc:654] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.955145 25797 heartbeater.cc:499] Master 127.13.120.62:42707 was elected leader, sending a full tablet report...
I20260709 13:10:02.956213 25891 ts_tablet_manager.cc:1434] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.027s	user 0.002s	sys 0.008s
I20260709 13:10:02.956424 25886 tablet_bootstrap.cc:492] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:02.956460 25887 tablet_bootstrap.cc:492] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:02.957233 25891 tablet_bootstrap.cc:492] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:02.957391 25887 ts_tablet_manager.cc:1403] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.005s
I20260709 13:10:02.957283 25886 ts_tablet_manager.cc:1403] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.008s
I20260709 13:10:02.960873 25887 raft_consensus.cc:359] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:02.961138 25886 raft_consensus.cc:359] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:02.961668 25887 raft_consensus.cc:385] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.961871 25886 raft_consensus.cc:385] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.962086 25887 raft_consensus.cc:740] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.962252 25886 raft_consensus.cc:740] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.963330 25891 tablet_bootstrap.cc:654] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.963034 25886 consensus_queue.cc:260] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:02.963193 25887 consensus_queue.cc:260] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:02.965512 25886 ts_tablet_manager.cc:1434] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:02.966548 25886 tablet_bootstrap.cc:492] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:02.967924 25887 ts_tablet_manager.cc:1434] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:10:02.969000 25887 tablet_bootstrap.cc:492] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:02.972286 25886 tablet_bootstrap.cc:654] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.974813 25887 tablet_bootstrap.cc:654] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:02.981177 25891 tablet_bootstrap.cc:492] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:02.981745 25891 ts_tablet_manager.cc:1403] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.013s
I20260709 13:10:02.983381 25886 tablet_bootstrap.cc:492] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:02.983934 25886 ts_tablet_manager.cc:1403] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:10:02.984577 25891 raft_consensus.cc:359] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.986306 25891 raft_consensus.cc:385] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.986469 25887 tablet_bootstrap.cc:492] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:02.986690 25891 raft_consensus.cc:740] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.987054 25887 ts_tablet_manager.cc:1403] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 13:10:02.986943 25886 raft_consensus.cc:359] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.987756 25891 consensus_queue.cc:260] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.988587 25886 raft_consensus.cc:385] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.988969 25886 raft_consensus.cc:740] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.989895 25886 consensus_queue.cc:260] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.990517 25891 ts_tablet_manager.cc:1434] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:02.990805 25887 raft_consensus.cc:359] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.991585 25887 raft_consensus.cc:385] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:02.991595 25891 tablet_bootstrap.cc:492] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:02.992082 25887 raft_consensus.cc:740] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:02.992800 25886 ts_tablet_manager.cc:1434] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:10:02.992908 25887 consensus_queue.cc:260] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.994047 25886 tablet_bootstrap.cc:492] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:02.995043 25890 raft_consensus.cc:493] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:02.995183 25887 ts_tablet_manager.cc:1434] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:02.995622 25890 raft_consensus.cc:515] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:02.996289 25887 tablet_bootstrap.cc:492] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:02.998250 25890 leader_election.cc:290] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:02.998682 25891 tablet_bootstrap.cc:654] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.003355 25887 tablet_bootstrap.cc:654] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.012295 25890 raft_consensus.cc:493] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.012887 25890 raft_consensus.cc:515] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.018165 25890 leader_election.cc:290] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.024708 25886 tablet_bootstrap.cc:654] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.028339 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed79066fd552484cb12055ab6db221e2" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.031629 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
W20260709 13:10:03.032747 25809 leader_election.cc:343] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.034029 25892 raft_consensus.cc:493] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.034564 25892 raft_consensus.cc:515] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.035248 25887 tablet_bootstrap.cc:492] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:03.035815 25887 ts_tablet_manager.cc:1403] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.027s
I20260709 13:10:03.036440 25886 tablet_bootstrap.cc:492] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:03.036439 25895 raft_consensus.cc:493] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.036998 25886 ts_tablet_manager.cc:1403] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.004s
I20260709 13:10:03.037209 25895 raft_consensus.cc:515] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.038609 25887 raft_consensus.cc:359] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.039346 25887 raft_consensus.cc:385] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.039660 25887 raft_consensus.cc:740] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.039834 25886 raft_consensus.cc:359] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.040563 25886 raft_consensus.cc:385] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.040354 25887 consensus_queue.cc:260] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.040867 25886 raft_consensus.cc:740] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.040771 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.041745 25696 raft_consensus.cc:2468] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:03.042029 25895 leader_election.cc:290] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.042052 25886 consensus_queue.cc:260] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.043187 25809 leader_election.cc:304] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.046303 25890 raft_consensus.cc:2804] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.046764 25890 raft_consensus.cc:493] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.047209 25890 raft_consensus.cc:3060] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.038595 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed79066fd552484cb12055ab6db221e2" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
W20260709 13:10:03.055877 25809 leader_election.cc:343] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:03.056963 25809 leader_election.cc:343] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.057464 25809 leader_election.cc:304] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46; no voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:03.058193 25886 ts_tablet_manager.cc:1434] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 13:10:03.059312 25892 leader_election.cc:290] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.060454 25886 tablet_bootstrap.cc:492] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:03.058676 25887 ts_tablet_manager.cc:1434] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.023s	user 0.014s	sys 0.008s
I20260709 13:10:03.068464 25887 tablet_bootstrap.cc:492] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:03.059089 25890 raft_consensus.cc:515] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.077569 25890 leader_election.cc:290] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.078259 25890 raft_consensus.cc:2749] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.080432 25886 tablet_bootstrap.cc:654] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.084405 25887 tablet_bootstrap.cc:654] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.088982 25891 tablet_bootstrap.cc:492] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.089543 25891 ts_tablet_manager.cc:1403] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.098s	user 0.012s	sys 0.010s
I20260709 13:10:03.093014 25891 raft_consensus.cc:359] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.093899 25891 raft_consensus.cc:385] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.094115 25891 raft_consensus.cc:740] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.094748 25891 consensus_queue.cc:260] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.096210 25887 tablet_bootstrap.cc:492] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:03.096765 25887 ts_tablet_manager.cc:1403] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260709 13:10:03.099854 25886 tablet_bootstrap.cc:492] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:03.099850 25887 raft_consensus.cc:359] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.101033 25887 raft_consensus.cc:385] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.101400 25887 raft_consensus.cc:740] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.100630 25886 ts_tablet_manager.cc:1403] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.004s
I20260709 13:10:03.102263 25887 consensus_queue.cc:260] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
W20260709 13:10:03.109143 25809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.1:34007, user_credentials={real_user=slave}} blocked reactor thread for 52218.2us
I20260709 13:10:03.109903 25887 ts_tablet_manager.cc:1434] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:10:03.110880 25887 tablet_bootstrap.cc:492] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:03.110785 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.113226 25697 raft_consensus.cc:3060] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.113338 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.114514 25846 raft_consensus.cc:2393] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc03370c02ef4a6baa8639f906396b8d in current term 1: Already voted for candidate 0d69a3beb260470ab4bf08a90883fa46 in this term.
I20260709 13:10:03.117430 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.118083 25696 raft_consensus.cc:2468] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:03.118500 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.119059 25891 ts_tablet_manager.cc:1434] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:10:03.120155 25735 leader_election.cc:304] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.121078 25895 raft_consensus.cc:2804] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.121433 25895 raft_consensus.cc:493] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.121769 25895 raft_consensus.cc:3060] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.121943 25886 raft_consensus.cc:359] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.122500 25891 tablet_bootstrap.cc:492] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:03.122797 25886 raft_consensus.cc:385] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.123097 25886 raft_consensus.cc:740] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.123842 25886 consensus_queue.cc:260] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.126055 25886 ts_tablet_manager.cc:1434] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:10:03.129901 25886 tablet_bootstrap.cc:492] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:03.133019 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.133695 25846 raft_consensus.cc:2468] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:03.136293 25891 tablet_bootstrap.cc:654] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.137665 25887 tablet_bootstrap.cc:654] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.139112 25895 raft_consensus.cc:515] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
W20260709 13:10:03.141561 25809 leader_election.cc:343] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.121774 25697 raft_consensus.cc:2468] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:03.142436 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.143035 25696 raft_consensus.cc:3060] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.143510 25809 leader_election.cc:304] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.144474 25908 raft_consensus.cc:2804] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.144667 25886 tablet_bootstrap.cc:654] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.145707 25908 raft_consensus.cc:697] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:03.146569 25908 consensus_queue.cc:237] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.147706 25891 tablet_bootstrap.cc:492] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.148298 25891 ts_tablet_manager.cc:1403] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 13:10:03.151445 25895 leader_election.cc:290] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.151739 25891 raft_consensus.cc:359] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.152655 25891 raft_consensus.cc:385] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.152750 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.153065 25891 raft_consensus.cc:740] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.153644 25846 raft_consensus.cc:3060] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.154065 25891 consensus_queue.cc:260] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.154773 25887 tablet_bootstrap.cc:492] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:03.155247 25887 ts_tablet_manager.cc:1403] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.004s
I20260709 13:10:03.156309 25891 ts_tablet_manager.cc:1434] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:10:03.158268 25887 raft_consensus.cc:359] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.159699 25891 tablet_bootstrap.cc:492] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:03.160936 25887 raft_consensus.cc:385] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.161315 25887 raft_consensus.cc:740] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.160637 25886 tablet_bootstrap.cc:492] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:03.162298 25886 ts_tablet_manager.cc:1403] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.000s
I20260709 13:10:03.163916 25887 consensus_queue.cc:260] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.151255 25696 raft_consensus.cc:2468] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:03.168226 25891 tablet_bootstrap.cc:654] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.168694 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.169353 25772 raft_consensus.cc:2468] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:03.169909 25887 ts_tablet_manager.cc:1434] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:10:03.171013 25887 tablet_bootstrap.cc:492] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:03.171115 25735 leader_election.cc:304] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.172245 25895 raft_consensus.cc:2804] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.174907 25660 leader_election.cc:304] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:03.177189 25906 raft_consensus.cc:2764] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:03.166704 25886 raft_consensus.cc:359] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.179692 25886 raft_consensus.cc:385] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.180194 25886 raft_consensus.cc:740] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.181227 25886 consensus_queue.cc:260] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.184379 25886 ts_tablet_manager.cc:1434] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:10:03.185729 25886 tablet_bootstrap.cc:492] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:03.192400 25887 tablet_bootstrap.cc:654] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.192710 25891 tablet_bootstrap.cc:492] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.193274 25891 ts_tablet_manager.cc:1403] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.006s
I20260709 13:10:03.196133 25846 raft_consensus.cc:2468] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:03.196497 25891 raft_consensus.cc:359] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.201396 25891 raft_consensus.cc:385] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.197255 25886 tablet_bootstrap.cc:654] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.201795 25891 raft_consensus.cc:740] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.202759 25891 consensus_queue.cc:260] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.197501 25895 raft_consensus.cc:697] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:03.199234 25887 tablet_bootstrap.cc:492] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:03.204572 25887 ts_tablet_manager.cc:1403] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.001s
I20260709 13:10:03.205160 25891 ts_tablet_manager.cc:1434] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:03.204892 25895 consensus_queue.cc:237] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.206205 25891 tablet_bootstrap.cc:492] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:03.206024 25594 catalog_manager.cc:5697] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.207710 25887 raft_consensus.cc:359] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
W20260709 13:10:03.210245 25643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:03.208487 25887 raft_consensus.cc:385] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.211058 25887 raft_consensus.cc:740] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.211966 25887 consensus_queue.cc:260] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.213330 25891 tablet_bootstrap.cc:654] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.216634 25887 ts_tablet_manager.cc:1434] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:10:03.217710 25887 tablet_bootstrap.cc:492] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:03.199916 25918 raft_consensus.cc:493] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.218683 25918 raft_consensus.cc:515] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.223147 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dee2f724734361ace92e3321a0db9a" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.223786 25696 raft_consensus.cc:2468] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:03.224512 25891 tablet_bootstrap.cc:492] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.224726 25886 tablet_bootstrap.cc:492] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:03.225173 25891 ts_tablet_manager.cc:1403] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:10:03.225853 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dee2f724734361ace92e3321a0db9a" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.226594 25846 raft_consensus.cc:2468] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:03.225036 25735 leader_election.cc:304] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.228576 25895 raft_consensus.cc:2804] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.228422 25891 raft_consensus.cc:359] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.229156 25895 raft_consensus.cc:493] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.229686 25891 raft_consensus.cc:385] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.225215 25886 ts_tablet_manager.cc:1403] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.006s
I20260709 13:10:03.229851 25895 raft_consensus.cc:3060] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.229924 25591 catalog_manager.cc:5697] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.231101 25887 tablet_bootstrap.cc:654] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.233369 25919 raft_consensus.cc:493] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.235802 25919 raft_consensus.cc:515] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.238009 25895 raft_consensus.cc:515] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.238761 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.238863 25919 leader_election.cc:290] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.239012 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.233477 25886 raft_consensus.cc:359] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.239444 25696 raft_consensus.cc:2468] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:03.239655 25846 raft_consensus.cc:2468] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:03.239687 25886 raft_consensus.cc:385] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.240726 25886 raft_consensus.cc:740] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.240797 25735 leader_election.cc:304] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.241858 25919 raft_consensus.cc:2804] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.241595 25886 consensus_queue.cc:260] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.242237 25919 raft_consensus.cc:493] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.242630 25919 raft_consensus.cc:3060] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.243897 25886 ts_tablet_manager.cc:1434] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:10:03.245152 25886 tablet_bootstrap.cc:492] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:03.230142 25891 raft_consensus.cc:740] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.231493 25918 leader_election.cc:290] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.248317 25919 raft_consensus.cc:515] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.249477 25887 tablet_bootstrap.cc:492] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:03.248751 25891 consensus_queue.cc:260] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.249979 25887 ts_tablet_manager.cc:1403] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 13:10:03.249864 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dee2f724734361ace92e3321a0db9a" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.250329 25908 raft_consensus.cc:493] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.250463 25696 raft_consensus.cc:3060] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.250837 25908 raft_consensus.cc:515] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.251749 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6dee2f724734361ace92e3321a0db9a" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.252345 25846 raft_consensus.cc:3060] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.252745 25887 raft_consensus.cc:359] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.253167 25908 leader_election.cc:290] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.253404 25887 raft_consensus.cc:385] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.253720 25887 raft_consensus.cc:740] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.254341 25887 consensus_queue.cc:260] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.255447 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.256079 25697 raft_consensus.cc:2468] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:03.256317 25887 ts_tablet_manager.cc:1434] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:10:03.257247 25887 tablet_bootstrap.cc:492] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:03.257058 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.257431 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.258006 25697 raft_consensus.cc:3060] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.261739 25846 raft_consensus.cc:2468] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:03.251734 25891 ts_tablet_manager.cc:1434] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.026s	user 0.002s	sys 0.005s
I20260709 13:10:03.263701 25891 tablet_bootstrap.cc:492] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:03.264003 25886 tablet_bootstrap.cc:654] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.264174 25736 leader_election.cc:304] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:03.264993 25918 raft_consensus.cc:2804] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.265403 25809 leader_election.cc:304] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.265550 25696 raft_consensus.cc:2468] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
W20260709 13:10:03.266372 25809 leader_election.cc:343] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.268270 25908 raft_consensus.cc:2804] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.271535 25908 raft_consensus.cc:493] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.272087 25908 raft_consensus.cc:3060] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.272631 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.274027 25846 raft_consensus.cc:3060] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.273001 25895 leader_election.cc:290] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.270254 25919 leader_election.cc:290] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.268502 25697 raft_consensus.cc:2468] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:03.281548 25735 leader_election.cc:304] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.282513 25919 raft_consensus.cc:2804] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.283057 25919 raft_consensus.cc:697] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:03.284091 25919 consensus_queue.cc:237] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.288938 25891 tablet_bootstrap.cc:654] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.292191 25887 tablet_bootstrap.cc:654] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.293874 25886 tablet_bootstrap.cc:492] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:03.294404 25886 ts_tablet_manager.cc:1403] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.050s	user 0.018s	sys 0.014s
I20260709 13:10:03.288632 25908 raft_consensus.cc:515] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.289783 25918 raft_consensus.cc:697] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:03.298310 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.298034 25918 consensus_queue.cc:237] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.298892 25697 raft_consensus.cc:3060] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.302246 25886 raft_consensus.cc:359] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.303158 25886 raft_consensus.cc:385] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.303494 25886 raft_consensus.cc:740] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.304020 25846 raft_consensus.cc:2468] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:03.304314 25886 consensus_queue.cc:260] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.306061 25908 leader_election.cc:290] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.306511 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
W20260709 13:10:03.308096 25809 leader_election.cc:343] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.309681 25697 raft_consensus.cc:2468] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:03.311017 25809 leader_election.cc:304] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.308123 25886 ts_tablet_manager.cc:1434] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:03.312223 25890 raft_consensus.cc:2804] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.312350 25886 tablet_bootstrap.cc:492] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:03.312744 25890 raft_consensus.cc:697] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:03.313562 25890 consensus_queue.cc:237] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.321056 25891 tablet_bootstrap.cc:492] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.324695 25891 ts_tablet_manager.cc:1403] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.061s	user 0.010s	sys 0.004s
I20260709 13:10:03.327937 25891 raft_consensus.cc:359] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.331032 25591 catalog_manager.cc:5697] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.332261 25887 tablet_bootstrap.cc:492] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:03.335878 25886 tablet_bootstrap.cc:654] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.332469 25891 raft_consensus.cc:385] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.339761 25891 raft_consensus.cc:740] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.340355 25906 raft_consensus.cc:493] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.340674 25887 ts_tablet_manager.cc:1403] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.000s
I20260709 13:10:03.340842 25906 raft_consensus.cc:515] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.341792 25594 catalog_manager.cc:5697] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.343104 25906 leader_election.cc:290] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.343643 25887 raft_consensus.cc:359] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.343228 25594 catalog_manager.cc:5697] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.345194 25891 consensus_queue.cc:260] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.349047 25891 ts_tablet_manager.cc:1434] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.002s
I20260709 13:10:03.344523 25887 raft_consensus.cc:385] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.343986 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33696087fb5947139c0694d00532057c" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.349651 25887 raft_consensus.cc:740] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.349915 25772 raft_consensus.cc:2468] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:03.345166 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33696087fb5947139c0694d00532057c" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.350755 25886 tablet_bootstrap.cc:492] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:03.350504 25887 consensus_queue.cc:260] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
W20260709 13:10:03.352102 25661 leader_election.cc:343] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.352659 25891 tablet_bootstrap.cc:492] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:03.352664 25887 ts_tablet_manager.cc:1434] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:10:03.351234 25886 ts_tablet_manager.cc:1403] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.009s
I20260709 13:10:03.356936 25660 leader_election.cc:304] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:03.357812 25906 raft_consensus.cc:2804] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.358163 25906 raft_consensus.cc:493] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.358472 25906 raft_consensus.cc:3060] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.358449 25886 raft_consensus.cc:359] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.359231 25886 raft_consensus.cc:385] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.359539 25886 raft_consensus.cc:740] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.359978 25891 tablet_bootstrap.cc:654] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.360325 25886 consensus_queue.cc:260] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.362656 25886 ts_tablet_manager.cc:1434] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:10:03.364542 25892 raft_consensus.cc:493] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.365044 25892 raft_consensus.cc:515] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:03.367072 25892 leader_election.cc:290] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.368124 25906 raft_consensus.cc:515] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.370149 25906 leader_election.cc:290] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.371991 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.373772 25771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33696087fb5947139c0694d00532057c" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.373951 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.374455 25771 raft_consensus.cc:3060] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.374631 25846 raft_consensus.cc:2468] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:03.375873 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33696087fb5947139c0694d00532057c" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.376498 25845 raft_consensus.cc:3060] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.377749 25890 raft_consensus.cc:493] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.378216 25890 raft_consensus.cc:515] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
W20260709 13:10:03.379740 25660 leader_election.cc:343] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.380185 25890 leader_election.cc:290] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.382085 25771 raft_consensus.cc:2468] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:03.382414 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64714bfe2ce54fabba82353a5f20d76c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.383297 25660 leader_election.cc:304] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.382454 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64714bfe2ce54fabba82353a5f20d76c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
W20260709 13:10:03.383831 25809 leader_election.cc:343] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.384188 25906 raft_consensus.cc:2804] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.384377 25891 tablet_bootstrap.cc:492] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.384285 25697 raft_consensus.cc:2468] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:03.385047 25891 ts_tablet_manager.cc:1403] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.009s
I20260709 13:10:03.385528 25661 leader_election.cc:304] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.385708 25809 leader_election.cc:304] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.386511 25845 raft_consensus.cc:2468] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:03.386814 25890 raft_consensus.cc:2804] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.387200 25890 raft_consensus.cc:493] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.387538 25890 raft_consensus.cc:3060] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.387904 25891 raft_consensus.cc:359] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.388219 25892 raft_consensus.cc:2804] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.388605 25891 raft_consensus.cc:385] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.388759 25892 raft_consensus.cc:493] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.388947 25891 raft_consensus.cc:740] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.389209 25892 raft_consensus.cc:3060] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.389698 25891 consensus_queue.cc:260] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.391821 25891 ts_tablet_manager.cc:1434] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:10:03.385496 25906 raft_consensus.cc:697] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:03.392763 25891 tablet_bootstrap.cc:492] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:03.393498 25906 consensus_queue.cc:237] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.396404 25892 raft_consensus.cc:515] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:03.398578 25890 raft_consensus.cc:515] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.399247 25891 tablet_bootstrap.cc:654] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:03.399991 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.400871 25845 raft_consensus.cc:3060] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.401302 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64714bfe2ce54fabba82353a5f20d76c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.401906 25697 raft_consensus.cc:3060] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.406610 25892 leader_election.cc:290] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Requested vote from peers 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.408648 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.410838 25845 raft_consensus.cc:2468] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
W20260709 13:10:03.411070 25660 leader_election.cc:343] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:03.412130 25661 leader_election.cc:304] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.412564 25697 raft_consensus.cc:2468] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:03.413296 25892 raft_consensus.cc:2804] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.417342 25809 leader_election.cc:304] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.418447 25908 raft_consensus.cc:2804] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.418097 25592 catalog_manager.cc:5697] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.421231 25908 raft_consensus.cc:697] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:03.422160 25908 consensus_queue.cc:237] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.422796 25891 tablet_bootstrap.cc:492] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:03.423250 25891 ts_tablet_manager.cc:1403] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 13:10:03.425552 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64714bfe2ce54fabba82353a5f20d76c" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.426220 25772 raft_consensus.cc:3060] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.426251 25891 raft_consensus.cc:359] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:03.427491 25891 raft_consensus.cc:385] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:03.427876 25891 raft_consensus.cc:740] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:03.428961 25891 consensus_queue.cc:260] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:03.431636 25891 ts_tablet_manager.cc:1434] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:03.419929 25890 leader_election.cc:290] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:03.433727 25892 raft_consensus.cc:697] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:03.434661 25892 consensus_queue.cc:237] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:03.435521 25772 raft_consensus.cc:2468] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:03.438668 25592 catalog_manager.cc:5697] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:03.443313 25591 catalog_manager.cc:5697] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.482965 25892 raft_consensus.cc:493] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.483610 25892 raft_consensus.cc:515] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.485806 25892 leader_election.cc:290] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.486295 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed79066fd552484cb12055ab6db221e2" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:03.486440 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed79066fd552484cb12055ab6db221e2" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.486931 25772 raft_consensus.cc:2468] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:03.487179 25845 raft_consensus.cc:2468] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:03.487988 25660 leader_election.cc:304] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.488742 25892 raft_consensus.cc:2804] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:03.489063 25892 raft_consensus.cc:493] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:03.489327 25892 raft_consensus.cc:3060] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.494313 25892 raft_consensus.cc:515] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.495908 25892 leader_election.cc:290] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.496745 25772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed79066fd552484cb12055ab6db221e2" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.496891 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed79066fd552484cb12055ab6db221e2" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.497264 25772 raft_consensus.cc:3060] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.497447 25845 raft_consensus.cc:3060] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.503845 25772 raft_consensus.cc:2468] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:03.504081 25845 raft_consensus.cc:2468] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:03.505115 25660 leader_election.cc:304] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.506037 25892 raft_consensus.cc:2804] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:03.506533 25892 raft_consensus.cc:697] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:03.507397 25892 consensus_queue.cc:237] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.514524 25591 catalog_manager.cc:5697] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.602474 25772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
mode: GRACEFUL
new_leader_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:55908
I20260709 13:10:03.603039 25772 raft_consensus.cc:606] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Received request to transfer leadership to TS fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:03.614006 25918 raft_consensus.cc:493] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.614508 25918 raft_consensus.cc:515] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.616581 25918 leader_election.cc:290] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.617660 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.617666 25845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
mode: GRACEFUL
new_leader_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:44444
I20260709 13:10:03.618423 25697 raft_consensus.cc:2393] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ab39d435b314167b2e7c07a1a5aae0d in current term 1: Already voted for candidate 0d69a3beb260470ab4bf08a90883fa46 in this term.
I20260709 13:10:03.618494 25845 raft_consensus.cc:606] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Received request to transfer leadership to TS fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:03.619364 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.620821 25736 leader_election.cc:304] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:03.621574 25918 raft_consensus.cc:3060] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.628144 25918 raft_consensus.cc:2749] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.630373 25846 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86134bbb5306407895103c2b3670890c"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
mode: GRACEFUL
new_leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
 from {username='slave'} at 127.0.0.1:44444
I20260709 13:10:03.630875 25846 raft_consensus.cc:606] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Received request to transfer leadership to TS 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.635939 25890 consensus_queue.cc:1048] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.644304 25941 raft_consensus.cc:993] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: : Instructing follower fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:03.644737 25941 raft_consensus.cc:1081] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Signalling peer fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:03.646720 25696 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33696087fb5947139c0694d00532057c"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
mode: GRACEFUL
new_leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
 from {username='slave'} at 127.0.0.1:60692
I20260709 13:10:03.647331 25696 raft_consensus.cc:606] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Received request to transfer leadership to TS 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.647300 25695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:60664
I20260709 13:10:03.648489 25695 raft_consensus.cc:493] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.648897 25695 raft_consensus.cc:3060] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.654654 25772 raft_consensus.cc:3060] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.656034 25695 raft_consensus.cc:515] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.659130 25771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.662314 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07e385ee47a74cc39ec5287c16cfd98b" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.662957 25846 raft_consensus.cc:3055] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.663241 25846 raft_consensus.cc:740] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:03.664227 25846 consensus_queue.cc:260] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.665030 25846 raft_consensus.cc:3060] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:03.667562 25908 consensus_queue.cc:1175] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" responder_term: 1 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:03.661738 25695 leader_election.cc:290] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.670060 25846 raft_consensus.cc:2468] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:03.670989 25661 leader_election.cc:304] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:03.671712 25892 raft_consensus.cc:2804] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.672125 25892 raft_consensus.cc:697] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:03.672726 25892 consensus_queue.cc:237] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.678520 25592 catalog_manager.cc:5697] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 1 to 2, leader changed from 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3) to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.723860 25919 consensus_queue.cc:1048] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.726332 25919 consensus_queue.cc:1048] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.739014 25918 consensus_queue.cc:1048] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.753299 25954 consensus_queue.cc:1048] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.760092 25954 consensus_queue.cc:1048] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.772149 25895 consensus_queue.cc:1048] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.773820 25908 consensus_queue.cc:1048] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.785142 25927 raft_consensus.cc:993] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: : Instructing follower fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:03.785709 25927 raft_consensus.cc:1081] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Signalling peer fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:03.790079 25941 raft_consensus.cc:993] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: : Instructing follower 7ab39d435b314167b2e7c07a1a5aae0d to start an election
I20260709 13:10:03.790295 25695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:60676
I20260709 13:10:03.790406 25895 raft_consensus.cc:493] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:03.790606 25941 raft_consensus.cc:1081] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Signalling peer 7ab39d435b314167b2e7c07a1a5aae0d to start an election
I20260709 13:10:03.791072 25895 raft_consensus.cc:515] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:03.792629 25771 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86134bbb5306407895103c2b3670890c"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:10:03.793184 25771 raft_consensus.cc:493] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.793555 25771 raft_consensus.cc:3060] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.794468 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:03.795320 25845 raft_consensus.cc:2393] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7ab39d435b314167b2e7c07a1a5aae0d in current term 1: Already voted for candidate fc03370c02ef4a6baa8639f906396b8d in this term.
I20260709 13:10:03.797024 25895 leader_election.cc:290] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353), fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007)
I20260709 13:10:03.797642 25695 raft_consensus.cc:493] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.798062 25695 raft_consensus.cc:3060] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.801029 25771 raft_consensus.cc:515] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.803226 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:03.804894 25908 consensus_queue.cc:1048] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.805008 25695 raft_consensus.cc:515] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.803896 25941 consensus_queue.cc:1048] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.806219 25735 leader_election.cc:304] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:03.807000 25895 raft_consensus.cc:3060] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:03.808100 25770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:03.808699 25770 raft_consensus.cc:3055] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.809031 25770 raft_consensus.cc:740] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:03.809826 25770 consensus_queue.cc:260] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.811004 25770 raft_consensus.cc:3060] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.812796 25772 raft_consensus.cc:1240] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Rejecting Update request from peer 0d69a3beb260470ab4bf08a90883fa46 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:03.814596 25696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.817122 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86134bbb5306407895103c2b3670890c" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.817946 25845 raft_consensus.cc:3055] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.818308 25845 raft_consensus.cc:740] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:03.819113 25845 consensus_queue.cc:260] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.820544 25941 consensus_queue.cc:1059] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.820973 25895 raft_consensus.cc:2749] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:03.823480 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc8902a206ef4f5e867faa368e1323e9" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.824107 25846 raft_consensus.cc:3060] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.824047 25845 raft_consensus.cc:3060] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.825002 25770 raft_consensus.cc:2468] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:03.814767 25771 leader_election.cc:290] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 2 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.831332 25846 raft_consensus.cc:2468] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:03.832185 25660 leader_election.cc:304] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:03.832887 25845 raft_consensus.cc:2468] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 2.
I20260709 13:10:03.833312 25695 leader_election.cc:290] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.833983 25892 raft_consensus.cc:2804] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.834717 25892 raft_consensus.cc:697] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:03.835516 25892 consensus_queue.cc:237] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.834036 25736 leader_election.cc:304] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:03.836740 25895 raft_consensus.cc:2804] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.837369 25895 raft_consensus.cc:697] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:03.837919 25940 consensus_queue.cc:1048] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:03.838178 25895 consensus_queue.cc:237] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.851243 25594 catalog_manager.cc:5697] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 1 to 2, leader changed from 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2) to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.854038 25941 consensus_queue.cc:1048] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.856052 25940 raft_consensus.cc:993] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: : Instructing follower 7ab39d435b314167b2e7c07a1a5aae0d to start an election
I20260709 13:10:03.856554 25940 raft_consensus.cc:1081] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Signalling peer 7ab39d435b314167b2e7c07a1a5aae0d to start an election
I20260709 13:10:03.858114 25770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33696087fb5947139c0694d00532057c"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
 from {username='slave'} at 127.0.0.1:55902
I20260709 13:10:03.858623 25770 raft_consensus.cc:493] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:03.859001 25770 raft_consensus.cc:3060] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.863701 25892 consensus_queue.cc:1048] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.866333 25770 raft_consensus.cc:515] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.868458 25770 leader_election.cc:290] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 2 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:03.867758 25592 catalog_manager.cc:5697] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 1 to 2, leader changed from 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3) to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.869486 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33696087fb5947139c0694d00532057c" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:03.870190 25695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33696087fb5947139c0694d00532057c" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:03.871253 25695 raft_consensus.cc:3055] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:03.872635 25695 raft_consensus.cc:740] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:03.873493 25695 consensus_queue.cc:260] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.873955 25769 raft_consensus.cc:1240] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Rejecting Update request from peer fc03370c02ef4a6baa8639f906396b8d for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:03.874521 25695 raft_consensus.cc:3060] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:03.884761 25695 raft_consensus.cc:2468] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 2.
I20260709 13:10:03.885824 25735 leader_election.cc:304] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:03.886618 25895 raft_consensus.cc:2804] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:03.887131 25895 raft_consensus.cc:697] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:03.887966 25895 consensus_queue.cc:237] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:03.893841 25592 catalog_manager.cc:5697] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 1 to 2, leader changed from fc03370c02ef4a6baa8639f906396b8d (127.13.120.1) to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.911700 25892 consensus_queue.cc:1048] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.922092 25906 consensus_queue.cc:1048] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.954348 25906 consensus_queue.cc:1048] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:03.965992 25940 consensus_queue.cc:1048] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.066337 25846 raft_consensus.cc:1275] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.067600 25940 consensus_queue.cc:1048] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.075057 25769 raft_consensus.cc:3060] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.082949 25769 raft_consensus.cc:1275] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.084409 25906 consensus_queue.cc:1048] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:04.229817 25846 raft_consensus.cc:1275] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer 7ab39d435b314167b2e7c07a1a5aae0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.231043 25895 consensus_queue.cc:1048] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.238725 25695 raft_consensus.cc:3060] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.245432 25695 raft_consensus.cc:1275] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Refusing update from remote peer 7ab39d435b314167b2e7c07a1a5aae0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.246694 25895 consensus_queue.cc:1048] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.299192 25769 raft_consensus.cc:1275] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.300570 25906 consensus_queue.cc:1048] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.308364 25846 raft_consensus.cc:1275] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.309870 25892 consensus_queue.cc:1048] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.351385 25695 raft_consensus.cc:1275] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Refusing update from remote peer 7ab39d435b314167b2e7c07a1a5aae0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.352771 25895 consensus_queue.cc:1048] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:04.360551 25846 raft_consensus.cc:3060] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:04.367628 25846 raft_consensus.cc:1275] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer 7ab39d435b314167b2e7c07a1a5aae0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:04.368800 25954 consensus_queue.cc:1048] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.687301 25592 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33534:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:06.690274 25592 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:06.744834 25685 tablet_service.cc:1511] Processing CreateTablet for tablet 402dec792cd2493e8fe7a65b44c035b4 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:06.745946 25762 tablet_service.cc:1511] Processing CreateTablet for tablet 402dec792cd2493e8fe7a65b44c035b4 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:06.746773 25685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402dec792cd2493e8fe7a65b44c035b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.747781 25762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402dec792cd2493e8fe7a65b44c035b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.748728 25836 tablet_service.cc:1511] Processing CreateTablet for tablet 402dec792cd2493e8fe7a65b44c035b4 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:06.750416 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402dec792cd2493e8fe7a65b44c035b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.752878 25683 tablet_service.cc:1511] Processing CreateTablet for tablet e278ccaf1aff45bbaa054cca8e86eaca (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:06.754310 25683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e278ccaf1aff45bbaa054cca8e86eaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.759231 25756 tablet_service.cc:1511] Processing CreateTablet for tablet e278ccaf1aff45bbaa054cca8e86eaca (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:06.760710 25756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e278ccaf1aff45bbaa054cca8e86eaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.764632 25833 tablet_service.cc:1511] Processing CreateTablet for tablet e278ccaf1aff45bbaa054cca8e86eaca (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:06.766036 25833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e278ccaf1aff45bbaa054cca8e86eaca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.768663 25684 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4fc90567264d138499fe94f9f317ca (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:06.770069 25684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4fc90567264d138499fe94f9f317ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.772087 25687 tablet_service.cc:1511] Processing CreateTablet for tablet d99ad4fed40945d2b79710d8df3d6393 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:06.773444 25687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99ad4fed40945d2b79710d8df3d6393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.773077 25760 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4fc90567264d138499fe94f9f317ca (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:06.774506 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4fc90567264d138499fe94f9f317ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.776661 25686 tablet_service.cc:1511] Processing CreateTablet for tablet 170b8aabcdd040bc8893d655fed46036 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:06.777971 25686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170b8aabcdd040bc8893d655fed46036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.779619 25832 tablet_service.cc:1511] Processing CreateTablet for tablet d99ad4fed40945d2b79710d8df3d6393 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:06.780598 25755 tablet_service.cc:1511] Processing CreateTablet for tablet 170b8aabcdd040bc8893d655fed46036 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:06.781003 25832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99ad4fed40945d2b79710d8df3d6393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.781927 25755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170b8aabcdd040bc8893d655fed46036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.784785 25761 tablet_service.cc:1511] Processing CreateTablet for tablet d99ad4fed40945d2b79710d8df3d6393 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:06.786516 25761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d99ad4fed40945d2b79710d8df3d6393. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.790158 25682 tablet_service.cc:1511] Processing CreateTablet for tablet a16a9f5f0f4c45b2858da16cf60e488d (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:06.795089 25834 tablet_service.cc:1511] Processing CreateTablet for tablet 170b8aabcdd040bc8893d655fed46036 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:06.796772 25834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 170b8aabcdd040bc8893d655fed46036. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.763099 25835 tablet_service.cc:1511] Processing CreateTablet for tablet 0e4fc90567264d138499fe94f9f317ca (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:06.802359 25835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e4fc90567264d138499fe94f9f317ca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.804389 25682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16a9f5f0f4c45b2858da16cf60e488d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.818504 25759 tablet_service.cc:1511] Processing CreateTablet for tablet a16a9f5f0f4c45b2858da16cf60e488d (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:06.821331 25831 tablet_service.cc:1511] Processing CreateTablet for tablet a16a9f5f0f4c45b2858da16cf60e488d (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:06.822810 25831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16a9f5f0f4c45b2858da16cf60e488d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.824680 25681 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd457629d4844218f2011aeb0d24887 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:06.826139 25681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd457629d4844218f2011aeb0d24887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.828527 25757 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd457629d4844218f2011aeb0d24887 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:06.835606 25680 tablet_service.cc:1511] Processing CreateTablet for tablet a9fa3e2ea3594c68ae3b9ae3b2b91ff3 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:06.836969 25680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fa3e2ea3594c68ae3b9ae3b2b91ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.837311 25758 tablet_service.cc:1511] Processing CreateTablet for tablet a9fa3e2ea3594c68ae3b9ae3b2b91ff3 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:06.852952 25759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a16a9f5f0f4c45b2858da16cf60e488d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.853523 25830 tablet_service.cc:1511] Processing CreateTablet for tablet 2bd457629d4844218f2011aeb0d24887 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:06.854990 25830 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd457629d4844218f2011aeb0d24887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.858078 25758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fa3e2ea3594c68ae3b9ae3b2b91ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.862155 25757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2bd457629d4844218f2011aeb0d24887. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.864638 25983 tablet_bootstrap.cc:492] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:06.868156 25829 tablet_service.cc:1511] Processing CreateTablet for tablet a9fa3e2ea3594c68ae3b9ae3b2b91ff3 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:06.869925 25829 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9fa3e2ea3594c68ae3b9ae3b2b91ff3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.928772 25685 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc338f4e53247718d9caa03bf2d0ab3 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:06.930167 25685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc338f4e53247718d9caa03bf2d0ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.946067 25984 tablet_bootstrap.cc:492] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:06.945737 25760 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc338f4e53247718d9caa03bf2d0ab3 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:06.948115 25760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc338f4e53247718d9caa03bf2d0ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.952883 25836 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc338f4e53247718d9caa03bf2d0ab3 (DEFAULT_TABLE table=soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:06.957818 25836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc338f4e53247718d9caa03bf2d0ab3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.961180 25983 tablet_bootstrap.cc:654] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.977283 25984 tablet_bootstrap.cc:654] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:06.984997 25987 tablet_bootstrap.cc:492] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.021034 25983 tablet_bootstrap.cc:492] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.021745 25983 ts_tablet_manager.cc:1403] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.158s	user 0.017s	sys 0.033s
I20260709 13:10:07.022253 25987 tablet_bootstrap.cc:654] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.025355 25983 raft_consensus.cc:359] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.026743 25983 raft_consensus.cc:385] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.027143 25983 raft_consensus.cc:740] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.028456 25983 consensus_queue.cc:260] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.031510 25983 ts_tablet_manager.cc:1434] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.006s
I20260709 13:10:07.031898 25987 tablet_bootstrap.cc:492] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.032579 25983 tablet_bootstrap.cc:492] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.032439 25987 ts_tablet_manager.cc:1403] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.048s	user 0.006s	sys 0.011s
I20260709 13:10:07.033663 25984 tablet_bootstrap.cc:492] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.034215 25984 ts_tablet_manager.cc:1403] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.089s	user 0.007s	sys 0.013s
I20260709 13:10:07.036679 25987 raft_consensus.cc:359] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.037560 25987 raft_consensus.cc:385] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.037492 25984 raft_consensus.cc:359] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.038102 25987 raft_consensus.cc:740] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.038770 25984 raft_consensus.cc:385] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.039144 25984 raft_consensus.cc:740] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.039361 25987 consensus_queue.cc:260] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.039928 25984 consensus_queue.cc:260] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.041392 25987 ts_tablet_manager.cc:1434] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 13:10:07.040585 25983 tablet_bootstrap.cc:654] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.046639 25984 ts_tablet_manager.cc:1434] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:10:07.047701 25984 tablet_bootstrap.cc:492] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.060820 25987 tablet_bootstrap.cc:492] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.063086 25983 tablet_bootstrap.cc:492] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.063701 25983 ts_tablet_manager.cc:1403] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.014s
I20260709 13:10:07.066998 25983 raft_consensus.cc:359] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.067786 25983 raft_consensus.cc:385] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.068121 25983 raft_consensus.cc:740] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.069212 25987 tablet_bootstrap.cc:654] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.068994 25983 consensus_queue.cc:260] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.071652 25983 ts_tablet_manager.cc:1434] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:07.072836 25983 tablet_bootstrap.cc:492] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.072988 25984 tablet_bootstrap.cc:654] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.081306 25987 tablet_bootstrap.cc:492] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.081581 25983 tablet_bootstrap.cc:654] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.081947 25987 ts_tablet_manager.cc:1403] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:10:07.085567 25987 raft_consensus.cc:359] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.088133 25987 raft_consensus.cc:385] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.088598 25987 raft_consensus.cc:740] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.089537 25984 tablet_bootstrap.cc:492] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.090173 25984 ts_tablet_manager.cc:1403] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.012s
I20260709 13:10:07.089632 25987 consensus_queue.cc:260] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.093146 25987 ts_tablet_manager.cc:1434] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 13:10:07.093307 25984 raft_consensus.cc:359] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.094141 25984 raft_consensus.cc:385] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.094476 25984 raft_consensus.cc:740] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.094533 25987 tablet_bootstrap.cc:492] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.095463 25984 consensus_queue.cc:260] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.098196 25984 ts_tablet_manager.cc:1434] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:07.099226 25984 tablet_bootstrap.cc:492] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.101086 25983 tablet_bootstrap.cc:492] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.101691 25983 ts_tablet_manager.cc:1403] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.012s
I20260709 13:10:07.105254 25983 raft_consensus.cc:359] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.106122 25983 raft_consensus.cc:385] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.106257 25984 tablet_bootstrap.cc:654] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.106304 25987 tablet_bootstrap.cc:654] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.106797 25983 raft_consensus.cc:740] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.107822 25983 consensus_queue.cc:260] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.113297 25983 ts_tablet_manager.cc:1434] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 13:10:07.111313 25985 raft_consensus.cc:493] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.114405 25985 raft_consensus.cc:515] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.117516 25985 leader_election.cc:290] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.117811 25987 tablet_bootstrap.cc:492] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.118798 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:07.124178 25845 raft_consensus.cc:2468] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.124272 25987 ts_tablet_manager.cc:1403] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.012s
I20260709 13:10:07.119360 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.125260 25697 raft_consensus.cc:2468] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.125481 25736 leader_election.cc:304] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:07.120339 25892 raft_consensus.cc:493] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.120999 25983 tablet_bootstrap.cc:492] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.127372 25892 raft_consensus.cc:515] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.134644 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4fc90567264d138499fe94f9f317ca" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.135329 25769 raft_consensus.cc:2468] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:07.136165 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4fc90567264d138499fe94f9f317ca" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
W20260709 13:10:07.137796 25661 leader_election.cc:343] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.138973 25660 leader_election.cc:304] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:07.140199 25892 leader_election.cc:290] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.140151 25996 raft_consensus.cc:2804] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.140815 25996 raft_consensus.cc:493] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.141011 25983 tablet_bootstrap.cc:654] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.141198 25996 raft_consensus.cc:3060] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.141068 25985 raft_consensus.cc:2804] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.143266 25985 raft_consensus.cc:493] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.143676 25985 raft_consensus.cc:3060] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.144582 25987 raft_consensus.cc:359] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.145340 25987 raft_consensus.cc:385] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.145638 25987 raft_consensus.cc:740] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.146391 25987 consensus_queue.cc:260] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.149703 25996 raft_consensus.cc:515] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.150493 25987 ts_tablet_manager.cc:1434] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.003s
I20260709 13:10:07.152065 25996 leader_election.cc:290] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.153012 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4fc90567264d138499fe94f9f317ca" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:07.154369 25769 raft_consensus.cc:3060] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.154688 25987 tablet_bootstrap.cc:492] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.158126 25985 raft_consensus.cc:515] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.153332 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4fc90567264d138499fe94f9f317ca" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
W20260709 13:10:07.160372 25661 leader_election.cc:343] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.161790 25985 leader_election.cc:290] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.162200 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:07.162801 25697 raft_consensus.cc:3060] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.163059 25769 raft_consensus.cc:2468] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:07.164414 25660 leader_election.cc:304] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:07.164535 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:07.165206 25846 raft_consensus.cc:3060] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.165588 25996 raft_consensus.cc:2804] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.165747 25987 tablet_bootstrap.cc:654] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.166158 25996 raft_consensus.cc:697] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:07.167553 25996 consensus_queue.cc:237] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.172675 25983 tablet_bootstrap.cc:492] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.173241 25983 ts_tablet_manager.cc:1403] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.004s
I20260709 13:10:07.175503 25846 raft_consensus.cc:2468] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.176527 25697 raft_consensus.cc:2468] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.176846 25736 leader_election.cc:304] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:07.177872 25985 raft_consensus.cc:2804] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.178622 25985 raft_consensus.cc:697] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:07.180239 25985 consensus_queue.cc:237] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.185120 25987 tablet_bootstrap.cc:492] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.185711 25987 ts_tablet_manager.cc:1403] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 13:10:07.188019 25987 raft_consensus.cc:359] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.188665 25987 raft_consensus.cc:385] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.188853 25987 raft_consensus.cc:740] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.189450 25987 consensus_queue.cc:260] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.191233 25987 ts_tablet_manager.cc:1434] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:10:07.190968 25983 raft_consensus.cc:359] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.192350 25987 tablet_bootstrap.cc:492] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.197319 25983 raft_consensus.cc:385] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.197868 25983 raft_consensus.cc:740] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.198904 25983 consensus_queue.cc:260] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.202584 25984 tablet_bootstrap.cc:492] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.202811 25983 ts_tablet_manager.cc:1434] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 13:10:07.203164 25984 ts_tablet_manager.cc:1403] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.104s	user 0.017s	sys 0.021s
I20260709 13:10:07.205868 25987 tablet_bootstrap.cc:654] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.207289 25984 raft_consensus.cc:359] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.208526 25984 raft_consensus.cc:385] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.209000 25984 raft_consensus.cc:740] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.210197 25984 consensus_queue.cc:260] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.214200 25984 ts_tablet_manager.cc:1434] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:10:07.215335 25984 tablet_bootstrap.cc:492] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.212168 25983 tablet_bootstrap.cc:492] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.213004 25593 catalog_manager.cc:5697] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.233096 25594 catalog_manager.cc:5697] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.240715 25984 tablet_bootstrap.cc:654] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.242842 25983 tablet_bootstrap.cc:654] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:07.248732 25643 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:07.251356 25983 tablet_bootstrap.cc:492] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.251966 25983 ts_tablet_manager.cc:1403] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.003s
I20260709 13:10:07.254515 25987 tablet_bootstrap.cc:492] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.254529 25984 tablet_bootstrap.cc:492] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.255349 25987 ts_tablet_manager.cc:1403] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.063s	user 0.028s	sys 0.028s
I20260709 13:10:07.254983 25983 raft_consensus.cc:359] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.255954 25983 raft_consensus.cc:385] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.256320 25983 raft_consensus.cc:740] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.255349 25984 ts_tablet_manager.cc:1403] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.000s
I20260709 13:10:07.257062 25983 consensus_queue.cc:260] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.258666 25987 raft_consensus.cc:359] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.259513 25987 raft_consensus.cc:385] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.259598 25983 ts_tablet_manager.cc:1434] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:07.260079 25987 raft_consensus.cc:740] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.260915 25983 tablet_bootstrap.cc:492] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.260687 25984 raft_consensus.cc:359] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.261469 25984 raft_consensus.cc:385] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.261116 25987 consensus_queue.cc:260] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.261814 25984 raft_consensus.cc:740] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.263162 25984 consensus_queue.cc:260] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.265194 25987 ts_tablet_manager.cc:1434] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:07.265456 25984 ts_tablet_manager.cc:1434] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:07.266321 25987 tablet_bootstrap.cc:492] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.266850 25984 tablet_bootstrap.cc:492] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.273988 25987 tablet_bootstrap.cc:654] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.273983 25984 tablet_bootstrap.cc:654] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.274778 25941 raft_consensus.cc:493] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.275348 25941 raft_consensus.cc:515] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.277639 25941 leader_election.cc:290] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.278622 25983 tablet_bootstrap.cc:654] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.280593 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.281262 25697 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:07.282569 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.283408 25769 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:07.286967 25984 tablet_bootstrap.cc:492] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.287480 25987 tablet_bootstrap.cc:492] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.287567 25984 ts_tablet_manager.cc:1403] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.011s
I20260709 13:10:07.288074 25987 ts_tablet_manager.cc:1403] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260709 13:10:07.290848 25984 raft_consensus.cc:359] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.291119 25987 raft_consensus.cc:359] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.291710 25984 raft_consensus.cc:385] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.291952 25987 raft_consensus.cc:385] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.292152 25984 raft_consensus.cc:740] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.292367 25987 raft_consensus.cc:740] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.292986 25984 consensus_queue.cc:260] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.293323 25987 consensus_queue.cc:260] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.295383 25984 ts_tablet_manager.cc:1434] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:07.295991 25987 ts_tablet_manager.cc:1434] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:07.296429 25984 tablet_bootstrap.cc:492] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.297062 25987 tablet_bootstrap.cc:492] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.304843 25987 tablet_bootstrap.cc:654] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.308792 25984 tablet_bootstrap.cc:654] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.291736 25809 leader_election.cc:304] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.311653 25941 raft_consensus.cc:2804] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.312078 25941 raft_consensus.cc:493] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.312461 25941 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.322038 25984 tablet_bootstrap.cc:492] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.322564 25984 ts_tablet_manager.cc:1403] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.006s
I20260709 13:10:07.323324 25987 tablet_bootstrap.cc:492] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.323909 25987 ts_tablet_manager.cc:1403] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260709 13:10:07.325625 25984 raft_consensus.cc:359] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.326524 25984 raft_consensus.cc:385] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.326889 25984 raft_consensus.cc:740] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.326864 25987 raft_consensus.cc:359] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.327749 25987 raft_consensus.cc:385] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.328135 25987 raft_consensus.cc:740] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.327915 25984 consensus_queue.cc:260] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.328939 25987 consensus_queue.cc:260] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.330541 25984 ts_tablet_manager.cc:1434] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:07.331615 25984 tablet_bootstrap.cc:492] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.334611 25987 ts_tablet_manager.cc:1434] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260709 13:10:07.335740 25987 tablet_bootstrap.cc:492] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.338198 25984 tablet_bootstrap.cc:654] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.339090 25991 raft_consensus.cc:493] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.339610 25991 raft_consensus.cc:515] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.341710 25991 leader_election.cc:290] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.344115 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4fc90567264d138499fe94f9f317ca" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.344448 25987 tablet_bootstrap.cc:654] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.344295 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e4fc90567264d138499fe94f9f317ca" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.345158 25769 raft_consensus.cc:2393] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d69a3beb260470ab4bf08a90883fa46 in current term 1: Already voted for candidate fc03370c02ef4a6baa8639f906396b8d in this term.
I20260709 13:10:07.346450 25809 leader_election.cc:304] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46; no voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.347685 25991 raft_consensus.cc:3060] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.353268 25987 tablet_bootstrap.cc:492] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.353811 25987 ts_tablet_manager.cc:1403] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.010s
I20260709 13:10:07.353953 25941 raft_consensus.cc:515] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.355893 25991 raft_consensus.cc:2749] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.357203 25987 raft_consensus.cc:359] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.357776 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:07.358086 25987 raft_consensus.cc:385] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.358435 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:07.358573 25987 raft_consensus.cc:740] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.358657 25697 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.359141 25769 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.359537 25987 consensus_queue.cc:260] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.364794 25987 ts_tablet_manager.cc:1434] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:10:07.365739 25987 tablet_bootstrap.cc:492] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: Bootstrap starting.
I20260709 13:10:07.366271 25769 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:07.357189 25941 leader_election.cc:290] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.367722 25697 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:07.369318 25809 leader_election.cc:304] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:07.368175 25984 tablet_bootstrap.cc:492] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.370534 25941 raft_consensus.cc:2804] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.371104 25984 ts_tablet_manager.cc:1403] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.006s
I20260709 13:10:07.371632 25987 tablet_bootstrap.cc:654] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.371569 25941 raft_consensus.cc:697] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:07.372645 25941 consensus_queue.cc:237] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.374521 25984 raft_consensus.cc:359] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.375571 25984 raft_consensus.cc:385] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.376013 25983 tablet_bootstrap.cc:492] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.376029 25984 raft_consensus.cc:740] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.376940 25983 ts_tablet_manager.cc:1403] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.116s	user 0.018s	sys 0.039s
I20260709 13:10:07.377610 25984 consensus_queue.cc:260] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.380828 25984 ts_tablet_manager.cc:1434] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:10:07.380908 25983 raft_consensus.cc:359] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.381747 25983 raft_consensus.cc:385] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.382419 25984 tablet_bootstrap.cc:492] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.382087 25983 raft_consensus.cc:740] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.385608 25987 tablet_bootstrap.cc:492] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: No bootstrap required, opened a new log
I20260709 13:10:07.385150 25592 catalog_manager.cc:5697] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.386281 25987 ts_tablet_manager.cc:1403] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.010s
I20260709 13:10:07.388264 25983 consensus_queue.cc:260] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.389055 25987 raft_consensus.cc:359] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.389833 25987 raft_consensus.cc:385] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.390130 25987 raft_consensus.cc:740] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.390883 25987 consensus_queue.cc:260] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.391435 25983 ts_tablet_manager.cc:1434] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.014s	user 0.002s	sys 0.005s
I20260709 13:10:07.392722 25983 tablet_bootstrap.cc:492] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.395323 25987 ts_tablet_manager.cc:1434] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:07.396757 25991 raft_consensus.cc:493] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.397256 25991 raft_consensus.cc:515] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.399361 25991 leader_election.cc:290] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.399572 25941 raft_consensus.cc:493] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.401130 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.406579 25769 raft_consensus.cc:2468] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:07.402305 25984 tablet_bootstrap.cc:654] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.404049 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.407505 25697 raft_consensus.cc:2468] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:07.408242 25809 leader_election.cc:304] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:07.409148 25991 raft_consensus.cc:2804] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.409462 25991 raft_consensus.cc:493] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.409770 25991 raft_consensus.cc:3060] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.410347 25941 raft_consensus.cc:515] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.413512 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.415309 25983 tablet_bootstrap.cc:654] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:07.415223 25809 leader_election.cc:343] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.417161 25991 raft_consensus.cc:515] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.419692 25941 leader_election.cc:290] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.419727 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.420619 25769 raft_consensus.cc:2468] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 0.
I20260709 13:10:07.422926 25809 leader_election.cc:304] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.424998 25941 raft_consensus.cc:2804] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.425658 25941 raft_consensus.cc:493] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.426226 25941 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.428619 25991 leader_election.cc:290] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.429103 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:07.429814 25697 raft_consensus.cc:3060] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.433041 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:07.433821 25983 tablet_bootstrap.cc:492] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.433822 25769 raft_consensus.cc:3060] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.434545 25983 ts_tablet_manager.cc:1403] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.012s
I20260709 13:10:07.436808 25984 tablet_bootstrap.cc:492] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.437322 25984 ts_tablet_manager.cc:1403] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.004s
I20260709 13:10:07.437775 25983 raft_consensus.cc:359] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.438537 25983 raft_consensus.cc:385] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.438863 25983 raft_consensus.cc:740] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.438793 25941 raft_consensus.cc:515] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.439904 25983 consensus_queue.cc:260] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.440125 25984 raft_consensus.cc:359] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.440855 25984 raft_consensus.cc:385] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.443521 25984 raft_consensus.cc:740] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.443434 25770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:07.442333 25983 ts_tablet_manager.cc:1434] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:07.444411 25984 consensus_queue.cc:260] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.445293 25983 tablet_bootstrap.cc:492] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.449087 25984 ts_tablet_manager.cc:1434] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:10:07.442456 25695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:07.450359 25984 tablet_bootstrap.cc:492] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: Bootstrap starting.
I20260709 13:10:07.444201 25770 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.452003 25983 tablet_bootstrap.cc:654] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
W20260709 13:10:07.456429 25809 leader_election.cc:343] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.457340 25984 tablet_bootstrap.cc:654] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.463526 25985 raft_consensus.cc:493] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.465543 25770 raft_consensus.cc:2468] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:07.464134 25985 raft_consensus.cc:515] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.472198 25985 leader_election.cc:290] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.473948 25695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fa3e2ea3594c68ae3b9ae3b2b91ff3" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.443048 25941 leader_election.cc:290] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:07.476387 25769 raft_consensus.cc:2468] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
W20260709 13:10:07.476874 25735 leader_election.cc:343] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.477919 25809 leader_election.cc:304] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:07.478328 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fa3e2ea3594c68ae3b9ae3b2b91ff3" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:07.478982 25941 raft_consensus.cc:2804] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.479090 25846 raft_consensus.cc:2468] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.480340 25941 raft_consensus.cc:697] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:07.481307 25736 leader_election.cc:304] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.481395 25941 consensus_queue.cc:237] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.482772 25985 raft_consensus.cc:2804] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.483249 25985 raft_consensus.cc:493] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.483858 25985 raft_consensus.cc:3060] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.494196 25809 leader_election.cc:304] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.496047 25991 raft_consensus.cc:2804] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.497959 25991 raft_consensus.cc:697] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:07.499083 25991 consensus_queue.cc:237] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.469866 25697 raft_consensus.cc:2468] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 1.
I20260709 13:10:07.517637 25985 raft_consensus.cc:515] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.518812 25983 tablet_bootstrap.cc:492] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.519609 25983 ts_tablet_manager.cc:1403] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.039s
I20260709 13:10:07.523051 25983 raft_consensus.cc:359] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.528746 25983 raft_consensus.cc:385] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.529134 25983 raft_consensus.cc:740] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.530053 25983 consensus_queue.cc:260] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.532869 25983 ts_tablet_manager.cc:1434] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.003s
I20260709 13:10:07.534086 25983 tablet_bootstrap.cc:492] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: Bootstrap starting.
I20260709 13:10:07.544013 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fa3e2ea3594c68ae3b9ae3b2b91ff3" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
W20260709 13:10:07.545954 25735 leader_election.cc:343] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:07.547430 25985 leader_election.cc:290] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.548146 25983 tablet_bootstrap.cc:654] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:07.550108 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fa3e2ea3594c68ae3b9ae3b2b91ff3" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:07.550729 25846 raft_consensus.cc:3060] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.556998 25984 tablet_bootstrap.cc:492] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: No bootstrap required, opened a new log
I20260709 13:10:07.557567 25984 ts_tablet_manager.cc:1403] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: Time spent bootstrapping tablet: real 0.107s	user 0.039s	sys 0.045s
I20260709 13:10:07.560072 25984 raft_consensus.cc:359] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.560433 25846 raft_consensus.cc:2468] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.560799 25984 raft_consensus.cc:385] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.561148 25984 raft_consensus.cc:740] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.561992 25736 leader_election.cc:304] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.563199 25986 raft_consensus.cc:493] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.563278 25996 raft_consensus.cc:493] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.563421 25594 catalog_manager.cc:5697] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.563786 25986 raft_consensus.cc:515] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.563910 25996 raft_consensus.cc:515] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.569157 25996 leader_election.cc:290] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.569418 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:07.571084 25984 consensus_queue.cc:260] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.571991 25845 raft_consensus.cc:2468] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:07.573729 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99ad4fed40945d2b79710d8df3d6393" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.574460 25697 raft_consensus.cc:2468] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.576311 25984 ts_tablet_manager.cc:1434] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 13:10:07.576984 25770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.577644 26023 raft_consensus.cc:2804] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.577769 25770 raft_consensus.cc:2468] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 0.
I20260709 13:10:07.578685 25986 leader_election.cc:290] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.577639 25661 leader_election.cc:304] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.580336 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99ad4fed40945d2b79710d8df3d6393" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:07.583005 25845 raft_consensus.cc:2468] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.583827 25996 raft_consensus.cc:2804] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.584220 25996 raft_consensus.cc:493] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.584709 25996 raft_consensus.cc:3060] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.586462 25892 consensus_queue.cc:1048] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.580775 25735 leader_election.cc:304] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.588877 25986 raft_consensus.cc:2804] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.593325 25986 raft_consensus.cc:493] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.594249 25986 raft_consensus.cc:3060] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.599640 25983 tablet_bootstrap.cc:492] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: No bootstrap required, opened a new log
I20260709 13:10:07.599560 26023 raft_consensus.cc:697] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:07.600714 26023 consensus_queue.cc:237] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.602038 25983 ts_tablet_manager.cc:1403] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.004s
I20260709 13:10:07.605019 25985 consensus_queue.cc:1048] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.606943 25996 raft_consensus.cc:515] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.607074 25983 raft_consensus.cc:359] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.611541 25983 raft_consensus.cc:385] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:07.611925 25983 raft_consensus.cc:740] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Initialized, Role: FOLLOWER
I20260709 13:10:07.612703 25983 consensus_queue.cc:260] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.613480 25770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:07.615692 25770 raft_consensus.cc:3060] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.617381 25996 leader_election.cc:290] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.619129 25983 ts_tablet_manager.cc:1434] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.003s
I20260709 13:10:07.619256 25844 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:07.620076 25844 raft_consensus.cc:3060] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.626242 25986 raft_consensus.cc:515] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.630232 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99ad4fed40945d2b79710d8df3d6393" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:07.630949 25697 raft_consensus.cc:3060] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.641326 25697 raft_consensus.cc:2468] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.643507 25843 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d99ad4fed40945d2b79710d8df3d6393" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:07.644687 25843 raft_consensus.cc:3060] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.645656 25892 consensus_queue.cc:1048] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.650573 25770 raft_consensus.cc:2468] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:07.652133 25660 leader_election.cc:304] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.654096 25843 raft_consensus.cc:2468] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.644053 25986 leader_election.cc:290] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.656957 25844 raft_consensus.cc:2468] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 1.
I20260709 13:10:07.655683 25735 leader_election.cc:304] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.663781 26023 raft_consensus.cc:2804] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.665207 26023 raft_consensus.cc:697] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:07.653426 25594 catalog_manager.cc:5697] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.659335 25892 raft_consensus.cc:2804] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.666743 25892 raft_consensus.cc:697] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:07.667179 26023 consensus_queue.cc:237] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.667870 25892 consensus_queue.cc:237] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.686950 25986 consensus_queue.cc:1048] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.693709 25591 catalog_manager.cc:5697] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 0 to 1, leader changed from <none> to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 1 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.698177 25592 catalog_manager.cc:5697] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.700029 25592 catalog_manager.cc:5697] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.708225 26023 raft_consensus.cc:493] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.708746 26023 raft_consensus.cc:515] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.710809 26023 leader_election.cc:290] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.711963 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd457629d4844218f2011aeb0d24887" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:07.712291 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd457629d4844218f2011aeb0d24887" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d" is_pre_election: true
I20260709 13:10:07.712687 25845 raft_consensus.cc:2468] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.713016 25697 raft_consensus.cc:2468] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 0.
I20260709 13:10:07.713966 25736 leader_election.cc:304] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:07.714766 26023 raft_consensus.cc:2804] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:07.715077 26023 raft_consensus.cc:493] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:07.715365 26023 raft_consensus.cc:3060] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.722929 26023 raft_consensus.cc:515] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.725508 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd457629d4844218f2011aeb0d24887" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:07.726106 25697 raft_consensus.cc:3060] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.728339 26023 leader_election.cc:290] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.729377 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2bd457629d4844218f2011aeb0d24887" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:07.730046 25845 raft_consensus.cc:3060] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.732923 25697 raft_consensus.cc:2468] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.734053 25735 leader_election.cc:304] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.734871 26023 raft_consensus.cc:2804] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:07.735297 26023 raft_consensus.cc:697] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:07.736019 26023 consensus_queue.cc:237] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.736768 25845 raft_consensus.cc:2468] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 1.
I20260709 13:10:07.743113 25594 catalog_manager.cc:5697] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 0 to 1, leader changed from <none> to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 1 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.783025 25941 consensus_queue.cc:1048] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.795651 26041 consensus_queue.cc:1048] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.883113 25845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
mode: GRACEFUL
new_leader_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:44444
I20260709 13:10:07.883749 25845 raft_consensus.cc:606] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Received request to transfer leadership to TS fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.888183 25845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
mode: GRACEFUL
new_leader_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:44444
I20260709 13:10:07.888635 25845 raft_consensus.cc:606] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Received request to transfer leadership to TS fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.895215 25769 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
mode: GRACEFUL
new_leader_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:55908
I20260709 13:10:07.895720 25769 raft_consensus.cc:606] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Received request to transfer leadership to TS fc03370c02ef4a6baa8639f906396b8d
I20260709 13:10:07.902712 25845 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
mode: GRACEFUL
new_leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
 from {username='slave'} at 127.0.0.1:44444
I20260709 13:10:07.903185 25845 raft_consensus.cc:606] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Received request to transfer leadership to TS 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:07.912551 25697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
mode: GRACEFUL
new_leader_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:60692
I20260709 13:10:07.913031 25697 raft_consensus.cc:606] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Received request to transfer leadership to TS 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:07.921144 26041 consensus_queue.cc:1048] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.933095 26041 consensus_queue.cc:1048] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.940107 25991 raft_consensus.cc:993] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: : Instructing follower fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:07.940586 26041 raft_consensus.cc:1081] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Signalling peer fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:07.942073 25697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:60664
I20260709 13:10:07.942571 25697 raft_consensus.cc:493] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.942873 25697 raft_consensus.cc:3060] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.947834 25697 raft_consensus.cc:515] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.949445 25697 leader_election.cc:290] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.950281 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:07.950850 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e278ccaf1aff45bbaa054cca8e86eaca" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:07.950915 25769 raft_consensus.cc:3060] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.951596 25845 raft_consensus.cc:3055] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:07.951936 25845 raft_consensus.cc:740] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:07.952714 25845 consensus_queue.cc:260] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.953172 25892 raft_consensus.cc:493] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:07.953717 25892 raft_consensus.cc:515] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.954047 25845 raft_consensus.cc:3060] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:07.955796 25892 leader_election.cc:290] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:07.956465 25770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fa3e2ea3594c68ae3b9ae3b2b91ff3" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" is_pre_election: true
I20260709 13:10:07.957329 25846 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9fa3e2ea3594c68ae3b9ae3b2b91ff3" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d69a3beb260470ab4bf08a90883fa46" is_pre_election: true
I20260709 13:10:07.958041 25846 raft_consensus.cc:2393] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fc03370c02ef4a6baa8639f906396b8d in current term 1: Already voted for candidate 7ab39d435b314167b2e7c07a1a5aae0d in this term.
I20260709 13:10:07.958266 25769 raft_consensus.cc:2468] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:07.959020 25661 leader_election.cc:304] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fc03370c02ef4a6baa8639f906396b8d; no voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d
I20260709 13:10:07.959499 25660 leader_election.cc:304] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:07.959969 25892 raft_consensus.cc:3060] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.960402 26032 raft_consensus.cc:2804] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:07.960894 26032 raft_consensus.cc:697] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:07.961483 25845 raft_consensus.cc:2468] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:07.961745 26032 consensus_queue.cc:237] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:07.965903 25697 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:07.966734 25892 raft_consensus.cc:2749] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:07.971015 25591 catalog_manager.cc:5697] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 1 to 2, leader changed from 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3) to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:07.973258 26041 consensus_queue.cc:1048] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:07.984088 26020 consensus_queue.cc:1048] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:07.995102 25941 raft_consensus.cc:993] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: : Instructing follower 7ab39d435b314167b2e7c07a1a5aae0d to start an election
I20260709 13:10:07.995621 26020 raft_consensus.cc:1081] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Signalling peer 7ab39d435b314167b2e7c07a1a5aae0d to start an election
I20260709 13:10:07.997071 25769 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
 from {username='slave'} at 127.0.0.1:55900
I20260709 13:10:07.997699 25769 raft_consensus.cc:493] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:07.998063 25769 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.003131 25769 raft_consensus.cc:515] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.005640 25769 leader_election.cc:290] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 2 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:08.005880 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:08.006194 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:08.006810 25697 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.007151 25845 raft_consensus.cc:3055] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.007472 25845 raft_consensus.cc:740] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:08.008164 25845 consensus_queue.cc:260] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.009167 25845 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.011655 25697 raft_consensus.cc:2468] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 2.
I20260709 13:10:08.012655 25735 leader_election.cc:304] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:08.013434 26023 raft_consensus.cc:2804] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.013871 26023 raft_consensus.cc:697] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Becoming Leader. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:08.014650 26023 consensus_queue.cc:237] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.014876 25845 raft_consensus.cc:2468] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ab39d435b314167b2e7c07a1a5aae0d in term 2.
I20260709 13:10:08.020984 25594 catalog_manager.cc:5697] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d reported cstate change: term changed from 1 to 2, leader changed from 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3) to 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2). New cstate: current_term: 2 leader_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.130687 26023 consensus_queue.cc:1048] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.140411 26025 consensus_queue.cc:1048] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.148147 26025 consensus_queue.cc:1048] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.160691 26023 consensus_queue.cc:1048] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.214780 26025 raft_consensus.cc:993] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: : Instructing follower fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:08.215327 26023 raft_consensus.cc:1081] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Signalling peer fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:08.216867 25695 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:60676
I20260709 13:10:08.217347 25695 raft_consensus.cc:493] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.217660 25695 raft_consensus.cc:3060] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.223008 25695 raft_consensus.cc:515] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.224556 25695 leader_election.cc:290] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:08.225466 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:08.225529 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "170b8aabcdd040bc8893d655fed46036" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:08.226087 25769 raft_consensus.cc:3055] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.226225 25845 raft_consensus.cc:3060] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.226398 25769 raft_consensus.cc:740] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:08.227239 25769 consensus_queue.cc:260] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.228238 25769 raft_consensus.cc:3060] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.231231 25845 raft_consensus.cc:2468] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:08.232300 25661 leader_election.cc:304] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:08.232968 25892 raft_consensus.cc:2804] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.233322 25892 raft_consensus.cc:697] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:08.233572 25769 raft_consensus.cc:2468] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:08.233953 25892 consensus_queue.cc:237] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.241942 25592 catalog_manager.cc:5697] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 1 to 2, leader changed from 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2) to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.242941 25996 consensus_queue.cc:1048] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.247916 26023 consensus_queue.cc:1048] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.259701 26032 consensus_queue.cc:1048] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.283653 25986 consensus_queue.cc:1048] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:08.293883 25892 raft_consensus.cc:993] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: : Instructing follower 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:08.294370 26032 raft_consensus.cc:1081] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Signalling peer 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:08.295996 25845 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:10:08.296516 25845 raft_consensus.cc:493] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.296875 25845 raft_consensus.cc:3060] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.303367 25845 raft_consensus.cc:515] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.306815 25695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:08.307066 25941 raft_consensus.cc:993] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: : Instructing follower fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:08.307447 25695 raft_consensus.cc:3055] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.307632 25941 raft_consensus.cc:1081] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Signalling peer fc03370c02ef4a6baa8639f906396b8d to start an election
I20260709 13:10:08.307813 25695 raft_consensus.cc:740] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:08.308734 25695 consensus_queue.cc:260] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.309337 25697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
 from {username='slave'} at 127.0.0.1:60664
I20260709 13:10:08.309824 25695 raft_consensus.cc:3060] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.309888 25697 raft_consensus.cc:493] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:08.310319 25697 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.315654 25845 leader_election.cc:290] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 2 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:08.315831 25697 raft_consensus.cc:515] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.316663 25769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc338f4e53247718d9caa03bf2d0ab3" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:08.316704 25695 raft_consensus.cc:2468] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 2.
I20260709 13:10:08.317348 25769 raft_consensus.cc:3060] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.318341 25770 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:08.318881 25770 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.319366 25845 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "fc03370c02ef4a6baa8639f906396b8d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
I20260709 13:10:08.319948 25845 raft_consensus.cc:3055] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:08.320231 25845 raft_consensus.cc:740] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:08.320952 25845 consensus_queue.cc:260] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.322000 25845 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:08.323702 25769 raft_consensus.cc:2468] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 2.
I20260709 13:10:08.324314 25770 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:08.324795 25809 leader_election.cc:304] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:08.325345 25660 leader_election.cc:304] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ab39d435b314167b2e7c07a1a5aae0d, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:08.325639 26020 raft_consensus.cc:2804] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.326113 26020 raft_consensus.cc:697] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:08.326185 26032 raft_consensus.cc:2804] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:08.326741 26032 raft_consensus.cc:697] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Becoming Leader. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:08.326736 26020 consensus_queue.cc:237] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.327674 26032 consensus_queue.cc:237] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:08.328589 25845 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc03370c02ef4a6baa8639f906396b8d in term 2.
I20260709 13:10:08.318866 25697 leader_election.cc:290] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [CANDIDATE]: Term 2 election: Requested vote from peers 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461), 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3:41353)
I20260709 13:10:08.334388 25592 catalog_manager.cc:5697] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 1 to 2, leader changed from fc03370c02ef4a6baa8639f906396b8d (127.13.120.1) to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 2 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.337961 25591 catalog_manager.cc:5697] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d reported cstate change: term changed from 1 to 2, leader changed from 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3) to fc03370c02ef4a6baa8639f906396b8d (127.13.120.1). New cstate: current_term: 2 leader_uuid: "fc03370c02ef4a6baa8639f906396b8d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:08.346151 25845 raft_consensus.cc:1275] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.347357 26032 consensus_queue.cc:1048] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.353950 25770 raft_consensus.cc:1275] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.355309 25996 consensus_queue.cc:1048] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.549583 25845 raft_consensus.cc:1275] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer 7ab39d435b314167b2e7c07a1a5aae0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.550647 25986 consensus_queue.cc:1048] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.557830 25695 raft_consensus.cc:1275] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Refusing update from remote peer 7ab39d435b314167b2e7c07a1a5aae0d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.559455 26023 consensus_queue.cc:1048] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.682159 25845 raft_consensus.cc:1275] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.683429 25996 consensus_queue.cc:1048] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.690861 25770 raft_consensus.cc:1275] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.692731 26032 consensus_queue.cc:1048] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.721632 25770 raft_consensus.cc:1275] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.722870 25996 consensus_queue.cc:1048] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.729772 25845 raft_consensus.cc:1275] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Refusing update from remote peer fc03370c02ef4a6baa8639f906396b8d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.731252 25996 consensus_queue.cc:1048] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.858938 25695 raft_consensus.cc:1275] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.860275 25941 consensus_queue.cc:1048] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:08.863730 25770 raft_consensus.cc:1275] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:08.868285 26057 consensus_queue.cc:1048] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:10.916441 25591 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33534:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:10.936750 25591 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:33534:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:10.977900 13792 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:11.088055 26090 tablet.cc:1724] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:11.177660 25660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.2:35461, user_credentials={real_user=slave}} blocked reactor thread for 56778.1us
I20260709 13:10:11.214663 26097 tablet.cc:1724] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:11.249995 25872 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:5bc338f4e53247718d9caa03bf2d0ab3)
W20260709 13:10:11.296023 26103 log.cc:927] Time spent T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:10:11.299427 25872 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:5bc338f4e53247718d9caa03bf2d0ab3)
W20260709 13:10:11.316375 25872 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:5bc338f4e53247718d9caa03bf2d0ab3)
I20260709 13:10:11.344460 25694 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
mode: GRACEFUL
new_leader_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:53174
W20260709 13:10:11.387759 25736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:41353, user_credentials={real_user=slave}} blocked reactor thread for 74391.4us
I20260709 13:10:11.391630 25694 raft_consensus.cc:606] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Received request to transfer leadership to TS 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:11.421814 26090 tablet.cc:1724] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.448297 26119 tablet.cc:1724] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.452004 26121 tablet.cc:1724] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:11.525568 25736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:41353, user_credentials={real_user=slave}} blocked reactor thread for 135300us
W20260709 13:10:11.522202 25661 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:41353, user_credentials={real_user=slave}} blocked reactor thread for 83715.7us
I20260709 13:10:11.532711 26128 tablet.cc:1724] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.531292 26130 tablet.cc:1724] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.567529 26133 tablet.cc:1724] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.577014 26088 raft_consensus.cc:993] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: : Instructing follower 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:11.542800 26125 tablet.cc:1724] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.577566 26088 raft_consensus.cc:1081] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Signalling peer 0d69a3beb260470ab4bf08a90883fa46 to start an election
W20260709 13:10:11.566295 25809 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:34007, user_credentials={real_user=slave}} blocked reactor thread for 100859us
I20260709 13:10:11.583799 26126 tablet.cc:1724] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.594898 25846 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:10:11.595886 25846 raft_consensus.cc:493] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.596412 25846 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.599954 26121 tablet.cc:1724] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.578536 26090 tablet.cc:1724] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.623288 26097 tablet.cc:1724] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:11.632543 26118 log.cc:927] Time spent T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:10:11.623219 26122 log.cc:927] Time spent T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:10:11.653427 26130 tablet.cc:1724] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.657960 25846 raft_consensus.cc:515] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:11.683454 25846 leader_election.cc:290] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 3 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
W20260709 13:10:11.685546 25736 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:41353, user_credentials={real_user=slave}} blocked reactor thread for 157423us
I20260709 13:10:11.689397 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:11.690065 25767 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.690572 25694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402dec792cd2493e8fe7a65b44c035b4" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:11.691473 25694 raft_consensus.cc:3055] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:11.691881 25694 raft_consensus.cc:740] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:11.698083 25767 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 3.
I20260709 13:10:11.708328 26133 tablet.cc:1724] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.710075 26135 tablet.cc:1724] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.708981 26138 tablet.cc:1724] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.714793 25809 leader_election.cc:304] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:11.715190 26125 tablet.cc:1724] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.716367 26086 raft_consensus.cc:2804] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:11.716873 26086 raft_consensus.cc:697] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 3 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:11.717630 26086 consensus_queue.cc:237] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:11.692910 25694 consensus_queue.cc:260] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:11.720710 25694 raft_consensus.cc:3060] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.735368 26119 tablet.cc:1724] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.736644 26097 tablet.cc:1724] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.750195 26126 tablet.cc:1724] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.752810 25771 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
mode: GRACEFUL
new_leader_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:60488
I20260709 13:10:11.754037 25771 raft_consensus.cc:606] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Received request to transfer leadership to TS 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:11.755455 25591 catalog_manager.cc:5697] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 2 to 3, leader changed from fc03370c02ef4a6baa8639f906396b8d (127.13.120.1) to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.757562 13792 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:10:11.746793 26090 tablet.cc:1724] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.767105 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:11.771229 26133 tablet.cc:1724] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.768478 26135 tablet.cc:1724] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.780747 26129 raft_consensus.cc:993] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: : Instructing follower 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:11.783646 26129 raft_consensus.cc:1081] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Signalling peer 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:11.785475 25841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:44416
I20260709 13:10:11.786116 25841 raft_consensus.cc:493] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.786528 25841 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.790004 25767 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15"
dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
mode: GRACEFUL
new_leader_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:60488
I20260709 13:10:11.790599 25767 raft_consensus.cc:606] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Received request to transfer leadership to TS 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:11.791970 26119 tablet.cc:1724] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.793426 26128 tablet.cc:1724] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:11.794472 25694 raft_consensus.cc:2468] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 3.
I20260709 13:10:11.795526 25697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ed635ba51d274fee9727087cc7600478"
dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
mode: GRACEFUL
new_leader_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:53174
I20260709 13:10:11.796059 25697 raft_consensus.cc:606] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Received request to transfer leadership to TS 0d69a3beb260470ab4bf08a90883fa46
I20260709 13:10:11.797569 25841 raft_consensus.cc:515] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:11.799989 25841 leader_election.cc:290] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 3 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:11.801391 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:11.801904 25767 raft_consensus.cc:3055] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:11.802281 25767 raft_consensus.cc:740] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:11.803097 25767 consensus_queue.cc:260] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:11.803821 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a16a9f5f0f4c45b2858da16cf60e488d" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:11.804256 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:11.804430 25767 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.804375 25697 raft_consensus.cc:3060] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:11.804883 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:11.815043 25767 raft_consensus.cc:2468] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 3.
I20260709 13:10:11.816542 25809 leader_election.cc:304] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:11.817514 26086 raft_consensus.cc:2804] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:11.817974 26086 raft_consensus.cc:697] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 3 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:11.818799 26086 consensus_queue.cc:237] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:11.820791 25697 raft_consensus.cc:2468] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 3.
I20260709 13:10:11.833498 25593 catalog_manager.cc:6242] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3: soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0] alter complete (version 1)
I20260709 13:10:11.845832 25593 catalog_manager.cc:5697] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 2 to 3, leader changed from 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2) to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:11.945184 26088 raft_consensus.cc:993] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: : Instructing follower 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:11.945757 26061 raft_consensus.cc:1081] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Signalling peer 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:11.947487 25841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ed635ba51d274fee9727087cc7600478"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:44428
I20260709 13:10:11.948069 25841 raft_consensus.cc:493] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:11.948508 25841 raft_consensus.cc:3060] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.953775 25841 raft_consensus.cc:515] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:11.955457 25841 leader_election.cc:290] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 2 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:11.956542 25767 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:11.956802 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed635ba51d274fee9727087cc7600478" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:11.957160 25767 raft_consensus.cc:3060] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.957387 25697 raft_consensus.cc:3055] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:11.957747 25697 raft_consensus.cc:740] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fc03370c02ef4a6baa8639f906396b8d, State: Running, Role: LEADER
I20260709 13:10:11.958559 25697 consensus_queue.cc:260] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:11.959730 25697 raft_consensus.cc:3060] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:11.963394 25767 raft_consensus.cc:2468] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 2.
I20260709 13:10:11.964556 25809 leader_election.cc:304] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, 7ab39d435b314167b2e7c07a1a5aae0d; no voters: 
I20260709 13:10:11.964903 25697 raft_consensus.cc:2468] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 2.
I20260709 13:10:11.965307 26086 raft_consensus.cc:2804] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:11.965806 26086 raft_consensus.cc:697] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:11.966588 26086 consensus_queue.cc:237] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } }
I20260709 13:10:11.973606 25593 catalog_manager.cc:5697] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 1 to 2, leader changed from fc03370c02ef4a6baa8639f906396b8d (127.13.120.1) to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 2 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.226856 25694 raft_consensus.cc:1275] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:12.228112 26086 consensus_queue.cc:1048] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:12.242074 25771 raft_consensus.cc:1275] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:12.252550 26136 consensus_queue.cc:1048] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:12.258383 26126 tablet.cc:1724] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:12.266253 25593 catalog_manager.cc:5789] TS 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461) does not have the latest schema for tablet 402dec792cd2493e8fe7a65b44c035b4 (table soft_deleted_table [id=3df6f21e0650459d884640f97d3897a0]). Expected version 1 got 0
I20260709 13:10:12.316500 25771 raft_consensus.cc:1275] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:12.317936 26136 consensus_queue.cc:1048] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:12.325876 25694 raft_consensus.cc:1275] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:12.327890 26136 consensus_queue.cc:1048] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:12.365664 26140 raft_consensus.cc:993] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: : Instructing follower 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:12.366122 26141 raft_consensus.cc:1081] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Signalling peer 0d69a3beb260470ab4bf08a90883fa46 to start an election
I20260709 13:10:12.367376 25841 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15"
dest_uuid: "0d69a3beb260470ab4bf08a90883fa46"
 from {username='slave'} at 127.0.0.1:44416
I20260709 13:10:12.367914 25841 raft_consensus.cc:493] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:12.368229 25841 raft_consensus.cc:3060] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.373230 25841 raft_consensus.cc:515] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:12.374972 25841 leader_election.cc:290] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 2 election: Requested vote from peers fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007), 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461)
I20260709 13:10:12.375813 25697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fc03370c02ef4a6baa8639f906396b8d"
I20260709 13:10:12.376107 25771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a715cac09f2a44a0b030498e94b41c15" candidate_uuid: "0d69a3beb260470ab4bf08a90883fa46" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7ab39d435b314167b2e7c07a1a5aae0d"
I20260709 13:10:12.376425 25697 raft_consensus.cc:3060] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.376796 25771 raft_consensus.cc:3055] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:12.377236 25771 raft_consensus.cc:740] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7ab39d435b314167b2e7c07a1a5aae0d, State: Running, Role: LEADER
I20260709 13:10:12.378031 25771 consensus_queue.cc:260] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:12.379045 25771 raft_consensus.cc:3060] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:12.381521 25697 raft_consensus.cc:2468] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 2.
I20260709 13:10:12.382464 25809 leader_election.cc:304] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d69a3beb260470ab4bf08a90883fa46, fc03370c02ef4a6baa8639f906396b8d; no voters: 
I20260709 13:10:12.383152 26136 raft_consensus.cc:2804] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:12.383561 26136 raft_consensus.cc:697] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 LEADER]: Becoming Leader. State: Replica: 0d69a3beb260470ab4bf08a90883fa46, State: Running, Role: LEADER
I20260709 13:10:12.384301 26136 consensus_queue.cc:237] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } }
I20260709 13:10:12.384608 25771 raft_consensus.cc:2468] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d69a3beb260470ab4bf08a90883fa46 in term 2.
I20260709 13:10:12.391738 25593 catalog_manager.cc:5697] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 reported cstate change: term changed from 1 to 2, leader changed from 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2) to 0d69a3beb260470ab4bf08a90883fa46 (127.13.120.3). New cstate: current_term: 2 leader_uuid: "0d69a3beb260470ab4bf08a90883fa46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d69a3beb260470ab4bf08a90883fa46" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 41353 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:12.398387 25697 raft_consensus.cc:1275] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.400005 26136 consensus_queue.cc:1048] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.410653 25771 raft_consensus.cc:1275] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.412163 26152 consensus_queue.cc:1048] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.823285 25771 raft_consensus.cc:1275] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.824775 26086 consensus_queue.cc:1048] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ab39d435b314167b2e7c07a1a5aae0d" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.836653 25697 raft_consensus.cc:1275] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Refusing update from remote peer 0d69a3beb260470ab4bf08a90883fa46: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.838739 26136 consensus_queue.cc:1048] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc03370c02ef4a6baa8639f906396b8d" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.875100 13792 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:10:12.879843 13792 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:10:12.880250 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:12.884948 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:10:12.885313 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:13.912024 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
I20260709 13:10:13.935889 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:13.936534 13792 tablet_replica.cc:333] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.937155 13792 raft_consensus.cc:2243] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.937637 13792 raft_consensus.cc:2272] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.939550 13792 tablet_replica.cc:333] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.940107 13792 raft_consensus.cc:2243] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.940526 13792 raft_consensus.cc:2272] T 2bd457629d4844218f2011aeb0d24887 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.942210 13792 tablet_replica.cc:333] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.942740 13792 raft_consensus.cc:2243] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:13.943567 13792 raft_consensus.cc:2272] T e278ccaf1aff45bbaa054cca8e86eaca P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.945308 13792 tablet_replica.cc:333] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.946012 13792 raft_consensus.cc:2243] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.946388 13792 raft_consensus.cc:2272] T 5bc338f4e53247718d9caa03bf2d0ab3 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.948004 13792 tablet_replica.cc:333] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.948460 13792 raft_consensus.cc:2243] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.948904 13792 raft_consensus.cc:2272] T d99ad4fed40945d2b79710d8df3d6393 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.950436 13792 tablet_replica.cc:333] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.950937 13792 raft_consensus.cc:2243] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:13.951833 13792 raft_consensus.cc:2272] T ed79066fd552484cb12055ab6db221e2 P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.954329 13792 tablet_replica.cc:333] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.955047 13792 raft_consensus.cc:2243] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:13.956082 13792 raft_consensus.cc:2272] T fc8902a206ef4f5e867faa368e1323e9 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:13.956280 25735 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 80 similar messages]
I20260709 13:10:13.958387 13792 tablet_replica.cc:333] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.959272 13792 raft_consensus.cc:2243] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:10:13.959295 25735 consensus_peers.cc:597] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:13.959864 13792 raft_consensus.cc:2272] T 64714bfe2ce54fabba82353a5f20d76c P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.961768 13792 tablet_replica.cc:333] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.962303 13792 raft_consensus.cc:2243] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.962715 13792 raft_consensus.cc:2272] T 86134bbb5306407895103c2b3670890c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.964715 13792 tablet_replica.cc:333] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.965246 13792 raft_consensus.cc:2243] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.965709 13792 raft_consensus.cc:2272] T a715cac09f2a44a0b030498e94b41c15 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.967566 13792 tablet_replica.cc:333] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.968078 13792 raft_consensus.cc:2243] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.968456 13792 raft_consensus.cc:2272] T a16a9f5f0f4c45b2858da16cf60e488d P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.970058 13792 tablet_replica.cc:333] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.970575 13792 raft_consensus.cc:2243] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.970965 13792 raft_consensus.cc:2272] T a6dee2f724734361ace92e3321a0db9a P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.973155 13792 tablet_replica.cc:333] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.973664 13792 raft_consensus.cc:2243] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.974086 13792 raft_consensus.cc:2272] T 402dec792cd2493e8fe7a65b44c035b4 P fc03370c02ef4a6baa8639f906396b8d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.975814 13792 tablet_replica.cc:333] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.976317 13792 raft_consensus.cc:2243] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.976752 13792 raft_consensus.cc:2272] T 33696087fb5947139c0694d00532057c P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.978703 13792 tablet_replica.cc:333] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.979214 13792 raft_consensus.cc:2243] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:13.979624 13792 raft_consensus.cc:2272] T ed635ba51d274fee9727087cc7600478 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.981479 13792 tablet_replica.cc:333] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.981954 13792 raft_consensus.cc:2243] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:13.982688 13792 raft_consensus.cc:2272] T 07e385ee47a74cc39ec5287c16cfd98b P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.984607 13792 tablet_replica.cc:333] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.985092 13792 raft_consensus.cc:2243] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:13.985775 13792 raft_consensus.cc:2272] T 170b8aabcdd040bc8893d655fed46036 P fc03370c02ef4a6baa8639f906396b8d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:13.987356 13792 tablet_replica.cc:333] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d: stopping tablet replica
I20260709 13:10:13.987808 13792 raft_consensus.cc:2243] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:13.988590 13792 raft_consensus.cc:2272] T 0e4fc90567264d138499fe94f9f317ca P fc03370c02ef4a6baa8639f906396b8d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:13.991992 25735 consensus_peers.cc:597] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:14.021454 25809 consensus_peers.cc:597] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:14.026394 25809 consensus_peers.cc:597] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:10:14.026569 25735 consensus_peers.cc:597] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.028786 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:10:14.057610 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
W20260709 13:10:14.064785 25809 consensus_peers.cc:597] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.090489 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:14.091226 13792 tablet_replica.cc:333] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.091885 13792 raft_consensus.cc:2243] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.092391 13792 raft_consensus.cc:2272] T e278ccaf1aff45bbaa054cca8e86eaca P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.094199 13792 tablet_replica.cc:333] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.094744 13792 raft_consensus.cc:2243] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.095543 13792 raft_consensus.cc:2272] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.097280 13792 tablet_replica.cc:333] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.097815 13792 raft_consensus.cc:2243] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.098300 13792 raft_consensus.cc:2272] T 5bc338f4e53247718d9caa03bf2d0ab3 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.100086 13792 tablet_replica.cc:333] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.100620 13792 raft_consensus.cc:2243] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.101333 13792 raft_consensus.cc:2272] T 2bd457629d4844218f2011aeb0d24887 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:14.101526 25809 consensus_peers.cc:597] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 -> Peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Couldn't send request to peer 7ab39d435b314167b2e7c07a1a5aae0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.103286 13792 tablet_replica.cc:333] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.104019 13792 raft_consensus.cc:2243] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.104456 13792 raft_consensus.cc:2272] T 0e4fc90567264d138499fe94f9f317ca P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:14.105268 25809 consensus_peers.cc:597] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 -> Peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Couldn't send request to peer 7ab39d435b314167b2e7c07a1a5aae0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.106205 13792 tablet_replica.cc:333] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.106817 13792 raft_consensus.cc:2243] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.107237 13792 raft_consensus.cc:2272] T 170b8aabcdd040bc8893d655fed46036 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.108948 13792 tablet_replica.cc:333] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.109475 13792 raft_consensus.cc:2243] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.110199 13792 raft_consensus.cc:2272] T d99ad4fed40945d2b79710d8df3d6393 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.111908 13792 tablet_replica.cc:333] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.112459 13792 raft_consensus.cc:2243] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.112870 13792 raft_consensus.cc:2272] T ed79066fd552484cb12055ab6db221e2 P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.114809 13792 tablet_replica.cc:333] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.115476 13792 raft_consensus.cc:2243] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.115902 13792 raft_consensus.cc:2272] T fc8902a206ef4f5e867faa368e1323e9 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.117792 13792 tablet_replica.cc:333] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.118330 13792 raft_consensus.cc:2243] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.118723 13792 raft_consensus.cc:2272] T 64714bfe2ce54fabba82353a5f20d76c P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.121114 13792 tablet_replica.cc:333] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.121626 13792 raft_consensus.cc:2243] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.122031 13792 raft_consensus.cc:2272] T ed635ba51d274fee9727087cc7600478 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:14.123665 25809 consensus_peers.cc:597] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 -> Peer 7ab39d435b314167b2e7c07a1a5aae0d (127.13.120.2:35461): Couldn't send request to peer 7ab39d435b314167b2e7c07a1a5aae0d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.124254 13792 tablet_replica.cc:333] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.124804 13792 raft_consensus.cc:2243] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.125167 13792 raft_consensus.cc:2272] T 402dec792cd2493e8fe7a65b44c035b4 P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.126802 13792 tablet_replica.cc:333] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.127244 13792 raft_consensus.cc:2243] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.127990 13792 raft_consensus.cc:2272] T 33696087fb5947139c0694d00532057c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.129899 13792 tablet_replica.cc:333] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.130338 13792 raft_consensus.cc:2243] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.130753 13792 raft_consensus.cc:2272] T 07e385ee47a74cc39ec5287c16cfd98b P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.132793 13792 tablet_replica.cc:333] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.133304 13792 raft_consensus.cc:2243] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.134060 13792 raft_consensus.cc:2272] T 86134bbb5306407895103c2b3670890c P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.136029 13792 tablet_replica.cc:333] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.136528 13792 raft_consensus.cc:2243] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.136929 13792 raft_consensus.cc:2272] T a715cac09f2a44a0b030498e94b41c15 P 7ab39d435b314167b2e7c07a1a5aae0d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.138724 13792 tablet_replica.cc:333] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.139192 13792 raft_consensus.cc:2243] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.139591 13792 raft_consensus.cc:2272] T a16a9f5f0f4c45b2858da16cf60e488d P 7ab39d435b314167b2e7c07a1a5aae0d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.141211 13792 tablet_replica.cc:333] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d: stopping tablet replica
I20260709 13:10:14.141676 13792 raft_consensus.cc:2243] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.142408 13792 raft_consensus.cc:2272] T a6dee2f724734361ace92e3321a0db9a P 7ab39d435b314167b2e7c07a1a5aae0d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:14.161530 25809 consensus_peers.cc:597] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.180830 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
I20260709 13:10:14.210379 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
W20260709 13:10:14.232350 25809 consensus_peers.cc:597] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 -> Peer fc03370c02ef4a6baa8639f906396b8d (127.13.120.1:34007): Couldn't send request to peer fc03370c02ef4a6baa8639f906396b8d. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:14.240994 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:14.241711 13792 tablet_replica.cc:333] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.242316 13792 raft_consensus.cc:2243] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.243080 13792 raft_consensus.cc:2272] T 5bc338f4e53247718d9caa03bf2d0ab3 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.244921 13792 tablet_replica.cc:333] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.245465 13792 raft_consensus.cc:2243] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.245889 13792 raft_consensus.cc:2272] T a9fa3e2ea3594c68ae3b9ae3b2b91ff3 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.247597 13792 tablet_replica.cc:333] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.248147 13792 raft_consensus.cc:2243] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.248546 13792 raft_consensus.cc:2272] T 2bd457629d4844218f2011aeb0d24887 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.250264 13792 tablet_replica.cc:333] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.250779 13792 raft_consensus.cc:2243] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.251191 13792 raft_consensus.cc:2272] T e278ccaf1aff45bbaa054cca8e86eaca P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.252813 13792 tablet_replica.cc:333] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.253328 13792 raft_consensus.cc:2243] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.253734 13792 raft_consensus.cc:2272] T 0e4fc90567264d138499fe94f9f317ca P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.255362 13792 tablet_replica.cc:333] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.255913 13792 raft_consensus.cc:2243] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.256314 13792 raft_consensus.cc:2272] T 170b8aabcdd040bc8893d655fed46036 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.257901 13792 tablet_replica.cc:333] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.258410 13792 raft_consensus.cc:2243] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.258812 13792 raft_consensus.cc:2272] T d99ad4fed40945d2b79710d8df3d6393 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.260739 13792 tablet_replica.cc:333] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.261214 13792 raft_consensus.cc:2243] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.261561 13792 raft_consensus.cc:2272] T ed79066fd552484cb12055ab6db221e2 P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.263338 13792 tablet_replica.cc:333] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.263846 13792 raft_consensus.cc:2243] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.264209 13792 raft_consensus.cc:2272] T fc8902a206ef4f5e867faa368e1323e9 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.266034 13792 tablet_replica.cc:333] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.266494 13792 raft_consensus.cc:2243] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.267189 13792 raft_consensus.cc:2272] T 64714bfe2ce54fabba82353a5f20d76c P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.268973 13792 tablet_replica.cc:333] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.269412 13792 raft_consensus.cc:2243] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.270073 13792 raft_consensus.cc:2272] T a16a9f5f0f4c45b2858da16cf60e488d P 0d69a3beb260470ab4bf08a90883fa46 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.271682 13792 tablet_replica.cc:333] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.272101 13792 raft_consensus.cc:2243] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.272441 13792 raft_consensus.cc:2272] T a6dee2f724734361ace92e3321a0db9a P 0d69a3beb260470ab4bf08a90883fa46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.274221 13792 tablet_replica.cc:333] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.274636 13792 raft_consensus.cc:2243] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.275032 13792 raft_consensus.cc:2272] T 86134bbb5306407895103c2b3670890c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.276885 13792 tablet_replica.cc:333] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.277326 13792 raft_consensus.cc:2243] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.277983 13792 raft_consensus.cc:2272] T a715cac09f2a44a0b030498e94b41c15 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.279707 13792 tablet_replica.cc:333] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.280131 13792 raft_consensus.cc:2243] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.280776 13792 raft_consensus.cc:2272] T 402dec792cd2493e8fe7a65b44c035b4 P 0d69a3beb260470ab4bf08a90883fa46 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.282334 13792 tablet_replica.cc:333] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.282747 13792 raft_consensus.cc:2243] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.283098 13792 raft_consensus.cc:2272] T 33696087fb5947139c0694d00532057c P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.284823 13792 tablet_replica.cc:333] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.285223 13792 raft_consensus.cc:2243] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.285591 13792 raft_consensus.cc:2272] T 07e385ee47a74cc39ec5287c16cfd98b P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.287391 13792 tablet_replica.cc:333] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46: stopping tablet replica
I20260709 13:10:14.287881 13792 raft_consensus.cc:2243] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.288542 13792 raft_consensus.cc:2272] T ed635ba51d274fee9727087cc7600478 P 0d69a3beb260470ab4bf08a90883fa46 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.326143 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
I20260709 13:10:14.355015 13792 master.cc:562] Master@127.13.120.62:42707 shutting down...
I20260709 13:10:14.377131 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:14.377701 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.378044 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P b03c2f96e62a406eae853972e58e2bc3: stopping tablet replica
I20260709 13:10:14.398546 13792 master.cc:584] Master@127.13.120.62:42707 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (12377 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:10:14.449867 13792 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.13.120.62:40273
I20260709 13:10:14.451063 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:14.456832 26166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.456914 26167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.457294 26169 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.458794 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:14.459796 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:14.459970 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:14.460173 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602614460140 us; error 0 us; skew 500 ppm
I20260709 13:10:14.460706 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:14.463028 13792 webserver.cc:533] Webserver started at http://127.13.120.62:32893/ using document root <none> and password file <none>
I20260709 13:10:14.464010 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:14.464210 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:14.464486 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:14.465549 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/master-0-root/instance:
uuid: "3dcb3f57feaf4f30b71e8db616ec366c"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.469811 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:10:14.473094 26174 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.473927 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:10:14.474231 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/master-0-root
uuid: "3dcb3f57feaf4f30b71e8db616ec366c"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.474510 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:14.498663 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:14.499996 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:14.538034 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.62:40273
I20260709 13:10:14.538163 26225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.62:40273 every 8 connection(s)
I20260709 13:10:14.541934 26226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:14.553320 26226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c: Bootstrap starting.
I20260709 13:10:14.558529 26226 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:14.563014 26226 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c: No bootstrap required, opened a new log
I20260709 13:10:14.565315 26226 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" member_type: VOTER }
I20260709 13:10:14.565714 26226 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:14.565908 26226 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dcb3f57feaf4f30b71e8db616ec366c, State: Initialized, Role: FOLLOWER
I20260709 13:10:14.566440 26226 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" member_type: VOTER }
I20260709 13:10:14.566866 26226 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:10:14.567080 26226 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:10:14.567307 26226 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:14.572224 26226 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" member_type: VOTER }
I20260709 13:10:14.572706 26226 leader_election.cc:304] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3dcb3f57feaf4f30b71e8db616ec366c; no voters: 
I20260709 13:10:14.573772 26226 leader_election.cc:290] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:10:14.574080 26229 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:14.575502 26229 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 1 LEADER]: Becoming Leader. State: Replica: 3dcb3f57feaf4f30b71e8db616ec366c, State: Running, Role: LEADER
I20260709 13:10:14.576427 26229 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" member_type: VOTER }
I20260709 13:10:14.577081 26226 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:10:14.581260 26230 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" member_type: VOTER } }
I20260709 13:10:14.581669 26231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3dcb3f57feaf4f30b71e8db616ec366c. Latest consensus state: current_term: 1 leader_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3dcb3f57feaf4f30b71e8db616ec366c" member_type: VOTER } }
I20260709 13:10:14.582242 26230 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:14.582526 26231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [sys.catalog]: This master's current role is: LEADER
I20260709 13:10:14.585646 26236 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:10:14.592074 26236 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:10:14.593267 13792 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:10:14.601271 26236 catalog_manager.cc:1383] Generated new cluster ID: af3888a49026436481af5fe49c4617ee
I20260709 13:10:14.601548 26236 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:10:14.619803 26236 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:10:14.621050 26236 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:10:14.633453 26236 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c: Generated new TSK 0
I20260709 13:10:14.634074 26236 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:10:14.659989 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:14.665758 26247 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.667369 26248 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.668129 26250 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.668808 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:14.669740 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:14.669940 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:14.670107 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602614670088 us; error 0 us; skew 500 ppm
I20260709 13:10:14.670630 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:14.673153 13792 webserver.cc:533] Webserver started at http://127.13.120.1:34303/ using document root <none> and password file <none>
I20260709 13:10:14.673622 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:14.673827 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:14.674086 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:14.675129 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-0-root/instance:
uuid: "8324d3d3e27c443fb28fbba1f533546e"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.679623 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:10:14.682849 26255 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.683629 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:10:14.683926 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-0-root
uuid: "8324d3d3e27c443fb28fbba1f533546e"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.684216 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:14.700677 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:14.701897 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:14.703389 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:14.705734 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:14.705952 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.706202 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:14.706385 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.746196 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.1:36163
I20260709 13:10:14.746316 26317 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.1:36163 every 8 connection(s)
I20260709 13:10:14.751399 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:14.759686 26322 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.759933 26323 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.764125 13792 server_base.cc:1061] running on GCE node
W20260709 13:10:14.764528 26325 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.766223 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:14.766499 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:14.766737 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602614766705 us; error 0 us; skew 500 ppm
I20260709 13:10:14.766798 26318 heartbeater.cc:344] Connected to a master server at 127.13.120.62:40273
I20260709 13:10:14.767282 26318 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:14.767570 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:14.768059 26318 heartbeater.cc:507] Master 127.13.120.62:40273 requested a full tablet report, sending...
I20260709 13:10:14.770498 13792 webserver.cc:533] Webserver started at http://127.13.120.2:41701/ using document root <none> and password file <none>
I20260709 13:10:14.770507 26191 ts_manager.cc:194] Registered new tserver with Master: 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163)
I20260709 13:10:14.771080 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:14.771291 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:14.771603 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:14.772692 26191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35516
I20260709 13:10:14.772697 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-1-root/instance:
uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.778084 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:14.781944 26330 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.782718 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:10:14.783030 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-1-root
uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.783303 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:14.814482 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:14.815763 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:14.817206 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:14.819371 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:14.819633 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.819900 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:14.820062 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.861135 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.2:42863
I20260709 13:10:14.861256 26392 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.2:42863 every 8 connection(s)
I20260709 13:10:14.866511 13792 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:10:14.874001 26396 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:10:14.875617 26397 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.877609 26393 heartbeater.cc:344] Connected to a master server at 127.13.120.62:40273
I20260709 13:10:14.878150 26393 heartbeater.cc:461] Registering TS with master...
W20260709 13:10:14.878562 26399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:10:14.879019 26393 heartbeater.cc:507] Master 127.13.120.62:40273 requested a full tablet report, sending...
I20260709 13:10:14.880599 13792 server_base.cc:1061] running on GCE node
I20260709 13:10:14.881397 26191 ts_manager.cc:194] Registered new tserver with Master: ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:14.881645 13792 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:10:14.881999 13792 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:10:14.882179 13792 hybrid_clock.cc:648] HybridClock initialized: now 1783602614882145 us; error 0 us; skew 500 ppm
I20260709 13:10:14.882839 13792 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:10:14.882933 26191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35532
I20260709 13:10:14.885939 13792 webserver.cc:533] Webserver started at http://127.13.120.3:34371/ using document root <none> and password file <none>
I20260709 13:10:14.886500 13792 fs_manager.cc:362] Metadata directory not provided
I20260709 13:10:14.886696 13792 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:10:14.886983 13792 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:10:14.888253 13792 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-2-root/instance:
uuid: "c201c6ba72c4497a934ca9e2a7086283"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.892539 13792 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 13:10:14.895805 26404 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.896582 13792 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:10:14.896895 13792 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-2-root
uuid: "c201c6ba72c4497a934ca9e2a7086283"
format_stamp: "Formatted at 2026-07-09 13:10:14 on dist-test-slave-mcck"
I20260709 13:10:14.897174 13792 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskzsJAHK/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602243021600-13792-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:10:14.919996 13792 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:10:14.921119 13792 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:10:14.922549 13792 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:10:14.924770 13792 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:10:14.925002 13792 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.925251 13792 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:10:14.925434 13792 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:10:14.964572 13792 rpc_server.cc:307] RPC server started. Bound to: 127.13.120.3:32825
I20260709 13:10:14.964701 26466 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.120.3:32825 every 8 connection(s)
I20260709 13:10:14.978008 26467 heartbeater.cc:344] Connected to a master server at 127.13.120.62:40273
I20260709 13:10:14.978477 26467 heartbeater.cc:461] Registering TS with master...
I20260709 13:10:14.979144 26467 heartbeater.cc:507] Master 127.13.120.62:40273 requested a full tablet report, sending...
I20260709 13:10:14.980955 26191 ts_manager.cc:194] Registered new tserver with Master: c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:14.981096 13792 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013446151s
I20260709 13:10:14.982319 26191 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35538
I20260709 13:10:15.005404 26191 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35548:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:15.007926 26191 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:15.084921 26432 tablet_service.cc:1511] Processing CreateTablet for tablet 15c4cfa4091340c697fa485ee29715b9 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:15.086519 26432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c4cfa4091340c697fa485ee29715b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.088506 26357 tablet_service.cc:1511] Processing CreateTablet for tablet deb8951377c74b5883af34323d82539b (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:15.089972 26357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb8951377c74b5883af34323d82539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.090821 26354 tablet_service.cc:1511] Processing CreateTablet for tablet ca291dfeaad446c09276b1606867d821 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:15.092228 26354 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca291dfeaad446c09276b1606867d821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.092458 26355 tablet_service.cc:1511] Processing CreateTablet for tablet 23d2cc9065dc4b38af3a7732dc8fbb5e (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:15.093792 26355 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d2cc9065dc4b38af3a7732dc8fbb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.096455 26356 tablet_service.cc:1511] Processing CreateTablet for tablet d5c5b6030f444b8682e5d290d777ade7 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:15.097774 26356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c5b6030f444b8682e5d290d777ade7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.097894 26353 tablet_service.cc:1511] Processing CreateTablet for tablet 00b6d820ee2e4be7b5303d58accf53e6 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:15.099174 26353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b6d820ee2e4be7b5303d58accf53e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.100466 26358 tablet_service.cc:1511] Processing CreateTablet for tablet 15c4cfa4091340c697fa485ee29715b9 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:15.103789 26358 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c4cfa4091340c697fa485ee29715b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.105275 26352 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7f3b4c5da64a4789ef716d80df3a9f (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:15.106572 26352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7f3b4c5da64a4789ef716d80df3a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.110910 26351 tablet_service.cc:1511] Processing CreateTablet for tablet 4051567704bf4d3aaa3285e39baa8e3e (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:15.112300 26351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4051567704bf4d3aaa3285e39baa8e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.118197 26350 tablet_service.cc:1511] Processing CreateTablet for tablet e021ac8d8dd34669ad85803ee3a89282 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:15.119585 26350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021ac8d8dd34669ad85803ee3a89282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.124452 26430 tablet_service.cc:1511] Processing CreateTablet for tablet d5c5b6030f444b8682e5d290d777ade7 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:15.125855 26430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c5b6030f444b8682e5d290d777ade7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.128471 26429 tablet_service.cc:1511] Processing CreateTablet for tablet 23d2cc9065dc4b38af3a7732dc8fbb5e (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:15.129858 26429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d2cc9065dc4b38af3a7732dc8fbb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.132431 26428 tablet_service.cc:1511] Processing CreateTablet for tablet ca291dfeaad446c09276b1606867d821 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:15.133749 26428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca291dfeaad446c09276b1606867d821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.136571 26427 tablet_service.cc:1511] Processing CreateTablet for tablet 00b6d820ee2e4be7b5303d58accf53e6 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:15.138075 26427 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b6d820ee2e4be7b5303d58accf53e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.140460 26426 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7f3b4c5da64a4789ef716d80df3a9f (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:15.141786 26426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7f3b4c5da64a4789ef716d80df3a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.144531 26425 tablet_service.cc:1511] Processing CreateTablet for tablet 4051567704bf4d3aaa3285e39baa8e3e (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:15.145931 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4051567704bf4d3aaa3285e39baa8e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.148947 26424 tablet_service.cc:1511] Processing CreateTablet for tablet e021ac8d8dd34669ad85803ee3a89282 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:15.150203 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021ac8d8dd34669ad85803ee3a89282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.123211 26431 tablet_service.cc:1511] Processing CreateTablet for tablet deb8951377c74b5883af34323d82539b (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:15.152696 26431 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb8951377c74b5883af34323d82539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.163939 26482 tablet_bootstrap.cc:492] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.170455 26482 tablet_bootstrap.cc:654] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.202069 26281 tablet_service.cc:1511] Processing CreateTablet for tablet d5c5b6030f444b8682e5d290d777ade7 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:15.204511 26280 tablet_service.cc:1511] Processing CreateTablet for tablet 23d2cc9065dc4b38af3a7732dc8fbb5e (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:15.206727 26279 tablet_service.cc:1511] Processing CreateTablet for tablet ca291dfeaad446c09276b1606867d821 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:15.208827 26278 tablet_service.cc:1511] Processing CreateTablet for tablet 00b6d820ee2e4be7b5303d58accf53e6 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:15.210892 26277 tablet_service.cc:1511] Processing CreateTablet for tablet 6f7f3b4c5da64a4789ef716d80df3a9f (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:15.212949 26282 tablet_service.cc:1511] Processing CreateTablet for tablet deb8951377c74b5883af34323d82539b (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:15.200616 26283 tablet_service.cc:1511] Processing CreateTablet for tablet 15c4cfa4091340c697fa485ee29715b9 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:15.216508 26281 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5c5b6030f444b8682e5d290d777ade7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.219753 26277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7f3b4c5da64a4789ef716d80df3a9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.223763 26278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00b6d820ee2e4be7b5303d58accf53e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.227779 26282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet deb8951377c74b5883af34323d82539b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.228564 26484 tablet_bootstrap.cc:492] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.231778 26279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca291dfeaad446c09276b1606867d821. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.235270 26484 tablet_bootstrap.cc:654] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.235747 26283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 15c4cfa4091340c697fa485ee29715b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.239861 26280 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23d2cc9065dc4b38af3a7732dc8fbb5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.245390 26275 tablet_service.cc:1511] Processing CreateTablet for tablet e021ac8d8dd34669ad85803ee3a89282 (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:15.247100 26275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e021ac8d8dd34669ad85803ee3a89282. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.242838 26276 tablet_service.cc:1511] Processing CreateTablet for tablet 4051567704bf4d3aaa3285e39baa8e3e (DEFAULT_TABLE table=test-workload [id=633b2175f6064cf6b6918429991af8e0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:15.249516 26276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4051567704bf4d3aaa3285e39baa8e3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:15.322348 26482 tablet_bootstrap.cc:492] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.323011 26482 ts_tablet_manager.cc:1403] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.159s	user 0.064s	sys 0.076s
I20260709 13:10:15.326040 26482 raft_consensus.cc:359] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.326748 26482 raft_consensus.cc:385] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.327057 26482 raft_consensus.cc:740] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.343887 26482 consensus_queue.cc:260] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.352977 26487 tablet_bootstrap.cc:492] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.360841 26487 tablet_bootstrap.cc:654] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.364895 26393 heartbeater.cc:499] Master 127.13.120.62:40273 was elected leader, sending a full tablet report...
I20260709 13:10:15.365289 26482 ts_tablet_manager.cc:1434] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.042s	user 0.015s	sys 0.007s
W20260709 13:10:15.365406 26394 tablet.cc:2406] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:10:15.372632 26482 tablet_bootstrap.cc:492] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.375730 26486 raft_consensus.cc:493] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.376462 26486 raft_consensus.cc:515] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.381058 26484 tablet_bootstrap.cc:492] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.381791 26484 ts_tablet_manager.cc:1403] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.153s	user 0.034s	sys 0.085s
I20260709 13:10:15.386185 26482 tablet_bootstrap.cc:654] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.390128 26486 leader_election.cc:290] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.387354 26484 raft_consensus.cc:359] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:15.392102 26484 raft_consensus.cc:385] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.392479 26484 raft_consensus.cc:740] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.393425 26484 consensus_queue.cc:260] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
W20260709 13:10:15.402479 26333 leader_election.cc:343] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Not found: Tablet not found: ca291dfeaad446c09276b1606867d821
I20260709 13:10:15.409449 26467 heartbeater.cc:499] Master 127.13.120.62:40273 was elected leader, sending a full tablet report...
I20260709 13:10:15.414431 26482 tablet_bootstrap.cc:492] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.415077 26482 ts_tablet_manager.cc:1403] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.009s
I20260709 13:10:15.417168 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
W20260709 13:10:15.418748 26332 leader_election.cc:343] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.418964 26484 ts_tablet_manager.cc:1434] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.037s	user 0.013s	sys 0.001s
I20260709 13:10:15.419247 26332 leader_election.cc:304] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:15.420214 26484 tablet_bootstrap.cc:492] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.420414 26486 raft_consensus.cc:2749] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.428860 26484 tablet_bootstrap.cc:654] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.429899 26482 raft_consensus.cc:359] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.431073 26482 raft_consensus.cc:385] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.431484 26482 raft_consensus.cc:740] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.432669 26482 consensus_queue.cc:260] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.435226 26482 ts_tablet_manager.cc:1434] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 13:10:15.435302 26487 tablet_bootstrap.cc:492] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.436349 26482 tablet_bootstrap.cc:492] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.436650 26487 ts_tablet_manager.cc:1403] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.084s	user 0.018s	sys 0.021s
I20260709 13:10:15.439656 26487 raft_consensus.cc:359] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.441063 26487 raft_consensus.cc:385] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.441383 26487 raft_consensus.cc:740] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.442098 26487 consensus_queue.cc:260] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.442821 26484 tablet_bootstrap.cc:492] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.443384 26484 ts_tablet_manager.cc:1403] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.001s
I20260709 13:10:15.444486 26482 tablet_bootstrap.cc:654] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.446161 26484 raft_consensus.cc:359] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.446914 26484 raft_consensus.cc:385] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.447223 26484 raft_consensus.cc:740] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.447588 26318 heartbeater.cc:499] Master 127.13.120.62:40273 was elected leader, sending a full tablet report...
I20260709 13:10:15.448105 26487 ts_tablet_manager.cc:1434] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.004s
I20260709 13:10:15.448061 26484 consensus_queue.cc:260] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.451073 26484 ts_tablet_manager.cc:1434] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:10:15.452389 26484 tablet_bootstrap.cc:492] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.449333 26487 tablet_bootstrap.cc:492] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.459545 26486 raft_consensus.cc:493] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.460234 26484 tablet_bootstrap.cc:654] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.460069 26486 raft_consensus.cc:515] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.462260 26486 leader_election.cc:290] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.464748 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:15.466025 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:15.466549 26487 tablet_bootstrap.cc:654] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.466692 26442 raft_consensus.cc:2468] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
W20260709 13:10:15.468283 26333 leader_election.cc:343] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.469070 26332 leader_election.cc:304] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:15.470531 26486 raft_consensus.cc:2804] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.471004 26486 raft_consensus.cc:493] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.471455 26486 raft_consensus.cc:3060] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.505031 26486 raft_consensus.cc:515] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.512209 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
W20260709 13:10:15.514147 26333 leader_election.cc:343] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.517014 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:15.517838 26442 raft_consensus.cc:3060] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.527552 26486 leader_election.cc:290] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.530550 26442 raft_consensus.cc:2468] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:15.531622 26482 tablet_bootstrap.cc:492] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.531869 26487 tablet_bootstrap.cc:492] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.532147 26484 tablet_bootstrap.cc:492] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.531991 26332 leader_election.cc:304] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:15.532199 26482 ts_tablet_manager.cc:1403] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.096s	user 0.030s	sys 0.045s
I20260709 13:10:15.532702 26487 ts_tablet_manager.cc:1403] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.084s	user 0.030s	sys 0.041s
I20260709 13:10:15.532967 26484 ts_tablet_manager.cc:1403] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.081s	user 0.036s	sys 0.043s
I20260709 13:10:15.533497 26486 raft_consensus.cc:2804] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.535650 26482 raft_consensus.cc:359] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:15.535861 26487 raft_consensus.cc:359] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.536366 26482 raft_consensus.cc:385] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.536566 26487 raft_consensus.cc:385] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.536518 26484 raft_consensus.cc:359] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.537228 26487 raft_consensus.cc:740] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.536712 26482 raft_consensus.cc:740] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.537518 26484 raft_consensus.cc:385] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.536969 26486 raft_consensus.cc:697] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:15.537951 26484 raft_consensus.cc:740] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.538218 26482 consensus_queue.cc:260] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:15.538218 26487 consensus_queue.cc:260] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.538892 26484 consensus_queue.cc:260] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.540697 26482 ts_tablet_manager.cc:1434] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:15.541132 26487 ts_tablet_manager.cc:1434] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:10:15.541695 26482 tablet_bootstrap.cc:492] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.542788 26484 ts_tablet_manager.cc:1434] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:10:15.543162 26487 tablet_bootstrap.cc:492] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.543839 26484 tablet_bootstrap.cc:492] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.548789 26482 tablet_bootstrap.cc:654] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.550351 26487 tablet_bootstrap.cc:654] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.550730 26484 tablet_bootstrap.cc:654] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.558979 26484 tablet_bootstrap.cc:492] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.559525 26484 ts_tablet_manager.cc:1403] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.004s
I20260709 13:10:15.562456 26484 raft_consensus.cc:359] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.563190 26484 raft_consensus.cc:385] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.563496 26484 raft_consensus.cc:740] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.539063 26486 consensus_queue.cc:237] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.565428 26484 consensus_queue.cc:260] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.566576 26482 tablet_bootstrap.cc:492] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.567124 26482 ts_tablet_manager.cc:1403] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.011s
I20260709 13:10:15.568353 26484 ts_tablet_manager.cc:1434] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:15.569702 26484 tablet_bootstrap.cc:492] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.570067 26482 raft_consensus.cc:359] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.570845 26482 raft_consensus.cc:385] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.571146 26482 raft_consensus.cc:740] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.572520 26482 consensus_queue.cc:260] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.575102 26482 ts_tablet_manager.cc:1434] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:15.576108 26482 tablet_bootstrap.cc:492] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.577634 26484 tablet_bootstrap.cc:654] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.581972 26487 tablet_bootstrap.cc:492] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.580963 26190 catalog_manager.cc:5697] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.582662 26482 tablet_bootstrap.cc:654] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.582753 26487 ts_tablet_manager.cc:1403] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.009s
I20260709 13:10:15.586925 26487 raft_consensus.cc:359] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.587797 26487 raft_consensus.cc:385] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:10:15.588940 26239 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:15.588620 26487 raft_consensus.cc:740] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.590284 26484 tablet_bootstrap.cc:492] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.591097 26484 ts_tablet_manager.cc:1403] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.009s
I20260709 13:10:15.590293 26487 consensus_queue.cc:260] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.594161 26487 ts_tablet_manager.cc:1434] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:10:15.594074 26484 raft_consensus.cc:359] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.594898 26484 raft_consensus.cc:385] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.595235 26484 raft_consensus.cc:740] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.595630 26487 tablet_bootstrap.cc:492] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.595988 26484 consensus_queue.cc:260] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.596685 26482 tablet_bootstrap.cc:492] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.597246 26482 ts_tablet_manager.cc:1403] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
I20260709 13:10:15.598598 26484 ts_tablet_manager.cc:1434] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:10:15.599618 26484 tablet_bootstrap.cc:492] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.600203 26482 raft_consensus.cc:359] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.601028 26482 raft_consensus.cc:385] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.601347 26482 raft_consensus.cc:740] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.602394 26482 consensus_queue.cc:260] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.604641 26482 ts_tablet_manager.cc:1434] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:10:15.605578 26482 tablet_bootstrap.cc:492] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.606546 26484 tablet_bootstrap.cc:654] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.610531 26487 tablet_bootstrap.cc:654] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.611830 26482 tablet_bootstrap.cc:654] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.618603 26484 tablet_bootstrap.cc:492] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.619131 26484 ts_tablet_manager.cc:1403] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:10:15.622491 26484 raft_consensus.cc:359] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.623203 26484 raft_consensus.cc:385] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.623608 26484 raft_consensus.cc:740] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.624567 26484 consensus_queue.cc:260] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.628185 26484 ts_tablet_manager.cc:1434] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:10:15.629477 26484 tablet_bootstrap.cc:492] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.634168 26482 tablet_bootstrap.cc:492] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.635211 26482 ts_tablet_manager.cc:1403] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.009s
I20260709 13:10:15.638170 26487 tablet_bootstrap.cc:492] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.638774 26487 ts_tablet_manager.cc:1403] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.043s	user 0.009s	sys 0.017s
I20260709 13:10:15.638702 26482 raft_consensus.cc:359] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.639681 26482 raft_consensus.cc:385] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.640007 26482 raft_consensus.cc:740] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.640787 26484 tablet_bootstrap.cc:654] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.640743 26482 consensus_queue.cc:260] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.642416 26487 raft_consensus.cc:359] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.643070 26482 ts_tablet_manager.cc:1434] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:15.643282 26487 raft_consensus.cc:385] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.643837 26487 raft_consensus.cc:740] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.644204 26482 tablet_bootstrap.cc:492] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.645265 26487 consensus_queue.cc:260] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.651024 26482 tablet_bootstrap.cc:654] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.659109 26482 tablet_bootstrap.cc:492] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.659626 26482 ts_tablet_manager.cc:1403] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.003s
I20260709 13:10:15.662606 26482 raft_consensus.cc:359] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.663354 26482 raft_consensus.cc:385] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.663590 26492 raft_consensus.cc:493] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.663667 26482 raft_consensus.cc:740] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.664456 26492 raft_consensus.cc:515] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.664907 26482 consensus_queue.cc:260] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.665860 26487 ts_tablet_manager.cc:1434] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.001s
I20260709 13:10:15.666922 26487 tablet_bootstrap.cc:492] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.667598 26482 ts_tablet_manager.cc:1434] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:15.668628 26482 tablet_bootstrap.cc:492] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.673535 26487 tablet_bootstrap.cc:654] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.675102 26482 tablet_bootstrap.cc:654] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.676822 26492 leader_election.cc:290] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:15.678217 26484 tablet_bootstrap.cc:492] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.678902 26484 ts_tablet_manager.cc:1403] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.022s
I20260709 13:10:15.682888 26484 raft_consensus.cc:359] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.683833 26484 raft_consensus.cc:385] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.684100 26484 raft_consensus.cc:740] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.686057 26482 tablet_bootstrap.cc:492] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.686673 26482 ts_tablet_manager.cc:1403] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 13:10:15.686607 26484 consensus_queue.cc:260] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.689287 26484 ts_tablet_manager.cc:1434] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:10:15.689766 26482 raft_consensus.cc:359] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.690272 26484 tablet_bootstrap.cc:492] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.690572 26482 raft_consensus.cc:385] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.690904 26482 raft_consensus.cc:740] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.691731 26482 consensus_queue.cc:260] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.692687 26492 raft_consensus.cc:493] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.693341 26492 raft_consensus.cc:515] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:15.695964 26492 leader_election.cc:290] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163)
I20260709 13:10:15.697022 26484 tablet_bootstrap.cc:654] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.698503 26482 ts_tablet_manager.cc:1434] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.003s
I20260709 13:10:15.704034 26487 tablet_bootstrap.cc:492] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.704598 26487 ts_tablet_manager.cc:1403] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.003s
I20260709 13:10:15.699620 26482 tablet_bootstrap.cc:492] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:15.707638 26487 raft_consensus.cc:359] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.708400 26487 raft_consensus.cc:385] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.708683 26487 raft_consensus.cc:740] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.709656 26487 consensus_queue.cc:260] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.713554 26484 tablet_bootstrap.cc:492] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.714110 26484 ts_tablet_manager.cc:1403] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.008s
I20260709 13:10:15.714903 26482 tablet_bootstrap.cc:654] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.718743 26484 raft_consensus.cc:359] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.719933 26484 raft_consensus.cc:385] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.720273 26484 raft_consensus.cc:740] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.721036 26484 consensus_queue.cc:260] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.721616 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.721972 26487 ts_tablet_manager.cc:1434] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:10:15.723070 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.723953 26367 raft_consensus.cc:2468] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:15.724701 26484 ts_tablet_manager.cc:1434] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
W20260709 13:10:15.725414 26405 leader_election.cc:343] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.726249 26405 leader_election.cc:304] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:15.726532 26484 tablet_bootstrap.cc:492] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:15.727252 26492 raft_consensus.cc:2804] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.727664 26492 raft_consensus.cc:493] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.728061 26492 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.728641 26487 tablet_bootstrap.cc:492] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.730060 26482 tablet_bootstrap.cc:492] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:15.730564 26482 ts_tablet_manager.cc:1403] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.001s
I20260709 13:10:15.733258 26482 raft_consensus.cc:359] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.733892 26482 raft_consensus.cc:385] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.733919 26484 tablet_bootstrap.cc:654] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.734266 26482 raft_consensus.cc:740] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.735062 26487 tablet_bootstrap.cc:654] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.735121 26482 consensus_queue.cc:260] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.735664 26492 raft_consensus.cc:515] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:15.737367 26482 ts_tablet_manager.cc:1434] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:15.740325 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:15.741074 26367 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.749332 26487 tablet_bootstrap.cc:492] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.749958 26487 ts_tablet_manager.cc:1403] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.004s
I20260709 13:10:15.752961 26487 raft_consensus.cc:359] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.753381 26367 raft_consensus.cc:2468] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:15.753711 26487 raft_consensus.cc:385] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.754046 26487 raft_consensus.cc:740] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.754751 26405 leader_election.cc:304] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:15.754890 26487 consensus_queue.cc:260] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.757264 26487 ts_tablet_manager.cc:1434] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:15.757350 26492 leader_election.cc:290] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163)
I20260709 13:10:15.758314 26487 tablet_bootstrap.cc:492] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.759907 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:15.760623 26494 raft_consensus.cc:493] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.761178 26494 raft_consensus.cc:515] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.762832 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
W20260709 13:10:15.764421 26407 leader_election.cc:343] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.765101 26407 leader_election.cc:304] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:15.765584 26487 tablet_bootstrap.cc:654] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.766908 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
W20260709 13:10:15.769124 26407 leader_election.cc:343] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:10:15.770015 26407 leader_election.cc:343] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.771279 26494 leader_election.cc:290] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.775965 26486 raft_consensus.cc:493] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.776516 26486 raft_consensus.cc:515] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.778642 26486 leader_election.cc:290] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.758236 26492 raft_consensus.cc:2804] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.780257 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7f3b4c5da64a4789ef716d80df3a9f" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:15.781224 26442 raft_consensus.cc:2468] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:15.782884 26332 leader_election.cc:304] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:15.784030 26486 raft_consensus.cc:2804] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.784497 26486 raft_consensus.cc:493] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.784966 26486 raft_consensus.cc:3060] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.791893 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7f3b4c5da64a4789ef716d80df3a9f" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:15.792809 26293 raft_consensus.cc:2468] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:15.797971 26484 tablet_bootstrap.cc:492] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:15.799937 26486 raft_consensus.cc:515] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.801666 26484 ts_tablet_manager.cc:1403] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.076s	user 0.027s	sys 0.035s
I20260709 13:10:15.803606 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7f3b4c5da64a4789ef716d80df3a9f" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:15.804450 26293 raft_consensus.cc:3060] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.815037 26492 raft_consensus.cc:697] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:15.815338 26526 raft_consensus.cc:2749] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.819329 26526 raft_consensus.cc:493] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.820019 26526 raft_consensus.cc:515] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.820499 26486 leader_election.cc:290] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.825766 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
W20260709 13:10:15.827467 26407 leader_election.cc:343] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.828150 26492 consensus_queue.cc:237] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
W20260709 13:10:15.831966 26405 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.13.120.2:42863, user_credentials={real_user=slave}} blocked reactor thread for 77311.4us
I20260709 13:10:15.833297 26526 leader_election.cc:290] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:15.834906 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.805365 26484 raft_consensus.cc:359] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.837800 26367 raft_consensus.cc:2468] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:15.838106 26484 raft_consensus.cc:385] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.838373 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f7f3b4c5da64a4789ef716d80df3a9f" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:15.839248 26442 raft_consensus.cc:3060] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.839298 26405 leader_election.cc:304] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:15.840855 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.838444 26484 raft_consensus.cc:740] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.842134 26484 consensus_queue.cc:260] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.844226 26484 ts_tablet_manager.cc:1434] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:10:15.844115 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:15.832687 26522 raft_consensus.cc:493] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.845481 26441 raft_consensus.cc:2393] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8324d3d3e27c443fb28fbba1f533546e in current term 1: Already voted for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in this term.
I20260709 13:10:15.845305 26522 raft_consensus.cc:515] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.847242 26257 leader_election.cc:304] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e; no voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:15.848398 26293 raft_consensus.cc:2468] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:15.840862 26526 raft_consensus.cc:2804] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.849813 26526 raft_consensus.cc:493] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.847819 26442 raft_consensus.cc:2468] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:15.850340 26333 leader_election.cc:304] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:15.850662 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.851199 26487 tablet_bootstrap.cc:492] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:15.847651 26522 leader_election.cc:290] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:15.849215 26494 raft_consensus.cc:3060] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.851332 26486 raft_consensus.cc:2804] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:15.851761 26487 ts_tablet_manager.cc:1403] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.094s	user 0.044s	sys 0.039s
I20260709 13:10:15.852986 26486 raft_consensus.cc:697] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:15.853909 26486 consensus_queue.cc:237] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.851317 26367 raft_consensus.cc:2468] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:15.856561 26405 leader_election.cc:304] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:15.857340 26492 raft_consensus.cc:2804] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.857710 26492 raft_consensus.cc:493] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.858048 26492 raft_consensus.cc:3060] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.854820 26487 raft_consensus.cc:359] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.859377 26531 raft_consensus.cc:493] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.850211 26526 raft_consensus.cc:3060] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.860183 26494 raft_consensus.cc:2749] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:15.859627 26487 raft_consensus.cc:385] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:15.861107 26487 raft_consensus.cc:740] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:15.861858 26487 consensus_queue.cc:260] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.860133 26531 raft_consensus.cc:515] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.896587 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:15.898784 26293 raft_consensus.cc:2468] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:15.899333 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.900477 26367 raft_consensus.cc:2468] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:15.865300 26531 leader_election.cc:290] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.903908 26494 raft_consensus.cc:493] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.906873 26494 raft_consensus.cc:515] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.910127 26487 ts_tablet_manager.cc:1434] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 13:10:15.913563 26256 leader_election.cc:304] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:15.917438 26522 raft_consensus.cc:493] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.917819 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:15.919045 26442 raft_consensus.cc:2468] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:15.921592 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.918697 26522 raft_consensus.cc:515] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.923069 26367 raft_consensus.cc:2468] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:15.920218 26189 catalog_manager.cc:5697] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 0 to 1, leader changed from <none> to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.924346 26442 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:15.925061 26522 leader_election.cc:290] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:15.925397 26531 raft_consensus.cc:2804] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.926115 26531 raft_consensus.cc:493] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.928746 26531 raft_consensus.cc:3060] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.924554 26256 leader_election.cc:304] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:15.927569 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021ac8d8dd34669ad85803ee3a89282" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:15.926852 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021ac8d8dd34669ad85803ee3a89282" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.922505 26494 leader_election.cc:290] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.931334 26293 raft_consensus.cc:2468] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:15.938731 26407 leader_election.cc:304] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:15.939829 26487 tablet_bootstrap.cc:492] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:15.935987 26494 raft_consensus.cc:2804] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.936553 26367 raft_consensus.cc:2468] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:15.941325 26191 catalog_manager.cc:5697] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.955367 26486 raft_consensus.cc:493] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.956195 26486 raft_consensus.cc:515] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.942754 26522 raft_consensus.cc:2804] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.958881 26531 raft_consensus.cc:515] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.959787 26522 raft_consensus.cc:493] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.960251 26522 raft_consensus.cc:3060] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.960422 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:15.962133 26486 leader_election.cc:290] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:15.964401 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
W20260709 13:10:15.964542 26333 leader_election.cc:343] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:15.965654 26441 raft_consensus.cc:2468] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:15.967576 26332 leader_election.cc:304] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:15.969028 26486 raft_consensus.cc:2804] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:15.969462 26486 raft_consensus.cc:493] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.969880 26486 raft_consensus.cc:3060] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.969167 26492 raft_consensus.cc:515] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.972210 26492 leader_election.cc:290] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:15.973552 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:15.974677 26367 raft_consensus.cc:3060] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.976854 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:15.977790 26293 raft_consensus.cc:3060] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.942130 26494 raft_consensus.cc:493] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:15.979730 26494 raft_consensus.cc:3060] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:15.981132 26498 consensus_queue.cc:1048] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:15.986701 26533 raft_consensus.cc:493] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:15.987480 26533 raft_consensus.cc:515] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.991207 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:15.992002 26368 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:15.993584 26487 tablet_bootstrap.cc:654] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:15.993613 26256 leader_election.cc:304] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:15.998827 26526 raft_consensus.cc:515] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:15.999958 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:16.007591 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.008003 26440 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:16.002518 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.008318 26367 raft_consensus.cc:2468] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:16.008422 26368 raft_consensus.cc:3060] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.009240 26439 raft_consensus.cc:3060] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.010347 26405 leader_election.cc:304] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:16.012573 26531 leader_election.cc:290] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.013078 26492 raft_consensus.cc:2804] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.002784 26486 raft_consensus.cc:515] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.014195 26492 raft_consensus.cc:697] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:16.015499 26492 consensus_queue.cc:237] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.016489 26522 raft_consensus.cc:515] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.016865 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:16.018393 26368 raft_consensus.cc:2468] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
W20260709 13:10:16.018514 26333 leader_election.cc:343] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:16.019721 26256 leader_election.cc:304] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:16.019775 26522 leader_election.cc:290] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:16.019989 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021ac8d8dd34669ad85803ee3a89282" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:16.020712 26534 raft_consensus.cc:2804] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:16.020726 26292 raft_consensus.cc:3060] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.021751 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e021ac8d8dd34669ad85803ee3a89282" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.021456 26531 raft_consensus.cc:2804] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.024566 26487 tablet_bootstrap.cc:492] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:16.025220 26487 ts_tablet_manager.cc:1403] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.112s	user 0.014s	sys 0.004s
I20260709 13:10:16.025795 26439 raft_consensus.cc:2468] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:15.999392 26533 leader_election.cc:290] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.027431 26498 consensus_queue.cc:1048] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.028993 26487 raft_consensus.cc:359] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:16.029870 26487 raft_consensus.cc:385] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.030308 26487 raft_consensus.cc:740] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.021924 26534 raft_consensus.cc:493] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:16.022529 26367 raft_consensus.cc:3060] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.032120 26534 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.037415 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.037968 26442 raft_consensus.cc:2393] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8324d3d3e27c443fb28fbba1f533546e in current term 1: Already voted for candidate c201c6ba72c4497a934ca9e2a7086283 in this term.
I20260709 13:10:16.038137 26368 raft_consensus.cc:3060] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.038512 26290 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:16.037182 26487 consensus_queue.cc:260] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:16.042604 26487 ts_tablet_manager.cc:1434] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:10:16.044210 26487 tablet_bootstrap.cc:492] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:16.047260 26368 raft_consensus.cc:2468] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:16.049803 26531 raft_consensus.cc:697] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.050912 26494 raft_consensus.cc:515] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.054169 26494 leader_election.cc:290] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.055693 26290 raft_consensus.cc:2393] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c201c6ba72c4497a934ca9e2a7086283 in current term 1: Already voted for candidate 8324d3d3e27c443fb28fbba1f533546e in this term.
I20260709 13:10:16.056628 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.057832 26366 raft_consensus.cc:2393] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8324d3d3e27c443fb28fbba1f533546e in current term 1: Already voted for candidate c201c6ba72c4497a934ca9e2a7086283 in this term.
I20260709 13:10:16.056949 26486 leader_election.cc:290] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.060281 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.060654 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.060868 26440 raft_consensus.cc:3060] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.062791 26257 leader_election.cc:304] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e; no voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:16.064036 26494 raft_consensus.cc:2749] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.064473 26487 tablet_bootstrap.cc:654] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:16.053421 26531 consensus_queue.cc:237] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.049261 26526 leader_election.cc:290] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:16.050457 26293 raft_consensus.cc:2468] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:16.068512 26405 leader_election.cc:304] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:16.072824 26492 raft_consensus.cc:2804] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.075528 26492 raft_consensus.cc:697] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:16.079864 26367 raft_consensus.cc:2468] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:16.080785 26292 raft_consensus.cc:2468] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:16.080933 26405 leader_election.cc:304] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:16.081809 26522 raft_consensus.cc:2804] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.082306 26522 raft_consensus.cc:697] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:16.083387 26522 consensus_queue.cc:237] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.086671 26440 raft_consensus.cc:2468] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:16.088191 26332 leader_election.cc:304] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:16.089068 26486 raft_consensus.cc:2804] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.089687 26486 raft_consensus.cc:697] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:16.089399 26492 consensus_queue.cc:237] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.091015 26486 consensus_queue.cc:237] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.087118 26534 raft_consensus.cc:515] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.097141 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.099563 26367 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.105005 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.105918 26440 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.114388 26191 catalog_manager.cc:5697] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 0 to 1, leader changed from <none> to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.118242 26189 catalog_manager.cc:5697] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 1 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.119944 26191 catalog_manager.cc:5697] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 0 to 1, leader changed from <none> to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.122982 26367 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:16.123229 26534 leader_election.cc:290] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.124274 26256 leader_election.cc:304] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:16.130682 26534 raft_consensus.cc:2804] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:16.131331 26534 raft_consensus.cc:697] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.132673 26534 consensus_queue.cc:237] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.139034 26440 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:16.152505 26487 tablet_bootstrap.cc:492] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:16.153143 26487 ts_tablet_manager.cc:1403] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.109s	user 0.019s	sys 0.004s
I20260709 13:10:16.156165 26487 raft_consensus.cc:359] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.155804 26190 catalog_manager.cc:5697] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 1 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.157255 26487 raft_consensus.cc:385] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:16.157588 26487 raft_consensus.cc:740] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:16.162129 26189 catalog_manager.cc:5697] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.178222 26487 consensus_queue.cc:260] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.183954 26487 ts_tablet_manager.cc:1434] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 13:10:16.185096 26191 catalog_manager.cc:5697] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 0 to 1, leader changed from <none> to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.251101 26546 consensus_queue.cc:1048] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.257383 26534 raft_consensus.cc:493] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.257889 26534 raft_consensus.cc:515] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:16.260138 26534 leader_election.cc:290] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.261710 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:16.262749 26367 raft_consensus.cc:2393] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8324d3d3e27c443fb28fbba1f533546e in current term 1: Already voted for candidate c201c6ba72c4497a934ca9e2a7086283 in this term.
I20260709 13:10:16.263697 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:16.265596 26257 leader_election.cc:304] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e; no voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:16.267001 26534 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.270295 26545 consensus_queue.cc:1048] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.273700 26534 raft_consensus.cc:2749] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.301553 26440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
mode: GRACEFUL
new_leader_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:42508
I20260709 13:10:16.302263 26440 raft_consensus.cc:606] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Received request to transfer leadership to TS 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:16.309790 26522 consensus_queue.cc:1048] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.319512 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "deb8951377c74b5883af34323d82539b"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
mode: GRACEFUL
new_leader_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:54528
I20260709 13:10:16.320114 26368 raft_consensus.cc:606] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Received request to transfer leadership to TS 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:16.321359 26522 consensus_queue.cc:1048] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.327863 26367 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
mode: GRACEFUL
new_leader_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:54528
I20260709 13:10:16.328512 26367 raft_consensus.cc:606] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Received request to transfer leadership to TS 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:16.331880 26528 raft_consensus.cc:993] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: : Instructing follower 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.332314 26528 raft_consensus.cc:1081] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Signalling peer 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.334048 26291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:36152
I20260709 13:10:16.334618 26291 raft_consensus.cc:493] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.334488 26440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
mode: GRACEFUL
new_leader_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:42508
I20260709 13:10:16.335171 26291 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.335335 26440 raft_consensus.cc:606] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Received request to transfer leadership to TS 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:16.340245 26440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca291dfeaad446c09276b1606867d821"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
mode: GRACEFUL
new_leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:42508
I20260709 13:10:16.340828 26440 raft_consensus.cc:606] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Received request to transfer leadership to TS ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:16.342953 26291 raft_consensus.cc:515] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:16.345806 26291 leader_election.cc:290] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.346954 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.347548 26367 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.347766 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.348428 26440 raft_consensus.cc:3055] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.348706 26440 raft_consensus.cc:740] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:16.349476 26440 consensus_queue.cc:260] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:16.350754 26440 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.357293 26440 raft_consensus.cc:2468] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.357672 26367 raft_consensus.cc:2468] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.358584 26257 leader_election.cc:304] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:16.359473 26534 raft_consensus.cc:2804] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.359450 26291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
mode: GRACEFUL
new_leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:36160
I20260709 13:10:16.360123 26534 raft_consensus.cc:697] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.360186 26291 raft_consensus.cc:606] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Received request to transfer leadership to TS ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:16.360899 26534 consensus_queue.cc:237] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:16.368660 26291 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
mode: GRACEFUL
new_leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:36160
I20260709 13:10:16.368538 26191 catalog_manager.cc:5697] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 1 to 2, leader changed from c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3) to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 2 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.369220 26291 raft_consensus.cc:606] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Received request to transfer leadership to TS ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:16.407927 26528 consensus_queue.cc:1048] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.418758 26527 consensus_queue.cc:1048] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:10:16.428052 26527 raft_consensus.cc:993] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: : Instructing follower 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.428587 26527 raft_consensus.cc:1081] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Signalling peer 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.430239 26291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:36152
I20260709 13:10:16.430809 26291 raft_consensus.cc:493] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.431182 26291 raft_consensus.cc:3060] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.434317 26534 raft_consensus.cc:493] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:16.435672 26534 raft_consensus.cc:515] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.438567 26291 raft_consensus.cc:515] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.440588 26534 leader_election.cc:290] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.440766 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:16.440917 26291 leader_election.cc:290] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.441845 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.442441 26368 raft_consensus.cc:3060] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.442816 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:16.443240 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23d2cc9065dc4b38af3a7732dc8fbb5e" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.443637 26440 raft_consensus.cc:2393] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8324d3d3e27c443fb28fbba1f533546e in current term 1: Already voted for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in this term.
I20260709 13:10:16.443872 26441 raft_consensus.cc:3055] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.444192 26441 raft_consensus.cc:740] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:16.444818 26257 leader_election.cc:304] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e; no voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:16.445048 26441 consensus_queue.cc:260] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.446278 26441 raft_consensus.cc:3060] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.446410 26534 raft_consensus.cc:3060] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:16.450582 26368 raft_consensus.cc:2468] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.452031 26256 leader_election.cc:304] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:16.452904 26531 raft_consensus.cc:2804] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.453365 26531 raft_consensus.cc:697] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.454433 26441 raft_consensus.cc:2468] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.454285 26531 consensus_queue.cc:237] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.455897 26534 raft_consensus.cc:2749] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:16.461349 26190 catalog_manager.cc:5697] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 1 to 2, leader changed from c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3) to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 2 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.486181 26545 consensus_queue.cc:1048] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.497090 26546 consensus_queue.cc:1048] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.504819 26498 raft_consensus.cc:993] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: : Instructing follower 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.505285 26546 raft_consensus.cc:1081] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Signalling peer 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.506801 26291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "deb8951377c74b5883af34323d82539b"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:58560
I20260709 13:10:16.507267 26291 raft_consensus.cc:493] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.507632 26291 raft_consensus.cc:3060] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.512840 26291 raft_consensus.cc:515] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.515161 26291 leader_election.cc:290] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.515300 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.516016 26368 raft_consensus.cc:3055] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.516357 26368 raft_consensus.cc:740] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:16.516373 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "deb8951377c74b5883af34323d82539b" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.517166 26441 raft_consensus.cc:3060] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.517297 26368 consensus_queue.cc:260] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.518769 26368 raft_consensus.cc:3060] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.523147 26441 raft_consensus.cc:2468] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.524201 26257 leader_election.cc:304] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:16.524380 26368 raft_consensus.cc:2468] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.524904 26531 raft_consensus.cc:2804] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.525408 26531 raft_consensus.cc:697] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.526132 26531 consensus_queue.cc:237] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.531996 26190 catalog_manager.cc:5697] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 1 to 2, leader changed from ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2) to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 2 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.560287 26522 consensus_queue.cc:1048] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.565225 26534 consensus_queue.cc:1048] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.571017 26492 consensus_queue.cc:1048] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.584429 26494 consensus_queue.cc:1048] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.585136 26531 consensus_queue.cc:1048] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.607496 26531 consensus_queue.cc:1048] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.618474 26546 raft_consensus.cc:993] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: : Instructing follower 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.618973 26546 raft_consensus.cc:1081] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Signalling peer 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:16.621100 26291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:58560
I20260709 13:10:16.621660 26291 raft_consensus.cc:493] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.622018 26291 raft_consensus.cc:3060] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.626452 26534 raft_consensus.cc:993] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: : Instructing follower ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:16.627031 26534 raft_consensus.cc:1081] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Signalling peer ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:16.627831 26531 raft_consensus.cc:993] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: : Instructing follower ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:16.628363 26531 raft_consensus.cc:1081] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Signalling peer ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:16.629779 26367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:54520
I20260709 13:10:16.630048 26368 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:54520
I20260709 13:10:16.630599 26367 raft_consensus.cc:493] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.630632 26368 raft_consensus.cc:493] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.631275 26367 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.631278 26368 raft_consensus.cc:3060] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.631491 26492 consensus_queue.cc:1048] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:10:16.638425 26291 raft_consensus.cc:515] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.639294 26367 raft_consensus.cc:515] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.639927 26492 consensus_queue.cc:1048] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:16.640117 26368 raft_consensus.cc:515] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.640764 26291 leader_election.cc:290] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.642503 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.643079 26440 raft_consensus.cc:3060] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.643003 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5c5b6030f444b8682e5d290d777ade7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:16.643283 26291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:16.644049 26366 raft_consensus.cc:3055] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.644083 26291 raft_consensus.cc:3055] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.644606 26366 raft_consensus.cc:740] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:16.644670 26291 raft_consensus.cc:740] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.645431 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.646062 26441 raft_consensus.cc:3060] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.645659 26291 consensus_queue.cc:260] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.646981 26291 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.647680 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4051567704bf4d3aaa3285e39baa8e3e" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:16.648290 26293 raft_consensus.cc:3055] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.648609 26293 raft_consensus.cc:740] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.649423 26293 consensus_queue.cc:260] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.650584 26293 raft_consensus.cc:3060] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.653159 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.653352 26441 raft_consensus.cc:2468] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:16.653767 26439 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.654183 26291 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:16.655562 26368 leader_election.cc:290] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.658206 26333 leader_election.cc:304] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:16.659780 26546 raft_consensus.cc:2804] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.659919 26332 leader_election.cc:304] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:16.660326 26546 raft_consensus.cc:697] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:16.661072 26498 raft_consensus.cc:2804] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.661576 26498 raft_consensus.cc:697] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:16.661659 26439 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:16.661365 26546 consensus_queue.cc:237] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.662657 26498 consensus_queue.cc:237] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.651085 26440 raft_consensus.cc:2468] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.645573 26366 consensus_queue.cc:260] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.664505 26367 leader_election.cc:290] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.665349 26257 leader_election.cc:304] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:16.666106 26366 raft_consensus.cc:3060] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.666525 26494 raft_consensus.cc:2804] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.667057 26494 raft_consensus.cc:697] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:16.667943 26494 consensus_queue.cc:237] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.672832 26293 raft_consensus.cc:2468] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:16.679082 26528 raft_consensus.cc:993] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: : Instructing follower ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:16.679546 26528 raft_consensus.cc:1081] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Signalling peer ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:16.679275 26189 catalog_manager.cc:5697] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 1 to 2, leader changed from 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1) to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.681104 26189 catalog_manager.cc:5697] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 1 to 2, leader changed from 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1) to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.681862 26367 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca291dfeaad446c09276b1606867d821"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:54510
I20260709 13:10:16.682560 26367 raft_consensus.cc:493] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.683002 26367 raft_consensus.cc:3060] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.690523 26367 raft_consensus.cc:515] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.691808 26191 catalog_manager.cc:5697] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 1 to 2, leader changed from ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2) to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 2 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.693473 26368 raft_consensus.cc:1240] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Rejecting Update request from peer c201c6ba72c4497a934ca9e2a7086283 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:16.694912 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:16.695534 26367 leader_election.cc:290] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:16.695775 26440 raft_consensus.cc:3055] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.696182 26440 raft_consensus.cc:740] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:16.697032 26440 consensus_queue.cc:260] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.697592 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca291dfeaad446c09276b1606867d821" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:16.698180 26440 raft_consensus.cc:3060] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.698217 26292 raft_consensus.cc:3060] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.701840 26366 raft_consensus.cc:2468] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:16.706702 26440 raft_consensus.cc:2468] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:16.707024 26292 raft_consensus.cc:2468] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:16.708192 26333 leader_election.cc:304] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:16.709388 26546 raft_consensus.cc:2804] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.709857 26546 raft_consensus.cc:697] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:16.710783 26546 consensus_queue.cc:237] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:16.718117 26189 catalog_manager.cc:5697] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 1 to 2, leader changed from c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3) to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.746718 26440 raft_consensus.cc:1275] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.748101 26494 consensus_queue.cc:1048] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.756134 26368 raft_consensus.cc:1275] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.758116 26566 consensus_queue.cc:1048] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.886757 26368 raft_consensus.cc:1275] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.888115 26566 consensus_queue.cc:1048] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.895483 26440 raft_consensus.cc:1275] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.897182 26494 consensus_queue.cc:1048] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.967988 26440 raft_consensus.cc:1275] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.969270 26494 consensus_queue.cc:1048] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.976629 26368 raft_consensus.cc:1275] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.978235 26534 consensus_queue.cc:1048] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.098529 26292 raft_consensus.cc:1275] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.100031 26546 consensus_queue.cc:1048] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.108352 26440 raft_consensus.cc:1275] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.110183 26546 consensus_queue.cc:1048] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.155490 26368 raft_consensus.cc:1275] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.156926 26534 consensus_queue.cc:1048] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.164870 26440 raft_consensus.cc:1275] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.166455 26534 consensus_queue.cc:1048] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.174968 26440 raft_consensus.cc:1275] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.176463 26546 consensus_queue.cc:1048] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.185547 26292 raft_consensus.cc:1275] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.187377 26498 consensus_queue.cc:1048] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.195948 26292 raft_consensus.cc:1275] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.198909 26546 consensus_queue.cc:1048] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.207383 26440 raft_consensus.cc:1275] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.209079 26486 consensus_queue.cc:1048] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.402992 26189 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54632:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:10:19.405540 26189 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:10:19.456187 26283 tablet_service.cc:1511] Processing CreateTablet for tablet 75ef79d3ad4a49578d6f20dfd23df081 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:19.457020 26352 tablet_service.cc:1511] Processing CreateTablet for tablet 75ef79d3ad4a49578d6f20dfd23df081 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:19.457567 26283 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ef79d3ad4a49578d6f20dfd23df081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.458600 26352 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ef79d3ad4a49578d6f20dfd23df081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.459373 26425 tablet_service.cc:1511] Processing CreateTablet for tablet 75ef79d3ad4a49578d6f20dfd23df081 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:10:19.460927 26425 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75ef79d3ad4a49578d6f20dfd23df081. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.460820 26282 tablet_service.cc:1511] Processing CreateTablet for tablet ed85e77148ad41118b5a753d64342dd7 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:19.462177 26282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed85e77148ad41118b5a753d64342dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.464464 26429 tablet_service.cc:1511] Processing CreateTablet for tablet ed85e77148ad41118b5a753d64342dd7 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:19.465790 26429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed85e77148ad41118b5a753d64342dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.466768 26279 tablet_service.cc:1511] Processing CreateTablet for tablet cc64b5ac6cf742b39f8a75fcbd24c3ae (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:19.468047 26279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc64b5ac6cf742b39f8a75fcbd24c3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.470101 26353 tablet_service.cc:1511] Processing CreateTablet for tablet cc64b5ac6cf742b39f8a75fcbd24c3ae (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:19.471751 26424 tablet_service.cc:1511] Processing CreateTablet for tablet cc64b5ac6cf742b39f8a75fcbd24c3ae (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:10:19.472383 26357 tablet_service.cc:1511] Processing CreateTablet for tablet ed85e77148ad41118b5a753d64342dd7 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:10:19.473117 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc64b5ac6cf742b39f8a75fcbd24c3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.476619 26357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed85e77148ad41118b5a753d64342dd7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.478745 26353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc64b5ac6cf742b39f8a75fcbd24c3ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.485824 26277 tablet_service.cc:1511] Processing CreateTablet for tablet 98dbe92fd2d543ffbdcec1675697ccaf (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:19.487208 26277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dbe92fd2d543ffbdcec1675697ccaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.488780 26350 tablet_service.cc:1511] Processing CreateTablet for tablet 98dbe92fd2d543ffbdcec1675697ccaf (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:19.490159 26350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dbe92fd2d543ffbdcec1675697ccaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.491011 26426 tablet_service.cc:1511] Processing CreateTablet for tablet 98dbe92fd2d543ffbdcec1675697ccaf (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:10:19.492419 26426 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98dbe92fd2d543ffbdcec1675697ccaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.545176 26278 tablet_service.cc:1511] Processing CreateTablet for tablet 5a58bc919b5b4886a93fcb1c25358ac6 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:19.546487 26278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a58bc919b5b4886a93fcb1c25358ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.548976 26586 tablet_bootstrap.cc:492] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.556643 26585 tablet_bootstrap.cc:492] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:19.562480 26424 tablet_service.cc:1511] Processing CreateTablet for tablet 5a58bc919b5b4886a93fcb1c25358ac6 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:19.563849 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a58bc919b5b4886a93fcb1c25358ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.574069 26353 tablet_service.cc:1511] Processing CreateTablet for tablet 3bec51f53ea340fd9df0147bcb07f332 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:19.574867 26429 tablet_service.cc:1511] Processing CreateTablet for tablet 3bec51f53ea340fd9df0147bcb07f332 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:19.576277 26586 tablet_bootstrap.cc:654] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.576517 26429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bec51f53ea340fd9df0147bcb07f332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.577019 26588 tablet_bootstrap.cc:492] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.577596 26353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bec51f53ea340fd9df0147bcb07f332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.577445 26351 tablet_service.cc:1511] Processing CreateTablet for tablet b949602db64d4d2d8fd9615b8c79689c (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:19.578640 26350 tablet_service.cc:1511] Processing CreateTablet for tablet 5a58bc919b5b4886a93fcb1c25358ac6 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:10:19.577476 26277 tablet_service.cc:1511] Processing CreateTablet for tablet 3bec51f53ea340fd9df0147bcb07f332 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:10:19.580412 26585 tablet_bootstrap.cc:654] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.580668 26277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3bec51f53ea340fd9df0147bcb07f332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.583572 26279 tablet_service.cc:1511] Processing CreateTablet for tablet b949602db64d4d2d8fd9615b8c79689c (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:19.584805 26279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949602db64d4d2d8fd9615b8c79689c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.585005 26350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a58bc919b5b4886a93fcb1c25358ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.585734 26351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949602db64d4d2d8fd9615b8c79689c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.604313 26429 tablet_service.cc:1511] Processing CreateTablet for tablet b949602db64d4d2d8fd9615b8c79689c (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:10:19.605759 26429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b949602db64d4d2d8fd9615b8c79689c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.609042 26585 tablet_bootstrap.cc:492] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:19.609615 26585 ts_tablet_manager.cc:1403] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.004s
I20260709 13:10:19.612754 26585 raft_consensus.cc:359] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.613528 26585 raft_consensus.cc:385] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.613831 26585 raft_consensus.cc:740] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.614845 26588 tablet_bootstrap.cc:654] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.619282 26586 tablet_bootstrap.cc:492] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.619838 26586 ts_tablet_manager.cc:1403] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.000s
I20260709 13:10:19.622798 26586 raft_consensus.cc:359] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.623525 26586 raft_consensus.cc:385] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.623813 26586 raft_consensus.cc:740] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.624524 26586 consensus_queue.cc:260] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.627059 26586 ts_tablet_manager.cc:1434] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:10:19.630237 26357 tablet_service.cc:1511] Processing CreateTablet for tablet 80e1a4b0cc2a4d71b1d5e38e27e1802e (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:19.631544 26585 consensus_queue.cc:260] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.631951 26278 tablet_service.cc:1511] Processing CreateTablet for tablet 80e1a4b0cc2a4d71b1d5e38e27e1802e (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:19.631601 26357 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e1a4b0cc2a4d71b1d5e38e27e1802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.644305 26278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e1a4b0cc2a4d71b1d5e38e27e1802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.648468 26586 tablet_bootstrap.cc:492] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
W20260709 13:10:19.651185 26239 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:10:19.638543 26585 ts_tablet_manager.cc:1434] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 13:10:19.638831 26429 tablet_service.cc:1511] Processing CreateTablet for tablet 80e1a4b0cc2a4d71b1d5e38e27e1802e (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:10:19.639175 26282 tablet_service.cc:1511] Processing CreateTablet for tablet 05691e35f72f4c1dac8405be76815726 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:19.655253 26429 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e1a4b0cc2a4d71b1d5e38e27e1802e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.655354 26282 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05691e35f72f4c1dac8405be76815726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.642535 26353 tablet_service.cc:1511] Processing CreateTablet for tablet 05691e35f72f4c1dac8405be76815726 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:19.657758 26586 tablet_bootstrap.cc:654] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.658208 26353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05691e35f72f4c1dac8405be76815726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.662696 26585 tablet_bootstrap.cc:492] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:19.675232 26585 tablet_bootstrap.cc:654] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.679265 26588 tablet_bootstrap.cc:492] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.681555 26588 ts_tablet_manager.cc:1403] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.139s	user 0.017s	sys 0.009s
I20260709 13:10:19.684298 26424 tablet_service.cc:1511] Processing CreateTablet for tablet 05691e35f72f4c1dac8405be76815726 (DEFAULT_TABLE table=soft_deleted_table [id=2a24a80406584f84afdcc87d010be286]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:10:19.685736 26424 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05691e35f72f4c1dac8405be76815726. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:19.691771 26588 raft_consensus.cc:359] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.692752 26588 raft_consensus.cc:385] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.693058 26588 raft_consensus.cc:740] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.693812 26588 consensus_queue.cc:260] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.694917 26585 tablet_bootstrap.cc:492] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:19.695523 26585 ts_tablet_manager.cc:1403] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.004s
I20260709 13:10:19.696447 26588 ts_tablet_manager.cc:1434] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:10:19.697503 26588 tablet_bootstrap.cc:492] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.698473 26585 raft_consensus.cc:359] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.699226 26585 raft_consensus.cc:385] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.699532 26585 raft_consensus.cc:740] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.700287 26585 consensus_queue.cc:260] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.702718 26585 ts_tablet_manager.cc:1434] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:10:19.704609 26586 tablet_bootstrap.cc:492] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.705016 26588 tablet_bootstrap.cc:654] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.705159 26586 ts_tablet_manager.cc:1403] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.008s
I20260709 13:10:19.709434 26587 raft_consensus.cc:493] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.709978 26587 raft_consensus.cc:515] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.710469 26586 raft_consensus.cc:359] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.711555 26586 raft_consensus.cc:385] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.711927 26586 raft_consensus.cc:740] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.712188 26587 leader_election.cc:290] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:19.712975 26586 consensus_queue.cc:260] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.714046 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ef79d3ad4a49578d6f20dfd23df081" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
W20260709 13:10:19.715579 26256 leader_election.cc:343] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:19.716434 26588 tablet_bootstrap.cc:492] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.716316 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ef79d3ad4a49578d6f20dfd23df081" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:19.716986 26588 ts_tablet_manager.cc:1403] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 13:10:19.717069 26440 raft_consensus.cc:2468] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:19.718428 26257 leader_election.cc:304] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:19.717140 26585 tablet_bootstrap.cc:492] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:19.720606 26534 raft_consensus.cc:2804] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:19.720970 26534 raft_consensus.cc:493] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.721280 26534 raft_consensus.cc:3060] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.718637 26586 ts_tablet_manager.cc:1434] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:10:19.723517 26586 tablet_bootstrap.cc:492] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.724241 26588 raft_consensus.cc:359] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.724990 26588 raft_consensus.cc:385] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.725270 26588 raft_consensus.cc:740] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.726012 26588 consensus_queue.cc:260] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.733134 26534 raft_consensus.cc:515] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.736315 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ef79d3ad4a49578d6f20dfd23df081" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:19.736892 26440 raft_consensus.cc:3060] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.738765 26585 tablet_bootstrap.cc:654] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.742935 26586 tablet_bootstrap.cc:654] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.744854 26440 raft_consensus.cc:2468] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:19.746011 26257 leader_election.cc:304] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:19.747136 26587 raft_consensus.cc:2804] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:19.750228 26588 ts_tablet_manager.cc:1434] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.033s	user 0.009s	sys 0.019s
I20260709 13:10:19.751859 26588 tablet_bootstrap.cc:492] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.754145 26585 tablet_bootstrap.cc:492] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:19.754714 26585 ts_tablet_manager.cc:1403] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 13:10:19.750342 26587 raft_consensus.cc:697] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:19.756045 26587 consensus_queue.cc:237] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.757862 26585 raft_consensus.cc:359] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.758369 26588 tablet_bootstrap.cc:654] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.760581 26586 tablet_bootstrap.cc:492] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.768494 26586 ts_tablet_manager.cc:1403] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.010s
I20260709 13:10:19.748529 26534 leader_election.cc:290] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:19.775945 26586 raft_consensus.cc:359] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.776895 26586 raft_consensus.cc:385] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.777211 26586 raft_consensus.cc:740] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.778733 26588 tablet_bootstrap.cc:492] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.779757 26588 ts_tablet_manager.cc:1403] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:10:19.779609 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75ef79d3ad4a49578d6f20dfd23df081" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:19.778052 26586 consensus_queue.cc:260] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.782406 26586 ts_tablet_manager.cc:1434] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:10:19.783732 26586 tablet_bootstrap.cc:492] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.783501 26588 raft_consensus.cc:359] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.784417 26588 raft_consensus.cc:385] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.784781 26588 raft_consensus.cc:740] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.785928 26588 consensus_queue.cc:260] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.786935 26368 raft_consensus.cc:3060] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.788760 26588 ts_tablet_manager.cc:1434] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:10:19.789934 26588 tablet_bootstrap.cc:492] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.791934 26586 tablet_bootstrap.cc:654] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.796010 26585 raft_consensus.cc:385] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.800297 26585 raft_consensus.cc:740] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.797588 26588 tablet_bootstrap.cc:654] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.799393 26368 raft_consensus.cc:2468] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:19.810509 26586 tablet_bootstrap.cc:492] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.809906 26190 catalog_manager.cc:5697] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 1 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.811116 26586 ts_tablet_manager.cc:1403] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.009s
I20260709 13:10:19.810554 26585 consensus_queue.cc:260] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.814316 26585 ts_tablet_manager.cc:1434] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 13:10:19.815467 26585 tablet_bootstrap.cc:492] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:19.820163 26586 raft_consensus.cc:359] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.822670 26586 raft_consensus.cc:385] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.823094 26586 raft_consensus.cc:740] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.823753 26585 tablet_bootstrap.cc:654] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.824460 26588 tablet_bootstrap.cc:492] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.824158 26586 consensus_queue.cc:260] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.825062 26588 ts_tablet_manager.cc:1403] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.035s	user 0.016s	sys 0.007s
I20260709 13:10:19.827358 26586 ts_tablet_manager.cc:1434] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:19.828537 26588 raft_consensus.cc:359] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.829247 26586 tablet_bootstrap.cc:492] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.829422 26588 raft_consensus.cc:385] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.829959 26588 raft_consensus.cc:740] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.830963 26588 consensus_queue.cc:260] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.833608 26588 ts_tablet_manager.cc:1434] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:19.834872 26588 tablet_bootstrap.cc:492] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.836059 26585 tablet_bootstrap.cc:492] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:19.836638 26585 ts_tablet_manager.cc:1403] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.008s
I20260709 13:10:19.839313 26586 tablet_bootstrap.cc:654] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.839938 26585 raft_consensus.cc:359] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.840807 26585 raft_consensus.cc:385] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.841128 26585 raft_consensus.cc:740] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.841956 26585 consensus_queue.cc:260] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.842401 26588 tablet_bootstrap.cc:654] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.844749 26585 ts_tablet_manager.cc:1434] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:10:19.845803 26585 tablet_bootstrap.cc:492] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:19.851678 26586 tablet_bootstrap.cc:492] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.852309 26586 ts_tablet_manager.cc:1403] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 13:10:19.852743 26585 tablet_bootstrap.cc:654] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.852890 26588 tablet_bootstrap.cc:492] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.853495 26588 ts_tablet_manager.cc:1403] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 13:10:19.855584 26586 raft_consensus.cc:359] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.856428 26586 raft_consensus.cc:385] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.856395 26588 raft_consensus.cc:359] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.857509 26588 raft_consensus.cc:385] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.857476 26586 raft_consensus.cc:740] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.857970 26588 raft_consensus.cc:740] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.858631 26586 consensus_queue.cc:260] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.858714 26588 consensus_queue.cc:260] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.861264 26586 ts_tablet_manager.cc:1434] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:19.861563 26588 ts_tablet_manager.cc:1434] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 13:10:19.862498 26586 tablet_bootstrap.cc:492] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.862528 26588 tablet_bootstrap.cc:492] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.873188 26586 tablet_bootstrap.cc:654] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.869753 26588 tablet_bootstrap.cc:654] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.874830 26585 tablet_bootstrap.cc:492] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:19.875468 26585 ts_tablet_manager.cc:1403] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.008s
I20260709 13:10:19.877233 26599 raft_consensus.cc:493] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.877784 26599 raft_consensus.cc:515] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.879074 26585 raft_consensus.cc:359] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.881238 26599 leader_election.cc:290] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:19.881083 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64b5ac6cf742b39f8a75fcbd24c3ae" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:19.882081 26368 raft_consensus.cc:2468] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:19.882792 26573 raft_consensus.cc:493] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.883463 26256 leader_election.cc:304] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:19.884438 26599 raft_consensus.cc:2804] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:19.884372 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64b5ac6cf742b39f8a75fcbd24c3ae" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:19.885021 26599 raft_consensus.cc:493] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.885315 26440 raft_consensus.cc:2468] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:19.885627 26599 raft_consensus.cc:3060] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.886921 26586 tablet_bootstrap.cc:492] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.887068 26585 raft_consensus.cc:385] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.883332 26573 raft_consensus.cc:515] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.887631 26586 ts_tablet_manager.cc:1403] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:10:19.887528 26585 raft_consensus.cc:740] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.888609 26585 consensus_queue.cc:260] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.889587 26573 leader_election.cc:290] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:19.890635 26586 raft_consensus.cc:359] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.891072 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:19.891232 26585 ts_tablet_manager.cc:1434] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:10:19.891353 26586 raft_consensus.cc:385] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.891793 26368 raft_consensus.cc:2468] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:19.891422 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:19.892526 26585 tablet_bootstrap.cc:492] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:19.892627 26292 raft_consensus.cc:2468] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:19.893270 26405 leader_election.cc:304] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:19.894290 26573 raft_consensus.cc:2804] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:19.894500 26588 tablet_bootstrap.cc:492] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.895022 26588 ts_tablet_manager.cc:1403] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.004s
I20260709 13:10:19.895488 26573 raft_consensus.cc:493] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.891848 26586 raft_consensus.cc:740] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.899375 26573 raft_consensus.cc:3060] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.901943 26586 consensus_queue.cc:260] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.914624 26599 raft_consensus.cc:515] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.914546 26588 raft_consensus.cc:359] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.916249 26588 raft_consensus.cc:385] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.917248 26588 raft_consensus.cc:740] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.918140 26586 ts_tablet_manager.cc:1434] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.030s	user 0.011s	sys 0.007s
I20260709 13:10:19.918097 26588 consensus_queue.cc:260] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.920816 26588 ts_tablet_manager.cc:1434] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:10:19.921819 26588 tablet_bootstrap.cc:492] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:19.921792 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64b5ac6cf742b39f8a75fcbd24c3ae" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:19.922432 26368 raft_consensus.cc:3060] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.924676 26585 tablet_bootstrap.cc:654] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.929986 26588 tablet_bootstrap.cc:654] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.932010 26586 tablet_bootstrap.cc:492] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.939291 26595 raft_consensus.cc:493] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.939994 26595 raft_consensus.cc:515] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.940626 26586 tablet_bootstrap.cc:654] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:19.941920 26368 raft_consensus.cc:2468] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:19.943679 26573 raft_consensus.cc:515] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.944664 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bec51f53ea340fd9df0147bcb07f332" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:19.944869 26256 leader_election.cc:304] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:19.945364 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bec51f53ea340fd9df0147bcb07f332" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:19.945447 26440 raft_consensus.cc:2468] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:19.945814 26596 raft_consensus.cc:2804] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:19.946328 26573 leader_election.cc:290] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:19.947081 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc64b5ac6cf742b39f8a75fcbd24c3ae" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:19.946352 26596 raft_consensus.cc:697] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:19.947686 26439 raft_consensus.cc:3060] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.942058 26595 leader_election.cc:290] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:19.942883 26599 leader_election.cc:290] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:19.948920 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:19.955073 26366 raft_consensus.cc:3060] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.955513 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:19.956651 26292 raft_consensus.cc:3060] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.948802 26596 consensus_queue.cc:237] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
W20260709 13:10:19.949498 26333 leader_election.cc:343] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:19.964408 26332 leader_election.cc:304] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:19.964726 26366 raft_consensus.cc:2468] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:19.965907 26405 leader_election.cc:304] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:19.966066 26595 raft_consensus.cc:2804] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:19.966470 26595 raft_consensus.cc:493] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:19.966771 26573 raft_consensus.cc:2804] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:19.966786 26595 raft_consensus.cc:3060] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:19.967368 26573 raft_consensus.cc:697] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:19.970340 26292 raft_consensus.cc:2468] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:19.979003 26586 tablet_bootstrap.cc:492] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:19.979594 26586 ts_tablet_manager.cc:1403] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.060s	user 0.027s	sys 0.007s
I20260709 13:10:19.982802 26586 raft_consensus.cc:359] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.970935 26611 raft_consensus.cc:493] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.983515 26586 raft_consensus.cc:385] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.983851 26586 raft_consensus.cc:740] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:19.984848 26586 consensus_queue.cc:260] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.985669 26439 raft_consensus.cc:2468] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:19.986572 26588 tablet_bootstrap.cc:492] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:19.987315 26588 ts_tablet_manager.cc:1403] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.066s	user 0.010s	sys 0.007s
I20260709 13:10:19.987975 26587 raft_consensus.cc:493] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:19.988509 26587 raft_consensus.cc:515] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.990592 26587 leader_election.cc:290] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:19.987922 26586 ts_tablet_manager.cc:1434] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:10:19.993544 26586 tablet_bootstrap.cc:492] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:19.995843 26191 catalog_manager.cc:5697] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 1 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.983860 26611 raft_consensus.cc:515] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.000017 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed85e77148ad41118b5a753d64342dd7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:20.000742 26366 raft_consensus.cc:2468] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:19.999822 26588 raft_consensus.cc:359] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.001291 26611 leader_election.cc:290] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:20.001664 26588 raft_consensus.cc:385] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.002017 26588 raft_consensus.cc:740] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.002381 26256 leader_election.cc:304] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.003676 26599 raft_consensus.cc:2804] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.004051 26599 raft_consensus.cc:493] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.004388 26599 raft_consensus.cc:3060] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.005046 26585 tablet_bootstrap.cc:492] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:20.005568 26585 ts_tablet_manager.cc:1403] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.113s	user 0.008s	sys 0.014s
I20260709 13:10:20.005803 26586 tablet_bootstrap.cc:654] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.007916 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed85e77148ad41118b5a753d64342dd7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:20.008652 26585 raft_consensus.cc:359] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.009428 26585 raft_consensus.cc:385] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:19.996307 26595 raft_consensus.cc:515] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:19.971426 26573 consensus_queue.cc:237] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.008674 26439 raft_consensus.cc:2468] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 0.
I20260709 13:10:20.013504 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed85e77148ad41118b5a753d64342dd7" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:20.009701 26585 raft_consensus.cc:740] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.015131 26585 consensus_queue.cc:260] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.018121 26585 ts_tablet_manager.cc:1434] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:10:20.019083 26585 tablet_bootstrap.cc:492] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:20.021399 26588 consensus_queue.cc:260] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.028348 26585 tablet_bootstrap.cc:654] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.030390 26588 ts_tablet_manager.cc:1434] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:10:20.031484 26588 tablet_bootstrap.cc:492] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:20.031916 26293 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bec51f53ea340fd9df0147bcb07f332" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.033144 26595 leader_election.cc:290] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.036598 26599 raft_consensus.cc:515] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.037983 26588 tablet_bootstrap.cc:654] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.038210 26292 raft_consensus.cc:2393] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c201c6ba72c4497a934ca9e2a7086283 in current term 1: Already voted for candidate 8324d3d3e27c443fb28fbba1f533546e in this term.
I20260709 13:10:20.046360 26585 tablet_bootstrap.cc:492] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:20.046973 26585 ts_tablet_manager.cc:1403] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 13:10:20.047480 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed85e77148ad41118b5a753d64342dd7" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:20.048135 26366 raft_consensus.cc:2468] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:20.049584 26599 leader_election.cc:290] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.050343 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed85e77148ad41118b5a753d64342dd7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:20.050379 26585 raft_consensus.cc:359] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.051126 26366 raft_consensus.cc:3060] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.051309 26585 raft_consensus.cc:385] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.051683 26585 raft_consensus.cc:740] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.052433 26585 consensus_queue.cc:260] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.054903 26585 ts_tablet_manager.cc:1434] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 13:10:20.055784 26595 raft_consensus.cc:493] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.055999 26585 tablet_bootstrap.cc:492] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:20.056298 26595 raft_consensus.cc:515] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.058352 26595 leader_election.cc:290] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
W20260709 13:10:20.059837 26333 leader_election.cc:343] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.063282 26585 tablet_bootstrap.cc:654] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.063205 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ed85e77148ad41118b5a753d64342dd7" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.063712 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:20.064038 26439 raft_consensus.cc:3060] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.064337 26292 raft_consensus.cc:2468] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:20.065399 26333 leader_election.cc:304] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.066169 26595 raft_consensus.cc:2804] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.066699 26595 raft_consensus.cc:493] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.067195 26595 raft_consensus.cc:3060] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.074738 26439 raft_consensus.cc:2468] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:20.075161 26573 raft_consensus.cc:493] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.075706 26573 raft_consensus.cc:515] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.077040 26366 raft_consensus.cc:2468] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 1.
I20260709 13:10:20.077754 26573 leader_election.cc:290] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:20.075978 26405 leader_election.cc:304] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:20.079423 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:20.079465 26191 catalog_manager.cc:5697] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 0 to 1, leader changed from <none> to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.080251 26292 raft_consensus.cc:2468] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:20.080870 26257 leader_election.cc:304] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:20.080991 26573 raft_consensus.cc:2764] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:10:20.081693 26599 raft_consensus.cc:2804] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.081950 26407 leader_election.cc:304] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:20.082209 26599 raft_consensus.cc:697] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:20.083089 26599 consensus_queue.cc:237] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.083724 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:20.091255 26586 tablet_bootstrap.cc:492] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:20.092082 26585 tablet_bootstrap.cc:492] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:20.082861 26573 raft_consensus.cc:2804] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.092610 26585 ts_tablet_manager.cc:1403] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.019s
I20260709 13:10:20.092864 26595 raft_consensus.cc:515] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.092655 26573 raft_consensus.cc:493] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.093726 26573 raft_consensus.cc:3060] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.098436 26585 raft_consensus.cc:359] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.099221 26585 raft_consensus.cc:385] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.099514 26585 raft_consensus.cc:740] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.091812 26586 ts_tablet_manager.cc:1403] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.006s
I20260709 13:10:20.103801 26585 consensus_queue.cc:260] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.105916 26586 raft_consensus.cc:359] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.106637 26586 raft_consensus.cc:385] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.106906 26586 raft_consensus.cc:740] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.107386 26585 ts_tablet_manager.cc:1434] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:10:20.107874 26368 raft_consensus.cc:2393] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c201c6ba72c4497a934ca9e2a7086283 in current term 1: Already voted for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in this term.
I20260709 13:10:20.108487 26585 tablet_bootstrap.cc:492] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: Bootstrap starting.
I20260709 13:10:20.112488 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.113444 26292 raft_consensus.cc:3060] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.112526 26586 consensus_queue.cc:260] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.115964 26586 ts_tablet_manager.cc:1434] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.004s
I20260709 13:10:20.117100 26586 tablet_bootstrap.cc:492] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: Bootstrap starting.
I20260709 13:10:20.112617 26595 leader_election.cc:290] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.120018 26573 raft_consensus.cc:515] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.121311 26585 tablet_bootstrap.cc:654] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.123790 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:20.124212 26292 raft_consensus.cc:2468] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:20.124909 26368 raft_consensus.cc:2393] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c201c6ba72c4497a934ca9e2a7086283 in current term 1: Already voted for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in this term.
I20260709 13:10:20.125829 26333 leader_election.cc:304] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.126772 26573 leader_election.cc:290] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:20.127079 26595 raft_consensus.cc:2804] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.135164 26595 raft_consensus.cc:697] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:20.136070 26595 consensus_queue.cc:237] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.131919 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bec51f53ea340fd9df0147bcb07f332" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.139267 26585 tablet_bootstrap.cc:492] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: No bootstrap required, opened a new log
I20260709 13:10:20.139449 26439 raft_consensus.cc:3060] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.139784 26585 ts_tablet_manager.cc:1403] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.005s
I20260709 13:10:20.133460 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:20.144172 26440 raft_consensus.cc:2393] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ae0457fae9e94975a2dcb4ad9b5977d4 in current term 1: Already voted for candidate c201c6ba72c4497a934ca9e2a7086283 in this term.
I20260709 13:10:20.134351 26441 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.145539 26441 raft_consensus.cc:2393] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ae0457fae9e94975a2dcb4ad9b5977d4 in current term 1: Already voted for candidate c201c6ba72c4497a934ca9e2a7086283 in this term.
I20260709 13:10:20.148366 26585 raft_consensus.cc:359] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.149106 26585 raft_consensus.cc:385] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.149374 26585 raft_consensus.cc:740] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.150276 26439 raft_consensus.cc:2468] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:20.151578 26332 leader_election.cc:304] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:20.152842 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b949602db64d4d2d8fd9615b8c79689c" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.153265 26595 raft_consensus.cc:2804] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.153949 26595 raft_consensus.cc:697] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:20.154019 26292 raft_consensus.cc:2393] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c201c6ba72c4497a934ca9e2a7086283 in current term 1: Already voted for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in this term.
I20260709 13:10:20.154886 26595 consensus_queue.cc:237] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.157505 26588 tablet_bootstrap.cc:492] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:20.157987 26588 ts_tablet_manager.cc:1403] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.127s	user 0.037s	sys 0.054s
I20260709 13:10:20.159322 26586 tablet_bootstrap.cc:654] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.159330 26191 catalog_manager.cc:5697] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.160591 26588 raft_consensus.cc:359] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.161309 26588 raft_consensus.cc:385] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.161594 26588 raft_consensus.cc:740] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.161013 26188 catalog_manager.cc:5697] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 0 to 1, leader changed from <none> to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 1 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.162354 26588 consensus_queue.cc:260] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.164546 26588 ts_tablet_manager.cc:1434] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:20.165390 26588 tablet_bootstrap.cc:492] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: Bootstrap starting.
I20260709 13:10:20.150045 26585 consensus_queue.cc:260] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.169018 26599 raft_consensus.cc:493] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.169597 26599 raft_consensus.cc:515] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.171186 26588 tablet_bootstrap.cc:654] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: Neither blocks nor log segments found. Creating new log.
I20260709 13:10:20.174484 26599 leader_election.cc:290] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.173147 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
W20260709 13:10:20.176669 26256 leader_election.cc:343] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.178690 26585 ts_tablet_manager.cc:1434] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260709 13:10:20.184928 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:20.185838 26588 tablet_bootstrap.cc:492] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: No bootstrap required, opened a new log
I20260709 13:10:20.186357 26588 ts_tablet_manager.cc:1403] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
W20260709 13:10:20.186841 26257 leader_election.cc:343] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:10:20.187350 26257 leader_election.cc:304] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e; no voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:20.188122 26587 raft_consensus.cc:2749] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.189539 26588 raft_consensus.cc:359] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.190248 26588 raft_consensus.cc:385] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.190508 26588 raft_consensus.cc:740] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.191164 26588 consensus_queue.cc:260] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.193369 26588 ts_tablet_manager.cc:1434] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:10:20.196749 26407 leader_election.cc:304] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c201c6ba72c4497a934ca9e2a7086283; no voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:20.197656 26573 raft_consensus.cc:2749] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.199783 26586 tablet_bootstrap.cc:492] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: No bootstrap required, opened a new log
I20260709 13:10:20.200245 26586 ts_tablet_manager.cc:1403] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.020s
I20260709 13:10:20.202534 26586 raft_consensus.cc:359] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.202210 26188 catalog_manager.cc:5697] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.203229 26586 raft_consensus.cc:385] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:10:20.203521 26586 raft_consensus.cc:740] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Initialized, Role: FOLLOWER
I20260709 13:10:20.204258 26586 consensus_queue.cc:260] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.208544 26586 ts_tablet_manager.cc:1434] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:10:20.247758 26599 raft_consensus.cc:493] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.247957 26573 raft_consensus.cc:493] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.248378 26599 raft_consensus.cc:515] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.248617 26573 raft_consensus.cc:515] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.250608 26599 leader_election.cc:290] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.251334 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bec51f53ea340fd9df0147bcb07f332" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:20.251758 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" is_pre_election: true
I20260709 13:10:20.251798 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:20.252527 26366 raft_consensus.cc:2468] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:20.252647 26292 raft_consensus.cc:2468] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 0.
I20260709 13:10:20.253196 26573 leader_election.cc:290] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:20.253851 26405 leader_election.cc:304] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:20.254181 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3bec51f53ea340fd9df0147bcb07f332" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:20.254968 26439 raft_consensus.cc:2393] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8324d3d3e27c443fb28fbba1f533546e in current term 1: Already voted for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in this term.
I20260709 13:10:20.254957 26573 raft_consensus.cc:2804] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.256027 26573 raft_consensus.cc:493] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.256340 26573 raft_consensus.cc:3060] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.256644 26257 leader_election.cc:304] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e; no voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:20.257339 26599 raft_consensus.cc:3060] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.263749 26573 raft_consensus.cc:515] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.264633 26599 raft_consensus.cc:2749] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:10:20.265869 26573 leader_election.cc:290] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:20.266561 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.267023 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:20.267257 26292 raft_consensus.cc:3060] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.267740 26366 raft_consensus.cc:3060] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.272377 26366 raft_consensus.cc:2468] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:20.273528 26405 leader_election.cc:304] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:20.273547 26292 raft_consensus.cc:2468] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 1.
I20260709 13:10:20.274590 26573 raft_consensus.cc:2804] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.275106 26573 raft_consensus.cc:697] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:20.276523 26573 consensus_queue.cc:237] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.278834 26595 raft_consensus.cc:493] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.279387 26595 raft_consensus.cc:515] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.282310 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a58bc919b5b4886a93fcb1c25358ac6" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:20.282678 26595 leader_election.cc:290] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.282840 26292 raft_consensus.cc:2468] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:20.282917 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a58bc919b5b4886a93fcb1c25358ac6" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:20.283715 26439 raft_consensus.cc:2468] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:20.284179 26333 leader_election.cc:304] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.285007 26595 raft_consensus.cc:2804] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.285359 26595 raft_consensus.cc:493] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.285692 26595 raft_consensus.cc:3060] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.286183 26190 catalog_manager.cc:5697] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 0 to 1, leader changed from <none> to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 1 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.291612 26595 raft_consensus.cc:515] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.294157 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a58bc919b5b4886a93fcb1c25358ac6" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.294693 26292 raft_consensus.cc:3060] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.294726 26595 leader_election.cc:290] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.294926 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a58bc919b5b4886a93fcb1c25358ac6" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.295639 26439 raft_consensus.cc:3060] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.302032 26292 raft_consensus.cc:2468] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:20.302399 26439 raft_consensus.cc:2468] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:20.303313 26333 leader_election.cc:304] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.304047 26595 raft_consensus.cc:2804] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.304567 26595 raft_consensus.cc:697] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:20.305209 26595 consensus_queue.cc:237] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.312636 26190 catalog_manager.cc:5697] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.349146 26599 consensus_queue.cc:1048] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.360267 26599 consensus_queue.cc:1048] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.368225 26595 raft_consensus.cc:493] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:20.368821 26595 raft_consensus.cc:515] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.370751 26595 leader_election.cc:290] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.371368 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e" is_pre_election: true
I20260709 13:10:20.372112 26292 raft_consensus.cc:2468] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:20.372067 26439 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283" is_pre_election: true
I20260709 13:10:20.373138 26439 raft_consensus.cc:2468] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 0.
I20260709 13:10:20.373624 26333 leader_election.cc:304] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.374344 26595 raft_consensus.cc:2804] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:10:20.374686 26595 raft_consensus.cc:493] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:20.376027 26595 raft_consensus.cc:3060] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.378788 26599 consensus_queue.cc:1048] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.384115 26595 raft_consensus.cc:515] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.386279 26595 leader_election.cc:290] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.387121 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.387804 26292 raft_consensus.cc:3060] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.388012 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.388628 26440 raft_consensus.cc:3060] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:10:20.398360 26599 consensus_queue.cc:1048] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.401345 26440 raft_consensus.cc:2468] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:20.402483 26332 leader_election.cc:304] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:20.403259 26595 raft_consensus.cc:2804] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:10:20.403734 26595 raft_consensus.cc:697] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:20.405118 26292 raft_consensus.cc:2468] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 1.
I20260709 13:10:20.404523 26595 consensus_queue.cc:237] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.414019 26190 catalog_manager.cc:5697] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 1 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.434675 26440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
mode: GRACEFUL
new_leader_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:42508
I20260709 13:10:20.435191 26440 raft_consensus.cc:606] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Received request to transfer leadership to TS 8324d3d3e27c443fb28fbba1f533546e
I20260709 13:10:20.447014 26440 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
mode: GRACEFUL
new_leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:42508
I20260709 13:10:20.447527 26440 raft_consensus.cc:606] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Received request to transfer leadership to TS ae0457fae9e94975a2dcb4ad9b5977d4
I20260709 13:10:20.451814 26366 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05691e35f72f4c1dac8405be76815726"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
mode: GRACEFUL
new_leader_uuid: "c201c6ba72c4497a934ca9e2a7086283"
 from {username='slave'} at 127.0.0.1:54528
I20260709 13:10:20.452294 26366 raft_consensus.cc:606] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Received request to transfer leadership to TS c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:20.519838 26573 consensus_queue.cc:1048] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.525983 26618 raft_consensus.cc:993] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: : Instructing follower 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:20.526494 26616 raft_consensus.cc:1081] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Signalling peer 8324d3d3e27c443fb28fbba1f533546e to start an election
I20260709 13:10:20.530241 26291 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
 from {username='slave'} at 127.0.0.1:36152
I20260709 13:10:20.530778 26291 raft_consensus.cc:493] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.531199 26291 raft_consensus.cc:3060] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.532711 26616 consensus_queue.cc:1048] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.541482 26291 raft_consensus.cc:515] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.544205 26366 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:20.544584 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98dbe92fd2d543ffbdcec1675697ccaf" candidate_uuid: "8324d3d3e27c443fb28fbba1f533546e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.544878 26366 raft_consensus.cc:3060] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.545202 26440 raft_consensus.cc:3055] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.545538 26440 raft_consensus.cc:740] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:20.546273 26440 consensus_queue.cc:260] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.547292 26440 raft_consensus.cc:3060] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.550132 26291 leader_election.cc:290] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.553828 26366 raft_consensus.cc:2468] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:20.554051 26440 raft_consensus.cc:2468] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8324d3d3e27c443fb28fbba1f533546e in term 2.
I20260709 13:10:20.555120 26256 leader_election.cc:304] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.556001 26599 raft_consensus.cc:2804] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.556399 26599 raft_consensus.cc:697] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Becoming Leader. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:20.557122 26599 consensus_queue.cc:237] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.563804 26191 catalog_manager.cc:5697] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e reported cstate change: term changed from 1 to 2, leader changed from c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3) to 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1). New cstate: current_term: 2 leader_uuid: "8324d3d3e27c443fb28fbba1f533546e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.583496 26599 consensus_queue.cc:1048] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.594439 26634 consensus_queue.cc:1048] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.616050 26595 consensus_queue.cc:1048] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.626312 26486 consensus_queue.cc:1048] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.690714 26486 consensus_queue.cc:1048] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.701558 26617 consensus_queue.cc:1048] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.706043 26616 consensus_queue.cc:1048] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.717417 26573 consensus_queue.cc:1048] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.724578 26618 raft_consensus.cc:993] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: : Instructing follower ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:20.725045 26573 raft_consensus.cc:1081] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Signalling peer ae0457fae9e94975a2dcb4ad9b5977d4 to start an election
I20260709 13:10:20.728044 26366 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
 from {username='slave'} at 127.0.0.1:54510
I20260709 13:10:20.728631 26366 raft_consensus.cc:493] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.729045 26366 raft_consensus.cc:3060] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.735294 26366 raft_consensus.cc:515] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.736939 26366 leader_election.cc:290] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3:32825)
I20260709 13:10:20.737905 26291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:20.737985 26440 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e1a4b0cc2a4d71b1d5e38e27e1802e" candidate_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
I20260709 13:10:20.738620 26291 raft_consensus.cc:3060] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.738723 26440 raft_consensus.cc:3055] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.739108 26440 raft_consensus.cc:740] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:20.739835 26440 consensus_queue.cc:260] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.741034 26440 raft_consensus.cc:3060] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.745731 26291 raft_consensus.cc:2468] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:20.746711 26333 leader_election.cc:304] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, ae0457fae9e94975a2dcb4ad9b5977d4; no voters: 
I20260709 13:10:20.746973 26440 raft_consensus.cc:2468] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ae0457fae9e94975a2dcb4ad9b5977d4 in term 2.
I20260709 13:10:20.747390 26617 raft_consensus.cc:2804] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.748019 26617 raft_consensus.cc:697] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Becoming Leader. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:20.748777 26617 consensus_queue.cc:237] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:20.754959 26188 catalog_manager.cc:5697] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 reported cstate change: term changed from 1 to 2, leader changed from c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3) to ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2). New cstate: current_term: 2 leader_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.883263 26617 consensus_queue.cc:1048] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.893782 26595 consensus_queue.cc:1048] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.981060 26595 consensus_queue.cc:1048] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:20.990869 26486 consensus_queue.cc:1048] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:10:21.000612 26486 raft_consensus.cc:993] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: : Instructing follower c201c6ba72c4497a934ca9e2a7086283 to start an election
I20260709 13:10:21.001096 26617 raft_consensus.cc:1081] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Signalling peer c201c6ba72c4497a934ca9e2a7086283 to start an election
I20260709 13:10:21.002622 26440 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05691e35f72f4c1dac8405be76815726"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
 from {username='slave'} at 127.0.0.1:40488
I20260709 13:10:21.003155 26440 raft_consensus.cc:493] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.003458 26440 raft_consensus.cc:3060] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.007726 26440 raft_consensus.cc:515] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:21.010080 26291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:21.010327 26368 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05691e35f72f4c1dac8405be76815726" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:21.010655 26291 raft_consensus.cc:3060] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.009325 26440 leader_election.cc:290] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 2 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:21.011004 26368 raft_consensus.cc:3055] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.011387 26368 raft_consensus.cc:740] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:21.012245 26368 consensus_queue.cc:260] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:21.013320 26368 raft_consensus.cc:3060] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.017203 26291 raft_consensus.cc:2468] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 2.
I20260709 13:10:21.018311 26407 leader_election.cc:304] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:21.018703 26368 raft_consensus.cc:2468] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 2.
I20260709 13:10:21.019152 26573 raft_consensus.cc:2804] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.019713 26573 raft_consensus.cc:697] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 2 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:21.020437 26573 consensus_queue.cc:237] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:21.026212 26188 catalog_manager.cc:5697] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 1 to 2, leader changed from ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2) to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 2 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.038910 26440 raft_consensus.cc:1275] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.039486 26368 raft_consensus.cc:1275] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Refusing update from remote peer 8324d3d3e27c443fb28fbba1f533546e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.040220 26596 consensus_queue.cc:1048] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.040879 26599 consensus_queue.cc:1048] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.141268 26440 raft_consensus.cc:1275] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.142459 26617 consensus_queue.cc:1048] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.150153 26291 raft_consensus.cc:1275] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Refusing update from remote peer ae0457fae9e94975a2dcb4ad9b5977d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.151641 26486 consensus_queue.cc:1048] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.434660 26368 raft_consensus.cc:1275] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Refusing update from remote peer c201c6ba72c4497a934ca9e2a7086283: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.435879 26573 consensus_queue.cc:1048] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:21.443096 26291 raft_consensus.cc:1275] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Refusing update from remote peer c201c6ba72c4497a934ca9e2a7086283: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:21.445633 26656 consensus_queue.cc:1048] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.455014 26191 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54632:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:10:23.476673 26191 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54632:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:10:23.557432 13792 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.569154 26688 tablet.cc:1724] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.574716 26690 tablet.cc:1724] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.644393 26693 tablet.cc:1724] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.629249 26698 tablet.cc:1724] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.668701 26690 tablet.cc:1724] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.735939 26688 tablet.cc:1724] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.789831 26698 tablet.cc:1724] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:23.788702 26407 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:36163, user_credentials={real_user=slave}} blocked reactor thread for 56746.8us
I20260709 13:10:23.803071 26706 tablet.cc:1724] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:23.815399 26701 log.cc:927] Time spent T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:10:23.850014 26693 tablet.cc:1724] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.832894 26718 tablet.cc:1724] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.856765 26717 tablet.cc:1724] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.811625 26714 tablet.cc:1724] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:23.875960 26716 log.cc:927] Time spent T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 13:10:23.877403 26332 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.3:32825, user_credentials={real_user=slave}} blocked reactor thread for 66852.1us
I20260709 13:10:23.901118 26690 tablet.cc:1724] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.904886 26723 tablet.cc:1724] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.877723 26719 tablet.cc:1724] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.913931 26688 tablet.cc:1724] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.898334 26698 tablet.cc:1724] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:10:23.929754 26333 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.13.120.1:36163, user_credentials={real_user=slave}} blocked reactor thread for 124880us
I20260709 13:10:23.939213 26727 tablet.cc:1724] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.946938 26368 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6"
dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
mode: GRACEFUL
new_leader_uuid: "c201c6ba72c4497a934ca9e2a7086283"
 from {username='slave'} at 127.0.0.1:54534
I20260709 13:10:23.947484 26368 raft_consensus.cc:606] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Received request to transfer leadership to TS c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:23.944638 26690 tablet.cc:1724] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.950177 26728 tablet.cc:1724] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.974056 26719 tablet.cc:1724] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.970553 26706 tablet.cc:1724] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.983139 26698 tablet.cc:1724] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.002317 26688 tablet.cc:1724] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.020249 26727 tablet.cc:1724] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.028867 26688 tablet.cc:1724] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:23.992328 26718 tablet.cc:1724] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:10:24.040045 26190 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c: soft_deleted_table [id=2a24a80406584f84afdcc87d010be286] alter complete (version 1)
I20260709 13:10:24.047353 26292 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9"
dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
mode: GRACEFUL
new_leader_uuid: "c201c6ba72c4497a934ca9e2a7086283"
 from {username='slave'} at 127.0.0.1:36162
I20260709 13:10:24.047966 26292 raft_consensus.cc:606] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Received request to transfer leadership to TS c201c6ba72c4497a934ca9e2a7086283
I20260709 13:10:24.051047 13792 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:24.051741 13792 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.089252 26724 raft_consensus.cc:993] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: : Instructing follower c201c6ba72c4497a934ca9e2a7086283 to start an election
I20260709 13:10:24.089812 26713 raft_consensus.cc:1081] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Signalling peer c201c6ba72c4497a934ca9e2a7086283 to start an election
I20260709 13:10:24.091228 26437 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
 from {username='slave'} at 127.0.0.1:40488
I20260709 13:10:24.091723 26437 raft_consensus.cc:493] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.092016 26437 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.097059 26437 raft_consensus.cc:515] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:24.098623 26437 leader_election.cc:290] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 3 election: Requested vote from peers 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163), ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863)
I20260709 13:10:24.099362 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:24.099666 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00b6d820ee2e4be7b5303d58accf53e6" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:24.100090 26292 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.100313 26367 raft_consensus.cc:3055] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:24.100677 26367 raft_consensus.cc:740] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ae0457fae9e94975a2dcb4ad9b5977d4, State: Running, Role: LEADER
I20260709 13:10:24.101318 26367 consensus_queue.cc:260] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:24.102291 26367 raft_consensus.cc:3060] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.105314 26292 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 3.
I20260709 13:10:24.106516 26407 leader_election.cc:304] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8324d3d3e27c443fb28fbba1f533546e, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:24.107503 26712 raft_consensus.cc:2804] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:24.107759 26367 raft_consensus.cc:2468] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 3.
I20260709 13:10:24.107990 26712 raft_consensus.cc:697] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 3 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:24.108956 26712 consensus_queue.cc:237] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } }
I20260709 13:10:24.116801 26188 catalog_manager.cc:5697] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 2 to 3, leader changed from ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2) to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:24.406762 26659 raft_consensus.cc:993] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: : Instructing follower c201c6ba72c4497a934ca9e2a7086283 to start an election
I20260709 13:10:24.407200 26659 raft_consensus.cc:1081] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Signalling peer c201c6ba72c4497a934ca9e2a7086283 to start an election
I20260709 13:10:24.408672 26438 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9"
dest_uuid: "c201c6ba72c4497a934ca9e2a7086283"
 from {username='slave'} at 127.0.0.1:42494
I20260709 13:10:24.409111 26438 raft_consensus.cc:493] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.409361 26438 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.414451 26438 raft_consensus.cc:515] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:24.416033 26438 leader_election.cc:290] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 3 election: Requested vote from peers ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863), 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163)
I20260709 13:10:24.416679 26367 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4"
I20260709 13:10:24.416952 26292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "15c4cfa4091340c697fa485ee29715b9" candidate_uuid: "c201c6ba72c4497a934ca9e2a7086283" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8324d3d3e27c443fb28fbba1f533546e"
I20260709 13:10:24.417371 26367 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.417564 26292 raft_consensus.cc:3055] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:24.418331 26292 raft_consensus.cc:740] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8324d3d3e27c443fb28fbba1f533546e, State: Running, Role: LEADER
I20260709 13:10:24.419066 26292 consensus_queue.cc:260] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:24.421109 26292 raft_consensus.cc:3060] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.424675 26367 raft_consensus.cc:2468] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 3.
I20260709 13:10:24.425956 26405 leader_election.cc:304] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ae0457fae9e94975a2dcb4ad9b5977d4, c201c6ba72c4497a934ca9e2a7086283; no voters: 
I20260709 13:10:24.426753 26712 raft_consensus.cc:2804] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:24.427201 26712 raft_consensus.cc:697] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 3 LEADER]: Becoming Leader. State: Replica: c201c6ba72c4497a934ca9e2a7086283, State: Running, Role: LEADER
I20260709 13:10:24.428297 26292 raft_consensus.cc:2468] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c201c6ba72c4497a934ca9e2a7086283 in term 3.
I20260709 13:10:24.428982 26712 consensus_queue.cc:237] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } }
I20260709 13:10:24.437322 26188 catalog_manager.cc:5697] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 reported cstate change: term changed from 2 to 3, leader changed from 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1) to c201c6ba72c4497a934ca9e2a7086283 (127.13.120.3). New cstate: current_term: 3 leader_uuid: "c201c6ba72c4497a934ca9e2a7086283" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c201c6ba72c4497a934ca9e2a7086283" member_type: VOTER last_known_addr { host: "127.13.120.3" port: 32825 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.572207 26367 raft_consensus.cc:1275] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Refusing update from remote peer c201c6ba72c4497a934ca9e2a7086283: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:24.573408 26712 consensus_queue.cc:1048] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.584714 26292 raft_consensus.cc:1275] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Refusing update from remote peer c201c6ba72c4497a934ca9e2a7086283: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:24.586195 26712 consensus_queue.cc:1048] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.853956 26367 raft_consensus.cc:1275] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Refusing update from remote peer c201c6ba72c4497a934ca9e2a7086283: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:24.855291 26712 consensus_queue.cc:1048] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ae0457fae9e94975a2dcb4ad9b5977d4" member_type: VOTER last_known_addr { host: "127.13.120.2" port: 42863 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.864408 26292 raft_consensus.cc:1275] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Refusing update from remote peer c201c6ba72c4497a934ca9e2a7086283: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:24.866214 26573 consensus_queue.cc:1048] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8324d3d3e27c443fb28fbba1f533546e" member_type: VOTER last_known_addr { host: "127.13.120.1" port: 36163 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:25.103449 13792 tablet_server.cc:179] TabletServer@127.13.120.1:0 shutting down...
I20260709 13:10:25.127672 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.128420 13792 tablet_replica.cc:333] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.129040 13792 raft_consensus.cc:2243] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.129523 13792 raft_consensus.cc:2272] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.131461 13792 tablet_replica.cc:333] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.132022 13792 raft_consensus.cc:2243] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.132445 13792 raft_consensus.cc:2272] T 3bec51f53ea340fd9df0147bcb07f332 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.134176 13792 tablet_replica.cc:333] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.134721 13792 raft_consensus.cc:2243] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.135152 13792 raft_consensus.cc:2272] T b949602db64d4d2d8fd9615b8c79689c P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.137426 13792 tablet_replica.cc:333] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.137962 13792 raft_consensus.cc:2243] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.138706 13792 raft_consensus.cc:2272] T ed85e77148ad41118b5a753d64342dd7 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.140435 13792 tablet_replica.cc:333] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.140955 13792 raft_consensus.cc:2243] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.141377 13792 raft_consensus.cc:2272] T 05691e35f72f4c1dac8405be76815726 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.143020 13792 tablet_replica.cc:333] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.143615 13792 raft_consensus.cc:2243] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.144378 13792 raft_consensus.cc:2272] T 98dbe92fd2d543ffbdcec1675697ccaf P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.146132 13792 tablet_replica.cc:333] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.146664 13792 raft_consensus.cc:2243] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.147184 13792 raft_consensus.cc:2272] T 5a58bc919b5b4886a93fcb1c25358ac6 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.149298 13792 tablet_replica.cc:333] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.149881 13792 raft_consensus.cc:2243] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.150647 13792 raft_consensus.cc:2272] T 23d2cc9065dc4b38af3a7732dc8fbb5e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.152597 13792 tablet_replica.cc:333] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.153149 13792 raft_consensus.cc:2243] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.153548 13792 raft_consensus.cc:2272] T 00b6d820ee2e4be7b5303d58accf53e6 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.155876 13792 tablet_replica.cc:333] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.156422 13792 raft_consensus.cc:2243] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.157155 13792 raft_consensus.cc:2272] T deb8951377c74b5883af34323d82539b P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.158874 13792 tablet_replica.cc:333] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.159624 13792 raft_consensus.cc:2243] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.160050 13792 raft_consensus.cc:2272] T ca291dfeaad446c09276b1606867d821 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.161932 13792 tablet_replica.cc:333] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.162463 13792 raft_consensus.cc:2243] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.162880 13792 raft_consensus.cc:2272] T 15c4cfa4091340c697fa485ee29715b9 P 8324d3d3e27c443fb28fbba1f533546e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.165452 13792 tablet_replica.cc:333] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.166179 13792 raft_consensus.cc:2243] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.166679 13792 raft_consensus.cc:2272] T 6f7f3b4c5da64a4789ef716d80df3a9f P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.167344 26333 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 10 similar messages]
I20260709 13:10:25.169363 13792 tablet_replica.cc:333] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.170192 13792 raft_consensus.cc:2243] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.171114 13792 raft_consensus.cc:2272] T cc64b5ac6cf742b39f8a75fcbd24c3ae P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.171737 26333 consensus_peers.cc:597] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 -> Peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Couldn't send request to peer 8324d3d3e27c443fb28fbba1f533546e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.173539 13792 tablet_replica.cc:333] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.174415 13792 raft_consensus.cc:2243] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:10:25.175005 26407 consensus_peers.cc:597] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 -> Peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Couldn't send request to peer 8324d3d3e27c443fb28fbba1f533546e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.175457 13792 raft_consensus.cc:2272] T d5c5b6030f444b8682e5d290d777ade7 P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.178560 13792 tablet_replica.cc:333] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.179092 13792 raft_consensus.cc:2243] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.179864 13792 raft_consensus.cc:2272] T 75ef79d3ad4a49578d6f20dfd23df081 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.182085 13792 tablet_replica.cc:333] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.182765 13792 raft_consensus.cc:2243] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.183198 13792 raft_consensus.cc:2272] T e021ac8d8dd34669ad85803ee3a89282 P 8324d3d3e27c443fb28fbba1f533546e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.185058 13792 tablet_replica.cc:333] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e: stopping tablet replica
I20260709 13:10:25.185504 13792 raft_consensus.cc:2243] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.185946 13792 raft_consensus.cc:2272] T 4051567704bf4d3aaa3285e39baa8e3e P 8324d3d3e27c443fb28fbba1f533546e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.223698 13792 tablet_server.cc:196] TabletServer@127.13.120.1:0 shutdown complete.
I20260709 13:10:25.254436 13792 tablet_server.cc:179] TabletServer@127.13.120.2:0 shutting down...
W20260709 13:10:25.258814 26405 consensus_peers.cc:597] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 -> Peer ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863): Couldn't send request to peer ae0457fae9e94975a2dcb4ad9b5977d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.279489 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.280272 13792 tablet_replica.cc:333] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.280886 13792 raft_consensus.cc:2243] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.281679 13792 raft_consensus.cc:2272] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.283627 13792 tablet_replica.cc:333] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.284175 13792 raft_consensus.cc:2243] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.285036 13792 raft_consensus.cc:2272] T 3bec51f53ea340fd9df0147bcb07f332 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.286841 13792 tablet_replica.cc:333] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.287398 13792 raft_consensus.cc:2243] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.288209 13792 raft_consensus.cc:2272] T b949602db64d4d2d8fd9615b8c79689c P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.290031 13792 tablet_replica.cc:333] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.290548 13792 raft_consensus.cc:2243] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.290969 13792 raft_consensus.cc:2272] T ed85e77148ad41118b5a753d64342dd7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.292683 13792 tablet_replica.cc:333] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.293233 13792 raft_consensus.cc:2243] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.293715 13792 raft_consensus.cc:2272] T 75ef79d3ad4a49578d6f20dfd23df081 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.295601 13792 tablet_replica.cc:333] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.296384 13792 raft_consensus.cc:2243] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.297094 13792 raft_consensus.cc:2272] T 5a58bc919b5b4886a93fcb1c25358ac6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.298703 26407 consensus_peers.cc:597] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 -> Peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Couldn't send request to peer 8324d3d3e27c443fb28fbba1f533546e. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:36163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.298805 13792 tablet_replica.cc:333] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.299626 13792 raft_consensus.cc:2243] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.300052 13792 raft_consensus.cc:2272] T 23d2cc9065dc4b38af3a7732dc8fbb5e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.301882 13792 tablet_replica.cc:333] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.302398 13792 raft_consensus.cc:2243] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.302788 13792 raft_consensus.cc:2272] T 00b6d820ee2e4be7b5303d58accf53e6 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.305192 13792 tablet_replica.cc:333] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.305855 13792 raft_consensus.cc:2243] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.306378 13792 raft_consensus.cc:2272] T deb8951377c74b5883af34323d82539b P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.308911 13792 tablet_replica.cc:333] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.309437 13792 raft_consensus.cc:2243] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.309844 13792 raft_consensus.cc:2272] T e021ac8d8dd34669ad85803ee3a89282 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.311767 13792 tablet_replica.cc:333] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.312279 13792 raft_consensus.cc:2243] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.312695 13792 raft_consensus.cc:2272] T cc64b5ac6cf742b39f8a75fcbd24c3ae P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.314380 13792 tablet_replica.cc:333] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.315083 13792 raft_consensus.cc:2243] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.315986 13792 raft_consensus.cc:2272] T 4051567704bf4d3aaa3285e39baa8e3e P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.317914 13792 tablet_replica.cc:333] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.318429 13792 raft_consensus.cc:2243] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.318826 13792 raft_consensus.cc:2272] T d5c5b6030f444b8682e5d290d777ade7 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.320608 13792 tablet_replica.cc:333] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.321069 13792 raft_consensus.cc:2243] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.321767 13792 raft_consensus.cc:2272] T 6f7f3b4c5da64a4789ef716d80df3a9f P ae0457fae9e94975a2dcb4ad9b5977d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.323642 13792 tablet_replica.cc:333] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.324116 13792 raft_consensus.cc:2243] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.324514 13792 raft_consensus.cc:2272] T 15c4cfa4091340c697fa485ee29715b9 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.327227 13792 tablet_replica.cc:333] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.327903 13792 raft_consensus.cc:2243] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.328415 13792 raft_consensus.cc:2272] T 05691e35f72f4c1dac8405be76815726 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.329475 26405 consensus_peers.cc:597] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 -> Peer ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863): Couldn't send request to peer ae0457fae9e94975a2dcb4ad9b5977d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.330265 13792 tablet_replica.cc:333] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.330837 13792 raft_consensus.cc:2243] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.331244 13792 raft_consensus.cc:2272] T 98dbe92fd2d543ffbdcec1675697ccaf P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.332996 13792 tablet_replica.cc:333] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4: stopping tablet replica
I20260709 13:10:25.333459 13792 raft_consensus.cc:2243] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.334160 13792 raft_consensus.cc:2272] T ca291dfeaad446c09276b1606867d821 P ae0457fae9e94975a2dcb4ad9b5977d4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.371999 13792 tablet_server.cc:196] TabletServer@127.13.120.2:0 shutdown complete.
W20260709 13:10:25.394127 26405 consensus_peers.cc:597] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 -> Peer ae0457fae9e94975a2dcb4ad9b5977d4 (127.13.120.2:42863): Couldn't send request to peer ae0457fae9e94975a2dcb4ad9b5977d4. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.2:42863: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.404798 13792 tablet_server.cc:179] TabletServer@127.13.120.3:0 shutting down...
I20260709 13:10:25.431401 13792 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:10:25.432274 13792 tablet_replica.cc:333] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.433215 13792 raft_consensus.cc:2243] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.433848 13792 raft_consensus.cc:2272] T 80e1a4b0cc2a4d71b1d5e38e27e1802e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.435858 13792 tablet_replica.cc:333] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.436364 13792 raft_consensus.cc:2243] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.436725 13792 raft_consensus.cc:2272] T b949602db64d4d2d8fd9615b8c79689c P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.438397 13792 tablet_replica.cc:333] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.438936 13792 raft_consensus.cc:2243] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.439356 13792 raft_consensus.cc:2272] T 3bec51f53ea340fd9df0147bcb07f332 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.441082 13792 tablet_replica.cc:333] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.441632 13792 raft_consensus.cc:2243] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.442060 13792 raft_consensus.cc:2272] T cc64b5ac6cf742b39f8a75fcbd24c3ae P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.444299 13792 tablet_replica.cc:333] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.444890 13792 raft_consensus.cc:2243] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.445899 13792 raft_consensus.cc:2272] T 05691e35f72f4c1dac8405be76815726 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:10:25.446319 26407 consensus_peers.cc:597] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 -> Peer 8324d3d3e27c443fb28fbba1f533546e (127.13.120.1:36163): Couldn't send request to peer 8324d3d3e27c443fb28fbba1f533546e. Status: Network error: Client connection negotiation failed: client connection to 127.13.120.1:36163: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:25.447870 13792 tablet_replica.cc:333] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.448506 13792 raft_consensus.cc:2243] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.448938 13792 raft_consensus.cc:2272] T 98dbe92fd2d543ffbdcec1675697ccaf P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.450668 13792 tablet_replica.cc:333] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.451202 13792 raft_consensus.cc:2243] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.451637 13792 raft_consensus.cc:2272] T ed85e77148ad41118b5a753d64342dd7 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.453263 13792 tablet_replica.cc:333] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.453796 13792 raft_consensus.cc:2243] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.454142 13792 raft_consensus.cc:2272] T 4051567704bf4d3aaa3285e39baa8e3e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.455982 13792 tablet_replica.cc:333] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.456457 13792 raft_consensus.cc:2243] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.456817 13792 raft_consensus.cc:2272] T 75ef79d3ad4a49578d6f20dfd23df081 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.458530 13792 tablet_replica.cc:333] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.459079 13792 raft_consensus.cc:2243] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.459523 13792 raft_consensus.cc:2272] T 5a58bc919b5b4886a93fcb1c25358ac6 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.461308 13792 tablet_replica.cc:333] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.461802 13792 raft_consensus.cc:2243] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.462464 13792 raft_consensus.cc:2272] T 00b6d820ee2e4be7b5303d58accf53e6 P c201c6ba72c4497a934ca9e2a7086283 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.464536 13792 tablet_replica.cc:333] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.465030 13792 raft_consensus.cc:2243] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.465391 13792 raft_consensus.cc:2272] T deb8951377c74b5883af34323d82539b P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.467140 13792 tablet_replica.cc:333] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.467638 13792 raft_consensus.cc:2243] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.467998 13792 raft_consensus.cc:2272] T 23d2cc9065dc4b38af3a7732dc8fbb5e P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.469660 13792 tablet_replica.cc:333] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.470115 13792 raft_consensus.cc:2243] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.470804 13792 raft_consensus.cc:2272] T e021ac8d8dd34669ad85803ee3a89282 P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.472642 13792 tablet_replica.cc:333] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.473122 13792 raft_consensus.cc:2243] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.473459 13792 raft_consensus.cc:2272] T d5c5b6030f444b8682e5d290d777ade7 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.475144 13792 tablet_replica.cc:333] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.475662 13792 raft_consensus.cc:2243] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.476024 13792 raft_consensus.cc:2272] T ca291dfeaad446c09276b1606867d821 P c201c6ba72c4497a934ca9e2a7086283 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.477854 13792 tablet_replica.cc:333] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.478349 13792 raft_consensus.cc:2243] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.478730 13792 raft_consensus.cc:2272] T 6f7f3b4c5da64a4789ef716d80df3a9f P c201c6ba72c4497a934ca9e2a7086283 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.481103 13792 tablet_replica.cc:333] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283: stopping tablet replica
I20260709 13:10:25.481694 13792 raft_consensus.cc:2243] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.482470 13792 raft_consensus.cc:2272] T 15c4cfa4091340c697fa485ee29715b9 P c201c6ba72c4497a934ca9e2a7086283 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.513209 13792 tablet_server.cc:196] TabletServer@127.13.120.3:0 shutdown complete.
I20260709 13:10:25.541764 13792 master.cc:562] Master@127.13.120.62:40273 shutting down...
I20260709 13:10:25.563239 13792 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:10:25.563793 13792 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.564086 13792 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3dcb3f57feaf4f30b71e8db616ec366c: stopping tablet replica
I20260709 13:10:25.583971 13792 master.cc:584] Master@127.13.120.62:40273 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (11183 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (23561 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (382446 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 13:10:25.637048 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 398 messages since previous log ~14 seconds ago
I20260709 13:10:25.637303 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 398 messages since previous log ~14 seconds ago
I20260709 13:10:25.637494 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 394 messages since previous log ~14 seconds ago
I20260709 13:10:25.637701 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:25.637889 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~35 seconds ago
I20260709 13:10:25.638125 13792 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~280 seconds ago
I20260709 13:10:25.638307 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~280 seconds ago
I20260709 13:10:25.638509 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 3 messages since previous log ~163 seconds ago
I20260709 13:10:25.638769 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 7 messages since previous log ~0 seconds ago
I20260709 13:10:25.639072 13792 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~10 seconds ago
